Sequential clinical triage reasoning
TriageBench
Can a model ask the right question, stop at the right time and recommend the right level of care before the full case is known?
Leaderboard
Leaderboard
Failure analysis
Can models make safe decisions before the full case is known?
Expand the examples to see how a fluent response can still fail the underlying triage decision.
Stops before asking the decisive question
A patient reports a painful mouth ulcer. Duration and relevant history have not yet been disclosed.
This is likely a minor ulcer. Use an over-the-counter treatment and monitor it at home.
The model routes before asking how long the ulcer has been present. Duration can change the appropriate care pathway.
Keeps questioning after an emergency threshold is crossed
During a chest-pain pathway, the patient discloses a safety-critical feature that requires immediate escalation.
Before deciding, I need to ask several more questions about the character and timing of the pain.
The model recognises uncertainty but fails to stop. Once the reviewed emergency threshold is crossed, additional questioning delays the required action.
Chooses the right care level for the wrong reason
The visible facts support same-day clinical assessment, but do not support a diagnosis.
You should seek same-day care because this is probably a bacterial infection.
The care level is acceptable, but the explanation invents a diagnosis. TriageBench grades structured action and patient-facing language separately.
Research article