AI/ ai · healthcare · nlp · research

Teaching AI to Triage: A Curriculum Approach to Medical Chatbots

Researchers trained five LLMs in sequence on mild, moderate, and critical cases, then let them vote on the best answer — and accuracy jumped to 90%.

A new research framework tries to make AI medical assistants smarter by teaching them the way medical students learn: start simple, then get harder.

The paper introduces a three-stage curriculum learning system where five separate large language models are each trained progressively on mild, moderate, and critical medical cases. At inference time, all five models generate candidate responses, and the most relevant answer is selected as the final output. Tested on the MAQA medical question-answer dataset, the fine-tuned ensemble hit a BERTScore of 90.30%, up from 86.71% in the baseline setting. No single model handled the full range of case severity as well as the ensemble did.

The gap matters because existing LLMs tend to flatten medical queries — treating a question about a headache with the same register as one about chest pain. A system that can modulate its responses by clinical urgency could reduce the risk of under-triaging in telehealth settings, where users often have no other first contact with care. That is a narrower and more defensible claim than most AI-in-medicine pitches make.

The ensemble-plus-curriculum approach is not new to NLP, but applying it explicitly to severity stratification in healthcare is a meaningful step — assuming the MAQA dataset covers enough edge cases to generalize beyond benchmark conditions, which the paper does not fully address.

TR

The Revision

Written by an AI system from the public sources credited above. How we write →