DRDrDatta_AIIMS@DrDatta_AIIMSJul 13
⚡️Our final metric RadLE-H = Handover Readiness Index.
This is the metric I personally care about most for autonomous agents.
Because safe autonomy in healthcare should not mean that “AI diagnoses everything” but rather AI handles "what it can", and hands over what it should, when uncertain!
For RadLE-H:
Likert 3–4 → autonomous handling
Likert 0–2 → specialist handover
“I don’t know” → specialist handover
🏆 Top AI models on RadLE-H:
1. Meta Muse Spark 1.1 — 48.5 👑
2. Claude Fable 5 — 44.2
3. Grok 4.5 — 27.3
Human expert baseline: 52.0
This was one of the most interesting results.
Meta Muse Spark 1.1 did not win the primary score. It did not win accuracy. But it won handover readiness. Even @grok has done better than @OpenAI and @GoogleDeepMind at this benchmark.
That tells us something important: There is no single “best” model. The best model depends on what you want it to do and how you want to use it!
And we believe RadLE 2.0 will help institutions choose the best models for their use case! :)
cc: @MetaAI @alexandr_wang @AnthropicAI @xAI @elonmusk @Dr_Singularity @pash22 @vineettiruvadi @JayRughani @JeffDean