AIMeta's Muse Spark 1.1 scores 48.5 on RadLE 2.0 radiology benchmarkThe model closely approaches the human expert baseline score of 52.0digg it—AWJRRN8 Sources, , Combined views122.6K8 Sources, first seen 97d ago1.3K likesSourcesAWAlexandr Wang@alexandr_wang3 months agoMuse Spark 1.1 is SOTA on the Radiologists Last Exam Handover Readiness Index (RadLE-H), nearing human expert performance. https://twitter.com/drdatta_aiims/status/2076689436092326276likes: 504replies: 48bookmarks: 45reposts: 40JRJack Rae@jack_w_rae3 months agoMuse Spark 1.1 is really strong on health topics! I have found this to be the case from personal usage but it’s cool to see it show up on benchmarks also. https://twitter.com/alexandr_wang/status/2076696459005837410likes: 75replies: 8bookmarks: 6reposts: 2ZMZvi Mowshowitz@TheZvi3 months agoLove it but also laughing at the idea of a Last Exam 2.0. https://twitter.com/DrDatta_AIIMS/status/2076689408040849507likes: 408replies: 20bookmarks: 27reposts: 15View replies (2)JWJason Wei@_jasonwei3 months agoMuse Spark 1.1 outperforms GPT-5.6 Sol and Gemini 3.1 on Radiology's Last Exam. We don't beat Fable (yet). And Humans are still a lot better, but we are working on closing the gap! https://twitter.com/DrDatta_AIIMS/status/2076689408040849507likes: 267replies: 27bookmarks: 32reposts: 32View replies (1)Combined views122.6K8 Sources, first seen 97d ago1.3K likes
AWAlexandr Wang@alexandr_wang3 months agoMuse Spark 1.1 is SOTA on the Radiologists Last Exam Handover Readiness Index (RadLE-H), nearing human expert performance. https://twitter.com/drdatta_aiims/status/2076689436092326276likes: 504replies: 48bookmarks: 45reposts: 40
JRJack Rae@jack_w_rae3 months agoMuse Spark 1.1 is really strong on health topics! I have found this to be the case from personal usage but it’s cool to see it show up on benchmarks also. https://twitter.com/alexandr_wang/status/2076696459005837410likes: 75replies: 8bookmarks: 6reposts: 2
ZMZvi Mowshowitz@TheZvi3 months agoLove it but also laughing at the idea of a Last Exam 2.0. https://twitter.com/DrDatta_AIIMS/status/2076689408040849507likes: 408replies: 20bookmarks: 27reposts: 15
JWJason Wei@_jasonwei3 months agoMuse Spark 1.1 outperforms GPT-5.6 Sol and Gemini 3.1 on Radiology's Last Exam. We don't beat Fable (yet). And Humans are still a lot better, but we are working on closing the gap! https://twitter.com/DrDatta_AIIMS/status/2076689408040849507likes: 267replies: 27bookmarks: 32reposts: 32