跳到正文
HuggingFace Daily Papers(社區熱門論文)·· 7 天前AI 評分39

InclusionMed:評測 AI 在共融醫療領域的表現

InclusionMed: Benchmarking AI for Inclusive Healthcare

AI 導讀

InclusionMed 推出共融醫療 AI 評測計劃,以 Atlas 整理醫療基準測試,並按醫療角色和 AI 能力分類,呈現基準涵蓋的醫療需求及不足之處。Index 匯總 Atlas 所收錄基準的模型結果,初始版本按五項基準分數等權計算各模型的 Index 分數,並按醫療角色和 AI 能力列出分數。

正文

InclusionMed is an open evaluation initiative for inclusive healthcare. Through successive releases of the Atlas and Index, this open collaboration aims to ensure that the diverse healthcare needs of people worldwide guide how progress in medical AI is defined and measured.

The InclusionMed Atlas organizes benchmarks along two axes: healthcare role and AI capability. The role axis distinguishes patients and the public, healthcare professionals, and healthcare administration professionals; the capability axis distinguishes knowledge, reasoning, and agency. The Atlas design makes clear which healthcare needs are represented by the included benchmarks and where coverage remains limited.

The InclusionMed Index aggregates model results across the benchmarks included in the Atlas. In the initial release, each model's Index score is the equally weighted mean of its five benchmark scores. The Index also reports scores by healthcare role and AI capability, revealing differences in both model rankings and score levels.

來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co