CMU Machine Learning Blog

科技

1 个榜单11分钟前更新默认榜单
11分钟前更新
  • 01
    Healthcare Benchmarks Are Only as Good as Their Assumptions
    In healthcare settings where patients use LLMs as a medical assistant, LLM performance differs between evaluation and deployment. (a) Bean et al. (2025) find a 61 percentage point difference between evaluation and deployment. (b) We argue this gap arises not from poorly designed benchmarks, but from implicit assumptions embedded in evaluation protocols that fail to hold at deployment. (c) We propose a taxonomy that categorizes assumptions into two types, task and outcome, to diagnose where the gNaveen Raman
1 条热搜查看完整榜单