全部/科技/实时热榜

CMU Machine Learning Blog · 实时热榜

  • 01
    Healthcare Benchmarks Are Only as Good as Their Assumptions
    In healthcare settings where patients use LLMs as a medical assistant, LLM performance differs between evaluation and deployment. (a) Bean et al. (2025) find a 61 percentage point difference between evaluation and deployment. (b) We argue this gap arises not from poorly designed benchmarks, but from implicit assumptions embedded in evaluation protocols that fail to hold at deployment. (c) We propose a taxonomy that categorizes assumptions into two types, task and outcome, to diagnose where the gNaveen Raman
CMU Machine Learning Blog实时热榜 | 什么火了