HuggingFace Daily Papers· Bingran You, Wenjun Ke, Ria Rosenauer, Bo Liu, Wenbo Chen, Min Chen, Shuqi Xu, Yue Ma, Jiechao Feng, Bo Chen, Xiangkai Sun, Jiarui Liu, Jinen Guo, Zeyu Zhou, Xu Huang, Zhuohan Li, Haoyu Li, Heguang Lin, Lijie Ding, Yadong Zeng, Kangqi Zhang, Xinge Liu, Hanwen Liu, Zhenghong Li, Alexander von Recum, Yuchen Zhu, Felix Schwarzfischer, Yizhou Zhao, Jicheng Wang, Binxu Li, Qian Yu, Chan Li, Cheng Dai, Di Wang, Haoyu Zhang, Jiankai Sun, Kaituo Feng, Mian Qin, Ruihong Yin, Yiqun Luo, Weiwei Wu, Shihong Pan, Tsung Yeh Hsieh, Xiao Huang, Yan Zhang, Sihan Li, Zirui Ren, Zengji Tu, Kyoung Whan Choe, Ke Sun, Vincenzo Galia, Vaisakhi Mishra, Jiashu He, Hongyang Wang, Zhiheng Yang, Shubham Gaur, Yifan Gu, Shuyi Wang, Zihao Zuo, Steven Dillmann, Yiyou Sun, Xinyang Han, Hanchung Lee, Molei Tao, Yue Zhao, Shilong Liu, Yuchen Wu, Xuandong Zhao, Xiangyi Li, Florian Brand, Gerbrand Ceder, Hartmut Haeffner·· 2 天前精选AI 评分65
FrontierPhysics: 评估端到端物理研究智能体的基准测试
FrontierPhysics: Evaluating Agents for End-to-End Physics Research
AI 导读
研究团队FrontierPhysics发布了一个包含56个任务的端到端基准测试，覆盖理论、计算和实验物理九个领域。该基准测试要求智能体完成文献综述、研究计划制定、实验研究和科学论文撰写等完整研究流程。测试显示，在22个模型的26种配置中，没有一种配置能通过超过46次测试（共168次测试），表明当前AI智能体在严谨推理和专家直觉方面存在明显不足。
推荐理由
56个真实物理研究任务组成的端到端基准测试，揭示了当前AI智能体在严谨推理和专家直觉方面的明显短板。
来源：HuggingFace Daily Papers · arxiv.org