跳到正文
HuggingFace Daily Papers· Qiuyang Mang, Wenhao Chai, Runyuan He, Dongruixuan Li, Zihan Zheng, Yujun He, Xuanyi Zhou, Hao Wang, Siddhant Ray, Bo Peng, Ruyi Ji, Shuo Yang, Haocheng Xi, Boru Chen, Xinyang David Han, Melissa Pan, Mayank Mishra, Boxi Yu, Sijia Liu, Kerem Akillioglu, Yi Pan, Zirui Wang, Mert Cemri, Diogo Antunes, Yichuan Wang, Aiwei Ivy Zhang, Zhenyang Chen, Qizheng Zhang, Kaiyuan Liu, Wenyuan Huang, Sherry Ruan, Shu Liu, Dacheng Li, Zerui Cheng, Zeyu Shen, Shang Zhou, Hanfei Chen, Yuzhong Zhang, Bohan Lyu, Qu Ao, Han Zheng, Chonghe Jiang, Jingzhuo Hu, Xiaokun Chen, Kunjun Li, Zhiqing Zhong, Haoye Tian, Tong Zhao, Yunzhong He, Hanchen Li, Ofir Press, Jiantao Jiao, Kunle Olukotun, Karthik R. Narasimhan, Jingbo Shang, Koushik Sen, Matei Zaharia, Alex Dimakis, Ion Stoica, Joseph E. Gonzalez, Alvin Cheung·· 5 天前精选AI 评分65

FrontierCS 2: 计算机科学研发基准测试

FrontierCS 2: A Benchmark for Computer Science R&D

AI 导读

研究团队发布FrontierCS 2基准测试,包含48个开放性任务,评估LLM智能体在计算机科学前沿研发中的贡献能力。最佳表现为Claude Opus 5.5,通过58%的测试任务,涵盖机器学习系统、高性能计算、数据库、安全和机器人等13个领域。

推荐理由

将LLM智能体置于真实研发环境测试,58%通过率揭示了当前AI在计算机科学前沿领域的实际贡献能力边界。

来源:HuggingFace Daily Papers · arxiv.org