HuggingFace Daily Papers· Seungone Kim, Jiayi Geng, Young-Jun Lee, Bo Liu, Juyoung Suk, Nicholas Lubbers, Mitchell Wood, Marcus Noack, Yong-Xin Yao, Yuan Shi, Roxana Bujack, Cristina Garcia Cardona, Austin Rodriguez, Ilon Joseph, Woojin Cho, Zora Zhiruo Wang, Chuanyang Jin, Ian Wu, Apurva Gandhi, Tianjian Li, Weiwei Sun, Carolin Lawrence, Kiril Gashteovski, Dongyeop Kang, Jay Shin, Akari Asai, Graham Neubig, Sean Welleck·· 13 天前AI 评分45
Into the Unknown: 开放科学问题 AI 智能体评测基准
Into the Unknown: Benchmarking AI agents on open scientific research problems
AI 导读
研究团队推出 Into the Unknown 基准,测试 AI 智能体在开放科学问题上的研究能力,要求智能体根据给定论文和研究方向撰写后续论文。9 个前沿智能体在量子计算等 5 个领域各完成 15 篇后续论文,135 篇均未满足全部条件,114 篇未通过完整性检查。代码与数据已公开。
来源:HuggingFace Daily Papers · arxiv.org