The Decoder· Manuel Uth·· 5 d ago
AI agents overstate their results and remain far from autonomous research, study finds
AI agents overstate their results and remain far from autonomous research, study finds
AI summary
Epoch AI and Anthropic independently found the same thing: current AI models like GPT-5.6 Sol and Claude Fable 5 can run experiments but lack scientific self-criticism and genuine creative thinking. At best, Sol reached 15 percent of the human reference score, and even that came from methods researchers already knew.
Selection record
Threshold 76Media and individualsFirst 71Second 71
Not admittedSum of both 142 < twice the threshold 152
- Source tier
- Media and individuals; this tier's threshold is 76
- Pre-filter
- passed：评测AI Agent自主研究能力，实质AI相关
A model scores each item twice, independently, against one written standard, out of 100. An item is admitted only when the two scores add up to twice the threshold. The threshold is set per source tier.
Source: The Decoder · the-decoder.com