The Decoder· Matthias Bastian·· 8 d ago
The inventor of the bitter lesson has a bitter lesson for LLM scaling enthusiasts
The inventor of the bitter lesson has a bitter lesson for LLM scaling enthusiasts
AI summary
Turing Award winner Richard Sutton reaffirms that raw compute alone isn't enough for intelligence and that fundamentally new learning methods are needed. Ex-OpenAI researcher Tworek agrees, saying blind transformer scaling "has reward hacked brains of a whole generation of scientists." A growing wave of startups is already betting on exactly this gap.
Selection record
Threshold 76Media and individualsFirst 58Second 52
Not admittedSum of both 110 < twice the threshold 152
- Source tier
- Media and individuals; this tier's threshold is 76
- Pre-filter
- passed：讨论LLM扩展与AI学习方法
A model scores each item twice, independently, against one written standard, out of 100. An item is admitted only when the two scores add up to twice the threshold. The threshold is set per source tier.
Source: The Decoder · the-decoder.com