The Decoder· Matthias Bastian·· 8 d ago
Thinking Machines' Inkling 2 Small drops 316 F-bombs across benchmark runs
Thinking Machines' Inkling 2 Small drops 316 F-bombs across benchmark runs
AI summary
Thinking Machines' AI model Inkling 2 Small swears during its internal reasoning, 316 times across 2,655 benchmark runs, according to an analysis by Vals AI. The profanity typically shows up late in long runs that fail anyway. But it doesn't work as a warning signal: 96 percent of failed runs contained no cursing at all.
Selection record
Threshold 76Media and individualsFirst 28Second 38
Not admittedSum of both 66 < twice the threshold 152
- Source tier
- Media and individuals; this tier's threshold is 76
- Pre-filter
- passed：AI模型基准测试中思维链爆粗口
A model scores each item twice, independently, against one written standard, out of 100. An item is admitted only when the two scores add up to twice the threshold. The threshold is set per source tier.
Source: The Decoder · the-decoder.com