The Decoder· Matthias Bastian·· 7 h ago
Anthropic's Message Threads cut time to first token by 35 percent for long conversations
Anthropic's Message Threads cut time to first token by 35 percent for long conversations
AI summary
Anthropic released Message Threads for the Messages API. Instead of resending the entire conversation with every turn, agents now only transmit what's changed. For requests between 500,000 and one million tokens, time to first token drops by about 35 percent.
Selection record
Threshold 76Media and individualsFirst 58Second 58
Not admittedSum of both 116 < twice the threshold 152
- Source tier
- Media and individuals; this tier's threshold is 76
- Pre-filter
- passed：Anthropic推出Claude平台AI功能优化
A model scores each item twice, independently, against one written standard, out of 100. An item is admitted only when the two scores add up to twice the threshold. The threshold is set per source tier.
Source: The Decoder · the-decoder.com