Simon Willison·· 7 d ago
ttok 0.4
ttok 0.4
AI summary
Release: ttok 0.4 ttok is my CLI tool for counting tokens, using OpenAI's open source tiktoken library. It hasn't been in updated in a couple of years, but I finally fixed a Click warning, updated CI, and added a --list-models command to list available models.
Selection record
Threshold 76Media and individualsFirst 12Second 14
Not admittedSum of both 26 < twice the threshold 152
- Source tier
- Media and individuals; this tier's threshold is 76
- Pre-filter
- passed：CLI工具用tiktoken计数token，属AI开发工具
A model scores each item twice, independently, against one written standard, out of 100. An item is admitted only when the two scores add up to twice the threshold. The threshold is set per source tier.
Source: Simon Willison · simonwillison.net