Hugging Face Blog·· 1 d ago
Egyptian and Nigerian English join the Open ASR Leaderboard
Egyptian and Nigerian English join the Open ASR Leaderboard
AI summary
Back to Articles A few months ago, we added private data to the Open ASR Leaderboard : 11 splits from Appen and DataOceanAI covering scripted and conversational speech from five accents ( blog ). The community response was great, with many highlighting the importance of held-out sets for trustworthy evaluations .
Selection record
Threshold 60Official, first-handFirst 22Second 22
Not admittedSum of both 44 < twice the threshold 120
- Source tier
- Official, first-hand; this tier's threshold is 60
- Pre-filter
- passed：ASR评测榜单新增数据，属AI评测
A model scores each item twice, independently, against one written standard, out of 100. An item is admitted only when the two scores add up to twice the threshold. The threshold is set per source tier.
Source: Hugging Face Blog · huggingface.co