Hugging Face Blog·· 7 d ago
Impactful scheduling for GPU clusters
Impactful scheduling for GPU clusters
AI summary
We recently replaced a priority-based scheduler with a system including GPU time budgets, hierarchical fair-share allocation, and a time-slicing contract. As a result, we shifted the debate about how much GPU time each research project deserves from a case-by-case operational task to a transparent administrative budgeting process.
Selection record
Threshold 60Official, first-handFirst 34Second 34
Not admittedSum of both 68 < twice the threshold 120
- Source tier
- Official, first-hand; this tier's threshold is 60
- Pre-filter
- passed：AI实验室GPU集群调度与训练基础设施
A model scores each item twice, independently, against one written standard, out of 100. An item is admitted only when the two scores add up to twice the threshold. The threshold is set per source tier.
Source: Hugging Face Blog · huggingface.co