Hugging Face Blog·· 3 h ago
Why your fine-tuning job takes longer than the FLOPs say
Why your fine-tuning job takes longer than the FLOPs say
AI summary
Predicting end-to-end fine-tuning time on shared GPU clusters, from 272 production runs. A preview of our upcoming paper, Predicting End-to-End Fine-Tuning Time for Generative Language Models . The full version will be on arXiv soon. GPUs are among the most expensive and scarcest resources in AI today.
Selection record
Threshold 60Official, first-handFirst 34Second 38
Not admittedSum of both 72 < twice the threshold 120
- Source tier
- Official, first-hand; this tier's threshold is 60
- Pre-filter
- passed:微调任务耗时预测,属AI训练与开发工具
A model scores each item twice, independently, against one written standard, out of 100. An item is admitted only when the two scores add up to twice the threshold. The threshold is set per source tier.
Source: Hugging Face Blog · huggingface.co