Skip to content
Hugging Face Blog·· 3 h ago

Why your fine-tuning job takes longer than the FLOPs say

Why your fine-tuning job takes longer than the FLOPs say

AI summary

Predicting end-to-end fine-tuning time on shared GPU clusters, from 272 production runs. A preview of our upcoming paper, Predicting End-to-End Fine-Tuning Time for Generative Language Models . The full version will be on arXiv soon. GPUs are among the most expensive and scarcest resources in AI today.

Selection record

Not admittedSum of both 72 < twice the threshold 120

Source tier
Official, first-hand; this tier's threshold is 60
Pre-filter
passed:微调任务耗时预测,属AI训练与开发工具

A model scores each item twice, independently, against one written standard, out of 100. An item is admitted only when the two scores add up to twice the threshold. The threshold is set per source tier.

Source: Hugging Face Blog · huggingface.co