NVIDIA and AI4Bharat release Indic pretraining corpus
What happened
On 16 October 2026, NVIDIA and the AI4Bharat lab at IIT Madras published the Nemotron-pretraining-Indic-v1 pretraining corpus on the Hugging Face blog: about 2.8 trillion tokens covering 22 Indian languages, of which 260.10 billion are native-script tokens and 22.46 billion are romanised tokens, counted with the Gemma-4 tokenizer. The report also says an open data generation pipeline was released. The earlier event title was "NVIDIA and IIT Madras release Indic pretraining corpus"; this is the latest first-hand release information.
Written by AI from the reports · updated 2 h ago
Timeline
Follow the reports to see the event from each side.
- Hugging Face BlogScaling Indic Pretraining: 2.8 Trillion Tokens and an Open Data Generation Pipeline
Native-script data for 22 languages, romanized data for twelve, and a reusable GPU-accelerated pipeline for translation, quality assessment, and repair. We're excited to introduce Nemotron-pretraining-Indic-v1 approximately 2.8 trillion tokens across 22 Indian languages, releasing soon alongside the open, GPU-accelerated data generation pipeline used to create it.
Heat of this event
Not enough continuous observations yet to draw a trend.