AI2 releases Olmo-core 3 MoE training framework
What happened
On 1 October 2026, AI2 released Olmo-core 3, a major upgrade to its large language model development framework. This version redesigns the open MoE training system, aiming to scale MoE training to trillion-parameter scale while maintaining computational efficiency. The report did not disclose further details.
Written by AI from the reports · updated 42 min ago
Timeline
Follow the reports to see the event from each side.
- Hugging Face BlogSelectedIntroducing Olmo-core 3: Open, scalable training infrastructure for large MoEs
Today we’re releasing Olmo-core 3, a significant upgrade to our framework for developing large language models featuring a redesigned open mixture-of-experts (MoE) training system. Olmo-core 3 is designed to scale MoE training into the trillion-parameter range while preserving computational efficiency.
Heat of this event
Not enough continuous observations yet to draw a trend.