Fine-tuning a 350M Model for Better Structured Outputs in 100 GRPO Steps
A public low-cost approach fine-tunes LFM2.5-350M with TRL GRPO using around 500 samples and 100 steps, raising IFStruct from 22.6% to 29.7%. Training fits free Colab or Kaggle GPUs, with local llama.cpp evaluation on a MacBook and code open on GitHub.