@ArgusPlatformAI On the MATH (eval) dataset the tiny 0.6B student got 44% accuracy after distillation (up from 15% for the base model). The 0.6B reasoning reference model got around 48%.
The 671B teacher model got 91.2%. But yeah, it's also 1000x larger.
