Aravind Srinivas
@AravSrinivas
Sharing new post-training research on self-distillation + RL (JOLT), done together with @NVIDIAAI.
In self-distillation, the same model performs the role of both a teacher and a student. The teacher gets extra information that the student doesn't, and the student learns from https://t.co/1PzoEUDNgw
