Soumith Chintala
@soumithchintala
@JoshPurtell got it. we'll try to do harness randomization better to cover codex. i suspect thats one possible reason we're not doing super well here.
either ways, we have a long way to go to generalize to the extent that frontier models do, appreciate the signal!