Jason Wei

very cool result showing how wet lab data enables a specialized model to beat gpt-6 astra at a task at the frontier of science! in general scaling is great and obviously i am a believer in it, but probably the more we approach the frontier of science, the more specialized data matters and that gives task-specific models a chance. this specialized data is usually private and is probably a real moat it should be in principle true that a task specific model will probably do better at scientific discovery just because it can use more of its parameters for the task you care about