We will see compute moving from areas like pretraining where FLOPs don’t return much progress to test time compute.
This will require very different infrastructure which will make system design fun. The first wave of infra designed for agents starting to hit.