Rohan Paul
@rohanpaul_ai
Jensen Huang explains why AI may soon need a billion times more compute.
The old way was retrieval: the model pulled up what it had memorized and answered.
The new way is problem solving, where the model weighs several options, rolls out the best one to three and prunes the rest.
That search takes far more work than recalling a stored answer, and every step of it runs on GPUs.
----
Full video on "Bg2 Pod" YouTube channel, (link in comment)