Arvind Narayanan
@random_walker
"agent evals are about to become as important as building the agents themselves" https://x.com/V1kiiiii/status/2112514905479987279
This is our thesis as well. I would go further — building an eval *is* what it means to build an agent.
In my ICML talk, I argued that as AI capabilities advance, more and more human effort will shift from building to evaluation, in many different domains. https://www.normaltech.ai/p/what-will-be-left-for-us-to-work
