Arvind Narayanan

We explained why Pareto frontiers should be convex hulls over two years ago, in our paper AI Agents That Matter, which tried to raise the intellectual rigor of benchmarking. https://arxiv.org/abs/2407.01502 Fun fact: it was also one of the first papers to call for reporting Pareto curves in the first place, instead of tables with only accuracy figures and no cost comparison—which was the norm at the time. Ancient history!