Santiago Valdarrama
@svpino
Can agents really do scientific research?
This is a new benchmark that focuses on this.
It comes with 50+ tasks across 9 scientific disciplines. There's also a leaderboard to see which agents work best.
Here is how we know an agent is good for scientific research:
• It should be able to choose the right methods
• It should be able to run computations
• It should be able to learn from failures
• It should be able to produce verifiable results