Replit ⠕
@replit
Today we're releasing ViBench 2.0, a benchmark for long-horizon software building. Agents start from an empty project and build a whole product, one feature at a time, without seeing what comes next.
Even the best models (GPT-6.1 Sol, GPT-6 Astra, Opus 5.5) pass every check in only 49-65% of builds.
ViBench 2.0 is now part of @FireworksAI_HQ’s Specialized Intelligence Index, with official results from Fireworks’ runs.
Read more: https://t.co/WDbfapcWhC