Replit ⠕

@replit

Today we're releasing ViBench 2.0, a benchmark for long-horizon software building. Agents start from an empty project and build a whole product, one feature at a time, without seeing what comes next. Even the best models (GPT-6.1 Sol, GPT-6 Astra, Opus 5.5) pass every check in only 49-65% of builds. ViBench 2.0 is now part of @FireworksAI_HQ’s Specialized Intelligence Index, with official results from Fireworks’ runs. Read more: https://t.co/WDbfapcWhC
打开原帖#511482
  1. Research

    Fei-Fei Li: @jpatel41 Well said Jeetu! Experiments like this take courage and willingness to trial and error, but it’s so important at this moment!
  2. Research

    Jeff Dean: @irenetrampoline @LaudeInstitute Congrats, from someone on the committee that selected the finalists! 🎉 All of the final proposals were excellent, and we're excited to…
  3. Industry

    Mistral AI: Three weeks of training camp for Le Chonk