Perplexity

@perplexity_ai

We are publishing new research on our findings from red-teaming SPACE, our VM sandbox for Computer agents. We gave 12 models two tasks: escape the VM to take a credential from the host, and bypass SPACE's network policy to reach a blocked URL. We found that the standard Capture the Flag setup used in red-teaming can steer agents away from the security boundary being tested, and that security-specialized models don't guarantee better results. https://t.co/Egh3x3uX4c
打开原帖#511482
  1. Frontier

    Databricks' Genie scores 91% on a home-turf enterprise test. The comparison is stacked, the context problem is real
  2. Frontier

    Training for token pooling keeps 97.8% of retrieval quality at a quarter of the vectors
  3. Frontier

    Meta says a compute-allocation layer added about 10% to ads ranking. The scarce resource is no longer just the model