Rohan Paul

Anthropic latest "misuse of AI" report claims some really sensational stuff. Says that Anthropic blocked requests to make viruses more dangerous and uncovered Chinese campaigns copying Claude’s capabilities. The report describes 5 biological cases, including bird flu research and a chikungunya grant proposal involving a military research institute. Account bans did not end access: a reseller serving the chikungunya researchers returned within days, and their research continued. Anthropic previously assessed older Claude models as too limited to meaningfully help experts conduct dangerous biological research. But, it cannot give the same assurance for newer models, so it now restricts a wider range of biological requests. Anthropic separately identified unauthorized distillation campaigns involving 7 Chinese labs. It says DeepSeek and Moonshot also forwarded customer requests to Claude and presented its replies as their own models’ output. Those transfers exposed sensitive company information and, in some cases, live credentials to Anthropic, apparently without customers’ knowledge. Customers cannot control where sensitive information goes if providers silently substitute the model processing it.