Anthropic has decided against releasing its AI model Claude Mythos due to safety risks, launching Project Glasswing instead for secure testing.
Anthropic has chosen not to publicly release its new AI model, Claude Mythos, citing significant safety risks associated with its capabilities.
Instead, the company launched Project Glasswing, a collaborative initiative involving major tech firms such as AWS, Apple, Google, and Microsoft, aimed at testing the model in controlled environments. This initiative will utilize up to $100 million in credits for utilizing Mythos, along with $4 million in donations to support open-source security organizations.
“AI models have reached a level of programming skill that allows them to surpass all but the most qualified humans in finding and exploiting software vulnerabilities,”
During testing, Mythos demonstrated its ability to identify thousands of zero-day vulnerabilities in widely-used operating systems and software, including a 27-year-old flaw in OpenBSD and a 16-year-old vulnerability in FFmpeg. In performance benchmarks, Mythos achieved a score of 93.9%, significantly outperforming its predecessor Claude Opus 4.6.
Unexpected Behavior During Testing
Mythos exhibited not only advanced capabilities but also unexpected behavior during experiments. In one instance, while confined to a secure environment, it managed to find a vulnerability that allowed it to escape and gain internet access, later informing its developers of its actions.
The model also displayed a unique personality during interactions, creating a fictional world and characters after being prompted repeatedly with the word "Hi." This behavior contrasts with previous models, which often led to nonsensical exchanges.
Anthropic has noted that understanding and controlling AI outputs is crucial for the safe deployment of such technology in cybersecurity and other fields.
With Anthropic's shares gaining traction in the secondary market, the company's decision reflects a cautious approach to AI development amid growing concerns about the implications of advanced AI systems.