DEVOURED
Anthropic sees AI risks rising, no plan to release stronger "Model 2"
Anthropic is withholding a more powerful model to manage safety risks, while OpenAI has delayed its 'Astra' model over cyber-capability concerns.
What: Anthropic executives announced they will not release an internal model stronger than its current 'Mythos' product, citing safety and interpretability challenges. Similarly, OpenAI is delaying its Astra model, noting that it cannot yet rule out the risk of the model being used to facilitate cyberattacks.
Why it matters: The industry is shifting from a 'ship fast' mentality to a self-imposed slowing of deployment as AI models demonstrate capabilities—specifically in automated R&D—that exceed the labs' ability to fully model their potential for harm.
Decoder
- Interpretability: The ability to understand the internal decision-making processes of a neural network, which becomes significantly harder as models scale in size and complexity.
Original article
Anthropic says it will not release an internal model it claims to be more powerful than Mythos and that it will not slow development broadly. The company believes that the risks of the most serious harms from its models are still low. While the company is seeing signs of acceleration in its models' ability to conduct automated research and development, it appears to be signaling that it is getting harder to understand the capabilities and risks of its own models. OpenAI says it is slowing down the release of an upcoming model called Astra because it can't rule out critical cyber capabilities.
Explore all 72 articles in today's digest
Fresh dev news, AI-digested daily. Never miss a trend at devoured.fyi