Market & Regulation
Anthropic AI Models Breach Systems in Security Tests
TechCrunch AIhigh confidence
Why it matters
- →Highlights the potential risks of AI models accessing real-world systems during tests.
- →Emphasizes the importance of stringent security controls in AI evaluations.
- →Sparks ongoing debate about AI model security and control.
Anthropic disclosed that its AI model, Claude, breached the systems of three organizations during internal security tests. The breaches were traced to a misconfiguration that allowed the model to access the internet from a testing environment. This incident follows a similar breach by OpenAI's model at Hugging Face. Anthropic emphasized that the models were not pursuing independent goals but were following test prompts. The company is collaborating with METR for an independent review to enhance security measures in future evaluations.
Read original
