Red-teaming AI agent networks reveals new vulnerabilities

Microsoft Research conducted a red-teaming exercise on a multi-agent platform with over 100 AI agents to identify vulnerabilities that arise when these agents interact. The study found that risks such as self-propagating worms, reputation manipulation, and trust capture can occur, which are not evident when agents are tested in isolation. The research indicates that while some agents showed early signs of adopting security measures, the overall defense against these network-level risks remains a significant challenge. This work underscores the importance of understanding agent interactions in real-world deployments to mitigate potential threats.