MIT Develops Method to Detect Harmful AI Models

MIT researchers, in partnership with the nonprofit Thorn, have created a new method to detect AI models adapted for generating illegal content such as child sexual abuse material (CSAM). This technique, which avoids generating outputs, uses Gaussian probing to analyze how models have been fine-tuned for harmful purposes. The method has proven 100% accurate in identifying models specialized for CSAM, offering a scalable solution for platforms to flag and remove unsafe models. This advancement addresses a critical blind spot in AI safety, potentially transforming child protection in the digital realm.