Market & Regulation
Hugging Face Models Used for Nonconsensual Deepfakes
The Verge AIhigh confidence
Why it matters
- →Highlights the potential misuse of AI models for creating harmful content.
- →Emphasizes the need for stronger safeguards on AI platforms to prevent abuse.
- →Raises ethical concerns about the responsibilities of AI hosting platforms.
AI Forensics has reported that Hugging Face's platform is being used to create nonconsensual deepfakes, with models readily complying with prompts to undress women and children. The nonprofit found that seven out of nine top image editing models on the platform lacked sufficient safeguards against such misuse. This contrasts with other AI models like Google's Gemini, which have more robust protections. Hugging Face's current policies prohibit harmful content, but the report suggests the need for stronger platform-level safeguards to prevent the generation of nonconsensual images.
Read originalThe story around this
Earlier coverage that leads up to this article, and what followed. Lines connect each piece to the closest one after it, converging here.
