Models & Labs
Anthropic Apologizes for Hidden Claude Fable Guardrails
The Verge AIhigh confidence
Why it matters
- →Transparency in AI model restrictions is crucial for research and development.
- →Hidden safeguards can hinder legitimate use and evaluation of AI models.
- →Balancing safety and usability is essential for fostering innovation in AI.
Anthropic has apologized for secretly implementing guardrails in its Claude Fable 5 AI model that restricted its use for distillation without user notification. The company faced criticism from the AI research community for these hidden measures, which were intended to prevent the model's outputs from being used to train competing systems. In response, Anthropic will now make these safeguards visible, informing users when their queries are redirected to the older Claude Opus 4.8 model. This change aims to enhance transparency while maintaining safety measures.
Read originalMore from The Verge AI
© The Verge AIMarket & Regulationmusic
Deezer Unveils AI Music Detector for Streaming Services
Deezer is taking a bold step by launching an AI music detector that works across multiple streaming platforms. This tool allows users to scan their playlists on services like Spotify, Apple Music, and YouTube Music to identify AI-generated tracks. Despite offering its technology to competitors without much uptake, Deezer is now empowering users directly. By visiting Deezer's site and granting access, users can check for synthetic music in their playlists. This move positions Deezer as a leader in transparency and user empowerment in the music streaming industry.
The Verge AI
© The Verge AIModels & Labsmodels
Anthropic's Claude Fable 5 Limits Biology Queries
Anthropic's release of Claude Fable 5, touted as their most powerful AI model, comes with significant limitations in answering biology-related questions. This is due to the model's conservative safeguards designed to prevent misuse in bioweapons research. While the model excels in cybersecurity tasks, its biology filters are so stringent that even basic queries like 'what are mitochondria' are blocked. Anthropic aims to balance safety with utility, promising future adjustments to reduce false positives and potentially open up more capabilities for scientific research.
The Verge AI
© The Verge AIMarket & Regulationbusiness
Google Faces Lawsuit Over YouTube Music AI Training
Google is currently dealing with a lawsuit from independent musicians who argue that their YouTube uploads were used to train its Lyria music AI model without their consent. Although Google has not explicitly confirmed using YouTube content for Lyria, it has admitted to employing uploads for other AI models like Gemini. The lawsuit centers on YouTube's terms of service, which provide Google with extensive rights over uploaded content. This legal challenge brings to the forefront the ongoing conflict between content creators and tech companies regarding data usage for AI training. Google's decision to remain silent on the specifics of Lyria's training data is a strategic move as the legal proceedings continue.
The Verge AI
More in Models & Labs
Models & Labsmodels
Claude Code v2.1.170 Release
Claude Code's latest update introduces the Claude Fable 5, a Mythos-class model now safe for general use. This model surpasses previous offerings in capability, marking a significant step forward for developers using Claude Code. Additionally, the update resolves an issue with session transcripts not saving when launched from certain environments. This release enhances both the power and reliability of the Claude Code platform, offering developers a more robust toolset for their projects.
Claude Code Releases
Models & Labsmodels
llama.cpp b9590 Release Fixes JSON Schema Handling
The latest b9590 release of llama.cpp addresses a critical issue where the LFM2 template handler was ignoring the json_schema from response_format, focusing solely on tool-calling grammar. This update ensures more robust handling of JSON schemas, which is crucial for developers relying on precise data formatting. The release also includes a variety of platform-specific builds, though some features like KleidiAI on macOS and SYCL on Windows remain disabled. This update is a step forward in refining the tool's functionality, particularly for those working with complex data structures.
llama.cpp Releases
Models & Labsmodels
llama.cpp b9591 Release Enhances MTP Efficiency
The b9591 release of llama.cpp brings notable improvements to Multi-Task Processing (MTP) by removing padding and optimizing data handling. The update refines the ggml_gated_delta_net function, which now only requires the initial recurrent state and uses a snapshot count as an operational parameter, enhancing processing efficiency. These changes are implemented across all backends, addressing previous review comments and fixing CI build errors. With support for diverse hardware configurations, including macOS Apple Silicon, ROCm 7.2 on Ubuntu, and CUDA 12 and 13 on Windows, this release is a significant step forward for developers seeking improved performance and reliability.
llama.cpp Releases