Models & Labs
llama.cpp b9601 Release Expands Platform Support
llama.cpp Releaseshigh confidence
Why it matters
- →Expands llama.cpp's compatibility across diverse hardware and operating systems.
- →Enhances support for AMD GPUs with ROCm 7.2, reducing reliance on NVIDIA.
- →Focuses on platform reach, making it a more versatile tool for developers.
The latest b9601 release of llama.cpp has been announced, featuring expanded support for multiple platforms including macOS, Linux, Windows, and openEuler. Key highlights include the addition of ROCm 7.2 support for Ubuntu, which benefits AMD GPU users. Some features, such as KleidiAI on macOS and SYCL on Windows, remain disabled. This release emphasizes platform expansion rather than new model introductions, aiming to enhance the tool's versatility for developers.
Read originalMore from llama.cpp Releases
Models & Labsmodels
llama.cpp b9590 Release Fixes JSON Schema Handling
The latest b9590 release of llama.cpp addresses a critical issue where the LFM2 template handler was ignoring the json_schema from response_format, focusing solely on tool-calling grammar. This update ensures more robust handling of JSON schemas, which is crucial for developers relying on precise data formatting. The release also includes a variety of platform-specific builds, though some features like KleidiAI on macOS and SYCL on Windows remain disabled. This update is a step forward in refining the tool's functionality, particularly for those working with complex data structures.
llama.cpp Releases
Models & Labsmodels
llama.cpp b9591 Release Enhances MTP Efficiency
The b9591 release of llama.cpp brings notable improvements to Multi-Task Processing (MTP) by removing padding and optimizing data handling. The update refines the ggml_gated_delta_net function, which now only requires the initial recurrent state and uses a snapshot count as an operational parameter, enhancing processing efficiency. These changes are implemented across all backends, addressing previous review comments and fixing CI build errors. With support for diverse hardware configurations, including macOS Apple Silicon, ROCm 7.2 on Ubuntu, and CUDA 12 and 13 on Windows, this release is a significant step forward for developers seeking improved performance and reliability.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9596 Release Expands Platform Support
The b9596 release of llama.cpp marks another step in broadening its compatibility, with ROCm 7.2 now supported on Ubuntu x64, enhancing the experience for AMD GPU users. This update helps close the performance gap with NVIDIA's CUDA, making llama.cpp a more attractive option for developers using AMD hardware. Although features like KleidiAI on macOS Apple Silicon are still disabled, the release underscores llama.cpp's commitment to becoming a versatile tool across different systems. Developers can now tap into improved performance on a wider array of hardware, though some expected features remain on the horizon.
llama.cpp Releases
More in Models & Labs
Models & Labsmodels
Claude Code v2.1.170 Release
Claude Code's latest update introduces the Claude Fable 5, a Mythos-class model now safe for general use. This model surpasses previous offerings in capability, marking a significant step forward for developers using Claude Code. Additionally, the update resolves an issue with session transcripts not saving when launched from certain environments. This release enhances both the power and reliability of the Claude Code platform, offering developers a more robust toolset for their projects.
Claude Code Releases
© WIRED AIModels & Labsagents
OpenAI Aims to Transform ChatGPT into a Super App
OpenAI is taking a bold step by evolving ChatGPT into a 'super app,' a move that could revolutionize AI interaction. Under the guidance of Thibault Sottiaux, the initiative seeks to merge ChatGPT and Codex into a unified platform designed to manage diverse personal and professional tasks. The vision is to develop a proactive digital assistant that integrates seamlessly into daily life, potentially revitalizing OpenAI's growth and re-establishing its leadership in the AI sector. Although the specifics of the super app's capabilities are still unfolding, the integration of Codex indicates a focus on sophisticated task automation and user personalization.
WIRED AI
© FireshipModels & Labsmodels
Anthropic Releases Claude Fable Model
Anthropic has introduced Claude Fable, a new model in their Mythos class, designed for public use. This release comes amid Anthropic's previous calls for caution in AI development, highlighting a shift towards making advanced AI more accessible. The Claude Fable model is described as 'carefully lobotomized,' suggesting it has been modified to ensure safety and compliance for broader deployment. This move indicates Anthropic's strategy to balance innovation with responsibility, offering a model that is both powerful and safe for public interaction.
Fireship