Models & Labs
Holo3.1 Enhances Local AI Agent Performance
Hugging Face Bloghigh confidence
Why it matters
- →Holo3.1 enables efficient local inference, crucial for privacy and speed.
- →It enhances performance across multiple environments, including mobile.
- →The release supports diverse deployment scenarios, broadening AI agent applicability.
Hugging Face has released Holo3.1, a new version of its computer-use agents designed for robust performance across web, desktop, and mobile environments. The update includes quantized checkpoints such as FP8, Q4 GGUF, and NVFP4, which allow for efficient local inference. Notably, Holo3.1 improves performance on mobile platforms, with significant gains on Android devices. The release supports local execution on consumer hardware, ensuring privacy and flexibility. These advancements position Holo3.1 as a powerful tool for developers integrating AI agents into various applications.
Read originalMore from Hugging Face Blog
© Hugging Face BlogResearchresearch
DharmaOCR Uses DPO to Reduce Text Degeneration
Hugging Face's DharmaOCR has demonstrated a novel application of Direct Preference Optimization (DPO) to significantly reduce text degeneration in OCR tasks. Unlike traditional supervised fine-tuning, which often fails to address degeneration directly, DPO uses the model's own degenerate outputs as negative training signals. This approach led to an average reduction in degeneration rates by 59.4%, with some cases seeing reductions as high as 87.6%. By focusing on the structural failure modes of models, DharmaOCR offers a new methodology for improving model performance in structured tasks without relying on subjective human judgments.
Hugging Face Blog
© Hugging Face BlogModels & Labsagents
Reachy Mini Adds Remote Tool Capabilities
Reachy Mini, a conversational robot, now supports remote tools, expanding its capabilities beyond local Python scripts. This update allows the robot to access external tools like web search and weather information, enhancing its ability to provide real-time responses. By integrating these remote tools, users can easily share and update functionalities without altering the core app. This development marks a significant step in making Reachy Mini more versatile and interactive, as it can now handle complex queries involving both local and remote data sources.
Hugging Face Blog
More in Models & Labs
Models & Labsmodels
v0.22.1rc2 resolves CUTLASS fmin issue
The v0.22.1rc2 release addresses a specific compatibility issue with CUTLASS fmin, crucial for initializing DeepSeek-V4. This fix ensures smoother integration and functionality for developers relying on this setup. While it may seem like a minor update, resolving such compatibility issues can significantly enhance the reliability and performance of AI models. This update is particularly relevant for developers working with the DeepSeek-V4 model, ensuring they can proceed without encountering initialization errors.
vLLM Releases
Models & Labsmodels
llama.cpp b9491 release addresses PDL race conditions
The b9491 release of llama.cpp resolves PDL race conditions by eliminating 'restrict' from PDL kernel headers, which were previously causing compatibility issues. This update introduces preprocessor directives to ensure performance is maintained on older architectures while simplifying the use of 'restrict' through macros. Additionally, the release addresses the PDL restrict issue on Hopper architectures. These changes are crucial for developers as they enhance compatibility and performance across different operating systems and hardware configurations, making llama.cpp more robust and versatile.
llama.cpp Releases
Models & Labsmodels
Llama.cpp b9498 Release Enhances RVV Quantization
The b9498 release of llama.cpp significantly boosts RVV quantization by extending vector dot operations to higher VLENs. This update introduces new 512b and 1024b implementations for quantization schemes like iq4_xs and q6_K, enhancing performance on targeted architectures. While no new models are introduced, the release focuses on refining existing functionalities, particularly for CPU and GPU tasks. With support for macOS, Linux, Windows, and openEuler, llama.cpp becomes a more adaptable tool for developers working with a range of hardware setups. This update underscores llama.cpp's commitment to optimizing performance across different environments.
llama.cpp Releases