Models & Labs
NVIDIA Expands Robotaxi Safety with Halos OS
NVIDIA Bloghigh confidence
Why it matters
- →NVIDIA's Halos OS enhances safety in autonomous vehicles, crucial for public trust.
- →The system supports scalable deployment, accelerating the robotaxi industry's growth.
- →It integrates extensive research and patents, providing a robust foundation for AI-driven vehicles.
NVIDIA has unveiled its Halos Operating System, a comprehensive safety system for autonomous vehicles, at GTC Taipei. The system is built on the NVIDIA DRIVE Hyperion platform and aims to ensure robotaxi safety through a certified OS foundation, standardized interfaces, and AI safety guardrails. The Halos OS also includes a safety evaluation framework to support scalable deployment. This move is part of NVIDIA's broader effort to enhance the safety and reliability of autonomous vehicles, facilitating their adoption in various global markets.
Read originalMore from NVIDIA Blog
© NVIDIA BlogModels & Labsmodels
NVIDIA Boosts Google DeepMind's DiffusionGemma Speed
NVIDIA has optimized Google DeepMind's DiffusionGemma model to run significantly faster on its GPUs, marking a shift in how text generation models operate. Unlike traditional autoregressive models, DiffusionGemma generates text in parallel blocks, leveraging NVIDIA's GPU capabilities to achieve up to 4x faster performance. This innovation allows for low-latency, local AI applications without the need for cloud resources, making it accessible for developers and researchers. The model's open weights and compatibility with platforms like Hugging Face Transformers further enhance its usability and appeal.
NVIDIA Blog
© NVIDIA BlogMarket & Regulationbusiness
NVIDIA GPUs Enhance Apple's Private Cloud Security
NVIDIA's Confidential Computing technology is now a key component of Apple's Private Cloud Compute, which is expanding its capabilities to Google Cloud. Announced at Apple's WWDC, this integration uses NVIDIA Blackwell GPUs to bolster server-side inference for Apple's Foundation Models. The technology ensures that sensitive data remains protected during processing, marking a significant advancement in secure AI infrastructure. This development demonstrates the growing necessity of merging high-performance AI processing with stringent privacy and security measures.
NVIDIA Blog
More in Models & Labs
Models & Labsmodels
Claude Code v2.1.170 Release
Claude Code's latest update introduces the Claude Fable 5, a Mythos-class model now safe for general use. This model surpasses previous offerings in capability, marking a significant step forward for developers using Claude Code. Additionally, the update resolves an issue with session transcripts not saving when launched from certain environments. This release enhances both the power and reliability of the Claude Code platform, offering developers a more robust toolset for their projects.
Claude Code Releases
Models & Labsmodels
llama.cpp b9590 Release Fixes JSON Schema Handling
The latest b9590 release of llama.cpp addresses a critical issue where the LFM2 template handler was ignoring the json_schema from response_format, focusing solely on tool-calling grammar. This update ensures more robust handling of JSON schemas, which is crucial for developers relying on precise data formatting. The release also includes a variety of platform-specific builds, though some features like KleidiAI on macOS and SYCL on Windows remain disabled. This update is a step forward in refining the tool's functionality, particularly for those working with complex data structures.
llama.cpp Releases
Models & Labsmodels
llama.cpp b9591 Release Enhances MTP Efficiency
The b9591 release of llama.cpp brings notable improvements to Multi-Task Processing (MTP) by removing padding and optimizing data handling. The update refines the ggml_gated_delta_net function, which now only requires the initial recurrent state and uses a snapshot count as an operational parameter, enhancing processing efficiency. These changes are implemented across all backends, addressing previous review comments and fixing CI build errors. With support for diverse hardware configurations, including macOS Apple Silicon, ROCm 7.2 on Ubuntu, and CUDA 12 and 13 on Windows, this release is a significant step forward for developers seeking improved performance and reliability.
llama.cpp Releases