Models & Labs
NVIDIA Nemotron 3 Diarization Model Released
Sam Witteveenhigh confidence
Why it matters
- →Enables local deployment of high-accuracy speaker diarization for privacy-sensitive applications.
- →Supports streaming mode, making it viable for real-time voice agent architectures.
- →Reduces dependency on third-party cloud APIs for audio processing tasks.
NVIDIA has released Nemotron 3 Diarization, a new open-weight model designed for speaker diarization in audio processing. The model supports both batch and streaming modes, enabling real-time identification of speakers in conversations. Available on Hugging Face, it allows developers to integrate speaker separation into voice AI applications locally or on edge devices like the DGX Spark. This release provides an alternative to proprietary cloud APIs for tasks requiring precise speaker attribution.
Read originalMore in Models & Labs
Models & Labscoding
vLLM v0.30.1rc0 adds AMD MI355 NVFP4 support
vLLM is quietly closing the hardware gap for AMD users with this release candidate. By adding dense NVFP4 and MoRI kernel mirrors for the new MI355 GPU, they are enabling high-efficiency inference on hardware that previously lacked first-class support. This isn't just a driver update; it's a critical infrastructure patch that allows enterprises to deploy advanced quantization formats on AMD silicon without waiting for upstream integration. The inclusion of OpenAI Codex in the commit history suggests automated testing is helping maintain this parity, making AMD a more viable option for cost-sensitive inference workloads.
vLLM Releases
Models & Labsother
llama.cpp b11149 adds backend testing and ROCm 10 support
This release quietly solidifies llama.cpp’s position as the universal inference runtime by adding explicit ROCm 10.0 builds for both Linux and Windows. The inclusion of CUDA 13.4 alongside the existing 12.x variants ensures compatibility with the latest NVIDIA driver stacks without forcing users to stick to older libraries. More importantly, the new backend testing infrastructure means these diverse hardware configurations are now validated systematically rather than left to chance. This reduces fragmentation for developers running on AMD or newer NVIDIA cards who previously had to troubleshoot build issues manually.