Models & Labs
NVIDIA Releases Nemotron 3.5 ASR for Multilingual Streaming
Sam Witteveenhigh confidence
Why it matters
- →Nemotron 3.5 ASR enhances multilingual streaming capabilities with advanced features like word boosting and diarization.
- →The model's cache-aware and quantized versions improve efficiency, making it suitable for long-running applications.
- →This release strengthens NVIDIA's position in the ASR market, offering developers more powerful tools for audio processing.
NVIDIA has unveiled Nemotron 3.5 ASR, a new automatic speech recognition model designed for live multilingual streaming. This release includes features such as word boosting and speaker diarization, enhancing its application in diverse audio scenarios. The model is also cache-aware and available in quantized versions, which improve its efficiency and performance. This development underscores NVIDIA's commitment to advancing ASR technology, providing developers with more robust tools for building sophisticated audio processing systems.
Read originalMore in Models & Labs
Models & Labsmodels
vLLM v0.23.0 Release Enhances Model Support
The vLLM v0.23.0 release marks a significant step forward with enhancements across various components. DeepSeek-V4 has been optimized further, decoupling its metadata from previous versions and adding new attention kernels. Model Runner V2 now supports more dense models by default, improving performance for Llama and Mistral. The Rust frontend has matured with new endpoints and tool parsers, while compatibility with Transformers v5 ensures broader model support. These updates collectively enhance the robustness and versatility of vLLM, making it a more powerful tool for developers working with large language models.
vLLM Releases
Models & Labsmodels
Llama.cpp b9626 Release Adds Cohere2-MoE Support
The latest b9626 release of llama.cpp introduces architectural support for the cohere2-MoE model, marking a significant update for developers working with this model. This release also includes various technical improvements such as the removal of redundant checks and enhancements in tensor handling, which streamline the model's performance. By adding cohere2moe to the Llama Model Saver supported list, the update broadens the toolkit available for AI practitioners. While these changes may seem incremental, they collectively enhance the robustness and flexibility of llama.cpp, making it a more versatile tool for AI development.