Open Source
NVIDIA Launches NeMo Switchyard for AI Agents
Sam Witteveenhigh confidence
Why it matters
- →NeMo Switchyard optimizes AI agent workflows by selecting the best model for each task.
- →It enhances efficiency in long-running AI agents, improving response times and token usage.
- →Being open-source, it invites community engagement and innovation in AI agent development.
NVIDIA has introduced NeMo Switchyard, an open-source library aimed at improving AI agent workflows. The library functions as a router, selecting the appropriate model for each step in an agent's process, thereby enhancing response times and token efficiency. This development is particularly relevant for long-running AI agents, offering a more streamlined and effective approach to managing workloads. As an open-source project, NeMo Switchyard is accessible to developers looking to innovate in the field of large language model agents.
Read originalThe story around this
TopicNvidia Product And Business UpdatesCooling
Earlier coverage that leads up to this article, and what followed. Lines connect each piece to the closest one after it, converging here.
How we got here
- 1Together AI's Inference Engine Outperforms Competitors
Together AI Blog · May 19, 2026 · Background
- 2NVIDIA Jetson Advances Agentic AI in Robotics
NVIDIA Blog · June 2, 2026 · Related
- 3Nvidia Unveils AI Agent-Centric Tech at COMPUTEX
The Rundown AI · June 2, 2026 · Related
- 4NVIDIA Unveils Nemotron 3 Ultra Model
Sam Witteveen · June 4, 2026 · Background
- 5NVIDIA Unveils Nemotron 3 Ultra for AI Agents
Matt Wolfe · June 5, 2026 · Background
- 6NVIDIA NeMo AutoModel Boosts Transformers Fine-Tuning
Hugging Face Blog · June 24, 2026 · Related
- 7NVIDIA Nemotron 3 Ultra Boosts AI Agent Performance
NVIDIA Blog · July 8, 2026 · Related
- 8NVIDIA's Nemotron Enhances AI with Open Synthetic Data
Hugging Face Blog · July 8, 2026 · Related
What happened next
- 9Nvidia Highlights Importance of AI Harness Over Model
TechCrunch AI · August 21, 2026 · Background
- 10Nvidia Unveils PAIR for Home AI Computing
The Verge AI · September 3, 2026 · Related
- 11NVIDIA Launches PAIR Local AI Router
Sam Witteveen · September 6, 2026 · Related
- 12Jev: A Decision-Only AI Model for Agents
Cole Medin · September 21, 2026 · Background
- 13Nvidia Launches Open-Source AI Agent Security Platform
WIRED AI · September 28, 2026 · Related
Follow this story
Open the full story →NVIDIA Nemotron 3.5 Lightning Launches for Local AI Agents
6 developments
- Aug 11 · Ollama Blog
NVIDIA Nemotron 3.5 Lightning Launches for Local AI Agents - Aug 11 · NVIDIA Blog
NVIDIA Unveils Nemotron 3.5 Lightning and NeMo Switchyard - Aug 11 · Sam Witteveen
NVIDIA Launches NeMo Switchyard for AI Agents (This article)↳ NeMo Switchyard is an open-source library that acts as a router to select the best model for each task, optimizing efficiency and token usag - Aug 11 · Sam Witteveen
NVIDIA Unveils Nemotron Lightning Model - Aug 14 · Matt Wolfe
NVIDIA Launches Nemotron 3.5 Lightning↳ The model is designed for specialized task execution. - Aug 14 · Lev Selector
NVIDIA Unveils Nemotron 3.5 Lightning
More from Sam Witteveen
© Sam WitteveenCoding Toolscoding
Fine-tunes reduce Qwen3.8-27B reasoning tokens
Reasoning models are notoriously slow and expensive because they generate excessive internal thought traces before answering. This analysis benchmarks three specific fine-tunes of Qwen3.8-27B—ThinkingCap, Swift 1.5, and QwenPi—that aggressively prune these tokens while maintaining accuracy. The results show a tangible trade-off: significantly faster inference and lower costs for practical tasks without the bloat of full chain-of-thought. For builders running local agents, this offers a viable path to deploy reasoning-capable models that actually feel responsive.
Sam Witteveen
© Sam WitteveenCoding Toolsagents
Specialized Image Models for RPA Decision Making
RPA has long struggled with unstructured visual inputs like forms and screenshots, often relying on brittle rule-based systems. This video explores two open models, ImaJev-4B and Jev-Omni, designed specifically to handle these image-based decisions. By focusing on confidence scores and conditional logic, these tools aim to bridge the gap between simple automation and true cognitive processing in document workflows. The approach moves beyond generic vision-language models to offer targeted accuracy for enterprise tasks like form inspection.
Sam Witteveen
More in Open Source
© The Verge AIOpen Sourceagents
Meta open sources Muse AI agent SDK for custom hardware
Meta is handing the keys to its Muse AI agent by open-sourcing the software needed to run it on custom hardware. Developers can now hook Muse into ESP32 boards or Raspberry Pi setups, effectively turning workbench scraps into personalized AI terminals. This moves Muse beyond a cloud-only interface into tangible, local devices like E Ink displays or HDMI sticks. It signals a shift toward decentralized, user-owned AI interactions rather than relying solely on proprietary apps.
The Verge AI
© Hugging Face BlogOpen Sourcewriting
Ai2 open-sources AstaBrief 8B for scientific reports
Allen Institute for AI has released AstaBrief 8B, an open-weight model designed specifically for generating cited scientific literature reviews. Built on Qwen3-8B and trained with supervised fine-tuning and direct preference optimization, it prioritizes speed and grounding over complex multi-step reasoning. The model generates full reports in a single pass, cutting generation time to roughly 51 seconds compared to the 178 seconds required by proprietary alternatives like Claude. This release offers researchers a faster, locally deployable option for synthesizing evidence without relying on external APIs.
Hugging Face Blog
Open Sourceother
llama.cpp adds IBM ZDNN backend support
IBM is finally getting first-class CI support in llama.cpp with the addition of the ZDNN backend for s390x architecture. This isn't just a minor tweak; it enables efficient inference on mainframe hardware, bridging a gap for enterprise environments that rely on IBM Z systems. While currently limited to build pipelines without automated testing, this signals a serious commitment to supporting non-x86/ARM infrastructure in the local LLM ecosystem. It’s a quiet but necessary expansion for anyone running models on legacy or specialized enterprise silicon.
llama.cpp Releases