Models & Labs
NVIDIA Launches Vera CPU for Agentic AI
NVIDIA Bloghigh confidence
Why it matters
- →Vera is designed specifically for agentic AI, addressing unique computational needs.
- →It enhances AI infrastructure efficiency with custom cores and high memory bandwidth.
- →NVIDIA's launch positions it as a leader in the next phase of AI hardware development.
NVIDIA has introduced its first custom CPU, Vera, aimed at supporting agentic AI workloads. The Vera CPU, featuring 88 custom Olympus cores, is designed to handle the complex demands of AI agents, which extend beyond traditional GPU capabilities. Initial deliveries have been made to top AI labs including Anthropic, OpenAI, and SpaceXAI. This development marks a significant advancement in AI infrastructure, as Vera is built to enhance the efficiency and speed of AI operations. NVIDIA's move underscores its commitment to leading the next phase of AI computing with specialized hardware.
Read originalMore from NVIDIA Blog
More in Models & Labs
Models & Labsmodels
llama.cpp b9297 release enhances tensor support
The b9297 release of llama.cpp brings a notable enhancement with the introduction of NVFP4 MTP scale tensors, boosting its tensor processing capabilities. This update also integrates Qwen3.5 MTP tensors, which improves performance across a spectrum of hardware configurations, including Apple Silicon, Vulkan, and ROCm on Ubuntu, as well as CUDA on Windows. The release supports a wide array of architectures, from macOS to Linux and Windows, ensuring compatibility with both CPU and GPU setups. While there are no new model architectures, the inclusion of KleidiAI on Apple Silicon and ROCm 7.2 on Ubuntu highlights llama.cpp's commitment to optimizing for diverse environments. This update reinforces llama.cpp's role as a flexible inference runtime, catering to a broad range of hardware setups.
llama.cpp Releases
Models & Labsmodels
llama.cpp b9309 release fixes integer overflows
The b9309 release of llama.cpp tackles significant integer overflow issues in its perplexity calculations, co-authored by Stanisław Szymczyk. This update is vital for enhancing the accuracy and reliability of the model's performance metrics, which are crucial for developers. By resolving these overflows, the release ensures that users can depend on precise data outputs. This fix is a testament to the ongoing efforts to improve the tool's robustness, allowing developers to trust the integrity of their AI computations. While it might seem like a minor adjustment, it plays a critical role in maintaining the tool's reliability.
llama.cpp Releases
© The AI Daily BriefModels & Labsmodels
OpenAI Achieves Math Breakthrough
OpenAI has made a significant advancement in mathematical capabilities within its AI models.
The AI Daily Brief