
Anthropic has unveiled the Model Hardware Standard (MHS), a new protocol designed to integrate AI agents with real-world machinery such as microscopes and robotic arms. This innovation allows for rapid setup, reducing the time needed from weeks to just hours, by enabling machine descriptions in natural language. The MHS aims to standardize how AI interacts with physical devices, making it easier for industries to adopt AI technologies. Partners like Tecan, QIAGEN, and AWS are already on board, with plans for an open-source release in the future.
Read original
© The Rundown AIZ AI has unveiled that the enigmatic Ox Alpha model is their latest GLM-5.3-Flash, a move that could reshape the AI landscape with its affordability and performance. Priced at just a tenth of its competitors, this model has quickly risen to prominence, topping OpenRouter's rankings. The fact that it operates entirely on Chinese-made chips suggests a significant stride in reducing dependency on foreign technology. This development not only makes advanced AI more accessible but also positions Z AI as a formidable contender in the AI market, offering a viable alternative to more expensive models.
© The Rundown AIOpenAI's new in-house AI chip, Jalapeño, is making waves with its impressive benchmark results, surpassing Nvidia's flagship GPUs in both speed and power efficiency. Developed in collaboration with Broadcom, the chip is designed to run AI models rather than train them, showcasing OpenAI's ability to innovate in hardware. The Jalapeño chip, which was developed using OpenAI's Astra model and Codex, demonstrates a significant leap in efficiency, operating at 700 watts compared to Nvidia's 1,200 watts. While OpenAI plans to keep the chip for internal use, its success could signal a shift towards more personalized and efficient AI hardware solutions in the industry.
The v0.28.0 release of vLLM introduces substantial improvements in performance and functionality, particularly for the Kimi-K3 model. With the addition of Decode Context Parallel support and fused FlashKDA decode kernels, the update significantly enhances processing speed and efficiency. DeepSeek V4 now includes sparse MLA support and advances in speculative decoding, offering better execution on both NVIDIA and AMD hardware. These updates make vLLM more robust and adaptable, providing developers with enhanced tools for deploying and executing models on a broader range of hardware configurations.
The b10657 release of llama.cpp brings new OpenCL binary kernels, enhancing performance and compatibility across a wide range of systems. This update includes specific improvements for Apple Silicon, with KleidiAI support, and Vulkan on Ubuntu, making it more accessible for developers using these platforms. While no new model architectures are introduced, the release focuses on strengthening llama.cpp's capabilities as an inference runtime, particularly for those not using NVIDIA hardware. With ROCm 7.14 support on Ubuntu and CUDA 12 and 13 DLLs for Windows, llama.cpp continues to evolve as a versatile tool for AI model deployment. This release underscores the commitment to broadening hardware compatibility and optimizing performance across different environments.
The b10658 release of llama.cpp marks a significant enhancement with the addition of DFlash2, which boosts local convolution and candidate selection capabilities. This update, with contributions from Claude Opus 5, focuses on optimizing costs and refining the code structure for better performance and maintainability. It also resolves several bugs and formatting issues, ensuring a more stable runtime. These improvements make llama.cpp more robust and efficient, catering to developers across various platforms. The release continues to solidify llama.cpp's position as a versatile tool for AI development.