
OpenAI has introduced a new 'Ultrafast' API tier in collaboration with Cerebras, enhancing the speed of its GPT-5.6 Sol model by up to 14 times. This advancement allows the model to process up to 750 tokens per second, significantly reducing the time required for complex tasks. The Ultrafast tier is currently available as an invite-only preview, with broader access expected as more Cerebras capacity becomes available. This development could revolutionize AI-driven workflows, although pricing information has not yet been released.
Read originalThe latest llama.cpp update expands its functionality by integrating the MiniMax-Text-01 and MiniMaxM1ForCausalLM models, enhancing its role in causal language modeling. This release focuses on refining the MiniMax-Text-01 model by eliminating state transpose operations and implementing a logits mask to manage zero-valued embeddings. These adjustments aim to streamline the token sampling process and boost model efficiency. While no new model architectures are introduced, the update significantly refines existing processes, making llama.cpp more robust and efficient for developers working with these specific models.
The latest release of llama.cpp, version b10441, introduces a significant change by replacing deprecated flags with a unified --load-mode argument. This update simplifies the configuration process across scripts, examples, and documentation, making it easier for developers to manage memory mapping and loading options. The release also includes updates to internal warning messages and environment variable documentation, ensuring clarity and consistency. While this update doesn't introduce new features, it streamlines the user experience and reduces potential confusion for developers working with llama.cpp.
The b10442 release of llama.cpp brings notable improvements to Vulkan support, specifically targeting Intel Xe platforms. By adding SHMEM_STRIDE_PAD and APPLY_SLM_A_RESHAPE for cooperative matrix operations, this update aims to optimize performance on Intel hardware. Additionally, it addresses a critical out-of-bounds read issue in kvalues_mxfp4 initialization, enhancing stability. While these changes are technical, they signify a focused effort to refine performance and compatibility for developers working with Intel's Vulkan drivers. This release doesn't introduce new models but strengthens the existing infrastructure for better efficiency.