
OpenAI has introduced Ultrafast, a new mode for its GPT-5.6 Sol model, which increases processing speed by 14 times. This mode allows the model to generate up to 750 tokens per second, enhancing its utility in real-time applications. Ultrafast is initially available to a limited group of users, with plans for broader access as capacity increases. This development positions OpenAI ahead of competitors like Anthropic, offering significant improvements in speed without sacrificing model size or capability.
Read original
© TechCrunch AIWriter has unveiled Palmyra X6, a new AI model designed to significantly reduce token costs for enterprises. Built on Z.ai’s open source GLM-5.2, this model aims to cut costs by up to 50% for basic tasks, addressing the growing concern over AI deployment expenses. Alongside the model, Writer has enhanced its agentic harness, optimizing it for complex, multi-step tasks. This dual approach not only promises cost efficiency but also challenges the dominance of major AI labs by offering a more economical alternative for businesses.
© TechCrunch AIDatabricks has successfully raised $5 billion in a funding round that values the company at a staggering $190 billion. Initially aiming for a $1 billion raise, the company was overwhelmed by investor interest, leading to a much larger round. This influx of capital will support Databricks' ambitious AI initiatives and ongoing M&A activities, including recent acquisitions like Electric and Panther. The company's impressive growth metrics, such as a $7 billion annualized revenue run rate, underscore its strong market position. With this funding, Databricks is well-positioned to continue its AI-driven expansion while remaining private.
© TechCrunch AIIBM's collaboration with OpenAI is a pivotal move to integrate cutting-edge AI models into enterprise environments. By incorporating OpenAI's technologies like GPT-5.6 and Codex into its consulting services, IBM aims to elevate its AI capabilities across industries such as finance and telecommunications. This partnership signifies a strategic focus on deploying AI at scale within corporate settings, as IBM continues to establish itself as a leader in AI integration. OpenAI's decision to partner with IBM reflects its ambition to broaden its enterprise footprint through alliances with major consulting firms.
The latest b10412 release of llama.cpp introduces backend sampling for both dflash and dspark, marking a technical enhancement in the platform's capabilities. This update allows for more refined control with the enablement of p_min > 0 in backend sampling, adding a layer of precision for developers. While the release doesn't introduce new models or architectures, it quietly strengthens the platform's backend functionality, making it more versatile for developers working across various systems. This update is a step forward in optimizing the performance and flexibility of llama.cpp's inference capabilities.
The b10414 release of llama.cpp marks a significant enhancement with the addition of GGML_TYPE_TQ2_0 type processing in the Metal backend, enabling ternary operations with 2 bits per element. This update brings a more efficient mul_mv kernel, focusing on float operations and optimizing data handling through techniques like precalculating sums. While the release doesn't feature new models, it refines the platform's performance and broadens its compatibility across systems like macOS, Linux, and Windows. By improving efficiency and versatility, llama.cpp continues to be a valuable tool for developers working with a variety of hardware configurations.
The b10418 release of llama.cpp brings notable improvements to SYCL support, particularly through the introduction of host pinned memory, which enhances host-to-device memory access. This update also resolves a thread-safety issue, ensuring more stable performance across different hardware setups. While no new models are introduced, the release focuses on strengthening the existing infrastructure, making it more robust for developers working with SYCL. This update is crucial for optimizing performance and ensuring compatibility, especially for those leveraging SYCL in their development environments.