
OpenAI's ChatGPT has sparked a race for improved LLMs, termed LLMs+, which aim to solve complex problems more efficiently. Innovations include mixture-of-experts and potential shifts to diffusion models for enhanced performance.
Read original
© MIT Technology Review AIAI is reshaping the pharmaceutical industry by accelerating drug discovery processes, potentially reducing the time and cost associated with bringing new drugs to market. By shifting from empirical screening to predictive design, AI allows for the creation and testing of drug candidates virtually, which can streamline the identification of promising compounds. However, the success of AI in this field hinges on access to comprehensive and high-quality data, including negative results, which are often underreported. As AI models improve, the vision of fully autonomous labs that operate with minimal human intervention becomes more attainable, promising to enhance the efficiency and success rates of drug development.
© MIT Technology Review AIIntel is investigating how agentic AI can revolutionize enterprise workflows, moving beyond the capabilities of traditional chatbots. Through extensive experimentation, Intel demonstrates the necessity of focusing on system-wide performance metrics rather than just inference capabilities. Their research underscores the importance of a robust infrastructure that supports scalable systems and precise task orchestration. By emphasizing agent density and task latency, Intel aims to optimize AI performance in business settings. This transition to agentic AI marks a shift from experimental AI to practical, scalable solutions that enhance productivity and governance within enterprises.
Llama.cpp's latest update introduces speculative decoding support for GLM-5.2, enhancing its capabilities with NextN/MTP features. This addition allows for more efficient tensor loading and context management, particularly benefiting models using the GLM_DSA architecture. The update also includes options for exporting models with or without the MTP feature, providing flexibility for developers. This release marks a step forward in optimizing model performance and adaptability, especially for those leveraging the GLM-5.2 framework.
The b10178 release of llama.cpp enhances its server capabilities by adding trace logging for slot similarity checking, offering developers detailed insights into prompt cache slot selection processes. This update includes specifics on skip reasons and similarity calculations, which can aid in performance optimization. While no new model architectures are introduced, the release continues to support a wide array of platforms, such as macOS with KleidiAI, Ubuntu with ROCm 7.2, and Windows with CUDA 12 and 13. This makes llama.cpp a more versatile tool for developers working on different systems, reinforcing its position as a comprehensive inference runtime.
The b10180 release of llama.cpp brings notable improvements to SYCL performance, focusing on unary elementwise operations. By introducing a contiguous fast path and employing 32-bit index math, the update aims to boost computational efficiency. The integration of fastdiv for elementwise index math further enhances processing speed. Although there are no new models in this release, llama.cpp continues to evolve as a flexible inference runtime, now more efficient on systems like macOS, Linux, and Windows. Developers working with SYCL can expect smoother and faster operations, reinforcing llama.cpp's adaptability across different computing environments.