
Google has announced the release of its new AI model, Gemini 3.8 Flash. This model is part of Google's continuous efforts to advance its AI technology and compete with other leading companies in the industry. While specific improvements of the Gemini 3.8 Flash model are not detailed, it is expected to enhance performance and capabilities. This release highlights Google's dedication to staying at the cutting edge of AI development, offering new possibilities for developers and researchers.
Read originalThe latest b10794 release of llama.cpp continues its trend of broadening platform compatibility, now supporting a wide array of systems including macOS, Linux, Windows, and openEuler. Notably, this update includes support for Vulkan and ROCm 10.0 on Ubuntu, as well as CUDA 13 on Windows, which enhances performance options for developers using these platforms. While the release doesn't introduce new model architectures, it solidifies llama.cpp's position as a versatile inference runtime across diverse hardware configurations. This update is a testament to llama.cpp's commitment to accessibility and performance optimization for developers working with AI models.
The b10795 release of llama.cpp brings notable improvements in SYCL fusion, specifically by combining operations like RMS_NORM+MUL+ADD and ADD+ADD. This enhancement, under GGML_SYCL_ENABLE_FUSION, boosts performance for supported data types, while unsupported combinations revert to standard methods. The update continues to support a wide array of platforms, including macOS with Apple Silicon, Ubuntu with Vulkan, and Windows with CUDA 12 and 13. This makes llama.cpp a robust choice for developers working across different hardware environments, ensuring efficient AI processing and broad compatibility.
The latest release of llama.cpp, b10796, introduces the n_expert_used_max function, enhancing the model's ability to handle expert layers. This update addresses previous issues where models with expert layers failed to load due to missing checks. By implementing this function, the software can now better manage the number of experts per layer, ensuring smoother model loading and operation. This release doesn't introduce new models but focuses on refining the existing infrastructure to support more complex configurations.