
Meta has released Muse Glimmer, a 30 billion parameter agentic model, under the Apache 2.0 license. This model is designed to offer developers extensive capabilities for AI application development. The open-source nature of Muse Glimmer allows for unrestricted use, making it a valuable resource for innovation in the AI field. This move by Meta highlights its commitment to supporting the open-source community and advancing AI technology.
Read originalThe latest b10412 release of llama.cpp introduces backend sampling for both dflash and dspark, marking a technical enhancement in the platform's capabilities. This update allows for more refined control with the enablement of p_min > 0 in backend sampling, adding a layer of precision for developers. While the release doesn't introduce new models or architectures, it quietly strengthens the platform's backend functionality, making it more versatile for developers working across various systems. This update is a step forward in optimizing the performance and flexibility of llama.cpp's inference capabilities.
The b10414 release of llama.cpp marks a significant enhancement with the addition of GGML_TYPE_TQ2_0 type processing in the Metal backend, enabling ternary operations with 2 bits per element. This update brings a more efficient mul_mv kernel, focusing on float operations and optimizing data handling through techniques like precalculating sums. While the release doesn't feature new models, it refines the platform's performance and broadens its compatibility across systems like macOS, Linux, and Windows. By improving efficiency and versatility, llama.cpp continues to be a valuable tool for developers working with a variety of hardware configurations.