Models & Labs
TurboQuant Introduces Extreme Compression for AI
Google Research Blogmedium confidence
Why it matters
- →The introduction of TurboQuant may enable AI practitioners to deploy models more efficiently, reducing costs and improving accessibility.
Google Research has unveiled TurboQuant, a new approach aimed at enhancing AI efficiency through extreme compression techniques. This development could significantly reduce the resource requirements for AI models.
Read originalMore from Google Research Blog
© Google Research BlogResearchresearch
Google Research Explores AI in Dermatology Assistance
Google Research has been delving into how AI can aid individuals in comprehending skin conditions, with their latest findings published in JAMA Dermatology. Their studies reveal that AI tools can significantly enhance users' ability to identify skin conditions compared to traditional search methods. Despite this improvement in condition identification, the AI tools still face challenges in guiding users on the appropriate medical actions to take. This research demonstrates the potential of AI to make dermatological information more accessible to the public, although further refinement is necessary to enhance decision-making support.
Google Research Blog
© Google Research BlogResearchresearch
UC San Diego Turns Old Phones into Low-Carbon Cloud
In a novel approach to sustainable computing, researchers at UC San Diego, with support from Google, are repurposing retired smartphones into a low-carbon cloud computing platform. By extracting and clustering the motherboards of 2,000 Pixel phones, they aim to create a datacenter that offers low-cost computing power while reducing the need for new hardware. This initiative not only addresses the carbon footprint of manufacturing but also leverages the surprising power of smartphone processors, which can rival modern servers. The project will serve as a testbed for the viability of smartphone-based computing at scale, potentially transforming how educational institutions manage their computing resources.
Google Research Blog
More in Models & Labs
Models & Labsmodels
vLLM v0.23.0 Release Enhances Model Support
The vLLM v0.23.0 release marks a significant step forward with enhancements across various components. DeepSeek-V4 has been optimized further, decoupling its metadata from previous versions and adding new attention kernels. Model Runner V2 now supports more dense models by default, improving performance for Llama and Mistral. The Rust frontend has matured with new endpoints and tool parsers, while compatibility with Transformers v5 ensures broader model support. These updates collectively enhance the robustness and versatility of vLLM, making it a more powerful tool for developers working with large language models.
vLLM Releases
Models & Labsmodels
Llama.cpp b9626 Release Adds Cohere2-MoE Support
The latest b9626 release of llama.cpp introduces architectural support for the cohere2-MoE model, marking a significant update for developers working with this model. This release also includes various technical improvements such as the removal of redundant checks and enhancements in tensor handling, which streamline the model's performance. By adding cohere2moe to the Llama Model Saver supported list, the update broadens the toolkit available for AI practitioners. While these changes may seem incremental, they collectively enhance the robustness and flexibility of llama.cpp, making it a more versatile tool for AI development.
llama.cpp Releases
Models & Labsmodels
llama.cpp b9627 Release Expands Platform Support
The b9627 release of llama.cpp continues to enhance its platform reach, though it doesn't introduce any groundbreaking features. This update includes support for a wide array of systems, from macOS and iOS to various Linux distributions and Windows configurations, including CUDA and Vulkan support. Notably, the release maintains its focus on making llama.cpp a versatile tool across different hardware setups, but it doesn't introduce new model architectures or quantization methods. This iteration is more about solidifying its presence across multiple operating systems rather than introducing novel capabilities.
llama.cpp Releases