Models & Labs
Google Enhances Gemini API with Managed Agents
Google AI Bloghigh confidence
Why it matters
- →Managed agents can now autonomously execute complex tasks, enhancing workflow automation.
- →The free tier access allows developers to experiment without financial risk.
- →Budget controls prevent excessive resource consumption, ensuring cost-effective operations.
Google has enhanced its Gemini API with new features for managed agents, including environment hooks and model selection. These updates allow for more autonomous and controlled execution of tasks within a cloud sandbox, making it easier for developers to manage workflows. The addition of a free tier enables developers to experiment without incurring costs, while budget controls help manage resource consumption. This positions the Gemini API as a valuable tool for developers seeking to automate and streamline coding processes.
Read originalMore in Models & Labs
Models & Labsmodels
llama.cpp b10156 Release Expands Platform Support
The latest b10156 release of llama.cpp continues its trend of broadening platform compatibility, notably adding support for ROCm 7.2 on Ubuntu x64. This update ensures that AMD GPU users can leverage llama.cpp more effectively, narrowing the gap with NVIDIA's CUDA. The release also includes Vulkan support for both Ubuntu and Windows, enhancing the versatility of the software for developers. While no new models or quantization methods are introduced, this update solidifies llama.cpp's position as a versatile inference runtime across diverse hardware configurations.
llama.cpp Releases
Models & Labsmodels
Llama.cpp b10164 Release Enhances CUDA Performance
The latest b10164 release of llama.cpp focuses on improving CUDA performance, particularly for Mamba-2 prefill acceleration. By introducing chunked SSD matrix multiplication, the update aims to enhance efficiency and memory coalescing. This release also addresses several technical fixes, including resolving a read-write race condition in CUDA operations. While there are no groundbreaking new features, these optimizations make llama.cpp a more robust choice for developers working with CUDA and related technologies.
llama.cpp Releases
Models & Labsmodels
llama.cpp b10166 Release Enhances Output Handling
The latest b10166 release of llama.cpp focuses on refining output handling, particularly by addressing issues with views in outputs. This update introduces changes like setting outputs to view sources and ensuring consistent logits handling, which are crucial for developers working with complex AI models. The release also simplifies the set_outputs function, making it more efficient for users. While there are no groundbreaking new features, these improvements contribute to a more stable and reliable platform for AI development.
llama.cpp Releases