Models & Labs
Apple to Offer AI Model Choices in iOS 27
TechCrunch AIhigh confidence
Why it matters
- →Apple's move to offer AI model choices could enhance user personalization and engagement.
- →Integrating third-party models may position Apple as a more flexible player in the AI space.
- →This strategy could help Apple leverage its hardware to create a more AI-centric user experience.
Apple plans to introduce a new feature in iOS 27, allowing users to select from various third-party AI models for on-device functionalities. Dubbed 'Extensions,' this feature will enable integration of generative AI capabilities into Apple's ecosystem, including Siri and Writing Tools. Models from Google and Anthropic are currently being tested, with ChatGPT likely remaining an option. This initiative is part of Apple's strategy to enhance its AI offerings by utilizing existing hardware, as the company seeks to strengthen its position in the AI landscape.
Read originalMore from TechCrunch AI
More in Models & Labs
Models & Labsmodels
Llama.cpp adds GLM-5.2 speculative decoding support
Llama.cpp's latest update introduces speculative decoding support for GLM-5.2, enhancing its capabilities with NextN/MTP features. This addition allows for more efficient tensor loading and context management, particularly benefiting models using the GLM_DSA architecture. The update also includes options for exporting models with or without the MTP feature, providing flexibility for developers. This release marks a step forward in optimizing model performance and adaptability, especially for those leveraging the GLM-5.2 framework.
llama.cpp Releases
Models & Labsmodels
Llama.cpp b10178 Release Adds Trace Logging
The b10178 release of llama.cpp enhances its server capabilities by adding trace logging for slot similarity checking, offering developers detailed insights into prompt cache slot selection processes. This update includes specifics on skip reasons and similarity calculations, which can aid in performance optimization. While no new model architectures are introduced, the release continues to support a wide array of platforms, such as macOS with KleidiAI, Ubuntu with ROCm 7.2, and Windows with CUDA 12 and 13. This makes llama.cpp a more versatile tool for developers working on different systems, reinforcing its position as a comprehensive inference runtime.
