Models & Labs
Claude 3.7 Sonnet Introduces Extended Thinking Mode
Anthropichigh confidence
Why it matters
- →Extended thinking mode allows for more nuanced problem-solving by AI models.
- →Visible thought processes enhance transparency but raise security concerns.
- →Improved agent capabilities could lead to more advanced AI applications.
Anthropic has unveiled Claude 3.7 Sonnet, featuring an 'extended thinking mode' that allows the AI to engage in deeper cognitive processing for complex tasks. Users can toggle this mode to direct the model's focus, while developers can set a 'thinking budget' to control the duration of problem-solving. The model's thought process is now visible, providing transparency but also posing potential security risks. This update significantly boosts Claude's capabilities, making it more effective in tasks like playing Pokémon and potentially impacting real-world AI applications.
Read originalMore in Models & Labs
Models & Labsmodels
llama.cpp b12029 adds CUDA 13 and Snapdragon support
This release quietly cements llama.cpp as the universal inference runtime by finally supporting NVIDIA's latest CUDA 13 stack alongside AMD's ROCm 10.0. The inclusion of native builds for Linux arm64 with Snapdragon chips, covering CPU, Adreno GPU, and Hexagon NPU, signals a serious push into mobile edge deployment. While Apple Silicon KleidiAI is disabled in this specific build, the broader hardware coverage means developers no longer need to compile from source for most modern accelerators. It’s less about new features and more about removing friction for anyone running local models on bleeding-edge or diverse hardware.
llama.cpp Releases
© The Verge AIModels & Labsother
