Models & Labs
Thinking Machines releases open-weight AI model Inkling
TechCrunch AIhigh confidence
Why it matters
- →Inkling offers a customizable alternative to proprietary AI models, allowing organizations to fine-tune it for specific needs.
- →The open-weight design challenges the dominance of closed models by giants like OpenAI and Google.
- →It emphasizes cost efficiency and adaptability, potentially outperforming proprietary models in specialized tasks.
Thinking Machines Lab has launched Inkling, its first open-weight AI model, which allows developers to download and modify it directly. Unlike the proprietary models from OpenAI or Google, Inkling is designed for adaptability, using a mixture-of-experts system with 975 billion parameters. The model is aimed at enterprises looking to fine-tune AI for specific tasks, offering a customizable alternative to the one-size-fits-all approach. While not claiming to be the strongest, Inkling focuses on well-rounded performance and cost efficiency, challenging the dominance of closed AI models.
Read originalThe story around this
Earlier coverage that leads up to this article, and what followed. Lines connect each piece to the closest one after it, converging here.
More from TechCrunch AI
© TechCrunch AIMarket & Regulationbusiness
Crusoe cancels $1.25B Boom turbine deal
The collapse of Crusoe’s $1.25 billion order for Boom Supersonic’s stationary turbines exposes the fragility of AI infrastructure financing. While Crusoe raised $3.9 billion, it pivoted away from on-site gas generation, opting instead for grid power and diverse energy mixes. This signals that even well-funded data center operators are prioritizing flexibility over massive, long-term capital commitments to specialized hardware. Boom’s pivot to sell jet engines as power plants was a bold bet on AI energy needs, but losing its anchor customer suggests the market is more cautious than anticipated.
TechCrunch AI
© TechCrunch AIMore in Models & Labs
Models & Labsother
llama.cpp b11193 adds Snapdragon Hexagon and ROCm 10
This release quietly expands llama.cpp's hardware support to include Qualcomm's Hexagon NPU on Linux arm64, a significant step for local inference on Snapdragon devices. It also updates CUDA builds to version 13.4 and introduces ROCm 10.0 binaries, keeping the project aligned with the latest NVIDIA and AMD driver ecosystems. KleidiAI on Apple Silicon is temporarily disabled in this build, likely due to stability checks rather than a feature rollback. For developers targeting edge AI or diverse GPU stacks, this update ensures broader compatibility without requiring custom compilation.
llama.cpp Releases
© Lev SelectorModels & Labsmodels
NVIDIA NVFP4 and SoL-Pi Token Efficiency
NVIDIA introduced the NVFP4 4-bit format and SoL-Pi technology, which uses 2x fewer tokens for improved efficiency.
