
Former OpenAI researcher Diogo Almeida has launched Jev, an AI model designed without text generation capabilities. The system focuses exclusively on 'System 1' fast thinking, claiming to be 200 times faster and 400 times cheaper than conventional large language models while remaining hallucination-free. By removing the ability to write code or speak, the model targets high-throughput, low-latency applications where natural language output is not required.
Read originalEarlier coverage that leads up to this article, and what followed. Lines connect each piece to the closest one after it, converging here.
Ollama Blog · May 28, 2026 · Background
Together AI Blog · June 2, 2026 · Background
MIT Technology Review AI · June 19, 2026 · Background
OpenAI · June 24, 2026 · Related
Lev Selector · July 3, 2026 · Background
MIT Technology Review AI · July 9, 2026 · Background
OpenAI · August 25, 2026 · Background
Sam Witteveen · August 30, 2026 · Background
Matt Wolfe · September 28, 2026 · Related
Sam Witteveen · September 29, 2026 · Related
TechCrunch AI · September 30, 2026 · Related
TechCrunch AI · October 9, 2026 · Related
Together AI Blog · November 4, 2026 · Related
TypeSafe Launches Jev Judgment Model
7 developments
This release quietly closes the hardware gap for local inference by adding default support for CUDA 13.5 and ROCm 10.0 alongside existing CUDA 12 builds. AMD GPU users finally get first-class parity with NVIDIA, while Snapdragon mobile chips gain dedicated NPU acceleration paths. Apple Silicon KleidiAI is explicitly disabled here, a notable regression for Mac performance that suggests ongoing tuning issues. The inclusion of OpenVINO and SYCL backends further cements llama.cpp as the universal runtime for inference across nearly every major silicon architecture.
Kimi’s new K3.1-Pro model joins the llama.cpp ecosystem, bringing a distinct architectural twist to local inference. By replacing full-attention MLA layers with DSA (Dynamic Sparse Attention) and linear-attention KDA layers, this release tests how well sparse caching handles hybrid attention patterns. The implementation keeps indexer precision high to avoid quality loss during top-k selection, ensuring the model runs accurately on consumer hardware. This expands the library’s reach into newer Chinese open-weight models that rely on complex memory management.
This release quietly cements llama.cpp as the universal inference runtime by adding default builds for CUDA 13.5 and ROCm 10.0 across Linux and Windows. The inclusion of ROCm 10 means AMD GPU users no longer need custom compilation to access modern acceleration, effectively closing the gap with NVIDIA's ecosystem support. While KleidiAI on Apple Silicon is disabled in this build, the broader platform coverage ensures that local inference remains accessible on virtually any hardware configuration without manual setup.