
TypeSafe has launched Jev, a new class of AI 'judgment model' designed to skip text generation entirely in favor of returning calibrated probabilities. The company claims this approach delivers speeds 20 to 200 times faster than standard large language models (LLMs) at a fraction of the cost. This release highlights a growing industry shift toward specialized models that handle small, discrete business decisions rather than generative tasks, positioning Jev as a component within a broader model stack alongside traditional LLMs.
Read originalEarlier coverage that leads up to this article, and what followed. Lines connect each piece to the closest one after it, converging here.
© The AI Daily BriefMenlo's latest report reveals enterprise AI spending has increased nearly five times in one year, primarily driven by the adoption of AI agents.
© The AI Daily BriefThis release quietly closes the hardware gap for local inference by adding default support for CUDA 13.5 and ROCm 10.0 alongside existing CUDA 12 builds. AMD GPU users finally get first-class parity with NVIDIA, while Snapdragon mobile chips gain dedicated NPU acceleration paths. Apple Silicon KleidiAI is explicitly disabled here, a notable regression for Mac performance that suggests ongoing tuning issues. The inclusion of OpenVINO and SYCL backends further cements llama.cpp as the universal runtime for inference across nearly every major silicon architecture.
Kimi’s new K3.1-Pro model joins the llama.cpp ecosystem, bringing a distinct architectural twist to local inference. By replacing full-attention MLA layers with DSA (Dynamic Sparse Attention) and linear-attention KDA layers, this release tests how well sparse caching handles hybrid attention patterns. The implementation keeps indexer precision high to avoid quality loss during top-k selection, ensuring the model runs accurately on consumer hardware. This expands the library’s reach into newer Chinese open-weight models that rely on complex memory management.
Matt Wolfe · September 28, 2026 · Same story
Ollama Blog · September 29, 2026 · Background
Sam Witteveen · September 29, 2026 · Background
TechCrunch AI · September 30, 2026 · Background
TechCrunch AI · October 9, 2026 · Related
TypeSafe Launches Jev Judgment Model
7 developments
NLW analysis shows Anthropic's market share is rising alongside increased demand for frontier models, even as doubts about its upcoming IPO grow.