Coding Tools
Together AI: Fine-tune Jev-like classifier for $17
Together AI Bloghigh confidence
Why it matters
- →Demonstrates that specialized classification can be cheaper and faster than prompting large foundation models.
- →Provides a reproducible pipeline for deploying task-specific AI endpoints at near-zero marginal cost.
- →Lowers the barrier to entry for developers needing deterministic, high-throughput text analysis.
Together AI has published a tutorial on fine-tuning its Tev1-4B-experimental model, a Jev-like classifier built on Qwen3.5 4B. The process involves sampling 38,000 examples from six Hugging Face datasets to train the model for specific classification tasks like intent detection or boolean policy checks. Training takes approximately 25 minutes and costs around $17, after which the model is deployed as a dedicated HTTP endpoint on Together's serverless platform. This allows developers to integrate fast, low-cost classification directly into applications without relying on expensive general-purpose LLMs.
Read originalThe story around this
Earlier coverage that leads up to this article, and what followed. Lines connect each piece to the closest one after it, converging here.
How we got here
- 1OpenJarvis: Local AI Framework Now Available
Ollama Blog · May 28, 2026 · Background
- 2Google DeepMind Launches Gemma 4 12B Multimodal Model
Google DeepMind · June 9, 2026 · Background
- 3Subquadratic claims breakthrough in LLM efficiency
MIT Technology Review AI · June 19, 2026 · Background
- 4OpenAI and Broadcom unveil LLM-optimized chip
OpenAI · June 24, 2026 · Background
- 5Alibaba and DeepSeek advance China's AI model race
AI News · August 5, 2026 · Background
- 6Startups Innovate Beyond Transformers in LLMs
MIT Technology Review AI · August 10, 2026 · Background
- 7Together AI Enables A/B Testing for LLMs
Together AI Blog · August 17, 2026 · Related
- 8Qwen3.8-27B Model Explored and Optimized
Sam Witteveen · August 18, 2026 · Background
What happened next
- 9OpenAI launches Decisions API for fast agent classification
TechCrunch AI · September 30, 2026 · Related
- 10Fine-tunes reduce Qwen3.8-27B reasoning tokens
Sam Witteveen · October 4, 2026 · Related
- 11Liquid AI releases efficient on-device agent model
Hugging Face Blog · October 13, 2026 · Related
- 12VocabX cuts SLM inference cost by 77% via specialized vocab
Hugging Face Blog · October 21, 2026 · Related
- 13Together AI automates inference optimization with agents
Together AI Blog · November 4, 2026 · Related
Follow this story
Open the full story →TypeSafe Launches Jev Judgment Model
7 developments
- Sep 17 · The AI Daily Brief
TypeSafe Launches Jev Judgment Model - Sep 18 · Sam Witteveen
Typesafe AI launches Jev for high-speed classification↳ Jev prioritizes System 1 reasoning for ultra-fast classification, targeting latency bottlenecks in agent workflows rather than chain-of-thou - Sep 18 · TechCrunch AI
TypeSafe AI launches Jev, a non-LLM model for automation - Sep 21 · Cole Medin
Jev: A Decision-Only AI Model for Agents↳ Jev abandons text generation to become a pure decision engine with sub-200ms latency and negligible costs. - Sep 21 · Fireship
Ex-OpenAI researcher launches Jev System 1 model↳ Ex-OpenAI researcher Diogo Almeida launches Jev System 1, claiming it is 200x faster and 400x cheaper than standard LLMs by stripping out te - Sep 22 · Duncan Rogoff
Jev AI Classifier: Speed vs. Hype↳ Jev excels at rigid schema-based routing but fails on open-ended generation or complex reasoning. - Sep 23 · Together AI Blog
Together AI: Fine-tune Jev-like classifier for $17 (This article)↳ Together AI fine-tunes Qwen3.5 4B into a Jev-style classifier for $17 in 25 minutes.
More in Coding Tools
Coding Toolscoding
Claude Code v2.1.323 adds experimental Code Mode and plugin safety
This release quietly introduces Code Mode, an opt-in feature where Claude writes JavaScript to call its own tools, marking a shift toward more autonomous agent-like behavior within the CLI. The update also hardens the plugin ecosystem by enforcing version ranges and adding strict TypeScript type checking for hooks, which should significantly reduce instability from third-party extensions. Beyond these features, the changelog is dominated by critical fixes for authentication drift in background sessions and memory leaks when handling large files, stabilizing the tool for heavy enterprise use.
Claude Code Releases
Coding Toolscoding
llama.cpp b12336 fixes HunyuanVL crash
This release quietly patches a critical memory overflow in the mtmd module that caused crashes when loading HunyuanVL models. The issue stemmed from F64 position embeddings overflowing an F32 buffer, a subtle bug that broke multimodal inference for users relying on this specific architecture. By enforcing strict F32 requirements, llama.cpp stabilizes support for Tencent's vision-language model without adding new features or changing the core API. It’s a necessary maintenance update that keeps local multimodal workflows from breaking unexpectedly.
llama.cpp Releases
Coding Toolscoding
llama.cpp b12343 adds qwen3.5 and ROCm 10
This release quietly extends llama.cpp’s hardware coverage with ROCm 10.0 binaries for both Linux and Windows, finally bringing AMD RDNA/CDNA users into the fold without manual compilation. The standout feature is native support for Qwen3.5 models via tensor merging during conversion, a necessary step as this new architecture gains traction in the open-source community. By shipping pre-built CUDA 13 binaries alongside the older 12.x versions, the project ensures forward compatibility with newer NVIDIA GPUs out of the box. There are no new quantization algorithms or performance breakthroughs here; it is purely an infrastructure update to keep pace with the rapidly shifting landscape of model architectures and GPU drivers.
llama.cpp Releases