Coding Tools
Fintech scales coding agents with self-serve inference
Together AI Bloghigh confidence
Why it matters
- →Self-service inference allows engineering teams to scale AI workloads instantly without waiting for platform tickets.
- →Prioritizing concurrency over raw throughput is critical for spiky, agent-based coding traffic patterns.
- →Direct API control over model tuning and endpoint configuration reduces operational friction significantly.
A global fintech has deployed Together AI's Dedicated Model Inference to support its internal coding assistant, running the GLM-5.2 model on a cluster of 56 NVIDIA B200 GPUs. The company shifted from a static capacity model to a self-service architecture that prioritizes concurrency headroom over raw throughput, allowing engineering teams to scale endpoints and adjust tuning parameters in real-time. This approach resolved previous issues with request queuing during peak working hours by giving developers direct control over endpoint lifecycle and observability metrics without platform team intervention.
Read originalMore in Coding Tools
Coding Toolscoding
Claude Code v2.1.277 fixes critical bugs and adds AGENTS.md
This release stabilizes Claude Code by patching a cascade of crashes and session hangs that plagued recent versions. The most notable functional shift is the fallback to AGENTS.md when CLAUDE.md is absent, aligning with broader industry standards for agent configuration. Gateway improvements allow better proxy handling for egress-bound environments, while numerous fixes address edge cases in file editing, plugin management, and resume functionality. It’s a maintenance-heavy update that restores reliability rather than introducing new capabilities.
Claude Code Releases
Coding Toolscoding
Claude Code v2.1.278 optimizes auto-mode billing
Anthropic quietly fixed a cost leak in Claude Code’s auto mode. By defaulting to the server-side classifier for API and enterprise users, the update eliminates charges for classifier overhead that previously bled into session costs. This shift means developers no longer pay double for the same logic, while still retaining the ability to opt out via environment variables if needed. The change is a subtle but necessary correction to pricing transparency in automated coding workflows.