Together AI adds capacity-aware traffic splitting for seamless rollouts, A/B testing, and zero-downtime updates using immutable configuratio
Together AI introduces autoscaling for LLM inference based on in-flight requests and GPU utilization to address cold starts and misleading C