Market & Regulation
Understanding 99.9% Uptime in AI Inference
Together AI Bloghigh confidence
Why it matters
- →High uptime is crucial for AI inference reliability, impacting product performance.
- →Infrastructure ownership allows for direct management of failures, enhancing service continuity.
- →Understanding the engineering behind uptime tiers helps in making informed decisions about service providers.
Together AI explores the engineering challenges of maintaining high uptime for AI inference services. Achieving 99.9% uptime involves deploying model weights across multiple facilities and ensuring live traffic routing to handle full data center failures. The company emphasizes the importance of infrastructure ownership, allowing them to manage failures directly without relying on third-party hyperscalers. This approach ensures that their systems are robust and capable of maintaining service continuity even during significant outages.
Read originalThe story around this
Earlier coverage that leads up to this article, and what followed. Lines connect each piece to the closest one after it, converging here.
More in Market & Regulation
© TechCrunch AIMarket & Regulationbusiness
Crusoe cancels $1.25B Boom turbine deal
The collapse of Crusoe’s $1.25 billion order for Boom Supersonic’s stationary turbines exposes the fragility of AI infrastructure financing. While Crusoe raised $3.9 billion, it pivoted away from on-site gas generation, opting instead for grid power and diverse energy mixes. This signals that even well-funded data center operators are prioritizing flexibility over massive, long-term capital commitments to specialized hardware. Boom’s pivot to sell jet engines as power plants was a bold bet on AI energy needs, but losing its anchor customer suggests the market is more cautious than anticipated.
TechCrunch AI
© TechCrunch AI