Bringing 100,000 GPUs to Europe

ThunderAgent Boosts Agentic Inference Efficiency

ThunderAgent introduces a novel approach to agentic inference, significantly improving throughput and reducing latency in synthetic data generation. By treating each agent workflow as a program rather than isolated requests, it mitigates KV cache thrashing and balances load across nodes. This results in up to 2.5× higher throughput on single nodes and near-linear scaling on multi-node clusters. ThunderAgent's compatibility with existing inference optimizations makes it a practical choice for enhancing large-scale agentic workloads.

Microsoft Challenges OpenAI, Anthropic with Own AI Models

Microsoft is positioning itself as a formidable competitor to AI giants OpenAI and Anthropic by promoting its own AI models and infrastructure. CEO Satya Nadella emphasizes the importance of enterprises maintaining control over their AI systems, advocating for a diverse model approach to avoid dependency on any single provider. This strategy is underscored by Microsoft's development of the MAI family of models and the Maya AI chips, which promise cost-effective and efficient performance. By offering a broad catalog of models, Microsoft aims to provide enterprises with flexible and secure AI solutions, challenging the dominance of established AI labs.

Music Industry Proposes AI Governance Framework