Research
ParallelKernelBench Reveals Gaps in Multi-GPU Kernel Generation
Together AI Bloghigh confidence
Why it matters
- →Multi-GPU kernel generation is crucial for scaling AI workloads efficiently.
- →Current LLMs struggle with complex communication patterns, limiting their utility.
- →The findings highlight areas for improvement in AI-driven optimization for distributed systems.
ParallelKernelBench (PKB) has highlighted the limitations of current large language models (LLMs) in generating efficient multi-GPU kernels. Despite progress in single-GPU scenarios, models like GPT-5.5 and Gemini 3 Pro solved fewer than a third of PKB's 87 benchmark problems correctly. The evaluation shows that these models struggle with complex communication patterns and rank coordination, which are essential for multi-GPU performance. While there are occasional successes in generating high-performance kernels for specific tasks, the findings underscore the need for further advancements in AI-driven optimization for distributed computing.
Read originalMore in Research
Researchresearch
GPT-5 aids in solving immunology mystery
GPT-5 Pro has made a notable impact in the field of immunology by resolving a complex issue related to T cell behavior that had puzzled researchers for three years. This achievement opens new avenues for cancer and autoimmune disease research, demonstrating AI's potential to contribute to scientific breakthroughs. By offering innovative data analysis and insights, GPT-5 Pro proves its value beyond conventional applications, potentially speeding up medical discoveries. This development signifies a shift in how AI can be utilized to tackle intricate biological challenges, setting the stage for future advancements in healthcare.
OpenAI
© MIT News AIResearchresearch
MIT Develops Low-Power Chip for Tiny Robots
MIT researchers have developed a groundbreaking chip that enables tiny robots to create detailed 3D maps of their environments using minimal power. This innovation combines an efficient mapping algorithm with specialized hardware, allowing the chip to consume only about 6 milliwatts of power. By using Gaussians instead of traditional voxels, the chip can represent obstacles more compactly, significantly reducing memory and power requirements. This advancement could revolutionize applications in autonomous drones and augmented reality, offering real-time mapping capabilities with minimal energy consumption.
MIT News AI
© NVIDIA BlogResearchresearch
JUPITER Supercomputer Powers Exascale Science Breakthroughs
JUPITER, Europe's first exascale supercomputer, is showcasing the transformative potential of exascale computing across various scientific domains. With NVIDIA Grace Hopper Superchips at its core, JUPITER is enabling groundbreaking projects like mapping the human brain at cellular scale and simulating Earth's climate at unprecedented resolution. These advancements highlight the shift from theoretical to practical applications of exascale computing, offering new insights into complex systems. The supercomputer's capabilities are also being leveraged to advance AI for next-gen wireless networks and simulate quantum computers, marking a significant leap in computational science.
NVIDIA Blog