Why AI needs a new kind of supercomputer network — the OpenAI Podcast Ep. 18
OpenAITraining frontier models isn’t as simple as adding more GPUs—one small problem and the whole coordinated dance falls apart. OpenAI’s Mark Handley and Greg Steinbrecher discuss how a new supercomputer network design, used to train some of the company’s latest models, keeps the whole system moving in