Tools

Explore

Videos Channels Figures

Atmrix

Tools

Explore

Videos Channels Figures

Atmrix

LF

Lex Fridman Cast

02/03/25

@ Lex Fridman

Elon Musk's xAI is building a data center with 200,000 GPUs, which is currently the largest cluster, surpassing those of Meta and OpenAI, which have 128,000 and 100,000 GPUs respectively.

Video

DeepSeek, China, OpenAI, NVIDIA, xAI, TSMC, Stargate, and AI Megaclusters | Lex Fridman Podcast #459

@ Lex Fridman

DeepSeek, China, OpenAI, NVIDIA, xAI, TSMC, Stargate, and AI Megaclusters | Lex Fridman Podcast #459

02/03/25

Related Takeaways

Lex Fridman Cast

02/03/25

@ Lex Fridman

Elon Musk's approach to AI infrastructure is to have the biggest cluster fully connected in one building, while Google has to spread its resources across multiple sites, which affects efficiency.

Lex Fridman Cast

02/03/25

@ Lex Fridman

The largest AI models, like GPT-4, require massive GPU clusters, with power consumption reaching unprecedented levels, highlighting the increasing scale of AI infrastructure.

Lex Fridman Cast

02/03/25

@ Lex Fridman

The scale of mega cluster buildouts for AI is unprecedented, with data center power consumption expected to rise significantly, driven by the demands of AI training and inference.

Chase Lochmiller

05/07/25

@ Sequoia Capital

Crusoe is currently constructing about 2 gigawatts of AI infrastructure and has 20 gigawatts in the pipeline, transforming both the energy and data center landscapes to support AI.

Lex Fridman Cast

02/03/25

@ Lex Fridman

DeepSeek has historically leveraged its hedge fund resources to build significant GPU clusters, including a claim of having the largest cluster in China with 10,000 A100 GPUs in 2021.

Y Combinator Cast

06/07/24

@ Y Combinator

Meta has invested heavily in AI infrastructure, acquiring GPUs for their recommendation models, which unexpectedly benefits their AI capabilities.

Demis Hassabis

05/23/25

@ Google for Developers

The demand for data centers is increasing as more people want to use AI models, and we need to ensure we have enough infrastructure to support this demand.

Y Combinator Cast

11/01/24

@ Y Combinator

OpenAI's recent $6.6 billion funding round indicates that AI models are becoming increasingly capital intensive, with future models expected to be orders of magnitude larger than current ones.

Sam Altman

06/18/25

@ OpenAI

There's a significant gap between the current compute capabilities and what could be achieved with ten to a hundred times more compute, which would allow for much greater AI services.