At Microsoft Build, NVIDIA founder and CEO Jensen Huang joined Microsoft chairman and CEO Satya Nadella's keynote via livestream from Taipei to discuss the expanded partnership: NVIDIA RTX Spark and DGX Station for Windows, NVIDIA GPU-accelerated Microsoft Fabric, NVIDIA open models on Microsoft Foundry, the NVIDIA OpenShell secure runtime in GitHub Copilot and the next generation of NVIDIA-powered AI factories.
AI Generated·May contain errors
Video Summary
AI Generated
Jensen Huang and Satya Nadella discuss the evolution of AI from pre-training to agentic systems. They highlight the transition of the PC into a \"personal AI\" via RTX Spark and the progression of data center architecture from Hopper to Grace Blackwell and the upcoming Vera Rubin, emphasizing low latency, energy efficiency, and the massive growth in developer productivity.
Thank you so much for being at Build again. I know it's late for you in Taipei. I really
appreciate you staying up. You know, at the end, you know, I've been looking at social and, you know,
and everything people have been talking about since your keynote over the weekend.
And suddenly, you know, this concept of unmetered intelligence right at the edge is so hot again.
So maybe you want to talk a little bit. You have thought about this, talked about this. And now,
of course, with RTX Spark really delivered, I think, what's a breakthrough system for AI to
be much more ubiquitous. But maybe, Jensen, you can just share a little bit your vision around
where you see this going. Well, this all started about three years ago between a conversation
between you and I. And we were talking about how we could build a new class of PCs that's
incredible for designers and creators. And it would be incredible for artificial intelligence.
And it would be one of these systems that has the processing capability, but also the software stack
that's integrated into the world's design packages and creator packages. And of course,
all the things that we're doing with AI. And here we are. Three years later, we built
an incredible new chip. And this system is supported by all of this new software that
you created for Windows. And we now have the ability to have essentially an autonomous agent
running on the PC. Now, when you take a step back and you think about what does that mean?
For the 40 years or some 30 years we've been working together, we went from inventing
DirectX together to creating now this incredible computer that has autonomous systems running.
The PC evolved from being an incredible tool to now being a tool that's used
autonomously by an AI assistant. And so the idea that I could be traveling and I'm on the phone
and I could text my PC and ask my PC to get some coding done or some idea that I have,
and it would fire up the tools on the PC. And it would make the modifications or the changes or the
design that I told it to do. And it would iterate with me while I'm away from the PC. My PC became
an assistant. While I'm sitting there, of course, this PC would be my great assistant as well.
And so this idea that the PC evolved from a personal computer to a personal AI,
it's just really exciting. And to see it come to life, Satya, to see it come to life
and actually doing that, you know, so I'm super excited about it. Spark, as you mentioned earlier,
has all this incredible capabilities, a petaflop of AI performance. It has a petaflop of NVFP4,
this numerical format that our two companies worked on together that allows us to take
advantage of this 128 gigabytes of memory and fit maybe a couple of hundred billion
parameter model. A couple of hundred billion parameter model is state of the art. And so
I think the days of having a really smart assistant running autonomously on the PC is here.
Yeah, no, it's so awesome. And in fact, I'm also excited about Windows coming to the GB300.
And so that's another thing that it's kind of like data center right on your desktop. And it's
so exciting. But talking about that data center side, obviously, you know, this entire thing
got started when we built the first supercomputer together to train the GPT models. And we have
come a long way. In fact, even I was talking about the Fairwater design, it is custom built
essentially for the Grace Blackwell era to be able to max the data center design with the system
design you had. And now, of course, we're validating Mirror Rubin. We're very excited about
it. Maybe you want to share a little bit about sort of what happens even on the cloud side with
how you're pushing on the system's innovation. Well, our journey is incredible. We built the
first AI supercomputer together that was based on Ampere. Of course, Hopper was an incredible
success. Those first two generations were focused on pre-training. Grace Blackwell came along,
and all of the focus moved to post-training reinforcement learning, which allowed us to
have reasoning models. And these reasoning models, based on a mixture of experts,
were incredibly intelligent, energy efficient, but it requires giant systems. And so we created
MVLink72, and the entire rack became one computer. We had evolved from one node to now one rack.
Well, Microsoft deployed the largest number of Grace Blackwells in the world today.
The fastest and the largest number of Grace Blackwells in the world. Fairwater is just a
magnificent system to look at. It's just a miracle of engineering. It's just an incredible feat.
It's completely liquid cooled. You mentioned something earlier that I'm very proud of as well,
that it's closed looped, basically uses almost no water, and it's incredibly environmentally
friendly. It's energy efficient. We're able to increase the token generation rate and reduce
the cost of token generation by an order of magnitude, some 30 times over Hopper. So that
was a huge achievement. Well, Vera Rubin was created for a world where these AIs are now
agentic. And so where as Hopper was created for pre-training, Grace Blackwell for training,
post-training, and also inference, Vera Rubin is designed to run agents. It's agents, as you know,
this computing pattern is exactly the same computing pattern we're going to run on the
RTX Spark. It's exactly the same agentic system, except of course, it's going to be much,
much larger when processed, enormous number of them simultaneously. Many of them are going to
be from different customers and different partners. And so the entire path, the entire coding path
from storage, which is the long-term memory, the working memory is encrypted. The data is
encrypted in transit. The data is also encrypted in use. And so we're going to really innovate
in the area of confidential computing. And so this entire disaggregated distributed computing system,
you mentioned CPUs, Vera is a revolutionary CPU designed for agents. The past CPUs were
designed for humans. And we're just more patient than agents are. And agents want low latency,
just as you've been working on as well. Vera was designed for extremely low latency.
And so Vera Rubin is just completely revolutionary. I can't wait to show it to everybody.
You've already stood it up. Our two teams have been working very closely. You know, almost
long before the chips taped out, long before the systems were brought up, our two teams were
already completely aligned. And so the design, the data centers were created for Vera Rubin.
Vera Rubin is designed and integrated into your complete stack, into your networking,
into your security. And so the moment that our systems were rolling off the lines,
they were being stood up at Microsoft. So I'm incredibly excited about the collaboration.
Yeah, I know this speed of light execution between the teams is fantastic to see.
And of course, all this is to power the ecosystem around us, right? I mean, you and I,
having grown up with the PC, the server, and now with AI, have always thought about ultimately
it's about creating the opportunity for every developer, every organization to build on the
work that we do and the platforms we create. And speaking of that, there's a lot of software
that NVIDIA builds that's all also coming. For example, we're going to have your models in
Foundry, your tooling in Foundry. We're going to have, in fact, your software even help us
with accelerating our workloads when it comes to even the data warehouse. We're going to obviously
have stuff in Windows. Just talk a little bit about that broader vision of what does it mean
for us an opportunity, right? Because everybody talks about this one model or one piece of tech,
but it's about the broadest, biggest opportunity for people to create value.
Maybe you want to share a little bit about that. Well, we've been preparing for this moment.
You know, what happened in the last several months? We've been working for a decade and a
half together, getting ready for really what happened in the last several months. All of a
sudden, because of agentic systems, the convergence of these really great models, AI is now useful.
If you just look at GitHub, the commits into GitHub, it's gone completely parabolic.
In the last several months, the number of commits increased by a factor of three.
It's clear that agentic systems are useful, that it's doing productive work, and also tokens are
now profitable as a result. And so the amount of demand for compute between the usage of the AI
and the computation that's necessary for agents, the compute demand has really gone through the
roof. Well, one of the things that we've been doing together is making sure that all of the
tools that the agents are going to use are fully accelerated. Fabric, for example,
is now fully accelerated. We're accelerating data processing, SQL, Spark, semantic-based,
vector-based, graph-based. We're going to make sure that all of the tools that are available on
Azure are going to be fully GPU accelerated because the agents are going to be impatient.
The faster we can get the answers back to the agents, the faster they can iterate,
the faster we can generate tokens, which are ultimately what the developers, both of our
customers, would like to do is generate a lot of tokens that are really profitable,
that are highly intelligent. Thank you so much, Jensen, for the partnership and the leadership
and the innovation that you bring to this entire ecosystem. I'm really thrilled to be working
closely with you and the team and bring all this to the developers here and beyond. I look forward
to seeing what the next few months and the next year will bring in terms of the innovation that
gets built on top of the platform. Thank you again for joining this late in the night from Taipei.
Thank you so much, Satya, for your partnership and friendship.