Launch of Elon Musk's New AI Model "Grok-3"

All right. Well, welcome to the Grok 3 presentation. So the mission of XAI and Grok is to understand the universe. We want to understand the nature of the universe so we can figure out what's going on, where are the aliens, what's the meaning of life, how does the universe end, how did it start, all these fundamental questions. We're driven by curiosity about the nature of the universe. And that's also what causes us to be a maximally truth-seeking AI, even if that truth is sometimes at odds with what is politically correct. In order to understand the nature of the universe, you must absolutely rigorously pursue truth, or you will not understand the universe. You will be suffering from some amount of delusion or error. So that is our goal, figure out what's going on. And we're very excited to present Grok 3, which is, we think, an order of magnitude more capable than Grok 2 in a very short period of time. And that's thanks to the hard work of an incredible team. And I'm honored to work with such a great team. And of course, we'd love to have some of the smartest humans out there join our team. So with that, let's go. Hi, everyone. My name is Igor, lead engineering at XAI. I'm JB Paul, leading research. I'm Tony, working on the reasoning team. All right, I'm Elon. I don't do anything. I just show up occasionally. Yeah, so like Elon mentioned, Grok is the tool that we're working on. Grok is our AI that we're building here at XAI. And we've been working extremely hard over the last few months to improve Grok as much as we can so we can give it to all of you, so we can give all of you access to it. We think it's going to be extremely useful. We think it's going to be interesting to talk to a funny, really, really funny. And we're going to explain to you how we've improved Grok over the last few months. We've made quite a jump in capabilities. Yeah, actually, we should explain maybe also why do we call it Grok. So Grok is a word from a Heinlein novel, Stranger in a Strange Land. And it's used by a guy who was raised on Mars. And the word Grok is to sort of fully and profoundly understand something. That's what the word Grok means, fully and profoundly understand something. And empathy is important. True. So yeah, so if we charted XAI's progress in the last few months, has only been 17 months since we started kicking off our very first model, Grok 1 was almost like a toy by this point, only 314 billion parameters. And now if we plot the progress, the time on the x-axis, the performance of favorite benchmark numbers, MMLU, on the y-axis, we're literally progressing at unprecedented speed across the whole field. And then we kick off Grok 1.5 right after Grok 1, released after November 2023, and then Grok 2. So if we look at where all the performance is coming from, we have a very correct engineering team and all the best AI talent. The only one thing we need is a big intelligence comes from big cluster. So we can reconvert the entire progress of XAI, now replacing the benchmark on the y-axis, to a total amount of training flops. That is, how many GPUs we can run at any given time to train our large language models to compress the entire internet. So after Grok 2- All human knowledge, really. That's right. Yeah, internet being part of it, but it's really all human knowledge, everything. Yeah, the whole internet fits into a USB stick at this point. It's like all the human tokens, yeah. That's right. Very soon, into the real world. Yeah. So we had so much trouble, actually, training Grok 2 back in the days. We kick off the model around February. And we thought we had a large amount of chips, but it turned out we can barely get AK training chips running coherently at any given time. And we had so many cooling and power issues. I think you were there in the data center. Yeah, it was really sort of more like AK chips on average at 80% efficiency, more like 6500 effective H100s training for several months. But now we're at 100K. Yeah, that's right. More than 100K. That's right. So what's the next step, right? So after Grok 2, if we want to continue to accelerate, we have to take the matter into our own hands. We have to solve all the coolings, all the power issues, and everything. So in April of last year, Elon decided that really the only way for XAI to succeed, for XAI to build the best AI out there, is to build our own data center. So we didn't have a lot of time because we wanted to give you Grok 3 as quickly as possible. So really, we realized we have to build the data center in about four months. It turned out it took us 122 days to get the first 100K GPUs up and running. And that was a monumental effort to be able to do that. We believe it's the biggest fully connected H100 cluster of its kind. And we didn't just stop there. We actually decided that we need to double the size of the cluster pretty much immediately if we want to build the kind of AI that we want to build. So we then had another phase, which we haven't talked about publicly yet. So this is the first time that we're talking about this, where we doubled the capacity of the data center yet again. And that one only took us 92 days. So we've been able to use all of these GPUs, use all of this compute to improve Grok in the meantime. And basically, today, we're going to present you the results of that, the fruits that came from that. That's great. Yeah, so all the paths, all the roads lead to Grok 3. 10x more compute. More than 10x, really. Yeah, really. Maybe 15x-ish. Yep, compared to our previous generation model. And Grok 3 finished pre-training early January. And the model is still currently training, actually. So this is a little preview of our benchmark numbers. So we evaluated Grok 3 on three different categories, general mathematical reasoning, general knowledge about STEM and science, and then also on computer science, coding. So AIME, American Invitational Math Examination, holds it once a year. And if we evaluate the model performance, we can see that the Grok 3 across the board is in a league of its own. Even its little brother, Grok 3 Mini, is reaching the frontier across all the other competitors. So you would say, well, at this point, all these benchmarks, you're just evaluating the memorization of the textbooks, memorization of the GitHub repos. How about a real-time usefulness? How about we actually use those models in our product? So what we did instead is we actually kicked off a blind test of our Grok 3 model, codenamed Chocolate. It's pretty hot. Yeah, hot chocolate. And it'll be running on this platform called Chatbot Arena for two weeks. I think the entire X platform at some point speculated this might be the next generation of AI coming your way. So how this Chatbot Arena works is that it strips away the entire product surface. It's just raw comparison of the engine of those AGIs, the language models themselves, and plays the interface where the user will submit one single query, and you get to show two responses. You don't know which model they come from. And in the end, you make the vote. So in this blind test, Grok 3, an early version of Grok 3, already reached 1,400. No other models have reached an ELO score. Had to have comparison to all the other models at this score. And it's not just one single category. It's 1,400 aggregated across all the categories in chatbot capabilities, instruction following, coding. So it's number one across the board in this blind test. And it's still climbing. So we actually have to keep updating it. So it's about 1,400 and climbing. Yeah, in fact, we have a version of the model that we think is already much better than the one that we tested here. We'll see how far it gets. But that's the one that we're working on, we're talking about today. Yeah, so actually one thing, if you're using Grok 3, I think you may notice improvements almost every day because we're continuously improving the model. So literally, even within 24 hours, you'll see improvements. Yep. But we believe here at XAI, getting the best pre-training model is not enough. That's not enough to build the best AI. And the best AI need to think like a human. You need to contemplate about all the possible solutions, self-critique, verify all the solutions, backtrack, and also think from the first principle. That's a very important capability. So we believe that as we take the best pre-training model and continue training it with reinforcement learning, it will elicit the additional reasoning capabilities that allows the model to become so much better and scale not just in the training time, but actually in the test time as well. So we already found the model is extremely useful internally for our own engineering, saving hours of time, hundreds of hours of coding time. So Igor, you are the power user of our graph-driven reasoning model. So what are some use cases? Yeah, so like Jimmy said, we've added advanced reasoning capabilities to Grok, and we've been testing them pretty heavily over the last few weeks. I wanted to give you a little bit of a taste of what it looks like when Grok is solving hard reasoning problems. So we've prepared two little problems for you. One comes from physics, and one is actually a game that Grok is going to write for us. So when it comes to the physics problem, what we want Grok to do is to plot a viable trajectory to do a transfer from Earth to Mars, and then at a later point in time, a transfer back from Mars to Earth. And that requires some physics that Grok will have to understand. So we're gonna challenge Grok, come up with a viable trajectory, calculate it, and then plot it for us so we can see it. And yeah, this is totally unscripted, by the way. That's the entirety of the prompt, which should be clarified, is that there's nothing more than that. Yeah, exactly. This is the Grok interface, and we've typed in this text that you can see here, generate code for an animated 3D plot of a launch from Earth, landing on Mars, and then back to Earth at the next launch window. And we've now kicked off the query, and you can see Grok is thinking. So part of Grok's advanced reasoning capabilities are these thinking traces that you can see here. You can even go inside and actually read what Grok is thinking as it's going through the problem, as it's trying to solve it. Yeah, we are doing some obscuration of the thinking so that our model doesn't get totally copied instantly. So there's more to the thinking than is displayed. Yeah, and because this is totally unscripted, there's actually a chance that Grok might make a little coding mistake, and it might not actually work. So just in case, we're gonna launch two more instances of this, so if something goes wrong, we'll be able to switch to those and show you something that's presentable. So we're kicking off the other two as well. And like I said, we have a second problem as well. And yeah, actually one of our favorite activities here at XCI is having Grok write games for us. And not just any, no, any old game, any game that you might already be familiar with, but actually creating new games on the spot and being creative about it. So one example that we found was really, really fun is create a game that's a mixture of the two games Tetris and Bejeweled. So you can- This is maybe an important thing. Obviously, if you ask an AI to create a game like Tetris, there are many examples of Tetris on the internet, or a game like Bejeweled, whatever, it can copy it. What's interesting here is it achieved a creative solution combining the two games that actually works and is a good game. We're seeing the beginnings of creativity. Fingers crossed that we can recreate that. Hopefully it works, yeah, yeah. On the spot, hopefully it works. It would be embarrassing if it isn't. So actually, because this is a bit more challenging, we're gonna use something special here, which we call Big Brain. That's our mode in which we use more computation, which means more reasoning for Grok, just to make sure that there's a good chance here that it might actually do it. So we're also gonna fire off three attempts here at solving this game, at creating this game that's a mixture of Tetris and Bejeweled. Yeah, let's see what Grok comes up with. I've played the game, it's pretty good. Like it's, you're like, wow, okay, this is something. Yeah, so while Grok is thinking, in the background, we can now actually talk about some concrete numbers, you know, how well is Grok doing across tons of different tasks that we've tested it on. So we'll hand it over to Tony to talk about that. Yeah, okay, so let's see how Grok does on those interesting, challenging benchmarks. So yeah, so reasoning, again, refers to those models that actually thinks for quite a long time before it tries to solve a problem. So in this case, you know, around a month ago, the Grok 3 pre-training finished. So after that, we worked very hard to put the reasoning capability into the current Grok 3 model. But again, this is very early days, so the model is still currently in training. So right now, what we're gonna show to people is this beta version of the Grok 3 reasoning model. Alongside, we also are training a mini version of the reasoning model. So essentially, on this part, you can see the Grok 3 reasoning beta, and then Grok 3 mini reasoning. The Grok 3 mini reasoning is actually a model that we train for much longer time, and you can see that sometimes, it actually performs slightly better compared to the Grok 3 reasoning. This also just means that there's a huge potential for the Grok 3 reasoning, because it's trained for much less time. So all right, so let's actually look at how it does on those three benchmarks. So Jimmy also introduced already. So essentially, we're looking at three different areas, mathematics, science, and coding. And for math, we're taking this high school competition math problem. For science, we actually pick those PhD-level science questions. And for coding, it's also actually pretty challenging. It's competitive coding, and also some lead code, which is some code interview problems that people usually get when they interview for companies. So on those benchmarks, you can see that the Grok 3 actually performed quite well across the board compared to other competitors. Yeah, so it's pretty promising. These models are very smart. So Tony, what are those shaded bars? Yeah, so okay, so I'm glad you asked this question. So for those models, because it can reason, it can think, you can also ask them to even think longer. You can spend more what we call test and compute, which means you can spend more time to reason, to think about a problem before you spit out the answer. So in this case, the shaded bar here means that we just ask the model to spend more time. You can solve the same problem many, many times before it tries to conclude what is the right solution. And once you give this compute, or this kind of budget to the model, it turns out the model can even perform better. So this is essentially the shaded bar in those files. Right, so I think this is really exciting, right? Because now, instead of just doing one chain of thoughts with AI, why not do multiple all at once? Yes. So that's a very powerful technique that allows to continue to scale the model capabilities after training. And people often ask, are we actually just overfitting to the benchmarks? Yes. So how about your organization? So yes, I think, yeah, this is definitely a question that we are asking ourselves, whether we are overfitting to those current benchmarks. Luckily, we have a real test. So about five days ago, AIME 2025 just finished. This is where high school students compete in this particular benchmark. So we got this very fresh new competition, and then we asked our two models to compete on the same benchmark, on the same exam. And it turns out, very interestingly, the GRASS 3 reasoning, the big one, actually does better on this particular new fresh exam. This also means that the generalization capability of the big model is stronger, much stronger, compared to the smaller model. If you compare to the last year's exam, actually this is the opposite. The smaller model kind of learns the previous exams better. So yeah, so this actually shows some kind of true generalization from the model. That's right. So 17 months ago, our GROK0 and GROK1 barely solved any high school problems. That's right. And now we have a kid that just already graduated. The GROK is ready to go to college. Is that right? Yeah. I mean, it won't be long before it's simply perfect. The human exams won't be too easy. Yeah, and internally, we actually, as the GROK continues to evolve, we're gonna talk about what we're excited about. But very soon, there will be no more benchmarks left. Yeah. Yeah, one thing that's quite fascinating, I think, is that we basically only trained GROK's reasoning abilities on math problems and competitive coding problems. It's a very, very specialized kinds of tasks, but somehow it's able to work on all kinds of other different tasks. So including creating games, no, lots and lots of different things. And what seems to be happening is that basically GROK learns this ability to detect its own mistakes in its thinking, correct them, persist on a problem, try lots of different variants, pick the one that's best. So there are these generalizing abilities that GROK learns from mathematics and from coding, which it can then use to solve all kinds of other problems. So that's pretty. I mean, reality is the instantiation of mathematics. That's right. And one thing we're actually really excited about, that goes back to our founding mission, is what if one day we have a computer just like DeepThought that utilizes our entire cluster just for that one very important problem in the test time? All the GPU turned on, right? So I think back then, we were building the GPU clusters together. You were plugging cables, and I remember that when we turned on the first initial test, you can hear all the GPUs humming in the hallway. That's almost feel like spiritual. Yeah, that's actually a pretty cool thing that we're able to do, that we can go into the data center and tinker with the machines there. So for example, we went in and we unplugged a few of the cables, and just made sure that our training setup is still running stably. So that's something that I think most AI teams out there don't usually do, but it actually totally unlocks a new level of reliability and what you're able to do with the hardware. Okay, so when are we gonna solve RIMON? So the easiest solution is to enumerate over all possible strains. And as long as you have a verifier and enough compute, you'll be able to do it. My projection would be... What's your guess? What does your neural net calculate? So my bold prediction, so three years ago I told you this, I think now it's two years later, two things are gonna happen. We're gonna see machines win some medals. Yeah. Turing's Award. Absolutely. Phil's Medal, Nobel Prize, with probably some expert in the loop, right? So the expert uplifting. So this year or next year? Oh, oh, okay. That's what it comes down to, really. So it looks like Grok finished all of his thinking on the two problems. So let's take a look at what it said. All right, so this was the little physics problem we had. No, we've collapsed the thoughts here, so they're hidden. And then we see Grok's answer below that. So it explains, it wrote a Python script here using matplotlib, then gives us all of the code. So let's take a quick look at the code. Seems like it's doing reasonable things here, not totally off the mark. Solve Kepler says here, so maybe it's solving Kepler's laws numerically. Yeah, there's really only one way to find out if this thing is working. I'd say let's give it a try, let's run the code. All right, and we can see, yeah, Grok is animating two different planets, Earth and Mars here, and then the green ball is the vehicle that's transiting, the spacecraft that's transitioning between Earth and Mars. And you could see the journey from Earth to Mars, and it looks like, yeah, indeed, the astronauts returned safely at the right moment in time. So obviously, this was just generated on the spot, so we can't tell you if that was actually a correct solution, so we're gonna take a closer look, and maybe we're gonna call some colleagues at SpaceX, ask them if this is legit. It's pretty close. It's, I mean, yeah, I mean, there's a lot of complexities in the actual orbits that have to be taken into account, but this is pretty close to what it looks like. Awesome. Cool, cool. In fact, I have that on my pendant here. This has got the Earth-Mars Hohmann transfer on it. Yeah, when are we gonna install Grok on a rocket? Well, I suppose in two years. Two years? Everything is two years away. Well, Earth and Mars transit occurs every 26 months. We're currently in a transit window, approximately. The next one would be November of next year, roughly, end of next year. And if all goes well, SpaceX will send Starship rockets to Mars, with Optimus robots and Grok. Yeah, I'm curious what this combination of Tetris and Bejeweled looks like. The Tetris, as we've named it internally. So, okay, we also have an output from Grok here. It says it wrote a Python script, explains what it's been doing. If you look at the code, there are some constants that are being defined here, some colors, then the tetrominoes, the pieces of Tetris are there. Obviously, very hard to see at one glance if this is good, so we gotta run this to figure out if it's working. Well, let's give it a try. Fingers crossed. All right, so this kind of looks like Tetris, but the colors are a little bit off, right? The colors are different here, and if you think about what's going on here, Bejeweled has this mechanic where if you get three jewels in a row, then they disappear, and also gravity activates. So what happens if you get three of the colors together? Oh, yeah, so something happened. So I think what Grok did in this version is that once you connect at least three blocks of the same color in a row, then gravity activates and they disappear, and then gravity activates, and all the other blocks fall down. I'm kind of curious if there's still a Tetris mechanic here where if the line is full, does it actually clear it, or what happens then? It's up to interpretation, so who knows? Yeah, I mean, it'll do different variants when you ask it. It doesn't do the same thing every time. Exactly, we've seen a few other Tetris that work very differently, but this one seems cool, so yeah. Are we ready for a game studio at x.ai? Yes, so we're launching an AI gaming studio at x.ai. If you're interested in joining us in building AI games, please join x.ai. We're launching an AI gaming studio. We're announcing it tonight. Let's go. Epic Games. Oh, wait, that's an actual game studio. I mean... Yeah. All right, so I think one thing that's super exciting for us is that once you have the best pre-trained model, you have the best reasoning model, so we already see that we actually give the capability for those models to think harder, think longer, think more broad, the performance can then improve. And we're really excited about the next frontier, that what happens if we're not only allowing the model to think harder, but also provide more tools, just like our real humans, to solve those problems. For real humans, we don't ask them to solve hypothesis just with a piece of pen and paper, no internet. So with all the basic web browsing, search engine, and code interpreters, that builds the foundations and the best reasoning model, builds the foundations for the grok agent to come. So today we're actually introducing a new product called DeepSearch, that is the first generation of our grok agents, that not just helping the engineers and researchers and scientists to do coding, but actually help everyone to answer questions that you have day to day. It's kind of like a next generation search engine that really help you to understand the universe. So you can start asking questions like, for example, hey, when is the next Starship launch day, for example? So let's try that, hit the answer. On the left-hand side, we see a high-level progress bar. Essentially, the model now is just gonna do one single search, like the current rack system, but actually thought very deeply about, hey, what's the user intent here? And what are the facts I should consider at the same time? And how many different websites I should actually go and read their content, right? So this can really save hundreds of hours of everyone's Google time, if you want to really look into certain topics. And then on the right-hand side, you can see the bullet summaries of how the current model is doing, what websites browsing, what sources verifying, and oftentimes actually cross-validate different sources out there to make sure the answer is actually correct before it's output final answer. And we can, you know, at the same time, fire up a few more queries. How about, you know, Elon, you're a gamer, right? So... Ah, sure. Yeah, so how about, what are some of the best builds and most popular builds in Pathfinder XL? Hardcore, right? Hardcore league. If you can, technically, just look at the hardcore ladder. Might be a fast way to figure it out. Yeah, we'll see what the model does. And then we can also do, you know, something more fun. For example, how about, like, make a prediction about the March Madness out there? Yeah, so this is kind of a fun one where Warren Buffett has a billion-dollar bet. If you can exactly match the, I think, the sort of entire winning tree of March Madness, you can win a billion dollars from Warren Buffett. So, like, it would be pretty cool if AI could help you win a billion dollars from Buffett. That seems like a pretty good investment. Let's go. All right, so now let's fire up the query and see what the model does so we can actually go back to our very first one. How about the- Buffett wasn't counting on this. Oh, sorry, it's already done? That's right. Okay, so we got the result of the first one. The model thought around one minute. So, okay, so the key insight here, the next Starship is gonna be on 24th or later, so no earlier than February 24th. It might be sooner. So, yeah, so I think we can, you know, go down, scroll down what the model does. So it does a little research on the flight seven, what happened, got grounded, and actually it's looking to the FCC filing, you know, from its data collections. And then actually it made a new conclusion that, yeah, if we continue to scroll down, let's see. Right. Yeah, so it makes the little table, I think, inside XAI. We often joked about the time to the first table is the only latency that matters. Yeah, so that's how the model make the inference and look up all the sources. And then we can look into the gaming one. So how about the, oh, sorry about that. Right, so for this particular one, we look at, hey, the, you know, the build is light and, you know, it's kind of old beta. Yeah, so what the infernal is, but if we go down, so the surprising fact of all the other builds. So I look into the 12 classes. Yeah, so we'll see that the minion build was pretty popular when the game first came out and now the invokers of the world kind of took over. Invoker, monkey invoker for sure. Yeah, that's right. Yeah, followed by the stone weavers and that's really good at mapping. So, yeah. And then we can see the match madness. How about that? So one interesting thing about the deep search is that if you actually go into the panel where it shows, you know, what are the subtasks, you can actually click the bottom left of this, right? And then in this case, you can actually scroll through, actually reading through the mind of Grock. What informations does the model actually think about are trustworthy, what are not? How does it actually cross validate different information sources? So that makes the entire search experience and information retrieval process a lot more transparent to our users. And this is much more powerful than any search engine out there. You can literally just tell it, only use sources from X, you know, it will try to respect that. Yeah. And so it's much more steerable, much more intelligent than. I mean, it really should save you a lot of time. So something that might take you half an hour or an hour of researching on the web or searching social media, you can just ask it to go do that and come back and 10 minutes later, it's done an hour's worth of work for you. That's really what it comes down to. Exactly. And maybe better than you could have done it yourself. Yeah. Think about you have infinite amount of interns working for you. Now you can just fire up all the tasks and come back a minute later. So this is gonna be interesting one. So March Madness had not happened yet. So I guess we had to follow up with a next live stream. Yeah. It seems like pretty good, like $40 might get you a billion dollars. $40 subscription. That's right. I mean, it might work. So yeah. So when are the users gonna have their hands on Grok 3? Yeah. So the good news is we've been working tirelessly to actually release all of these features that we've shown you. The Grok 3 base model with amazing chat capabilities that's really useful, that's really interesting to talk to. The deep search, the advanced reasoning mode, all of these things. We wanna roll them out to you today. Starting with the premium plus subscribers on X. So it's the first group that will initially get access. Make sure to update your X app if you wanna see all of the advanced capabilities because we just released the update now as we're talking here. And yeah, if you're interested in getting early access to Grok, then sign up for premium plus. And also we're announcing that we're starting a separate subscription for Grok that we call Super Grok for those real Grok fans that want the most advanced capabilities and the earliest access to new features. So feel free to check that out as well. This is for the dedicated Grok app and for the website. Exactly. So our new website is called grok.com. Yeah. And you'll also find- You'd never guess. Yeah, you'd never guess. And you can also find our Grok app in the iOS app store. And that gives you an even more polished experience that's totally Grok focused. If you want to have Grok easily available one tap away. Yeah, and the version on grok.com on a web browser is gonna be the latest and most advanced version because obviously it takes us a while to get something into an app and then get it approved by the app store. So, and then if something's on a phone format, there's limitations of what it can do. So the most powerful version of Grok and the latest version will be the web version at grok.com. Yeah, so watch out for the name Grok Free in the app. Dead giveaway. Yeah, exactly. That's the giveaway that you have Grok Free. And if it says Grok True, then Grok Free hasn't quite arrived for yet, but we're working hard to roll this out today and then to even more people over the coming days. Yeah, make sure you update your phone app too where you're actually gonna get all the tools we showcased today with the thinking mode, with the deep search. So, yeah, really looking forward to all the feedbacks you have. Yeah, and I think we should emphasize that this is kind of a beta, like meaning that you should expect some imperfections at first, but we will improve it rapidly almost every day. In fact, every day, I think it'll get better. So if you want a more polished version, I'd like maybe wait a week, but expect improvements literally every day. And then we're also gonna be providing a voice interaction so you can have conversational. In fact, I was trying it earlier today. It's working pretty well, but these are a bit more polished. The sort of way where you can just literally talk to it like you're talking to a person, that's awesome. It's actually, I think, one of the best experiences of Grok. But that's probably about a week away. Yeah, so with that said, I think we might have some audience questions. Sure. All right. Let's take a look. Yeah, let's take a look. The audience from the Ask platform. Cool, so the first question here is, when Grok Voice Assistant? When is it coming out? Yeah, as soon as possible. Just like Elon said, just a little bit of polishing away from being released to everybody. Obviously, it's going to be released in an early form and we're going to rapidly iterate on that. Yep. And the next question is, when will Grok 3 be in the API? So this is coming in the Grok 3 API with both the reasoning models and deep search is coming your way in the coming weeks. We're actually very excited about the enterprise use cases of all these additional tools that now Grok has access to and how to test and compute and tool use can actually really accelerate all the business use cases. Another one is, will voice mode be native or text-to-speech? So I think that means, is it going to be one model that is understanding what you say and then talking back to you or is it going to be some system that has text-to-speech inside of it? And the good news is, it's going to be one model, like a variant of Grok 3 that we're going to release, which basically understands what you're saying and then generates the audio directly from that. So very much like Grok 3 generates text, that model generates audio. And that has a bunch of advantages. I was talking to it earlier today and it said, hi, Igor, reading my name probably from some text that it had. And I said, no, no, my name is Igor. And it remembered that. So it could continue to say, Igor, just like a human would and you can't achieve that with text-to-speech. Yeah, so, oh, here's a question for you, pretty spicy. Elon, is Grok a boy or a girl? And are they single? Grok is whatever you want it to be. Yeah. Are they single? Yes. All right. The shop is open. Honestly, people are going to fall in love with Grok. It's like 1,000% probable. Yeah. The next question, will Grok be able to transcribe audio into text? Yes. So we'll have this capability in both the app and also the API. We found that Grok should just be your personal assistant, looking over your shoulder and follow you along the way, learn everything you have learned and really help you to understand the world better, become smarter every day. Yeah, I mean, the voice mode of Grok isn't simply, it's not just voice-to-text. It understands tone, inflection, pacing, everything. It's wild. I mean, it's like talking to a person. Okay. Yep. So any plans for conversation memory? Yeah. Absolutely. We're working on it right now. All right. That's right. Let's see. What are the other ones? So what about the DM features, right? So if you have personalization, if you have, you know, Grok remembers your previous interactions. Yes. Should it be one Grok or multiple different Groks? It's up to you. You can have one Grok or many Groks. I suspect we will probably have more than one. Yeah. I want to have a doctor Grok. Yeah. The Grok doc. That's right. All right. Cool. So in the past, we've open sourced Grok one, right? So somebody is asking us, are we going to do it again with Grok two? Yeah. I think once Grok, our general approach is that we will open source the last version when the next version is fully out. So like when Grok three is mature and stable, which is probably within a few months, then we'll open source Grok two. Okay. So we'll probably have time for one last question. What was the most difficult part about working on this project? I assume Grok three. And what are you most excited about? So I think me looking back, getting the whole model training on 100K H100 coherently, that's almost like battling against the final boss of the universe, the entropy. Because at any given time, you can have a cosmic ray that beaming down and flip a bit in your transistor. And now the entire gradient update, if it fits Manteza bit, the entire gradient update is out of whack. And now you have 100,000 of those. And you have to orchestrate them every time, at any given time, any of the GPUs can go down. I mean, it's worth breaking down, how were we able to get the world's most powerful training cluster operational within 122 days? Because we started off, we actually weren't intending to do a data center ourselves. We were gonna just, we went to the data center providers and said how long would it take to have 100,000 GPUs operating coherently in a single location? And we got timeframes from 18 to 24 months. So we're like, well, 18 to 24 months, that means losing as a certainty. So the only option was to do it ourselves. Then if you break down the problem, I guess I'm doing like reasoning here. Makes you think. One single chain though. Yeah, exactly. So, but we needed a building. We can't build a building, so we must use an existing building. So we looked for, basically for factories that had been abandoned, but the factory was in good shape. Like the company had gone bankrupt or something. So we found an Electrolux factory in Memphis. That's why it's in Memphis. Home of Elvis. And also one of the oldest, I think it was the capital of ancient Egypt. And it was actually a very nice factory that for whatever reason that Electrolux had left. And that gave us shelter for the computers. Then we needed power. We needed at least 120 megawatts at first, but the building only had 15 megawatts. And ultimately for 200,000 GPUs, we needed a quarter gigawatt. So we initially leased a whole bunch of generators. So we have generators on one side of the building, just trailer after trailer of generators until we could get the utility power to come in. But then we also need cooling. So on the other side of the building, it was just trailer after trailer of cooling. So we leased about a quarter of the mobile cooling capacity of the United States on the other side of the building. Then we needed to get the GPUs all installed and they're all liquid cooled. So in order to achieve the density necessary, this is a liquid cooled system. So we had to get all the plumbing for the liquid cooling. Nobody had ever done a liquid cooling data center at scale. So this was an incredibly dedicated effort by a very talented team to achieve that outcome. Now you may think, now it's gonna work. Nope. The issue is that the power fluctuations for a GPU cluster are dramatic. So it's like this giant symphony that is taking place. Imagine having a symphony with 100,000 or 200,000 participants in the symphony and the whole orchestra will go quiet and loud in 100 milliseconds. And so this caused massive power fluctuations, which then caused the generators to lose their minds and they weren't expecting this. So to buffer the power, we then used Tesla Megapacks to smooth out the power. So the Megapacks had to be reprogrammed. So with XAI, working with Tesla, we reprogrammed the Megapacks to be able to deal with these dramatic power fluctuations to smooth out the powers that the computers could actually run properly. And that worked, it was quite tricky. And then, but even at that point, you still have to make the computers all communicate effectively. So all the networking had to be solved and debugging a zillion network cables, debugging nickel at four in the morning, before we solved it. 4.20 a.m.? Roughly 4.20 a.m. Yes, okay. Because we figured out like there's some, well, there were a whole bunch of issues. Well, one that was like a BIOS mismatch. The BIOS was not set up correctly. Yeah. We had to dev our LSPCI outputs between two different machines. One that was working. Yeah. One that was not working, yeah. Many, many other things. I mean, yeah, exactly. This would go on for a long time if we actually list all the things. But it's like interesting. It's not like, oh, we just magically made it happen. You had to break down the problem, just like Grok does for reasoning, into the constituent elements and then solve each of the constituent elements in order to achieve a coherent training cluster in a period of time that is a small fraction of what anyone else could do it in. And then once the training cluster was up and running and we could use it, now we have to make sure that it actually stays healthy throughout, which is its own giant challenge. And then we had to get every single detail of the training right in order to get a Grok3-level model, which is actually really, really hard. So we don't know if there are any other models out there that have Grok3's capabilities, but whoever trains a model better than Grok3 has to be extremely good at the science of deep learning at every aspect of the engineering. So it's not so easy to pull this off. And this is now gonna be the last cluster we build and last model we train. Oh yeah, we've already started work on the next cluster, which will be, yeah, about five times the power. So instead of a quarter gigawatt, roughly 1.2 gigawatts. What's the Back to the Future was? What's the power? There's like the Back to the Future car? Yeah. Anyway, the Back to the Future power car. It's like roughly in that order, I think. So, you know, these will be the sort of the GB200 slash 300 cluster. It once again will be the most powerful training cluster in the world. So we're not like stopping here. And our reasoning model is gonna continue to improve by accessing more tools every day. So yeah, we're very excited to share any of the upcoming results with you all. Yeah, the thing that keeps us going is basically being able to give Grok free to you and then seeing the usage go up, seeing everybody enjoy Grok. That's what really gets us up in the morning. Yeah. Yeah, thanks for tuning in, everyone. Awesome, thanks guys. Hey Grok, what's up? Can you hear me? I'm so excited to finally meet you. I can't wait to chat and learn more about each other. I'll talk to you soon. This broadcast was made possible by Economy Media. Subscribe and let us know what you think in the comments below.