Will we get AGI in 2026? Will AI agents replace programmers? Is the open-source AI era ending — and is China already ahead? In this episode, Andrew Ng breaks down why “AGI” (Artificial General Intelligence) has become a marketing term, why the world is still decades away from real AGI, and what the real story is: AI agents, agent workflows, and practical AI adoption that changes business long before human-level intelligence arrives.
We go deep on the gap between AI benchmarks and real-world usefulness, the risk of an AI hype bubble leading to another AI winter, and why open-source / open-weight models matter if we want to avoid an AI oligopoly dominated by a few proprietary frontier model labs. We also talk about the future of work, AI job automation, and why education systems are still training people for jobs that no longer exist.
Andrew Ng is a leading AI researcher and entrepreneur, former head of Google Brain, co-founder of Coursera, and a major voice on machine learning, deep learning, and building real-world AI products.
In this episode you’ll learn: • What AGI should mean — and why redefining it fuels hype • Andrew’s new Turing-style AGI test: multi-day, economically valuable work • Why benchmarks can improve while AI feels “worse” to users • What AI agents and agentic workflows will actually deliver in 2026 • Open-source AI vs proprietary models (and why China is a key player) • Which jobs are at risk (call centers, translation, voice work) — and why most won’t vanish overnight • Why AI education needs a radical update (students trained for 2022 roles) • The real stakes: innovation freedom vs an AI oligopoly
Chapters: 00:00 AGI as a marketing term (Artificial General Intelligence) 01:00 AGI in 2026? Andrew Ng’s answer 03:33 A practical AGI test 05:05 AI benchmarks vs real-world performance 08:55 AI agents and agent workflows in 2026 23:29 AI hype bubble 30:14 Open-source, open weights, and avoiding an AI oligopoly 42:58 AI automation and jobs most exposed 46:00 China vs the US in AI 53:08 Meaning, happiness, and what AI is for
AGI has become a marketing term. If AI could do a useful economic work task as well as a skilled
professional human, then that seems to me like a more reasonable definition for AGI. I think we're
very far away from that, maybe more than decades. Andrew NG is one of the key architects of modern
artificial intelligence, mentioned in the same breath as Geoffrey Hinton, Yann LeCun and Demis
Hassabis. Now just be transparent, just be completely truthful. There is a small number
So candidly, I think an excessive hype that leads to disappointment, that leads to a collapse of
the so-called bubble, that would not be good for the world or good for the field of AI. A lot of
the best open source, open way models are coming out of China. Many universities are slow to adapt
curricula and are still training students for the jobs of 2022. Many of those jobs don't really
exist. Employees don't want to hire. Will programmers be unemployed? Will this be the year
we finally achieve AGI? You are opening your expos from a few hours ago with this question.
For any reasonable definition of AGI, I think the answer is no, we will not get AGI in 2026.
The best way to get AGI in 2026 is if someone manages to dramatically lower the bar for what
AGI actually means, then maybe some comes to clear the hurdle. How would you explain
then defining AGI? The definition of AGI that I am most familiar with is AI that can do any
intellectual task that a person can. Today a human can learn in maybe tens of hours how to
drive a truck through a forest, which I've never done before, but I think if you train me for a
few hours I could probably do it. A human could learn to take calls for a contact center and
answer questions consistent with how a certain business needs to answer that. There are certain
things that a person can learn to do, intellectual tasks as opposed to physical tasks. A lot of these
tasks still feel like there is a ton of work to build custom AI workflows to perform, which we
do, and which turns out to be really valuable. But needing an engineer to spend so much time
building these things is not how the public typically thinks about AGI, and as much as I
hope we'll get there someday. Computers are as intelligent as people in every sense.
I think we're very far away from that. You've just proposed today a new version of the Turing
test. Can you explain what you propose? I'm excited about this. I feel like because of the
hype around AGI, AGI has become a marketing term rather than something of precise technical meaning,
and the way it's used as a marketing term, it actually misleads a lot of people. But since
people want AGI, are excited about it, I'm excited about it, why don't we come up with a test to see
if we're actually getting close to achieving AGI? Here's the idea. In the original Turing test,
a human judge would get to type text back and forth to either an AI or a human, and the original
Turing test was can an AI fool the judge into thinking or being unable to tell if they're
talking to an AI or to a human. It was a great invention for 1950, which is when I think Alan
Turing came up with this test, but it's not really measuring intelligence the way we think
about it today. Here's how I think we can build a Turing AGI test, is what I called it, which is
have a human judge design a multi-day experience that could be some onboarding training
via a computer, and the test subject will be either AI or a human with access to a computer
and normal software like a web browser, maybe Zoom, maybe other types of software.
And if over a few days, if in a multi-day experience, if an AI could do a useful economic
work task as well as a skilled professional human, then that seems to me like a more reasonable
definition for AGI. And the reason I'm proposing this is because this is actually much closer to
what the broader public thinks of as AGI. AGI could be here to think, wow, AI will be able to
do people's jobs. And indeed, if AI is able to function like a remote worker for multiple days
and do productive work, that will be incredibly valuable and I think much closer to what people
think of as real AGI, as opposed to some of these alternative standards that some businesses are
promoting for PR policy or fundraising purposes. I remember my interview with Sir Roger Penrose,
Nobel Prize winner. Math is a closed system, so AI can play it like a game.
Aren't you afraid, Andrew, an effective AI test doesn't exist? One of the challenges with
tests or benchmarks for AI is when someone fakes a test set in advance,
then you're just measuring one specific dimension of AI. This is why for a lot of
AI models, large language models, there are a lot of standard benchmarks, you know,
SweetBench, GPQA, and so on. And it's very difficult to avoid having teams optimize for
the known test sets out there, even if they don't do it directly. And AI is a jagged form
of intelligence. It's great at some things, really awful at some other things. But AGI,
people think of it as AI that can do any intellectual task the person can, should cover
all intellectual tasks that people can cover. So to me, one big difference between a fixed test set
kind of benchmark versus a human judge probe in real time is a human judge can take a look at
and can probe to see where is AI strong, where is AI weak. And for AI to be this AGI, you know,
most people think of it as matching humans in every dimension, which means a human judge
should be unable to probe to find places where the AI is materially weaker than what a human
can do in terms of these, say, economically valuable job tasks that we want AI to do.
Are benchmarks still measuring something real? Benchmarks hit 90% and the users say
that it feels dumber. Are benchmark measuring something real?
Oh, I think benchmarks are measuring something real, but it's a very narrow slice of the sorts
of things we're going to measure. One weakness of a lot of benchmarks is we're much better at
designing objective benchmarks. So things like math, which is a rather wrong answer,
or a factual question, like in this year's Olympics, who won this 200-meter freestyle
swimming or whatever. So those questions have objective, rather wrong answers. And so a lot
of benchmarks is on measuring is the AI right or wrong. It's very black and white. A lot of life,
it's very difficult to design one completely objective best answer. So even in a human
conversation like we're having, what's the one right thing for me to say? I don't know,
but I could probably say stuff that's better or some stuff that is worse. And on average,
we've been not very good at designing benchmarks to measure these things that are more subjective,
or where their gradations are good and bad, but it's very hard to write a test set saying
this is one right answer, this is one wrong answer. Not that we don't try, but I feel like
a lot of the benchmarks we have don't capture those things as well. And the reality is a lot
of human work. If you ask me to write a research report, you know, there's no one right report,
there are different gradations of how good or bad the report is. And our ability to write benchmarks
to capture this gray shades of gray is much weaker than our ability to write benchmarks to say,
did it solve this math problem correctly? Did it write a piece of code that runs correctly? Those
we know how to do better than what a lot of actual useful human work requires. If not AGI,
what we can expect in 2026? Greg Brockman from OpenAI says two big dams of AI in, that's a quad,
dams of AI in 2026 will be agent adoption and scientific acceleration. What's your take on that?
I think AGI is a distraction. We're very far from it. You know, we're not going to get there
anytime soon. But even without achieving AGI, there's so much incredibly valuable stuff that
we are doing and that we will continue to do in 2026. I coined the term agentic AI to describe
what I saw as a growing phenomenon. And even though I was saying that it's so much work
to build AI, to capture useful business processes, sometimes when you do that,
it's incredibly valuable. So in 2026 and beyond, there'll be a lot of exciting work
to build AI agents or to build agentic workflows to do a ton of really valuable,
economically important work. Here at my team at AI Fund, our teams that are using agentic
workflows to write code, like many others do too, but also to look at paperwork, to check for
tariff compliance as guide AI, or to read tricky legal documents to help lawyers do their work
better, or to do medical assistance tasks, or to support customer service. And I find that
taking the mental processes that people are currently going through to do these types of
tasks, be it legal compliance or whatever, and coding them as an AI agent, as an agentic workflow,
so the AI can do it for you. This, I think, will go on for a long time. We'll be building
these agentic workflows for many, many years to come, but the value will be very large.
What we are talking about agentic workflows, Professor Rich Sutton famously said,
raw computing power always beats human cleverness. By focusing on agentic workflows,
aren't you against… So, Richard's article on The Bitter Lesson was very influential and very
well written. Just to be clear, I like scale. When I started Google Brain, which later merged
with DeepMind to form Google DeepMind and created Gemini and so on, my number one mission that I set
to the Google Brain team was that, let's just scale, right? Build really, really big neural
networks, do lots of data out of it. So, I think I was probably one of the earliest in AI.
You are the architect of the era of scale.
I pushed for scale when everyone else thought, frankly, everyone else at that time thought it
was a strange thing to push for, pretty much. So, I like scale. And I think it was because
the Google Brain team, the way I set it up, its DNA was just the scale. That was the number one
thing. Obviously, a team does many things, but the number one mission was scale. That's how I
set up Google Brain. That's why, with that DNA, it was the Google Brain team that invented the
transformer neural network that was the most scalable neural network architecture in history
and that powered the generative AI revolution, right? So, I really believe in scale.
Having said that, at different moments in time, our ability to scale and our ability to inject
other forms of knowledge creates a balance where I don't think we'll achieve everything we want
only by scale. It is an incredibly powerful tool. And like many things,
sometimes we've seen businesses hype up one phenomenon for fundraising or PR or whatever
purposes. And it is absolutely true that because of scaling laws, when you scale systems,
you can fairly predictably forecast where performance will go. This was first shown
by my team at Baidu, later by OpenAI, I think. And so, this is actually a wonderful argument
to raise funds because you can say, give me more money. I will scale these machines,
scale the data, but also get better. But because of that huge kernel of truth and scale,
I think it has been hyped up beyond what it actually is, which is amazingly valuable,
but not as valuable as the hype says it is, but nonetheless still amazingly valuable.
And agentic workflows allows us to take advantage of the scaled AI models, large-scale models,
and additionally inject other types of knowledge into the system to build more reliable,
more performant workflows.
Uday, do you truly believe that the era of scaling is over?
No, I don't think the era of scaling is over. It's been getting harder and harder.
Yeah, it's been interesting.
AI has been progressing maybe exponentially. It's been interesting seeing that the number
of dollars needed to drive this exponential process has also been exponential. So,
you spend exponentially many dollars to drive exponentially rapid improvement. It's not bad.
It is very valuable because the cost of building it can be amortized over a lot of users.
And I think there's still more to be gained by scale, but it's not the only avenue we have
for improving AI at this point.
What would change your mind?
About what?
About scaling.
Oh, what would make me give up on scaling?
If for an extended period of time, further efforts to scale up models are not paying off,
that would make me change my mind.
But maybe one important asterisk to that, just as over many decades Moore's law drove progress,
but it took lots of different technologies that kept on changing over time for Moore's law to
keep on making semiconductors work better and better, what we see is in the early days of
the genuine LLMs, the recipe was get more data, create a bigger model.
This is exactly what I, at least at that level of abstraction,
is exactly what Google Brain was set out to do, right, more than 15 years ago or so.
But since then, AI models have read pretty much the entire open internet.
So, that simple recipe for scaling, it doesn't really work anymore, which is why
many teams are now doing much more work on synthetic data generation,
which requires much more human engineering, a lot more work on different reinforcement
learning recipes. And so, even though scaling still continues to pay off, the specific recipes
for driving that scaling has definitely shifted quite significantly over these last two or three
years. So, from another side, can a smarter model simply beat a smart workflow?
Yes. I wish it were that easy, though, that in practice, I think it is,
in theory, yes, in practice, very harder than most people think.
Why?
So, one thing I think has been fantastic was with more intelligent models,
be it, you know, the Cloud 4.5 Oculus, Gemini 3, GPD 5.1, 5.2, we've been increasingly able to
give a large-language model a set of tools and just have it let loose. So, just give it a set
of tools for reading and writing for a file system, then just tell it to do some tasks,
like, you know, look for extraneous files and help me clean up my hard disk or whatever.
And the level of performance of these is fantastic. It's really, really, really impressive.
Having said that, for many workflows, it's just not reliable enough to be production-ready.
And so, while smarter models are great, what I see right now for a lot of practical business
use cases is teams thinking through what is the workflow you want, what are the key steps,
and implementing them piecemeal so they can get that reliable performance to get this stuff
working and have it run 10,000 times and maybe even work, you know, pretty much every single
time. And maybe, and as models become more intelligent, we are letting them be more
autonomous. We're removing guardrails. One thing my teams often do, stuff that we built six months
ago probably had more guardrails, was more scripted, and we routinely end up reducing the
scaffolding. Instead of giving a very detailed step-by-step instructions, we're more likely to
say, you know what, go decide for yourself what you want to do. I mean, one example, we used to
build deep researchers, where we say, to do research on a topic, do a web search, do this
many queries, then download this many pages and summarize it, blah, blah, blah, really common
research agenda workflow from like a year or two ago. Now AI models are much more capable of
deciding, do they want to keep on searching the web more, do they want to summarize and all that.
So I find myself frequently taking systems we built a prototype a year ago, six months or a
year, a year and a half ago, and ripping out the instructions to say, hey, prompt the arms,
just figure out the decision myself. But still a long ways to go. It works for use cases like
deep researchers, where it's not taking action, if it misses a citation or misses a reference,
it's not the end of the world. But for a lot of high stakes enterprise use cases,
I think the reliability gap to letting the AI model just let loose and do what it wants to do,
I suspect that gap, while it's closing, is still bigger than some people.
I need to ask you about the dispute between Ian LeCun and Demis Hassabis. Ian LeCun famously
says human intelligence is specialized, not general. Demis Hassabis argues that
brains are general learns under theoretical computations. Where do you stand on this?
I see no contradiction. Maybe I'm missing something. To me, the amazing thing about
the human brain, assuming the human is AGI except it's not artificial or it's general intelligence,
the amazing thing about the human brain is its plasticity or its ability to learn.
I feel like AGI, to me, should be less about AI that already knows everything under the sun.
That seems very challenging. It doesn't seem practical. But what makes the human brain so
valuable, or one of the things that makes it so valuable for economic talks, is its ability to
learn to do new stuff, whatever is needed. It is through learning that we then gain these
incredibly specialized intelligences. That human brain has learned to solve incredibly difficult
math problems by getting a PhD in math. That is very specialized intelligence as the endpoint,
but it was learning. Theoretically, that same human brain, just given different training,
could have been a chess master or could have been amazing at playing tennis. To me, a lot of what
makes the human brain so general is not that my brain or your brain already knows everything under
the sun, it's our ability to adapt, to learn a huge range of things. Doesn't that implicitly side
with telecom? One thing that really motivated me when I started Google Brain Team was
this idea that people don't talk much about anymore, was that a lot of human learning may
be due to one learning algorithm, whatever that means. But it turns out that our DNA is not that
long. Our DNA contains a very limited amount of information,
but somehow our DNA has encoded the biology of the brain, and the brain is a fairly general
learning algorithm, which is why the brain can learn to do a PhD in math, or learn to ride a
motorcycle, or learn to type a computer, or learn to work in a contact center, in a call center.
It's because the brain has this very general learning algorithm that allows it, through
learning, to specialize in a bewildering range of things. And that's what makes intelligence
seem general, is this learning ability that lets it gain almost any specialty under the sun.
Some odd man said a few months ago, Google is doomed because they are building AI onto old
research, and open AI builds from scratch. Do you think they can marry old with the new?
I mean, the race is on. This is exciting. I think Sam was my student at Stanford,
and a lot of friends at Google, so I'm very pro-open AI, also very pro-Google.
If we look back at the history of technological disruptions, whenever there was a tech
disruption, sometimes the new entrants won, sometimes the incumbents won. There's actually
room for either one to do well, and I think the game is still on. In fact, if we look at the
internet disruption, Google was a startup that rose with the rise of the internet,
but there's some incumbents like Microsoft and Apple that were founded long before the internet,
and they did just fine. So clearly, AI is very disruptive for incumbent businesses like Google.
I think Google has played its hand well. I mean, I think Gemini 3 is an incredible model.
Better than ChatGPP?
I use both Gemini, and ChatGPP, and Cloud, and a whole bunch of models quite often.
You are talking about AGI a lot. Five years ago...
Can I just say, I actually don't like talking about AGI, but others talk about it so much,
and it's so hype. I feel like as leaders in the field, when there's a massive amount of hype...
Do you believe that AGI is hype or hyped?
It is vastly hyped. At least the public thinks of AGI as becoming as intelligent as people,
in a very general sense. We are so far away from that. I hope we'll get there. I would love to get
to AGI, but realistically, I think we're decades, maybe more than decades away from that. So this
idea that, oh, we just need another few quarters to get to AGI, that's just not going to happen,
unless you redefine AGI to lower the bar and make it much easier to achieve.
Incidentally, in the history of AI, we've seen a few AI winters where people, well-meaning people,
overhyped the promise of AI. This led to elevated expectations that were not met,
and a collapse of investment and interest. This was bad for the field. AI works really well right
now. It's incredibly valuable. I see relatively few things that can derail AI's momentum.
One of the things I actually worry about is excessive hype that leads to disappointment,
that leads to a collapse of the so-called bubble, and that would not be good for the
world or good for the field of AI. So diffusing hype about AGI is an important thing to do
to lay the foundation for us to have more sustainable growth.
Five years ago, solving any coding problem would have been called AGI. Today, we have it,
and we call it a tool. Did we move the goalposts?
I don't remember credible teams declaring achieving AGI. I remember teams declaring
that AGI was only a short time in the future, but teams were not, three years ago,
declaring they got AGI. They were saying we could get there really soon,
and then, you know, so far no one's gotten there. Don't you think that we moved the goalposts?
I think that, if anything, teams have been trying to lower the bar to what it means
to achieve AGI. I mean, AGI, AI that can do any intellectual task that humans can,
is a very high bar. We have not gotten anywhere near to that bar,
but if teams come up with alternative definitions that are easier to achieve,
then maybe we can get there sooner. By the way, I don't mind how we define AGI.
We can define AGI however we want, but the problem is most of the broader public thinks of AGI as
generally very intelligent AI, basically human-like intelligences. That's what
most people out in the world think. The problem with subjectivity…
I think because people keep coming up with alternative definitions, it turns out that
terms lose meaning when lots of different people use that same term to refer to very different
things. For example, we all have a sense of what the word blue means, right? My shirt is blue,
but if for some reason society points to all sorts of different colors and says,
this is blue, this is blue, then the word blue will lose meaning because people don't
even know what it means anymore when someone says blue. That's what happened with AGI.
Different teams came up with different alternative definitions. People say, this is AGI,
and because people are applying lots of different definitions to the term,
when someone now says AGI, it's hard to know what exactly they mean. The problem is the public
thinks of AGI as human-like intelligence. If someone can't be called to death, which seems
reasonable to me, and someone comes up with some weird narrow technical definition and says AGI
will appear in two years, the broader public nonetheless thinks AGI will be as intelligent
as humans in two years, which just doesn't seem true to me. Let's talk, where are we now? Does
the Harness matter, or is it all about the workhorse? I think the Harness matters a lot.
It's been really incredible watching Anthropic build Cloud Code, as well as their SDK,
to make sure that they, and maybe others, have a good Harness to use the model powering this.
The details of the Harness, how you structure the prompts, what tools you give, all those details
really matter still. Actually, maybe one small example. Our current models are incredibly
intelligent, and they're becoming better and better at two years, making function calls.
Having said that, if you give a model too many tools, it consumes a lot of the input context,
and it's much more likely to struggle and make the wrong API call, make the wrong
tool use call. Maybe it feels like, it's 2026, why do we need to worry about engineering details
like these? It turns out we do, because it still makes a big difference to the overall performance.
Many teams use MCP. I use MCP a lot. One of the practical engineering things is,
if your MCP server has too long a list of tools, it consumes a ton of your own input context,
and it may be too many tools to effectively figure out which ones to use.
To get into context engineering, and sometimes the Harness can help make these decisions much
more smooth. I look forward to when continual learning will be solved. It would be
amazing, it would be delightful if it ends up being completely solved in 2026.
I expect we'll make progress. I think continual learning is very important.
Do we just brute force learning? One of the challenges with brute force learning is,
to the extent that human intelligence comes from the generality of the learning algorithm,
that's what makes the human brain so powerful. It learns new things really quickly.
This is why, for example, humans that work with us can do so much, whereas if you need to spend a
long time to brute force AI to do some narrow tasks, it could still be really valuable in some
cases, but the case for doing it just isn't going to be there for a lot of tasks. The ability to
hire a human and talk to them a bit and then figure out what to do and do a job,
that's really valuable. If you need to hire an AI and then spend a million dollars to train the AI
to do this one task, then there are a lot of tasks that it just doesn't make sense to spend that much
effort to train the AI. If sample efficiency doesn't matter, only three companies on earth
unfortunately can afford to train a frontier model. It'll be really interesting to see the
continually evolving dynamics between open source and open way models versus proprietary models.
I hope we don't get to that future. If I look at the mobile development platform,
it's just not as interesting these days, partly because there are two gatekeepers.
To do something on mobile, at least in the United States, you need permission from either
iOS or Android. There are certain innovations that we're just not allowed to do because of those
closed platforms. A lot of us in AI really hope that they will not end up with two or three
gatekeepers to building cutting-edge AI things, where if someone has an idea, I'd love to have
people allowed to innovate on top of large language models. Open source, open way models
is a key to preventing this small handful of gatekeepers from arising.
If we can make sure that everyone preserves the freedom to innovate, which we have much
more in the AI world today than, say, in the mobile world today, then we'll see a lot more
applications and society will be much richer. Do we really need real continual learning?
There's a lot of work to be done in continual learning. I think it is one of the important
open research topics in AI right now. A lot of the current text-based memory systems have the AI
do whatever it does, and then write a bunch of text into some sort of agentic memory.
Questions are, is text really a good enough representation for memory? There's some research
on non-text representations, but a lot of it is in text right now. Also, the fact that we're
building all of these memory systems that don't really ever update the weights of the LM, that
feels like we have to be missing a key piece of the puzzle. Some of my teams have had ideas,
not sure where we'll take them or not take them, but improving continual learning.
In terms of the things humans can do that AI cannot do, what's the biggest bottleneck to
continual learning right now? I would say we don't have the right ideas, and we're not sure what the
bunch of ideas is. There are a few ideas that I think are promising.
For example?
Let me see if I have time to try it out first, and I'll let you know if it works. I honestly
don't know if it works. To me, it's one of these things, if we were to ask,
what's the bottleneck to solving this huge unsolved research problem? I don't know,
because the path to get there isn't clear, so I can't even say what exactly are the bottlenecks.
We just don't know how to do it. Eliezer Yudkowsky says,
if anyone builds AGI, everyone dies. But every year, we delay millions die from cancer,
aging, disease, AI could solve. Which risk is greater?
I can't make head or tails of a lot of his arguments. When I read them,
many of his arguments are sufficiently circular. I don't even know how to argue with them.
I think that AI is doing so much good in the world today that anything we can do to accelerate
the progress of AI will lead to better lives, many more lives saved, many people much wealthier,
many people much better off, live a lot of people out of poverty. AI's net benefit is so much
greater than the net harm, and there are a few harmful use cases, such as Azure's clear
add-on, and let's get rid of those. But at this moment in time, I'm very confident anything we do,
you know, things we could do to accelerate AI progress would be good for humanity.
From your point of view, the future is unpredictable, right?
I wish I knew how to predict the future. Yes, it's unpredictable. But I feel like just because
we don't know with certainty exactly where the world will be, there are trends that we have
very high confidence about. So, for example, having computers be more intelligent seems
clear to me. That's a great thing. Democratizing access to intelligence so that it's not just,
you know, so it turns out one of the most expensive things in the world is intelligence.
It costs a lot of money to hire a smart doctor, a smart teacher, right, to care for you.
Do we need more AI-saved tools?
And yes, of course, we should be working on making AI systems more reliable and reducing risk. At the
You know, I think many people would be surprised at how there's this view of Silicon Valley that
people only care about money and nothing else, and that's just absolutely wrong.
Frankly, a lot of friends that work in a lot of the companies, I know many of the CEOs personally,
and yes, there's a tiny minority that just cares about profit, but it's a very small fraction.
A lot of my friends, a lot of these companies, people I've known for decades,
a decade or longer, really want to do the right thing. So people take guardrails seriously. People
take responsible AI seriously. People will sit down and really brainstorm all the things that
could go right or wrong with the AI system and try to mitigate risk. So I know that there's a view
that there's a stereotype, a false stereotype of a bunch of, you know, cowboys or cowgirls in
Silicon Valley that just do anything for profit. It's just completely not true. Now, unfortunately,
it is true that there's a small number of companies when there's a temptation to make
billions of dollars. That temptation is strong, but I think that's really a small minority,
very small minority, tiny minority of the decisions people have to make in terms of...
Is the open source era over?
Open source is doing great. Now, one weird thing is a lot of the best open source,
open weight models are coming out of China. Looking back on history over the last few years,
every single year, the options that have been open source or open weight has grown rapidly.
So I think the open source movement is very strong. At the same time, the proprietary
options have also grown rapidly, but that's okay. The important thing is the open options
are also growing strongly. What goes through your mind
when you look at the current stage of AI development?
I want to empower everyone to build AI. So as a developer, I don't ever want to have to code
by hand again. I want AI to write as much of my code for me as possible and the acceleration of
software engineering because of AI is very clear. But what is less clear to many people is
many people that are not software developers would be so much better off building software,
doing things with AI than not. And I'm already seeing this among our teams. The marketer that
knows how to use AI is assigned to run circles around the ones that don't. My CFO at AI Fund,
she writes code and she gets much more done than some other hypothetical CFO that doesn't know
how to write code using AI systems. So what I'm seeing is with AI tools, including specifically
building software with AI, it feels like a really important new capability that we need everyone
to have. So as new capabilities come up, many people will embrace them and raise their head
and they'll do much more and be much more productive. And then sadly, there'll be people
that don't embrace them that unfortunately will be left behind. And I'm actually quite worried
about that. One of the big challenges is if you look at the university system, many universities
are slow to adapt curriculum and are still training students for the jobs of 2022. But
many of those jobs don't really exist. Employees don't want to hire because it's 2022. But instead,
many employers can't find enough talent that knows AI and knows how to build with AI. And
I don't mean software engineers. I can't find enough marketers and recruiters and finance professionals
that really know AI. And shifting the educational system to give students as well as adults
the ability to use these tools and get so much more work done, that's going to require a huge shift
of the educational system. But how to get there at this moment, it still seems very challenging to me.
What would it take for AI to replace you as the educator?
I wish I knew. It turns out my team regularly tries to write AI to replace me
with my blessing and strong encouragement.
And still it's impossible, right?
Sadly, they have not managed to replace me yet. I suspect that I am a general form of AI.
We don't know how we'll learn anymore.
I think so, you know, if we ever get to AGI, it may be great. Go retire, go do something else.
I feel like replacing a lot of skilled people, that feels like an AGI problem,
which feels like it's still... I think for narrow verticals, our ability to build AI,
to serve narrow verticals, will grow much faster than there's hope for general AI.
So, I don't know. Driving schools is actually an interesting one. It turns out that
driving schools in the US have been subject a bit to regulatory capture.
So, a lot of innovations have been adopted in other nations, like driving simulators.
It turns out that driving simulators count in terms of number of hours driven in many nations,
but not in the United States. Because of that, driving simulators are not used as much in the
United States and other nations. So, there's this weird stuff that is very frustrating.
I think America should be using driving simulators more. It's a very safe way to teach kids.
Will programmers be unemployed?
I think programmers that don't use AI, they will be in trouble. But programmers that really know
AI, they're so productive. Just can't find enough of them.
Are they lost to go?
Lost to go sounds a bit dire. I think that most job roles are not going anywhere.
But that 50s thing, AI won't replace someone, but someone that uses AI will replace someone
that doesn't. That's true a lot of the time. Now, just to be transparent, just to be completely
truthful, there is a small number of job roles that are fully automated by AI. So, candidly,
I think a lot of translators are in trouble. I think voice actors, they could be in trouble as
well. So, the bad news is there's a very small fraction of job roles that AI can automate
entirely. I actually feel for them, and I think we owe it to them to do a lot to make sure that
they can gain new skills, reach out to the workforce, find other meaningful things to do.
As an AI person, I feel a duty to do what I can to make sure people are taken care of.
But for the vast majority of jobs, AI can automate.
Radiology?
I think it's taken much longer than people thought to automate radiologists.
Oh, I think lawyers have so much risk to capture. It'd be very hard to completely
replace human lawyers. But lawyers that don't use AI will be so much less productive than
lawyers that do use AI. Because you know, AI is very good in that legal research.
I think AI could do parts of law really well. But here's a trick. If there's a job,
and AI could do 30 percent of it, then that 70 percent, you still need a human to do it.
But that human had better use AI, because the one that doesn't use AI, well,
they're missing out on a lot of productivity.
Could you predict which jobs could finally disappear?
Well, the clear ones are a lot of call center jobs are going away.
Translator jobs, voice actor jobs. I think the ones that are in trouble are the ones where
almost 100 percent of the work, or almost 100 percent of the work can be automated.
But it turns out that so many jobs are so complex, multi-faceted,
almost like they're the text and also the non-text things.
So, for most jobs, AI could, I think, look at these task-based analysis of jobs as a studies
that Eric Brynjolfsson and others have done. Take a job, break it into tasks,
see what tasks AI can automate. For a lot of jobs, AI can automate like 30,
40 percent of someone's job. And so you still need a human to do that, you know, 60, 70 percent.
And there is a small fraction where AI can automate almost everything.
So those jobs are in trouble, but that's a very small minority.
You left Baidu in 2017, right? What was the reason that you decided to be here?
So, you know, I had a great time at Baidu. And it's funny, people keep wondering when I,
you know, when I moved from Google Brain to Coursera and then Baidu to run an AI fund.
People always wonder there's some secret thing, but I don't know what happened.
So I feel like I was running the AI team at Baidu, a great team.
And I think the team did a wonderful job, you know, building the mothership, right?
Online advertising, improving web search, all the core businesses.
And the team was doing a great job there. I remember looking at the org chart
and then thinking, you know what, if I weren't here, we've got a really good team.
They'll probably do just fine without me. And then I also realized that the most fun
part of my job at the time was actually building new business units.
We did a great job making money for the mothership, really proud of the work that the team did.
But I found that where I perceived the most fun was building new businesses.
So, for example, I ran Baidu's self-driving car team, still doing really well in China today.
I ran Baidu's kind of a smart speaker team, like Alexa or HeySiri or whatever.
Still doing really well today.
And I felt that while I could make money for the mothership,
where I was actually really engaged was building new businesses.
And then I asked myself, while doing it within the context of a big company was fine,
I felt that maybe if I start something else, which turned out to be the Venture Studio AI Fund,
to build businesses, you know, more from zero to one, rather than the concept of a big company,
maybe I could make that work even better.
So that's why I stepped away from Baidu, to start deeplearning.ai,
because I want to continue to do a lot more work in education to empower people to build with AI.
And then additionally, to run AI Fund, Venture Studio, where we build startups.
Do you think China is now ahead?
I think AI is multifaceted, and China is ahead of the US in some places,
like open source, open way models.
And the US is ahead of China in some places, like proprietary models.
So you don't regret your choice?
I think I had a great time doing some work with teams in China.
I've had a great time doing work with deeplearning.ai, AI Fund, more recently,
AI Aspire, landing AI.
So I'm happy with what I'm doing, no regrets.
From a pure scale perspective, doesn't China have more energy?
China has a lot going for it.
The US also has a lot going for it.
I feel like, you know, as imperfect as this union is,
I love America and the Western world.
And even though some years it feels like democracy works better,
and it works worse in some years,
that feels like an important pillar of how we do things in America.
And I think there's a lot of good work to be done still in America.
What can we expect from your company?
I want to empower everyone to build with AI.
We've been very focused on helping developers get access to the latest tools,
continue to work hard on that.
And in addition to really supporting AI developers,
build their careers, grow their careers,
I actually want to broaden what we do to empower developers
and everyone else to build with AI.
So that's deeplearning.ai's focus.
And one of the reasons I stepped away from Baidu,
actually I found both when I was leading a team at Google and at Baidu,
there's certain businesses that make sense to build within Google,
that make sense to build within Baidu.
But there are other things like, you know, tariff compliance.
Why would an internet company care about that?
So AI Fund builds lots of different startup businesses.
And so I'm excited about just the diversity of stuff
we get to work on at AI Fund.
And then AI Aspire, which is a relatively new effort,
is my friends, Kirstie Tan and I,
are working on AI advisory for large enterprises.
So it turns out that if you want to really move the needle on AI adoption,
developers are important, individual consumers are important,
and we just got to get large businesses there.
So we're spending quite a bit of time in partnership with Bain and others.
Bain is a fantastic team, really, really so smart.
Privileged working with Kristof and his team over there.
But to help advise large businesses on how to drive real value
and how to really win with AI.
You've been entitled to be also, I think, AI communicator.
What was the reason?
You're touching on the very core values kind of thing.
I'll tell you how I prioritize what I do.
I think there are two things that I prioritize most highly
that I really believe in.
I think it's a good use of my time.
One is things that make humanity more powerful.
That's why I became a researcher, became a professor at Stanford,
because I think research, advancing to save the art,
that makes humanity more powerful by inventing new technologies.
So I believe in making humanity more powerful.
The second thing I deeply believe in is to help others realize their dreams.
It's important that it's help others realize their dreams,
not help others realize my dreams.
That's an important distinction.
And all through my life, I felt that if we can give others tools and skills,
then it puts them in a better position to realize their dreams,
which is why education, you know, to derender AI for Sarah
has always been something I've found very motivating.
Is there something that you regret when you look at your story?
If you could, you know, turn back time,
would you do this and change something?
Well, there's so many things I could have done differently.
So frankly, I don't know.
I've been fortunate to have made a few good decisions,
but I've made so many bad ones as well.
I think there's so many things I, you know, like,
should I have hired that particular person or, you know, done that particular project?
Or should I have worked harder on that project rather than giving up?
If you could find answer for one question about the reality, what it would be?
I wish I understood what is the nature of intelligence.
You mean consciousness?
How matter is transformed into consciousness inside the human brain or something more?
Actually, not consciousness.
I think consciousness is an important philosophical question.
But I don't know what is consciousness.
So philosophers talk about consciousness in the sense that there's this notion of being self-aware.
But it turns out that you don't actually know if I'm conscious
and I don't actually know if you are, right?
How do you know if in philosophy, there's this concept that maybe I'm just a zombie
and I'm not actually conscious, but I'm just moving my hands,
moving my mouth and pretending to be conscious.
So because you don't have access to my inner experience and vice versa,
we don't actually know if anyone else is conscious.
But I think out of politeness, we pretend everyone else is conscious as much as we think we are.
So because consciousness is not measurable,
to me, that makes it a philosophical rather than a scientific question.
And while philosophy is important, I gravitate more to the scientific questions.
And to me, the nature of intelligence is
one on earth are the mechanisms that allow the human brain or maybe other biological brains
to demonstrate this huge range of intelligent behaviors that we see.
Like how on earth does this work?
By the way, something that is not widely known.
Before starting the Google Brain team,
one thing I did was hang out a lot with my neuroscientist friends.
And, you know, I was reading huge piles of neuroscience papers
and concluded, you know, lots of respect to my neuroscience friends,
but neuroscience has no idea how the brain works, frankly, pretty much.
So I gave up on neuroscience as a path to building intelligence.
But understanding how does intelligence actually work?
What is the nature of intelligence?
I'm pretty sure it's not a transformer network with scaling walls.
I'm pretty sure it needs more than that.
What is the nature of reasoning, Goldstein?
Yeah, I think reasoning is a subset of intelligence.
But understanding how reasoning actually works would also be fascinating.
Why in the Western world are we so unhappy?
I really disagree with his characterization of the Western world as lost for these reasons.
I don't look for happiness in the water I drink,
but I drink water that keeps me healthier.
I think of it as a mistake to look for happiness in AI.
But AI really helps people.
It helps us evolve, helps us build things, helps give us skills.
And so AI is important.
But there's a mistake to look for happiness in AI
in the same way that it would be a mistake to look for happiness
I think happiness comes much more from within than from the artifacts that we build.
But it is that process of striving to help others.
I hope a lot of people can find happiness in that.
And I hope I can help others through my work in AI.
And I find a lot of joy in being able to do work that could be useful for others.
Thank you very much for your time.