黃仁勳臺大演講4 展示更人性化機器人

精品薈萃
19粉絲
41 次觀看·2024年6月11日
黃仁勳臺大演講4 展示更人性化機器人,並展示“一個全球行的NVIDIA加速基礎設施地圖”,讓小粉紅再次崩潰
NIMS, incredible invention
This is one of my favorites
And of course, as you know
We now have the ability to create large language models
And pre-trained models of all kinds
And we have all of these various versions
Whether it's language based or vision based
Or imaging based
We have versions that are available for healthcare
Digital biology
We have versions that are digital humans
That I'll talk to you about
And the way you use this
Just come to ai.nvidia.com
And today we just posted up in Hugging Face
The Llama 3 NIMS
Fully optimized
It's available there for you to try
And you can even take it with you
It's available to you for free
And so you could run it in the cloud
Run it in any cloud
You could download this container
Put it into your own data center
And you could host it
Make it available for your customers
We have, as I mentioned
All kinds of different domains
Physics
Some of it is for semantic retrieval
Called regs
Vision languages
All kinds of different languages
And the way that you use it
Is connecting these microservices
Into large applications
One of the most important applications
In the coming future, of course
Is customer service agents
Customer service agents
Are necessary in just about
Every single industry
It represents trillions of dollars
Of customer service around the world
Nurses are customer service agents
In some ways
Some of them are non-prescription
Or non-diagnostic based nurses
Are essentially customer service
Customer service for retail
For quick service foods
Financial services, insurance
Just tens and tens of millions
Of customer service
Can now be augmented by language models
And augmented by AI
And so these boxes that you see
Are basically NIMS
Some of the NIMS are reasoning agents
Given a task
Figure out what the mission is
Break it down into a plan
Some of the NIMS retrieve information
Some of the NIMS might go and do search
Some of the NIMS might use a tool
Like co-op that I was talking about earlier
It could use a tool that
Could be running on SAP
And so it has to learn
A particular language called ABAP
Maybe some NIMS have to do SQL queries
And so all of these NIMS are experts
That are now assembled as a team
So what's happening?
The application layer has been changed
What used to be
Applications written with instructions
Are now applications
That are assembling teams
Assembling teams of AIs
Very few people know how to write programs
Almost everybody knows
How to break down a problem
And assemble teams
Every company I believe in the future
Will have a large collection of NIMS
And you would bring down
The experts that you want
You connect them into a team
And you don't even have to
Figure out exactly how to connect them
You just give the mission to an agent
To a NIM to figure out
Who to break the task down
And who to give it to
And that central
The leader of the application if you will
The leader of the team
Would break down the task
And give it to the various team members
The team members would do their
Perform their task
Bring it back to the team leader
The team leader would reason about that
And present an information back to you
Just like humans
This is in our near future
This is the way applications are going to look
Now of course
We could interact with
These large
These AI services
With text prompts and speech prompts
However there are many applications
Where we would like to interact
With what is otherwise
A human like form
We call them digital humans
NVIDIA has been working on
Digital human technology for some time
Let me show it to you
And before I do that
Hang on a second
Before I do that
Okay digital humans
Has the potential
Of being a great
Interactive agent with you
They make much more engaging
They could be much more empathetic
And of course
We have to
Cross this incredible chasm
This uncanny chasm of realism
So that the digital humans
Would appear much more natural
This is of course our vision
This is a vision of where we love to go
But let me show you where we are
Great to be in Taiwan
Before I head out to the night market
Let's dive into some exciting
Frontiers of digital humans
Imagine a future
Where computers interact with us
Just like humans can
Hi my name is Sophie
And I am a digital human
Brand ambassador for Younique
This is the incredible reality
Of digital humans
Digital humans
Will revolutionize industries
From customer service
To advertising
And gaming
The possibilities for digital humans
Are endless
Using the scans you took
Of your current kitchen with your phone
They will be AI interior designers
Helping generate beautiful
Photorealistic suggestions
And sourcing the materials and furniture
We have generated several design options
For you to choose from
They'll also be AI customer service agents
Making the interaction more engaging and personalized
Or digital healthcare workers
Who will check on patients
Providing timely personalized care
I did forget to mention to the doctor
That I am allergic to penicillin
Is it still okay to take the medication
The antibiotics you've been prescribed
Ciprofloxacin and metronidazole
Don't contain penicillin
So it's perfectly safe for you to take them
And they'll even be AI brand ambassadors
Setting the next marketing and advertising trends
Hi I'm Ima
Japan's first virtual model
New breakthroughs in generative AI
And computer graphics
Let digital humans see
Understand and interact with us
In human-like ways
Hmm from what I can see
It looks like you're in some kind of
Recording or production setup
The foundation of digital humans
Are AI models
Built on multilingual
Speech recognition and synthesis
And LLMs that understand and generate conversation
你們部落有什麼特別的習俗嗎
我們有豐富的祭祀儀式和傳統舞蹈
還有對大自然的崇拜
The AIs connect to another generative AI
To dynamically animate
A lifelike 3D mesh of a face
And finally, AI models
That reproduce lifelike appearances
Enabling real-time path-traced subsurface scattering
To simulate the way light penetrates the skin
Scatters and exits at various points
Giving skin its soft and translucent appearance
NVIDIA ACE is a suite of digital human technologies
Packaged as easy-to-deploy
Fully optimized microservices or NIMS
Developers can integrate ACE NIMS
Into their existing frameworks, engines
And digital human experiences
Nemotron SLM and LLM NIMS
To understand our intent
And orchestrate other models
RIVA Speech NIMS
For interactive speech and translation
Audio-to-face and gesture NIMS
For facial and body animation
And Omniverse RTX
With DLSS for neural rendering of skin and hair
ACE NIMS run on NVIDIA GDN
A global network of NVIDIA-accelerated infrastructure
That delivers low-latency digital human processing
To over 100 regions
