Moving from 2 to 3 to 1,000 dimensions in 3 steps, a ball inscribed inside a cube fills almost 0% of the space. Everything you learned about shapes stops working.
Terence Tao is a Fields Medal winner and professor at UCLA, widely considered the greatest living mathematician.
We cover: why geometry in high dimensions defies every low-dimensional instinct, why mathematicians deliberately go to higher dimensions to solve problems in lower ones, what Jim Simons' cone discovery revealed about singularities in 8+ dimensions, and why this isn't abstract — it's exactly where AI and LLMs operate.
High-dimensional space doesn't behave. And that's now everyone's problem.
🎯 Support Into the Impossible on Patreon — get my weekly M.A.G.I.C. Message, unfiltered bonus content, and live monthly Office Hours with me: https://www.patreon.com/drbriankeating
Terrence Towne told me something that completely broke my brain about geometry.
Take a circle inside a square. It fills up about 75% of the space.
A ball inside a cube? About half. Sounds like it keeps going, right?
Now go to 100 dimensions. The ball fills almost nothing.
And that's important, because this is where AI and LLMs work, in extremely high dimensions.
Here's Terry explaining why everything you think you know about shapes is wrong.
So he discovered what's called the Simons cone.
Okay, you're pushing it a little bit, because geometry is not completely my area of mathematics.
Minimal surfaces, most famously, are two-dimensional surfaces like silk foams.
But in mathematics, there's nothing stopping you
from considering the same notion in other dimensions.
In one dimension, it's just like rubber bands.
One dimension, minimal surfaces are very boring. They're just straight lines.
But you can consider them three-dimensional surfaces in four-dimensional space,
which already is hard to visualize, but mathematically you can consider it.
And five and six.
Weirdly, sometimes problems become easier in higher dimensions.
So even if you care about the physical world, and you only care about two and three dimensions,
sometimes it makes sense, as a mathematician, to first study higher dimensions.
It gets you some intuition, which can help guide you with the problems that you do care about.
Yeah, so it turns out, yeah, that in up below eight dimensions, I think,
all minimal surfaces are smooth.
You can't tie a soap bubble and create any kind of knot,
because there's always some way to pull it apart and reduce the surface tension.
Yeah, starting in eight dimensions, he discovered a very surprising
fact that singularities can actually form.
It looks like a cone, except in much higher dimensions.
And there's no way to modify the cone to reduce the surface area.
If you made a cone, if you tried to arrange soap into a cone in three dimensions,
you could just do what's called a surgery.
You remove the vertex of the cone and replace it by two rounded nubs.
Okay, and that would reduce the surface tension.
Interesting.
You can't do that in higher dimensions.
So nowadays, because of data science, actually, we need to understand high dimensional
geometries much better than we used to.
And a lot of our old intuition, which you get from low dimensional geometry,
is actually completely false in high dimensions.
So just to give you one example, if you inscribe a circle inside a square,
it occupies a pretty large chunk of the square, maybe like 75% or something.
And if you inscribe a ball inside a cube, it's still pretty big, I think about half the volume
of a cube.
But if you take a thousand dimensional cube and you inscribe a thousand dimensional ball inside
it, it's incredibly tiny.
It's like 0.0001%.
Balls become extremely…
Poor space filling.
Yeah, they're nowhere near space filling in high dimensions.
And this is important.
When you look at clouds of data, and if you're taking a thousand measurements,
and that's like a thousand data points, but there's some errors in them.
You know, do you measure the root mean square error, which is like trying to place
your measurement inside some ball?
Or do you measure the worst of the 1,000 errors, which is like placing…
The question is, do you want your error bars in high dimensions to be like a ball or a cube?
And it starts making a difference.
Right, there are significant differences between that approximation.
So you mentioned that technique of going to higher dimensions to solve problems in lower
dimensions.
That's one of the many tools that mathematicians use.
Others include proof by radicchio ad absurdium.
Can you talk about what's your favorite type of mathematical proof?
And when you're onto it, you just get so excited to finish the film.
Proof by contradiction.
I think Hardy had a great quote that in chess, a chess player may offer a pawn or a bishop,
but a mathematician offers the entire game.
Sacrifice, yeah.
Yeah, so he says, okay, we want to prove this is a conclusion.
I will give you that the conclusion is false.
I will just let you run with it.
But you do that, and I will show that it gives you a contradiction.
It actually is a technique.
So on the one hand, it is very unintuitive.
The undergraduate students that we teach, they struggle a lot with the notion of proof
by contradiction.
On the other hand, it is a concept that I have seen primary school students teach each other.
So in recess, you might see kids play the game of who can name the largest number.
So they say, okay, 1,000, and then a million, a billion, a billion, billion.
And they'll go on like this.
But at some point, someone will realize, one of the kids will realize that no matter what
number the other kid says, they can just say that number plus one.
They have proven that there is no largest number in the natural numbers.
And this is a proof by contradiction, because if anyone ever did claim to have a natural
largest natural number, you say add one, and you have contradiction.