F.L.E.X. — My Most Advanced Robotic Hand Yet

Infinity Robotic
4 followers
In this video, I give a overview of my project F.L.E.X., the future of robotic hands capable of detecting and mimicking your finger movements in real time without the use of gloves or physical attachments.
Fun Fact! F.L.E.X. is acronym for Fully Leveraged Exo-Hand.
#machine #Robotics #robot
This is Flex, a robotic hand that can track and mimic every single finger movement without
the need of gloves or physical attachments.
And the best part?
It works across the world!
So in this video, I'm going to show you how I built this project, the science behind it,
and why this technology could change the way we interact with the world, and might even
save lives.
A lot of people think science and creativity are somehow opposites, but in reality, it
takes both to create something new.
For me, it all started with an Iron Man hand.
At first, it was just a personal project.
I built it to challenge myself and learn more about wiring and voltages, but as I worked
on it, I started wondering, what if I could control something robotic without having to
That idea stuck with me.
Fueled by that question, I made a prototype, there's a full video about it here.
But science is all about making improvements, it's taking what you've learned and using
it to create something new.
That idea guided me through this whole journey.
So instead of just rebuilding my old robotic hand, I wanted to take it further, to really
push the design, fully leverage it, as some would say.
Now, for all those curious computer scientists, I decided to use Python as my coding language
of choice for this project.
For a robotic hand to actually mimic real movements, it has to recognize a hand first.
To do that, I used MediaPipe, an open source framework by Google that's great for visual
data recognition.
I combined it with OpenCV, a Python library for computer vision, to track every joint
when your hand moves in front of the camera.
Intuitive modules like these are a big reason why I use Python for all my robotics projects.
Now then, how do we bring this code to life?
One of the biggest limits with my old robotic hand was the finger control system.
It was just an on-off system, which means the fingers were either opened or closed,
no in-between.
That worked for basic demos, like doing the peace sign, but for real world applications,
I knew that this next version would have to capture every tiny micro-movement.
So I ended up writing completely new code for this project.
The system works by tracking your joints, and then measuring the distance between your
fingertips and each joint.
Then it runs these calculations so that we can later map that distance to a servo rotation,
from 0 to 180 degrees.
So the more you close your finger, the more the servo rotates.
It took weeks of work and fine-tuning, but after a lot of testing, I turned what used
to be an on-off system into one that can control five servos independently, just by moving
your fingers.
This code alone has so many applications.
We'll get into those applications in a minute, but now we need to make the actual
hand itself.
I knew this new advanced system needed a more specialized robotic hand.
The old design I used was open source and made for prosthetics, but this project needed
something a lot more technical, so I decided to create a brand new hand, inspired by my
3D printed Iron Man one.
I 3D modeled the flex hand myself in Blender, creating it to be fit for servos and wiring.
Then I used Cura to get it ready for printing.
Once that was done, I loaded up my 3D printer with filament and got to work.
By the way, 3D printing is a process where a machine builds an object layer by layer
from a digital model by melting plastic and cooling it in those specific patterns.
Like my last project, this one uses flexible TPU filament for the joints.
However, this time, I modeled the joint myself, so I could fix an issue with the previous ones.
This project uses a dual-string system, while most robotic hands use one string for each
finger to close it and then release it, this project actually uses two.
One that closes the finger like normal, but another string that pulls it back up, unlocking
that extra bit of precision.
Now that we've got the digital and physical parts figured out, the next challenge is getting
them to communicate and mimic our finger movements.
That's where this little guy comes in.
This is the Arduino Uno.
This printed circuit board is the translator of the system.
It reads the digital signals from the code and transforms them into physical movement
by controlling the servos that drive the robotic hand.
It was also especially important to me that this time around, the robotic hand could be
controlled from anywhere, not just the camera connected to my MacBook.
I wanted a Wi-Fi camera that could be accessed from anywhere, but also sit on my shoulder.
Little did I know, this would spark the creation of Pico.
Make sure to stay subscribed because a full video on how to design and create your own
shoulder robot is coming soon.
Now I'm going to show you the two months of building it took to create Flex in a 30-second
build montage.
And to answer the big question, yes, I do feel like Iron Man when I use it.
Jarvis, hit the music.
Ready when you are.
With these five flexible LEDs, Flex can now play rock, paper, scissors with you.
It's the ultimate battle of man versus machine, and...
Let's just say there are jobs for humans, and jobs where it's better to let the robots
take over.
Actually, that's the whole point of Flex.
Let's recap.
I made a robotic hand that can be operated from anywhere around the world, using no gloves
or physical attachments.
This type of technology could one day be developed to perform tasks too dangerous for humans,
such as disarming a bomb, or performing space station repairs, maybe even surgery from across
the world.
Could all be possible with Flex.
This technology doesn't have to be limited to controlling robotic hands either.
I mean, look at how small the camera is on Pico.
This technology could be installed in our houses to control all sorts of technology
just by waving our hands, bringing us one step closer to that Iron Man future.
So in the end, this project gave me a chance to combine my creativity and knowledge of
science to build a robotic hand that can detect and mimic my movements completely hands-free
from across the world.
Along the way, I studied, researched, and learned what it takes to take an idea and
actually bring it to life.
And if I had to give one piece of advice, it would be that there is no better way to
get good at something than to simply start doing it.
I didn't even know how to code before I started this original project.
With more improvements, this project could someday make a real difference and help change
lives.
But for now, it can be seen as a stepping stone, one that I'm incredibly proud of.
This is the future of technology, and this is just the beginning.
I can't wait to keep pushing the limits and share where Flex goes next, starting right
here on Mateo Tech Lab.
So make sure to subscribe.
