yego.me
💡 Stop wasting time. Read Youtube instead of watch. Download Chrome Extension

A mini robot -- powered by your phone - Keller Rinaudo


4m read
·Nov 8, 2024

[Music]

So just by a show of hands, how many of you all have a robot at home? Not very many of you, okay. And, actually of those hands, if you don't include Roomba, by how many of you have a robot at home? Okay, so a couple, that's okay. That's the problem that we're trying to solve at Remotev that I and the other 20 nerds at Remotev are obsessed with solving.

We really want to build a robot that anyone can use, whether you're eight or eighty. As it turns out, that's a really hard problem because you have to build a small portable robot that's not only really affordable, but it has to be something that people actually want to take home and have around their kids. This robot can't be creepy or uncanny; he should be friendly and cute.

So meet Romo. Romo is a robot that uses a device you already know and love—your iPhone—as his brain. By leveraging the power of the iPhone's processor, we can create a robot that is Wi-Fi enabled and computer vision capable for $150, which is about one percent of what these kinds of robots have cost in the past.

When Romo wakes up, he's in creature mode, so he's actually using the video camera on the device to follow my face. If I duck down, he'll follow me. He's wary, so he'll keep his eyes on me. If I come over here, he'll turn to follow me. If I come over here, he's smart. If I get too close to him, oh, he gets scared, just like any other creature.

So in a lot of ways, Romo is like a pet that has a mind of his own. Thanks little guy, bless you! And if I want to explore the world, oh, Romo's tired! If I want to explore the world with Romo, I can actually connect him from any other iOS device.

So here's the iPad, and Romo will actually stream video to this device so I can see everything that Romo sees, and I get a robot's eye view of the world. Now, this is a free app on the App Store, so if any of you guys had this app on your phones, we could literally right now share control of the robot and play games together!

So I'll show you really quickly, Romo actually—he's streaming videos so you can see me and the entire TED audience. If I get in front of Romo here, and if I want to control him, I can just drive. So I can drive him around, and I can take pictures of you. I've always wanted a picture of a 1500-person TED audience, so I'll snap a picture.

In the same way that you scroll through content on an iPad, I can actually adjust the angle of the camera on the device, so there are all of you through Romo's eyes. And finally, because Romo is an extension of me, I can express myself through his emotions. So I can go in, and I can say let's make Romo excited.

But the most important thing about Romo is that we wanted to create something that was literally completely intuitive. You do not have to teach someone how to drive Romo. In fact, who would like to drive a robot? Okay, awesome! Here you go, thank you Scott!

Even cooler, you actually don't have to be in the same geographic location as the robot to control him. So you can imagine—he actually streams two-way audio and video between any two smart devices. You can log in through the browser, and it's kind of like Skype on wheels.

We were talking before about telepresence, and this is a really cool example. You can imagine an eight-year-old girl, for example, who has an iPhone, and her mom buys her a robot. That girl can take her iPhone, put it on the robot, send an email to grandma who lives on the other side of the country. Grandma can log into that robot and play hide and go seek with her granddaughter for 15 minutes every single night when otherwise she might only be able to get to see her granddaughter once or twice a year.

Thanks, Scott! So those are a couple of the really cool things that Romo can do today. But I just want to finish by talking about something that we're working on in the future. This is actually something that one of our engineers, Dom, built in a weekend.

It's built on top of a Google open framework called Blockly. This allows you to drag and drop these blocks of semantic code and create any behavior for this robot you want. You do not have to know how to code to create a behavior for Romo, and you can actually simulate that behavior in the browser, which is what you see Romo doing on the left.

Then if you have something you like, you can download it onto your robot and execute it in real life—run the program in real life. And then if you have something you're proud of, you can share it with every other person who owns a robot in the world.

So all of these Wi-Fi enabled robots actually learn from each other. The reason we're so focused on building robots that everyone can train is that we think the most compelling use cases in personal robotics are personal; they change from person to person.

So we think that if you're going to have a robot in your home, that robot ought to be a manifestation of your own imagination. So I wish that I could tell you what the future of personal robotics looks like. To be honest, I have no idea.

But what we do know is that it isn't 10 years or 10 billion dollars or a large humanoid robot away. The future of personal robotics is happening today and it's going to depend on small agile robots like Romo and the creativity of people like yourselves. So we can't wait to get you all robots, and we can't wait to see what you build. Thank you!

[Music]

More Articles

View All
Welcome to the (Breakfast) Club | Generation X
John Hughes was, you know, our prophet. Even though there are any spaceships and Wookiees, I’m part of the reason I do what I do today. It’s because John made those movies: Pretty in Pink, Sixteen Candles, The Breakfast Club. They have a lot of the pleasu…
Anti-Gravity Wheel?
I am here at the University of Sydney where the mechanical engineering shop has built this incredible piece of apparatus for me. It is a forty pound, that is nineteen kilogram flywheel on the end of a meter long shaft. Can you imagine trying to hold this …
What to do the night before an exam: 3 tips from Sal Khan
Here are my three tips to reducing stress the night before a test. Tip one, stay physically healthy. There’s a tendency that the night before you wanna cram; you wanna stay up late. You’re stressed, you’re anxious. That’s the exact wrong thing to do. The…
LearnStorm Growth Mindset: Khan Academy's economics content creator on learning strategies
My name is Melanie Fox. I create the AP Macroeconomics and AP Microeconomics content for Khan Academy. Well, if you don’t develop that mindset and you say, “I can’t overcome this,” this barrier, you’ve just made that barrier permanent for yourself. For …
Capturing Death - What One Photographer Learned on Assignment | Exposure
How do you want to die? Is really the question. You know, what is the quality of your death? What is the quality of a good death? It is the thing that we’re most afraid of. You’re going to die. You will be no more. Who, whoever it is that you believe you …
Innovative | Vocabulary | Khan Academy
Ah, hello wordsmiths! You found me in my workshop, coining new words— a little soldering, a little welding, and there you are, a brand new word! Let’s take it out of the forge and see what I’ve made. Oh, well, this word already exists—it’s Innovative. In…