yego.me
💡 Stop wasting time. Read Youtube instead of watch. Download Chrome Extension

A mini robot -- powered by your phone - Keller Rinaudo


4m read
·Nov 8, 2024

[Music]

So just by a show of hands, how many of you all have a robot at home? Not very many of you, okay. And, actually of those hands, if you don't include Roomba, by how many of you have a robot at home? Okay, so a couple, that's okay. That's the problem that we're trying to solve at Remotev that I and the other 20 nerds at Remotev are obsessed with solving.

We really want to build a robot that anyone can use, whether you're eight or eighty. As it turns out, that's a really hard problem because you have to build a small portable robot that's not only really affordable, but it has to be something that people actually want to take home and have around their kids. This robot can't be creepy or uncanny; he should be friendly and cute.

So meet Romo. Romo is a robot that uses a device you already know and love—your iPhone—as his brain. By leveraging the power of the iPhone's processor, we can create a robot that is Wi-Fi enabled and computer vision capable for $150, which is about one percent of what these kinds of robots have cost in the past.

When Romo wakes up, he's in creature mode, so he's actually using the video camera on the device to follow my face. If I duck down, he'll follow me. He's wary, so he'll keep his eyes on me. If I come over here, he'll turn to follow me. If I come over here, he's smart. If I get too close to him, oh, he gets scared, just like any other creature.

So in a lot of ways, Romo is like a pet that has a mind of his own. Thanks little guy, bless you! And if I want to explore the world, oh, Romo's tired! If I want to explore the world with Romo, I can actually connect him from any other iOS device.

So here's the iPad, and Romo will actually stream video to this device so I can see everything that Romo sees, and I get a robot's eye view of the world. Now, this is a free app on the App Store, so if any of you guys had this app on your phones, we could literally right now share control of the robot and play games together!

So I'll show you really quickly, Romo actually—he's streaming videos so you can see me and the entire TED audience. If I get in front of Romo here, and if I want to control him, I can just drive. So I can drive him around, and I can take pictures of you. I've always wanted a picture of a 1500-person TED audience, so I'll snap a picture.

In the same way that you scroll through content on an iPad, I can actually adjust the angle of the camera on the device, so there are all of you through Romo's eyes. And finally, because Romo is an extension of me, I can express myself through his emotions. So I can go in, and I can say let's make Romo excited.

But the most important thing about Romo is that we wanted to create something that was literally completely intuitive. You do not have to teach someone how to drive Romo. In fact, who would like to drive a robot? Okay, awesome! Here you go, thank you Scott!

Even cooler, you actually don't have to be in the same geographic location as the robot to control him. So you can imagine—he actually streams two-way audio and video between any two smart devices. You can log in through the browser, and it's kind of like Skype on wheels.

We were talking before about telepresence, and this is a really cool example. You can imagine an eight-year-old girl, for example, who has an iPhone, and her mom buys her a robot. That girl can take her iPhone, put it on the robot, send an email to grandma who lives on the other side of the country. Grandma can log into that robot and play hide and go seek with her granddaughter for 15 minutes every single night when otherwise she might only be able to get to see her granddaughter once or twice a year.

Thanks, Scott! So those are a couple of the really cool things that Romo can do today. But I just want to finish by talking about something that we're working on in the future. This is actually something that one of our engineers, Dom, built in a weekend.

It's built on top of a Google open framework called Blockly. This allows you to drag and drop these blocks of semantic code and create any behavior for this robot you want. You do not have to know how to code to create a behavior for Romo, and you can actually simulate that behavior in the browser, which is what you see Romo doing on the left.

Then if you have something you like, you can download it onto your robot and execute it in real life—run the program in real life. And then if you have something you're proud of, you can share it with every other person who owns a robot in the world.

So all of these Wi-Fi enabled robots actually learn from each other. The reason we're so focused on building robots that everyone can train is that we think the most compelling use cases in personal robotics are personal; they change from person to person.

So we think that if you're going to have a robot in your home, that robot ought to be a manifestation of your own imagination. So I wish that I could tell you what the future of personal robotics looks like. To be honest, I have no idea.

But what we do know is that it isn't 10 years or 10 billion dollars or a large humanoid robot away. The future of personal robotics is happening today and it's going to depend on small agile robots like Romo and the creativity of people like yourselves. So we can't wait to get you all robots, and we can't wait to see what you build. Thank you!

[Music]

More Articles

View All
Identifying scale factor in drawings | Geometry | 7th grade | Khan Academy
So right over here, figure B is a scaled copy of figure A, and what we want to do is figure out what is the scale factor to go from figure A to figure B. Pause the video and see if you can figure that out. Well, all we have to do is look at corresponding…
Example: Analyzing distribution of sum of two normally distributed random variables | Khan Academy
Shinji commutes to work, and he worries about running out of fuel. The amount of fuel he uses follows a normal distribution for each part of his commute, but the amount of fuel he uses on the way home varies more. The amounts of fuel he uses for each part…
2015 AP Calculus BC 2b | AP Calculus BC solved exams | AP Calculus BC | Khan Academy
[Voiceover] Part b. “For zero is less than t is less than one, there is a point on the curve at which the line tangent to the curve has a slope of two.” The line tangent to the curve has a slope of two. “At what time is the object at that point?” So, the …
Startup Experts Share Their Investor Horror Stories
Raising money is a game that you sort of have to figure out. Oftentimes, these meetings can go terribly awry. The worst sort of investor meeting is one that makes you question why you’re even doing a company anymore. Today, we’re talking about our worst i…
Threshold for low percentile | Modeling data distributions | AP Statistics | Khan Academy
The distribution of average wait times in drive-thru restaurant lines in one town was approximately normal, with a mean of 185 seconds and a standard deviation of 11 seconds. Amelia only likes to use the drive-through for restaurants where the average wai…
The Gig Economy is Terrible: Here's Why
Meet Abraham. He’s trying to pay off the lease on his new Lincoln. He got it to stand out in the fleet of other Uber vehicles. He drives for hours every day to try and make a living from what was once a lucrative job. Now, Abraham is barely making it from…