Let’s Bring Rosie Home: 5 Challenges We Need to Solve for Home Robots
From IEEE Spectrum
By Shahin Farshchi
Posted 13 Jan 2016 | 16:25 GMT
Science fiction authors love the robot sidekick. R2-D2, Commander Data, and KITT—just to name a few—defined “Star Wars,” “Star Trek,” and “Knight Rider,” respectively, just as much as their human actors. While science has brought us many of the inventions dreamed of in sci-fi shows, one major human activity has remained low tech and a huge source of frustration: household chores. Why can’t we have more robots helping us with our domestic tasks? That’s a question that many roboticists and investors (myself included) have long been asking ourselves. Recently, we’ve seen some promising developments in the home robotics space, including Jibo’s successful financing and SoftBank’s introduction of Pepper. Still, a capable, affordable robotic helper—like Rosie, the robot maid from “The Jetsons”—remains a big technical and commercial challenge. Should robot makers focus on designs that are extensions of our smartphones (as Jibo seems to be doing), or do we need a clean-sheet approach towards building these elusive bots?
Take a look at the machines in your home. If you remove the bells and whistles, home automation hasn’t dramatically changed since the post–World War II era. Appliances, such as washing machines, dishwashers, and air conditioners, seemed magical after WWII. Comprised primarily of pumps, motors, and plumbing, they were simply extensions of innovations that came to bear during the industrial revolution. It probably doesn’t come as a surprise that industrial behemoths such as GE, Westinghouse, and AEG (now Electrolux) shepherded miniature versions of the machines used in factories into suburban homes. At the time, putting dirty clothes and dishes into a box from which they emerged clean was rather remarkable. To this day, the fundamental experience remains the same, with improvements revolving around reliability, and efficiency. Features enabled by Internet-of-Things technologies are marginal at best, i.e., being able to log into your refrigerator or thermostat through your phone.
But before wondering when we’ll have home robots, it might be fair to ask: Do we even need them? Consider what you can already do just by tapping on your phone, thanks to a host of on-demand service startups. Instacart brings home the groceries; Handy and Super send professionals to fix or clean your home; Pager brings primary care, while HomeTeam does elderly care. (Disclosure: my company, Lux Capital, is an investor in Super, Pager, and HomeTeam.) So, again, why do we need robots to perform these services when humans seem to be doing them just fine? I don’t think anyone has a compelling answer to that question today, and home robots will probably evolve and transform themselves over and over until they find their way into our homes. Indeed, it took decades of automobiles until the Model T was born. The Apple IIs and PC clones of the early 1980s had difficulty justifying their lofty price tags to anyone who wasn’t wealthy, or a programmer. We need to expect the same from our first home bots.
So it might be helpful to examine what problems engineers need to crack before they can attempt to build something like Rosie the robot. Below I discuss five areas that I believe need significant advances if we want to move the whole home robot field forward.
1. We Need Machine-Human Interfaces
Siri and Amazon’s Alexa demonstrate how far speech recognition and natural language processing have come. Unfortunately, they are no more than a human-machine interface, designed to displace the keyboard and mouse. What we need is a machine-human interface. Where is the distinction? It starts with understanding people, rather than aggregating data and using statistical patterns to make inferences. It can understand our moods and emotional contexts, as an artificial intelligence would. Humans do not interact with one another through a series of commands (well, maybe some do); they establish a connection, and once a computer can take on that role, then we have a true machine-human interface. Scientists are starting to tackle this by applying concepts used in programming toward establishing rules for robot-human conversations, but we’ll need much more if we want to have engaging AI assistants like the one in the movie “Her.”
2. Cheap Sensors Need to Get Cheaper
Driverless cars will generate hard cash for their operators, so forking over thousands for an array of lidar, radar, ultrasound, and cameras is a no-brainer. Home robots, however, may need to fit the ever-discretionary consumer budget. The array of sensors the robot would need to properly perceive its environment could render it cost prohibitive unless the sensors cost pennies as they do in mobile phones. MEMS technology dramatically lowered the cost of inertial sensors, which previously cost thousands of dollars and were relegated to aircraft and spacecraft. Can computer vision applied to an array of cheap cameras and infrared sensors provide adequate sensing capability? And can we expect lidar to come down in price, or do we need a whole new sensing technology? A startup called Dual Aperture has added a second aperture for infrared hence creating the ability to infer short distances. Meanwhile, DARPA is funding the research on chip-based lidar, and Quanergy expects to launch a solid-state optical phased array, thereby eliminating the mechanical components that raise the cost of lidar. We expect engineers to find creative ways to reduce the cost of existing sensing technology, while obviating others altogether, and hopefully making them as cheap as sensors in our phones today.
3. Manipulators Need to Get a Grip
Loose objects find their way into our homes because they are easy to manipulate with our hands. If we expect a robot to be able to clean and organize these objects as efficiently as humans do, it needs manipulators that are at least as effective as the human hand. Companies such as Robotiq, Right Hand Robotics, and Soft Robotics, among others, have designed efficient and reliable manipulators. Though air-powered inflatable grippers have the advantage of being soft and lightweight, they do require a pump, which is not very practical for a mobile robot. Efforts funded by DARPA at iRobot, SRI, and other labs and companies seem to be taking us in the right direction, helping robots get a grip.
4. Robots Need to Handle Arbitrary Objects
Opening doors, flipping switches, and cleaning up scattered toys are simple tasks for us humans, but compute-intense for machines today. A robot like Roomba performs two tasks: running a suction motor and generating a path along what’s expected to be a flat surface with rigid obstacles. How about washing dishes or folding laundry? These tasks require a suite of capabilities ranging from recognizing objects, identifying grasping points, understanding how an object will interact with other objects, and even predicting the consequences of being wrong. DARPA, NSF, NASA, and European Union science funding agencies are sponsoring much-needed research in this area, but “solving manipulation” will probably require leveraging a number of different technologies, including cloud robotics and deep learning.
5. Navigating Unstructured Environments Needs to Become Routine
Anyone who saw this year’s DARPA Robotics Challenge would appreciate how difficult of a problem it is to navigate and manipulate an unstructured, unknown environment. Those robots were slow. Though driverless cars pose a formidable challenge, it has been proven to be more tractable. Deep learning techniques can help robots recognize soft objects vs. hard obstructions, and human assistants may be able to “teach” robots until the algorithms take over. Like the manipulation problem, real-time navigation requires robots to quickly sense, perceive, and execute—probably several orders of magnitude faster that they DRC winning team is today. Full autonomy won’t happen overnight, but that isn’t a problem: humans can help robots get out of a bind. Willow Garage was a pioneer with its Heaphy Project, where assistance to robots is crowdsourced to remote operators. More robotics and industrial automation companies are embracing the notion of humans overseeing robots, with the expectation of going from the (superfluous) 1:1 human-robot ratio to a single operator being able to oversee/assist many robots.
Shahin Farshchi is a partner at Lux Capital, where he invests in hardware and robotics companies. Follow him on Twitter:@farshchi
With the Internet of Things (IoT) becoming a “big deal”, IEEE has started a big push to get ahead of the game. They created a new IoT Web Portal for the latest news and also started a new IEEE IoT Journal.
There is also work underway to create Standards for IoT communications protocols so IoT devices can talk to each other on ONE standard (maybe we can finally get to that “Digital Convergence” we were prommissed back in 2000 by the CueCat)
You might want to also check out THIS ARTICLE on a Kit for the Internet of Things that IBM and ARM have teamed up to create.
from: The Institute (IEEE)
By KATHY PRETZ 1 December 2015
Members are making it possible for all your appliances and devices to communicate with each other
That once-futuristic vision of a home full of smart gadgets that anticipate our needs, keep us healthy, and save us money is slowly taking shape. Thermostats now learn our preferred settings and schedule, lights turn on and off as we come and go, and refrigerators adjust their temperatures according to how much food they hold.
Such applications make the home a bit smarter, but they’re not really intelligent. That’s because most home-automation devices are loners: They don’t work with each other. They’re made by different manufacturers, and by the way, they lack privacy and security protection. IEEE is working with industry to build an architecture that provides connectivity; simultaneously, it is developing standards and addressing security concerns.
“The smart home is a great example of where many technology and business domains start interacting and leveraging the Internet of Things,” says IEEE Member Oleg Logvinov, chair of the IEEE P2413 Standard for an Architectural Framework for the Internet of Things Working Group. “IoT probably represents the biggest tidal wave in technology development since the industrial revolution.”
Yet another robotic gift guide for 2015, this one done by IEEE, can be found at IEEE Spectrum – 2015 Robot Gift Guide
In short, their list includes:
- Starter Drone: Parrot AR Drone 2.0
- Camera Drone: DJI Phantom 2 With Gimbal
- Drone to Do Cool Stuff With: 3D Robotics DIY Quad Kit
Robot Toys and Kits
- Robotis Mini
- Robotis Play 600
- Lego Mindstorms
- Sphero SPRK
- RobotGeek Snapper Arduino Robotic Arm
- TurtleBot 2
- Beam+ Smart Presence System
- Robomow RC306
- iRobot Roomba 980
- iRobot Roomba 560 (Refurbished)
- Dyson 360 Eye
- Ecovacs Deebot D77
- iRobot Looj
- 4Moms Origami Stroller
From IEEE Specturm
We’ve always known that the ATLAS DRC humanoid robot was due for some serious upgrades before the DARPA Robotics Challenge Finals, because having a robot that’s tethered for power and safety is just not in the spirit of what the DRC is all about: moving towards robotic systems that can provide meaningful assistance during a real-world disaster scenario.
Back in November, we started hearing that DRC Track B teams were sending their ATLAS robots back to Google-owned Boston Dynamics for some tweaks, and today, DARPA has posted a video of the brand new ATLAS. And it really is almost entirely brand new.
All the below is from IEEE Spectrum Feb 17, 2017
FAA Unveils Drone Rules: Autonomy Is In, Drone Delivery Is Out
The U.S. Federal Aviation Administration has recently announced the long-awaited Notice of Proposed Rulemaking for small unmanned aircraft systems, governing the operation of drones under 55 pounds (25 kilograms). Many observers had worried that the FAA would attempt to over-regulate, proposing requirements like airworthiness certificates for drones and pilot’s licenses for drone operators and other restrictions that would make it a lot harder for businesses to use drones. But although there are some sticking points that will surely generate more debate, the proposed rules seem surprisingly reasonable.
Spot Is Boston Dynamics’ Nimble New Quadruped Robot
Boston Dynamics is infuriatingly cool. They have to be the only robotics company out there that can just post a YouTube video of an incredibly agile autonomous quadruped named “Spot” with a four sentence description, and that’s that—no info on their site, no press release, no interviews. Because they know that everybody is going to watch it and think it’s awesome anyway. Grr.
Spanish robot maker PAL Robotics, best known for their REEM humanoid robots, has just introduced a new mobile manipulator called Tiago (Take It And Go). Want to pick stuff up and move it around in a research environment? This could be the robot for you.