Except in fanciful movies like 2003's
The Matrix Revolutions, where fearsome squid-like robots maneuvered with incredible ease, most robots are too clumsy to move around obstacles at high speeds. This is true in large part because they have trouble judging in the images they "see" just how far ahead obstacles are. This week, however, Stanford computer scientists will unveil a machine vision algorithm that gives robots the ability to approximate distances from single still images.
"Many people have said that depth estimation from a single monocular image is impossible," says computer science Assistant Professor Andrew Ng, who will present a paper on his research at the Neural Information Processing Systems Conference in Vancouver Dec. 5-8. "I think this work shows that in practical problems, monocular depth estimation not only works well, but can also be very useful."
With substantial sensor arrays and considerable investment, robots are gaining the ability to navigate adequately. Stanley, the Stanford robot car that drove a desert course in the DARPA Grand Challenge this past October, used lasers and radar as well as a video camera to scan the road ahead. Using the work of Ng and his students, robots that are too small to carry many sensors or that must be built cheaply could navigate with just one video camera. In fact, using a simplified version of the algorithm, Ng has enabled a radio-controlled car to drive autonomously for several minutes through a cluttered, wooded area before crashing.
Inferring depth
To give robots depth perception, Ng and graduate students Ashutosh Saxena and Sung H. Chung designed software capable of learning to spot certain depth cues in still images. The cues include variations in texture (surfaces that appear detailed are more likely to be close), edges (lines that appear to be converging, such as the sides of a path, indicate increasing distance) and haze (objects that appear hazy are likely farther).
To analyze such cues as thoroughly as possible, the software breaks images into sections and analyzes them both individually and in relationship to neighboring sections. This allows the software to infer how objects in the image appear relative to each other. The software also looks for cues in the image at varying levels of magnification to ensure that it doesn't miss details or prevailing trends—literally missing the forest for the trees.
Using the Stanford algorithm, robots were able to judge distances in indoor and outdoor locations with an average error of about 35 percent—in other words, a tree that is actually 30 feet away would be perceived as being between 20 and 40 feet away. A robot moving at 20 miles per hour and judging distances from video frames 10 times a second has ample time to adjust its path even with this uncertainty. Ng points out that compared to traditional stereo vision algorithms—ones that use two cameras and triangulation to infer depth—the new software was able to reliably detect obstacles five to 10 times farther away.
"The difficulty of getting visual depth perception to work at large distances has been a major barrier to getting robots to move and to navigate at high speeds," Ng says. "I'd like to build an aircraft that can fly through a forest, flying under the tree canopy and dodging around trees." Of course, that brings to mind another movie image: that of the airborne chase scene through the forest on the Ewok planet in Return of the Jedi. Ng wants to take that idea out of the realm of fiction and make it a reality.
Source: Stanford University
Related stories:
Stanford researchers developing 3-D camera with 12,616 lenses
The camera you own has one main lens and produces a flat, two-dimensional photograph, whether you hold it in your hand or view it on your computer screen. On the other hand, a camera with two lenses (or two cameras placed apart from each other) can take more interesting 3-D photos.
Stanford site advances science of turning 2-D images into 3-D models
An artist might spend weeks fretting over questions of depth, scale and perspective in a landscape painting, but once it is done, what's left is a two-dimensional image with a fixed point of view. But the Make3d algorithm, developed by Stanford computer scientists, can take any two-dimensional image and create a three-dimensional "fly around" model of its content, giving viewers access to the scene's depth and a range of points of view.
Engineers Develop Undetectable Means Of Measuring Speed, Motion
Research aimed at teaching robots to "see" may soon make it possible to bag speeding motorists, track enemy planes, and automatically safeguard the nation’s borders and resources without any chance of detection.
A University of Florida engineering researcher is developing a method to determine speed and other characteristics of a moving object using computer algorithms, or instructions, that rely on data from standard visual cameras rather than radar or lasers. The technique has the potential to render current detection systems in so-called "fuzz busters" and some military technologies useless. That’s because, instead of painting a target with radar waves or laser beams, a camera merely needs to capture an image or series of images from the target.
Professor Finally Publishes Controversial Brain Theory
(PhysOrg.com) -- In the late '90s, Asim Roy, a professor of information systems at Arizona State University, began to write a paper on a new brain theory. Now, 10 years later and after several rejections and resubmissions, the paper “Connectionism, Controllers, and a Brain Theory” has finally been published in the November issue of
IEEE Transactions on Systems, Man, and Cybernetics – Part A: Systems and Humans.
Microsoft Releases New Robot-Building Software
(PhysOrg.com) -- As part of its belief that robotics is an important emerging technology, Microsoft has released Robotics Developer Studio 2008, a software program that enables users to create applications for robots.
A first in online gaming: Humans team up with AI software
Hey, online gamers, artificial intelligence researchers need your help! As part of an international team of researchers, Northwestern University has officially released the first online game in which human players partner with artificial intelligence (AI) software –- in this case with the goal of solving a treasure hunt in a virtual world.
Prototyping with industrial robots
Ship's propellers, parts for wind energy converters, turbine housings – such large-volume castings can only be produced with special molds. The procedure is elaborate and cost-intensive because foundry workers must still perform most of the work steps manually.
Robots and sensors to help elderly stay independent
Someday soon, older adults may not need to move into nursing homes because they'll have a household of technological wonders to keep an eye on them when they become frail.
