Identifying what a robot is looking at is a key approach of AI and machine cognition. So far ambitious researchers have managed to teach a computer’s vision system to recognise up to 100 objects. Granted, this is a huge achievement, yet far short of an I,Robot scenario.
But there is another radically different approach available that European researchers have applied to the study of robotics and AI. The MACS project does not attempt to get robots to perceive what something is, but how it can be used.
This is an application of the cognitive theory of ‘affordances’, developed by the American psychologist James J. Gibson between 1950 and 1979. He rejected behaviourism and proposed a theory of ‘affordances’, a term signifying the range of possible interactions between an individual and a particular object or environment. The theory focuses on what a thing or environment enables a user to do.
Computer vision might identify the object as a chair, but a system of affordances will instruct the robot that it can be used for sitting. This system is key to the new approach. The system means that once an affordance-perceiving robot ‘sees’ a flat object of a certain height and rigidity, it knows that the object can be used for sitting.
But it also means that an affordance-based robot will be able to determine that the flat object of a certain height and rigidity is too heavy to lift, and must be pushed, and that it can be used to hold a door open.
Ultimately, the aim of goal-oriented, affordance-based machine cognition is to enable a robot to use whatever it finds in its environment to complete a particular task.
“Affordance based perception would look at whether something is graspable, or if there is an opening, rather than worrying about what an object is called,” explains Dr Erich Rome, coordinator of the MACS project.
Five ambitious goals
‘MACS’ stands for multi-sensory autonomous cognitive systems interacting with dynamic environments for perceiving and learning affordances. Started in September 2004, the project began with five scientific and technological goals.
First the researchers sought to create new software architecture to support affordance-based robot control. Second, they wanted to use affordances to direct a robot to complete a goal-directed task. Third, they wanted to establish methods for perceiving, learning and reasoning about affordances.
Next, they wanted to create a system so the robot could acquire knowledge of new affordances through experimentation or observation. Finally the MACS team planned to demonstrate the entire system on a robotic platform called the Kurt3D.
The EU-funded project successfully created an integrated affordance-inspired robot control system. This included the implementation of a perception module, a behaviour system, an execution control module, planner, learning module and affordance representation repository.
The proof-of-concept has been shown in various experiments with the simulator MACSim and in the real robot Kurt3D.
“We performed a physics-based simulation using a model of the robot,” says Rome. We tested single components like perception and learning, and also the entire architecture in simulation. And then we tested the whole system in the robot.”
In that test, Kurt3D used affordance-based perception to identify what could be grasped, where there was free space, and what was traversable. The robot found an object, picked it up, and put it on a pressure-activated switch that controlled a door. Then, once the robot detected the passage, it opened and moved through the door.
The robot improvises
The tests were a remarkable achievement. The robot essentially figured out how to manipulate its environment to achieve a real-world goal. It showed a capacity for improvisation.
“This is the very early stages of this approach,” warns Rome. “So we are a long way from commercialisation. There are others working on it. But what is unique about the MACS project is that we introduced direct support for the affordances concept in our architecture.”
And MACS has also made affordances a more mainstream concept in robotics, perception and cognition. Some of the partners are involved in other projects, like ROSSI, which tracks the relation of language to actions (http://www.rossiproject.eu).
“The project helped generate a lot of interest in the concept and it is also now a very visible topic,” says Rome.
In all, MACS and its work have moved robotics into a new paradigm, teaching robots to identify what they can do.
Source:
ICT Results
Related stories:
Intel CTO Says Gap between Humans, Machines will Close by 2050
Intel Corporation's chief technology officer took a fascinating look at how technology will bring man and machine much closer together by 2050.
Robot with a Biological Brain: new research provides insights into how the brain works
(PhysOrg.com) -- A multidisciplinary team at the University of Reading has developed a robot which is controlled by a biological brain formed from cultured neurons. This cutting edge research is the first step to examine how memories manifest themselves in the brain, and how a brain stores specific pieces of data. The key aim is that eventually this will lead to a better understanding of development and of diseases and disorders which affect the brain such as Alzheimer's Disease, Parkinson's Disease, stroke and brain injury.
Researchers Combine Technologies to Heal Patients, Virtually
(PhysOrg.com) -- University of Arkansas researchers seeking new ways to make health care more efficient and cost-effective have built a new kind of hospital: one that uses location aware systems, sensors, smart devices, radio-frequency identification and virtual reality.
Why the slow paced world could make it difficult to catch a ball...
BBSRC researchers at the University of Birmingham have uncovered new information about the way that we perceive fast moving, incoming objects – such as tennis or cricket balls. The new research, published today in the
Proceedings of the National Academy of Sciences (PNAS), studies why the human brain has difficulty perceiving fast moving objects coming from straight ahead; something that should be a key survival skill. The research has implications for understanding how top-class sportspeople make decisions about playing a shot but could also be important for improving road safety and for the development of robotic vision systems.
Europe, Japan join forces to map out future of intelligent robots
The field of robotics could be poised for a breakthrough, leading to a new generation of intelligent machines capable of taking on multiple tasks and moving out of the factory into the home and general workplace. The great success of robots so far has been in automating repetitive tasks in process control and assembly, yielding dramatic cuts in production, but the next step towards cognition and more human-like behaviour has proved elusive.
Emotional robots in the spotlight
(PhysOrg.com) -- A robot with empathy sounds like the stuff of sci-fi movies, but with the aid of neural networks European researchers are developing robots in tune with our emotions. The tantalising work of the Feelix Growing project is grabbing the world’s attention.
Care-O-bot 3: Always at your service
Who doesn’t long for household help at times? Service robots will soon be able to relieve us of heavy, dirty, monotonous or irksome tasks. Research scientists have now presented a new generation of household robots, the “Care-O-bot® 3”.
Computer scientist turns his face into a remote control
New work at nexus of facial expression recognition research and automated tutoring
A computer science Ph.D. student can turn his face into a remote control that speeds and slows video playback. The proof-of-concept demonstration is part of a larger project to use automated facial expression recognition to make robots more effective teachers.
