Can robots learn to communicate by studying and imitating humans' gestures? That's what MIRROR's researchers aimed to find out by studying how infants and monkeys learn complex acts such as grasping and transferring it to
robots.
"Our main motivation for the project was to advance the understanding of how humans recognise and imitate gestures," says Professor Giulio Sandini, coordinator of the three-year IST-funded project, MIRROR. "We did that by building an artificial system that can learn to communicate by means of body gestures."
Researchers began by designing and conducting behavioural experiments with infants of different ages and with monkeys within the framework of the so-called ‘mirror neurons’. These neurons, first discovered in the brains of monkeys, have the unique property of being activated not only when monkeys or human infants perform specific grasping actions, but also when they see the same grasping action performed by someone else – for example, the mirror image of his or her own body. Mirror neurons behave as a motor resonant system activated both during goal-directed actions and the observation of similar actions performed by others.
During the first year of the project, researchers worked at improving humanoid robotic platforms and conducted experiments using a ‘cyber glove’. This set-up allowed researchers to collect visual and motor data that was used in investigating the relationship between vision and action in the recognition of hand gestures.
The second year’s experiments with monkeys and infants investigated how visual and motor information can be used to learn to discriminate grasping actions. They then used that information to show how, by detecting visual clues to the function of an object, a robot can mimic simple object-directed actions.
In the final year they concentrated on integrating the developed work into a humanoid robot, which consisted of a binocular head, an arm, and a multi-fingered hand. Although the integration is not fully complete, they believe they have uncovered many elements of a biologically-compatible architecture that can be replicated in robots.
”We now have better knowledge of how and when the ability to grasp objects appropriately appears in human babies,” says Professor Sandini. “From the robotics point of view, we demonstrated that it is easier to interpret actions performed by others if the system has built a representation of the action during learning. Learning precedes understanding. We implemented a complex behaviour on our robot based on this representation.”
Although the project is finished, all the members of the consortium now participate in a follow-up FP6 IST project called RobotCub that has, among other aspects, the scientific goal of continuing the MIRROR’s project work. RobotCub focuses on building a humanoid platform and studying the development of manipulation skills.
Source:
IST Results
Related stories:
The musician in the mirror
A new imaging study shows that when we learn a new action with associated sounds, the brain quickly makes links between regions responsible for performing the action and those associated with the sound.
Look ma, no hands!
A few years ago scientists
managed to wire a monkey’s brain to a robotic arm. The monkey learned to manipulate the arm simply by thinking. This year, John Donoghue at Brown University has managed to do the same – with a human.
Coming to grips with robot learning
A 'living' artificial hand that learns through imitation has been developed, enhancing human-machine communication and paving the way for novel prosthetic aides.
"The last decade has seen enormous advances in the design and implementation of all kinds of robot platforms," says Alois Knoll of Technische Universität München and coordinator of the ArteSImit project. "However, their abilities to ‘learn’ how to solve even simple tasks are still very restricted."
Animals and Human Experience the Same Emotions
The link between humans and animals may be closer than we may have realised. Research by Liverpool John Moores University (LJMU) has found that our furry relatives may share many of the same emotions that humans experience in everyday life.
Researchers find important clue to learning deficit in children with autism
A study by researchers at the UC Davis M.I.N.D. Institute has discovered an important clue to why children with autism spectrum disorders have trouble imitating others: They spend less time looking at the faces of people who are modeling new skills.
Psychologists show experience may be the best teacher for infants
(PhysOrg.com) -- There's a lot of truth in the old proverb "experience is the best teacher," and apparently it even applies to 10-month-old infants.
Interactive technology could help students feel what can't be seen
Equations or graphs can explain what happens when atoms bump into each other, but a technology called haptics could help students know how it feels. A Purdue University researcher says haptic, or force-feedback, technology can be used in a variety of classroom subjects, especially in the sciences.
Two beta blockers found to also protect heart tissue
(PhysOrg.com) -- A newly discovered chemical pathway that helps protect heart tissue can be stimulated by two of 20 common beta-blockers, drugs that are prescribed to millions of patients who have experienced heart failure.