A 'living' artificial hand that learns through imitation has been developed, enhancing human-machine communication and paving the way for novel prosthetic aides.
"The last decade has seen enormous advances in the design and implementation of all kinds of robot platforms," says Alois Knoll of Technische Universität München and coordinator of the ArteSImit project. "However, their abilities to ‘learn’ how to solve even simple tasks are still very restricted."
According to Knoll imitation is a powerful shortcut to successful task learning. “If a robot learner is shown a certain behaviour necessary for solving a task by an instructor, the motion alternatives for producing the goal-reaching behaviour with the learner’s own devices and effectors can be dramatically reduced,” says Knoll. “The learner would then try to mimic the coarse motions of the instructor and adapt them to achieve the same goal.”
Exploring the functional and neuropsychological mechanisms of imitation learning was the aim of the ArteSImit project funded by the Future and Emerging Technologies initiative of the IST programme. The overarching goal was to reveal the neurophysiological structures for finger and hand movements in humans and monkeys, and design a computer-operational dynamic model of imitation learning. The consortium constructed a fully functional visual-motor system for a limited domain to control a bio-analogue hand, which is thus capable of mimicking imitation behaviour.
The system implements the full visual serving loop in that it observes the environment with a camera, recognises the instructor’s gestures from a set of predefined gestures, makes the necessary decisions to achieve the goal, i.e. the appropriate sequence of actions of the arm, hand and finger movements. This is optimised in such a way that it is achieved with the minimum amount of motion. The visual system is highly innovative and unique: it recognises finger positions in a precise way through a novel algorithm with just one camera.
“Our final objective was to implement imitational learning on this artificial hand and to suggest applications of the new methods and models to other artefacts with many degrees of freedom that cooperate with humans,” says Knoll.
“We believe that the methods we developed in the ArteSImit project could be directly applied, for example, to new generations of prostheses. These could react for example to finger movements, controlled by a camera applying the concept of imitation, and additionally, they could be linked directly to the nerves.”
Research will be continued within the follow-up project JAST, which took up some of the ArteSImit findings. JAST aims to develop jointly-acting autonomous systems that communicate and work intelligently on mutual tasks in dynamic unstructured environments expanding the concept of group to human plus artificial agents.
Further potential applications of ArteSImit findings are numerous. “It could be applied to control instruments used for medical operations or even to capture and detect a person’s movement within a crowd of people. This method could be interesting for example for security systems,“ Knoll says. Although some of the results were mostly interesting for further basic research, there are some results, e.g. in the area of computer vision and object tracking, that could be phased out and be developed into useful products in their own right.
Source:
IST Results
Related stories:
Automatic imitation is not only a human trait, research finds
(PhysOrg.com) -- Scientists have shed new light on a process known as 'automatic imitation' — and discovered that we have more in common with the humble budgerigar than previously thought.
Biometric expert shows an easy way to spoof fingerprint scanning devices
Eyeballs, a severed hand or fingers carried in ziplock bags. Back alley eye replacement surgery. These are scenarios used in recent blockbuster movies like Steven Spielberg’s "Minority Report" and "Tomorrow Never Dies" to illustrate how unsavory characters in high-tech worlds beat sophisticated security and identification systems.
Researchers find important clue to learning deficit in children with autism
A study by researchers at the UC Davis M.I.N.D. Institute has discovered an important clue to why children with autism spectrum disorders have trouble imitating others: They spend less time looking at the faces of people who are modeling new skills.
Robots, the bizarre and the beautiful (Robot Special part 4)
(PhysOrg.com) -- The future is a foreign country, and nowhere is it more foreign that the designs thrown up by a surge in robotics research. The feverish imagination and creativity of European robot scientists has led to dozens of robot designs, some bizarre, some beautiful, but all are inspired.
New tool to assess speech development in infants, toddlers with hearing impairments
The number of hearing impaired infants and toddlers who are successfully aided by technological devices, such as hearing aids and cochlear implants, continues to grow, but there are still unknowns about these children's speaking abilities, according to a Purdue University expert.
Yahoo mixes old and new in Internet-age news service
Yahoo is building an Internet-age news service, leveraging its global audience of a half-billion people to win exclusive interviews with world leaders.
Tuning in to a new language on the fly: Effects of context and seasonality on songbird brain
Research conducted at Rutgers University has shown that exposure to a changed acoustic and social environment can rewire the way the brain processes sounds. Beginning in the cochlea of the inner ear, nerve cells of the auditory system parse incoming sounds into their different components. Study of the responses of individual brain cells has shown that they respond best to a particular frequency (pitch) of sound, less well to nearby frequencies, and poorly to distant sound frequencies. The range of effective frequencies can be measured as the "tuning width." Cells with similar tuning are found together, producing an orderly map of all the possible frequencies spread out across the auditory part of the brain.
Europe, Japan join forces to map out future of intelligent robots
The field of robotics could be poised for a breakthrough, leading to a new generation of intelligent machines capable of taking on multiple tasks and moving out of the factory into the home and general workplace. The great success of robots so far has been in automating repetitive tasks in process control and assembly, yielding dramatic cuts in production, but the next step towards cognition and more human-like behaviour has proved elusive.