Where the brain combines what's heard and felt

Using functional magnetic resonance imaging, researchers at the Max Planck Institute for Biological Cybernetics in Tübingen, Germany have showed that the integration of auditory and touch information takes place in the 'hearing centre' of the brain – the auditory cortex – and thus at an earlier point than has traditionally been assumed.

Everyday, the brain accesses information from various sense organs simultaneously to create a "picture" of its environment. This important mixture of information from various sense organs is known as "multisensory integration".

Many activities would be difficult to carry out if the brain did not receive information from a number of different sources at the same time. Furthermore, by manipulating multisensory integration, one can create illusions of perception. One well-known example is the 'ventriloquist effect'. If one hears a voice (for example, from a loudspeaker), and then simultaneously sees a face or a mouth moving to speak, then the voice appears to come from the mouth – even when, in the case of ventrioloquist, the mouth belongs to a dummy. Similar effects are known to occur with the other senses: if someone rubs their hands together, they produce a noise that one can use to determine if their hands are dry or raw. If the sound, however, is cleverly manipulated, then subjects make completely different guesses about the condition of their skin.

The auditory cortext in action. The picture was created using functional magnetic resonance imaging. The colored points indicate regions which react with strong activation to particular impulses. A: tactile stimulation of the hand. B: auditory stimulation. C: simultaneous tactile and auditory stimulation. In C there is more activity than in B, which suggests that the processing of the auditory stimulus is influenced by the tactile stimulation.

One important question in neuro-research is where multisensory integration takes place. Traditionally, it has been assumed that it doesn't take place in the sensory areas, where the information from sense organs comes in, but rather in a downstream, 'higher' area of the brain known as the 'association cortex'. The information from sense organs – in other words, what is taken in – was considered to be first processed in specific sensory areas; for example, the auditory information from the cochlea in the auditory cortex. Only then, it was assumed, it was integrated with similarly prepared information from visual and tactile impressions.

But new findings, including those of the Max Planck researchers, have showed that this description is not exactly correct. Multimodal integration does indeed take place at deeper levels. Using functional magnetic resonance imaging, the scientists from Tübingen measured the activity of brain cells in the auditory cortex of primates. The anatomical partitioning of the primary and secondary auditory cortexes is known in detail and the scientists can take advantage of the high spatial resolution offered by their approach. This is important because the areas under investigation are smaller than two or three millimeters.

The results clearly show that the activity in the auditory cortex by an auditory impulse is strengthened when it is combined with tactile stimulation of a hand. Furthermore, the researchers found areas inside the auditory cortex that react more strongly to simultaneous impulses than to single stimuli – this is a classic criterion for the identification of multimodal integration. The researchers also showed that this integration takes place in the secondary auditory cortex.

The scientists suspect that one reason that sensory information is combined so early in the brain is that this way false "pictures" can be more easily prevented. Such false pictures match a single sense impression, but are inconsistent across a number of sense impressions. The brain can thus rule them out. However, this speculation, among others, must still be subject to further research.

Source: Max-Planck-Gesellschaft

Related stories:

Sound adds speed to visual perception
The traditional view of individual brain areas involved in perception of different sensory stimuli—i.e., one brain region involved in hearing and another involved in seeing—has been thrown into doubt in recent years. A new study published in the online open access journal BMC Neuroscience, shows that, in monkeys, the region involved in hearing can directly improve perception in the visual region, without the involvement of other structures to integrate the senses.
Neurobiologists discover individuals who 'hear' movement
Individuals with synesthesia perceive the world in a different way from the rest of us. Because their senses are cross-activated, some synesthetes perceive numbers or letters as having colors or days of the week as possessing personalities, even as they function normally in the world.
Why can’t I learn a new language?
Adults, even the brightest ones, often struggle with learning new languages. Dr Nina Kazanina in the Department of Psychology at the University of Bristol explains why.
What It's Like to Be a Bat
Not many people think about what it's like to be a bat, but for those who do, it's enlightening and potentially groundbreaking for understanding aspects of the human brain and nervous system.
Tune-deaf people may hear a sour note unconsciously
People with tune deafness aren't able to tell when a musician accidentally strikes the wrong note in a song, but their brains know the difference. Researchers from the National Institute on Deafness and Other Communication Disorders (NIDCD), part of the National Institutes of Health, have found that people with tune deafness, an auditory processing disorder in which a person with normal hearing has trouble distinguishing notes in a melody, are able to detect a wrong note unconsciously. The study is published in the June 11, 2008, issue of the online journal PLoS ONE.
Plastic Brain Outsmarts Experts
Can human beings rev up their intelligence quotients, or are they stuck with IQs set by their genes at birth? Until recently, nature seemed to be the clear winner over nurture.
Sight Recovery After Blindness Offers New Insights on Brain Reorganization
Studies of the brains of blind persons whose sight was partially restored later in life have produced a compelling example of the brain's ability to adapt to new circumstances and rewire and reconfigure itself.
Linking low frequency hearing to the cochlea's curvature
Shape matters, even in hearing. Specifically, it is the shape of the cochlea — the snail-shell-shaped organ in the inner ear that converts sound waves into nerve impulses that the brain deciphers — which proves to be surprisingly important.

News discussion:

General Science news