Modeling how we see natural scenes

Sophisticated mathematical modeling methods and a “CatCam” that captures feline-centric video of a forest are two elements of a new effort to explain how the brain’s visual circuitry processes real scenes. The new model of the neural responses of a major visual-processing brain region promises to significantly advance understanding of vision.

Valerio Mante and colleagues published a description of their model and its properties in an article in the May 22, 2008, issue of the journal Neuron, published by Cell Press.

The researchers sought to develop the new model because until now, studies of the visual system have used simple stimuli such as dots, bars and gratings.

“Such simple, artificial stimuli present overwhelming advantages in terms of experimental control: their simple visual features can be tailored to isolate and study the function of one or few of the several mechanisms shaping the responses of visual neurons,” wrote the researchers. “Ultimately, however, we need to understand how neurons respond not only to these simple stimuli but also to image sequences that are arbitrarily complex, including those encountered in natural vision. The visual system evolved while viewing complex scenes, and its function may be uniquely adapted to the structure of natural images,” they wrote.

Specifically, the researchers sought to model the neuronal response the lateral geniculate nucleus (LGN) in the thalamus, a brain region that processes raw visual signals received from the retina.

To gather data for the model, they first recorded from LGN neurons in anesthetized cats, as the cats were presented with images of drifting gratings of different sizes, locations and spatial and temporal frequency. They also varied luminance and contrast of the images.

From these data, they created a mathematical model that aimed to describe how these neurons respond and adapt to such complex, changing stimuli. Their ultimate goal was to create a model that would describe not just neural response to the gratings, but to the complexities of natural scenes.

To test their model, they presented cats with two kinds of natural scenes, while recording from LGN neurons. One of these scenes was video recorded from a “CatCam” mounted on the head of a cat as it roamed through a forest. The other was short sequences from the cartoon Disney movie Tarzan.

The researchers found that their model predicted “much of the responses to complex, rapidly changing stimuli… Specifically, the model captures how these responses are affected by changes in luminance and contrast level, overcoming many of the shortcomings of simpler models,” they wrote.

“Even though our model does not capture the operation of all known nonlinear mechanisms, it promises to be a useful tool to understand the computations performed by the early visual system,” they wrote.

Mante and colleagues have provided “a long-needed bridge between the two stimulus worlds,” wrote Garrett Stanley of the Georgia Institute of Technology, in a preview of the paper in the same issue of Neuron.

“By creating an encoding model from a set of experiments involving sinusoidal gratings at different mean luminances and contrasts, and subsequently demonstrating that this model predicts the neuronal response to an entirely different class of visual stimuli based on the visual scene alone, Mante, et al. have made this problem general and provided a powerful description of the encoding properties of the pathway,” wrote Stanley.

Source: Cell Press

Related stories:

Sound adds speed to visual perception
The traditional view of individual brain areas involved in perception of different sensory stimuli—i.e., one brain region involved in hearing and another involved in seeing—has been thrown into doubt in recent years. A new study published in the online open access journal BMC Neuroscience, shows that, in monkeys, the region involved in hearing can directly improve perception in the visual region, without the involvement of other structures to integrate the senses.
Probing Question: Fishhooks of addiction
When the American writer Theodore Roethke taught at Penn State from 1936 to 1943, he was known for three things: being a good poet, coaching the men’s tennis team, and falling down drunk, perhaps the latter more than the former. Roethke, a brilliant and tortured man, knew well the seduction of drink and the agony of addiction. In his poem “Journey Into the Interior,” Roethke writes, “In the long journey out of the self, / There are many detours, washed-out interrupted raw places / Where the shale slides dangerously / And the back wheels hang almost over the edge / At the sudden veering, the moment of turning.”
Designing bug perception into robots
Insects have provided the inspiration for a team of European researchers seeking to improve the functionality of robots and robotic tools.

Antidepressants enhance neuronal plasticity in the visual system
In the April 18 issue of Science, scientists from the Scuola Normale Superiore in Pisa, Italy and the Neuroscience Centre at the University of Helsinki, Finland, provide new information about the mechanism of action of antidepressant drugs. In addition, the study suggests that antidepressants could also be used for the treatment of amblyopia. However, to produce a functional effect, antidepressant treatment also seems to require environmental stimuli, such as rehabilitation or therapy.
Why does the world appear stable while our eyes move?
Whenever we shift our gaze, attention is directed to a new target. This shift in attention causes a brief compression of visual space, according to a study published February 15 in the open-access journal PLoS Computational Biology.
Face facts: People don't stand out in crowds
Why is it difficult to pick out even a familiar face in a crowd? We all experience this, but the phenomenon has been poorly understood until now. The results of a recent study may have implications for individuals with face-recognition disorders and visual-attention related ailments — and eventually could help scientists develop an artificial visual system that approaches the sophistication of human visual perception.
Inside the brain of a crayfish
Voyage to the bottom of the sea, or simply look along the bottom of a clear stream and you may spy lobsters or crayfish waving their antennae. Look closer, and you will see them feeling around with their legs and flicking their antennules – the small, paired sets of miniature feelers at the top of their heads between the long antennae. Both are used for sensing the environment.
Do fruit flies have free will?
Free will and true spontaneity exist … in fruit flies. This is what scientists report in a groundbreaking study in the May 16, 2007 issue of the open-access journal PLoS ONE.

News discussion:

Medicine & Health news