In the mind's eye: how the brain makes a whole out of parts
Part 1

When a human looks at a number, letter or other shape, neurons in various areas of the brain's visual centre respond to different components of that shape, almost instantaneously fitting them together like a puzzle to create an image that the individual then "sees" and understands.

A report of the Johns Hopkins University discusses findings based on recordings of nerve cells in the visual cortex of macaque monkeys. The research reveals that neurons in the higher-level visual cortex at first respond to a visual stimulus ¡°somewhat indiscriminately," signalling all the individual features within a shape to which they are sensitive. For instance, a particular neuron may respond to objects with either a concave fragment at the top or a convex fragment at the bottom. At this point, the neural signals are ambiguous; the brain does not know whether the concavity, the convexity or both are present. Milliseconds later neurons begin to react exclusively to combinations of shape fragments, rather than to individual fragments. In other words, the brain begins to put the pieces together to form larger sections, in the same way that an artisan might fasten discrete pieces of stained glass to create a design. Funding for this research was provided by the National Institute of Health.

So, how do humans recognise and understand objects so quickly?

The research team from the university's Zanvyl Krieger Mind-Brain Institute describes the complex but speedy process in detail in the 5 January 2006 issue of the journal Neuron. Associate professor and paper co-author Charles E. Connor says:

"The question of how the brain sees, recognizes and understands objects is one of the most intriguing in neuroscience. This may not even seem like a scientific question to some people, because seeing is so automatic and we are so good at it ¡ª far better than the best computer vision systems yet devised. That is because a large part of the human brain is devoted to interpreting objects in our world, so that we have the necessary information for interacting with our environment.

"Vision doesn't happen in the eye. It happens at multiple processing stages in the brain. We study how objects are signalled or encoded by large populations of neurons at higher-level stages in the object-processing part of the brain.

"Humans do a rough categorization of objects very quickly. For instance, in just a tenth of a second, we can recognize whether something we see is an animal or not. Our results show that this immediate, rough impression probably depends on recognizing just one or more individual parts of what we see. Fine discriminations - such as recognizing individual faces - take longer to happen, and our study suggests that this delay depends upon emerging signals for combinations of shape fragments. In a sense, the brain has to construct an internal representation of an object from disparate pieces.

"Our ability to see is one of the great evolutionary accomplishments of the human brain. We still don't know how the visual system accomplishes this marvel of information processing. Such experiments are beginning to reveal how large networks of neurons in the brain extract meaning from the eye image.

¡°In the long term, understanding exactly how the brain processes information may lead to neural prostheses - artificial replacements for lost sensory, motor and perhaps even memory and cognitive functions. In the short term, such work is driven by curiosity about one of the fundamental mysteries: how the brain works."

Reference:
Brincat SL & Connor CE, 2006. Dynamic shape synthesis in posterior Interferotemporal cortex. Neuron, 5 January, 49(1):17¨C24.

 

Monika

Monika Bhatia
Program Manager and Editor, Quality4life

06 February 2006