Wednesday, March 14, 2007

What do dodgeball and ventriloquism have in common?

Imagine a game of dodgeball, in which your attention is consumed by whizzing balls and the warlike cries of aggressive athletes, all reverberating off the gymnasium walls. Suddenly, you hear someone on the opposing side yell to his teammates that his next shot will be aimed at you. At that instant, you look over at his side of the court and see three hostile-looking boys holding dodgeballs, approaching the halfline, mouths moving as they boldly communicate strategy and support. Which one identified you as his target? Luckily, the same voice continues its warmongering, designating targets for his other teammates, and you are now able to match the movement of the mouth of one of the boys with the relevant sounds. Sound and sight have come together, and you are prepared for the appropriate ball.

Amidst that bombardment of sensory information, how did your brain find the appropriate auditory-visual correspondence to determine the origin of the battle cry? At every moment, in dodgeball and in life, our appreciation of the external world is due to a combination of sights, smells, sounds, touches, and tastes. Our brains must integrate this deluge of information to generate a coherent, seamless picture of the environment; this process is called multisensory integration. When integrated properly, the simultaneous acquisition of information from different sources helps us refine our percept of the world. However, our incoming sensory information is often fraught with uncertainty.

To explore this concept on sensory uncertainty, it is useful to focus on one sensory modality, such as vision. Getting back to the game: we know where the ball is coming from, but we still need to dodge (or catch!) it. Your assailant winds his bulging arm back like a catapult and mechanically releases the projectile; as it careens towards you, you attempt to calculate its speed and trajectory. Your eyes convey imperfect information about the ball's velocity, so your brain can only estimate it. Combining this information with your memory of his previous throws reduces the error in this estimate, but not all velocities are equally probable in theory; over the course of the game, there will be a probability distribution of velocities. Your best estimate, and your ability to dodge the ball, results from combining information about the distribution of prior velocities with evidence from sensory (visual) feedback. This interpretation of probabilities is called "Bayesian inference," and various studies have shown that the human brain performs Bayesian inference at a nearly optimal level.

Multisensory integration becomes far more complex when we consider this uncertainty inherent to our sensory information. Nevertheless, our brains are intriguingly capable of weighing different sensory signals according to their corresponding reliabilities; that is, our brains pay more attention to "reliable" sensory information, while disregarding "unreliable" information. This ability results in an "optimal" approximation of reality: we are (nearly) perfect maximum-likelihood integrators.

The complexity of this integration process is exposed when our perceptual world does not correspond to reality. One striking example of this vulnerability is ventriloquism. A good ventriloquist will thwart our multisensory integration process by synchronizing the movements of a puppet's mouth with his or her voice, while the movements of his or her mouth are imperceptible. Thus, we perceive the voice as originating from the puppet, as opposed to the ventriloquist.

This deception is a consequence of our brain's propensity to give more weight to visual information than auditory information during the integration process; the neural circuits have adapted to the fact that the visual system is far more reliable at determining location than the auditory system. The direction of a light source is directly determined by the position stimulated on the retina, whereas the direction of a sound is calculated by the differences in timing and intensity of stimulation in one ear relative to the other. Thus, our brain "trusts" the visual system more than the auditory system, and rightly so. If there is a discrepancy between the two, the visual information is favored in the generation of a unified percept of reality, and the puppet "speaks."

So, the big question is, as always: what are the neural mechanisms underlying this process? How does the brain weigh different signals according to their corresponding reliabilities when generating the most realistic percept? How is uncertainty represented at the neural level?

A group in Alex Pouget's laboratory recently published theoretical answers to these questions in Nature Neuroscience. The premise for their exploration was the fact that neurons in the cortex respond to identical stimuli with high variability. For example, think of a neuron in the visual cortex that responds to an object moving from left to right. When exposed to such a stimulus, it will not respond exactly the same way each time: the same neuron may respond by firing 9 times, or 14 times, or not at all. Although this particular cell is, on average, activated by left-to-right motion, its response to this stimulus may change dramatically from one presentation to the next.

Pouget's group hypothesized that this variability may represent sensory uncertainty. Let’s return our focus to the visual system and dodgeball. Your uncertainty of the speed at which the dodgeball is moving is related to the fact that neurons in your visual cortex do not fire in exactly the same way every time you see a ball moving towards you. Balls flying at your head can look different depending on your vantage point (and other factors, such as the physical properties of the ball itself), and thus give rise to different responses in your visual cortex every time. If an approaching dodgeball always elicited the same neural responses, you would be able to determine its speed with certainty, by evoking your memory of the ball's speed in past occasions.

The researchers showed mathematically that this variability could represent probability distributions for an object's location. Greater uncertainty (i.e. wider probability distributions) would thus be represented by higher variability in responses of neurons in the auditory cortex relative to those in the visual cortex. This internal representation of sensory uncertainty allows the brain a relatively straightforward (linear) way to combine neural activities: the Bayesian “decoder” of the brain can simply pool the probability functions of multiple neurons (which can represent multiple sensory channels) together to generate an optimal inference of an object's location.

So when watching a ventriloquist act, our visual system detects the movement of a puppet’s mouth, which neurons in our visual cortex register with low variability (high certainty and a narrower, more mathematically dominant probability function), while the neurons in our auditory cortex represent sound originating from the mouth of the ventriloquist with high variability (low certainty and a wider, less influential probability function). When the brain combines these functions together with its Bayesian decoder, the visual system "wins" and we think the sound came from the puppet.

42 comments:

business process management consultant said...

Good tips that are worth checking and these tips are also worth suggesting to friends. Thanks for sharing. Great stuff! . I am new to seo, trying to visit more seo blogs for guides and tips. You can be friends with me. Please come visit my site business process management softwares when you got time. Thanks.

asset liability management said...

Awesome article, definitely liked the info provided. Just subscribed to your blog. Great stuff! . I am new to seo, trying to visit more seo blogs for guides and tips. You can be friends with me. Please come visit my site asset management softwares when you got time. Thanks.

Anonymous said...

viagra sales natural viagra substitutes get viagra cheap herbal viagra marijuana and viagra viagra oral viagra sales viagra pharmacy order viagra online free viagra samples before buying viagra rx uk alternative viagra free sample prescription for viagra canadian viagra

Knee Injury Football Injuries said...

It is very interesting article and quite impressive and more informative and looking forward to read such article. Please come visit my site common sports injuries include knee injury when you got time.

Living In Apartment said...

Since I’m new to blogging, these articles are greatly appreciated; very useful and informative blog and every body must visit this blog. Please come visit my site living in apartment give me any valuable feedbacks.

Anonymous said...

Endometriosis pain, treatment endometriosis, symptoms of endometriosis.signs of endometriosis

Anonymous said...

Nice to meet you!!!
[URL=http://superjonn.50webs.com/restaurant-week-westchester-county.html]restaurant week westchester county[/URL]

Rain gutters cleaning said...

Dodgeball, I haven't heard any game of this name in my life. Well, it sounds funny.

Anonymous said...

http://members.lycos.nl/cynorneqa/jewelry-77/fovathisede.html sbi credit card bangalore
http://members.lycos.nl/xanajsmihu/credit-cf0/ususicti.html credit free in online report second
http://members.lycos.nl/giernami/guaranteb1/culalinequ.html pandora jewelry new york
movie made most money
rainbow saphire jewelry
http://members.lycos.nl/cynorneqa/jewelry-77/zdkexensnt.html talloren jewelry
bell bell hand silver

Unknown said...

Me & my neighbour were preparing to do some research about that. We got a good book on that matter from our local library and most books where not as influensive as your information. I am very glad to see such information which I was searching for a long time.
Alabama group insurance, Alaska group insurance, Arizona group insurance, Arkansas group insurance, Bail Bonds Referral Services group insurance, California group insurance, North Dakota group insurance, Ohio group insurance, Oklahoma group insurance,

Unknown said...

I just couldnt leave your website before saying that I really enjoyed the quality information you offer to your visitors... Will be back often to check up on new stuff you post here!
Colorado group insurance, Connecticut group insurance, Delaware group insurance, District Of Colombia group insurance, Florida group insurance, Georgia group insurance, Hawaii group insurance, Idaho group insurance, Illinois group insurance,

Unknown said...

Hawaii insurance companies, insurance agents brokers and insurance guide. Comprehensive information about Hawaii car insurance, home owner insurance, health insurance, life insurance and more.
Hawaii
Home Health Care Insurance
, Hawaii
Home Insurance
, Hawaii
Hospitalization Insurance
, Hawaii
Insurance
, Hawaii
Insurance Adjusters
, Hawaii
Insurance Agents & Brokers
, Hawaii
Insurance Annuities
, Hawaii
Insurance Bonds
, Hawaii
Insurance Claims & Services
, Hawaii
Insurance Claims Processing Services
, Hawaii
Insurance Consultants & Advisors
, Hawaii
Insurance Employment Agencies
, Hawaii
Insurance Examinations
, Hawaii
Insurance Examiners

Anonymous said...

which averages to about 7,353 watches per year.
http://www.watchestoo.com
ROLEX
rolex oyster perpetual datejust watch
rolex oyster perpetual datejust replica watch
rolex oyster perpetual datejust
rolex ladies datejust
rolex 116200
rolex 18k
rolex stainless
BREITLING
TAG HEUER
CARTIER
OMEGA
IWC
u boat
iw500112
IW376705

Unknown said...

There is obviously a lot to know about this. I think you made some good points in Features also.
New York insurance adjuster, North Carolina insurance adjuster, North Dakota insurance adjuster, Ohio insurance adjuster, Oklahoma insurance adjuster, Oregon insurance adjuster, Pennsylvania insurance adjuster, Rhode Island insurance adjuster, South Carolina insurance adjuster, South Dakota insurance adjuster

Unknown said...

found your site on del.icio.us today and really liked it.. i bookmarked it and will be back to check it out some more later ..
Tennessee insurance adjuster, Texas insurance adjuster, Utah insurance adjuster, Vermont insurance adjuster, Virginia insurance adjuster, Washington insurance adjuster, West Virginia insurance adjuster, Wisconsin insurance adjuster, Wyoming insurance adjuster

Anonymous said...

Good writing. Keep up the good work. I just added your RSS feed my Google News Reader..
Oklahoma
Insurance Information & Referral Services
, Oklahoma
Insurance Inspection Services
, Oklahoma
Insurance Law Attorneys
, Oklahoma
Insurance Plan Administrators
, Oklahoma
Insurance Retirement Annuities & Pension
, Oklahoma
Insurance Underwriters
, Oklahoma
Insured Property Replacement Services
, Oklahoma
Landlords insurance
, Oklahoma
Liability & Malpractice Insurance
, Oklahoma
Life Insurance
, Oklahoma
Marine insurance
, Oklahoma
Medicare Supplemental & Long Term Care Insurance

Anonymous said...

Well Whattadya know, yet another great site to add to my reader! Google blog search has you pretty well indexed it seems! you have some brilliant contents!
Well Whattadya know, yet another great site to add to my reader! Google blog search has you pretty well indexed it seems! you have some brilliant contents!

Anonymous said...

Me & my neighbour were preparing to do some research about that. We got a good book on that matter from our local library and most books where not as influensive as your information. I am very glad to see such information which I was searching for a long time.
Georgia
Family Attorney
, Hawaii
Family Attorney
, Idaho
Family Attorney
, Illinois
Family Attorney
, Indiana
Family Attorney
, Iowa
Family Attorney
, Kansas
Family Attorney
, Florida Immigration Attorney

Anonymous said...

I just couldnt leave your website before saying that I really enjoyed the quality information you offer to your visitors... Will be back often to check up on new stuff you post here!

Georgia
Immigration Attorney
, Hawaii
Immigration Attorney
, Idaho
Immigration Attorney
, Illinois
Immigration Attorney

Indiana
Immigration Attorney
, Iowa
Immigration Attorney
, Kansas
Immigration Attorney

Anonymous said...

If you had some way of rating posts I would for sure give you a high rating my friend! Hawaii
Medical Malpractice Attorney
, Idaho
Medical Malpractice Attorney
, Illinois
Medical Malpractice Attorney
, Indiana
Medical Malpractice Attorney
, Iowa
Medical Malpractice Attorney

Anonymous said...

Your summaries are always top-notch. Thanks for keeping us apprised. I’m reading every word here.

Kansas
Medical Malpractice Attorney
, Florida Attorney At Law, Georgia
Attorney At Law
, Hawaii
Attorney At Law
, Idaho
Attorney At Law
, Illinois
Attorney At Law
, Indiana
Attorney At Law
, Iowa
Attorney At Law
, Kansas
Attorney At Law,

Anonymous said...

hey your blog design is very nice, clean and fresh and with updated content, make people feel peace and I always like browsing your site.

- Joe

Anonymous said...

I have been exploring for a little for any high quality articles or weblog posts in this sort of area .
Exploring in Yahoo I ultimately stumbled upon this web site.
Studying this info So i am happy to show that I've an incredibly excellent uncanny feeling I came upon exactly what I needed. I such a lot without a doubt will make certain to don?t fail to remember this web site and give it a look on a relentless basis.

My site: orquesta atraccion

Anonymous said...

Actually Interesting. Thanks for the Info. I enjoy
your website.

Here is my site ... xerox phaser 8560

Anonymous said...

Many thanks for this option!

Here is my blog; xerox phaser 8560n

Anonymous said...

If you are going for finest contents like me, just pay
a visit this website all the time because it presents
quality contents, thanks

Here is my blog post acoustic guitar chord

Anonymous said...

I have a grinding sound that is keeping me from printing everything from the Cyan toner.
Could this coincide case?

Feel free to surf to my weblog; Xerox phaser 8560dn

Anonymous said...

very appealing short article.
I am getting a mistake:
PS limitcheck mistake, offending command "setpagedevice".


Here is my blog; blogspot.com

Anonymous said...

Thank you for the good writeup. It in fact was a amusement account
it. Look advanced to more added agreeable from you!
By the way, how can we communicate?

Look at my web page - free sexiest porn videos

Anonymous said...

you're really a good webmaster. The web site loading speed is amazing. It kind of feels that you are doing any unique trick. Also, The contents are masterwork. you've performed a magnificent process on
this matter!

my weblog: xerox 8560 mfp

Anonymous said...

Good day,
Am making use of Hp LaserJet 1018 printer for my Mac book pro Really am made use of home windows xp previously to my system.

Now it is upgraded with Mac OS X Snow leopard.

Listed here is an issue is that the gadget is not able function well with the unit.


Here is my weblog http://bestzzz.Info

Anonymous said...

This printer doesn't have a voltage choose change. It is sold as a 110 volt variation or a 220 volt model. To transform the printer from one variation to the various other, you would have to replace both the power provide and the fuser. At least it simply didn't electric up.
If you had relocated the printer in the contrary
instructions, it would most likely have actually gone bang and/or tripped out the whole office.


Feel free to surf to my web site ... http://www.fxserversite.com

Anonymous said...

Greetings,
Am utilizing Hp LaserJet 1018 printer for my
Mac book pro. In fact am utilized windows xp previously to my system.
Now it is updated with Mac OS X Snow leopard. Right here is a trouble with
motorists that unable to function well with
the unit.

My weblog ... http://videos.guidehorse.com/uprofile.php?UID=9665

Anonymous said...

I for all time emailed this website post page to all my contacts, for the reason that if like to
read it after that my links will too.

Here is my webpage ... xerox 8560n

Anonymous said...

I like the helpful information you provide to your articles.
I'll bookmark your weblog and test once more right here frequently. I am relatively sure I'll learn lots of new stuff
proper here! Good luck for the following!


Also visit my page Best hosting companies

Anonymous said...

Excellent post! We will be linking to this particularly great content on our website.

Keep up the good writing.

Here is my weblog xerox 8560 drivers

Anonymous said...

Exactly how can I download a free version of hplaserjet 1020?


Stop by my website :: xerox phaser 8560 printer

Anonymous said...

Nice job, Aaron. I managed to keep my Lexmark E210 printer (an ML-1210 duplicated) operating along, now in Home windows 8.


Feel free to visit my web blog - xerox phaser 8560 ink

Anonymous said...

Thks man, there are still good fellows, cya.

Feel free to visit my blog :: Xerox Phaser 8560 ink

Anonymous said...

the hp printer behaves task.

Here is my web page ... xerox phaser 8560 maintenance kit

Brian Taylor said...

I was searching for a proper explanation about the injury lawyer. Thanks, admin, for sharing such wonderful content on this topic. Now I have got everything I need about it. Here’s another piece of informative content on Lethbridge Injury Lawyer You will get well-researched information about it.

Anonymous said...

golden goose starter
golden goose outlet
kobe shoes
off white nike
fear of god clothing
palm angels t shirt
hermes outlet
off white clothing
off white clothing
bapesta shoes