|
|
||||||||
Letter |
yoshi{at}sat.t.u-tokyo.ac.jp Department of Complexity Science and Engineering, Graduate School of Frontier Sciences, University of Tokyo, Tokyo 277-8562, and Aihara Complexity Modeling Project, ERATO, Japan Science and Technology Agency, Tokyo 151-0064, Japan
taro.toyoizumi{at}brain.riken.jp RIKEN Brain Science Institute, Saitama 351-0198, Japan, and Department of Complexity Science and Engineering, Graduate School of Frontier Sciences, University of Tokyo, Tokyo 277-8562, Japan
aihara{at}sat.t.u-tokyo.ac.jp Institute of Industrial Science, University of Tokyo, Tokyo 153-8505, Japan; Aihara Complexity Modeling Project, ERATO, Japan Science and Technology Agency, Tokyo 151-0064, Japan, and Department of Complexity Science and Engineering, Graduate School of Frontier Sciences, University of Tokyo, Tokyo 277-8562, Japan
We study a computational model of audiovisual integration by setting a Bayesian observer that localizes visual and auditory stimuli without presuming the binding of audiovisual information. The observer adopts the maximum a posteriori approach to estimate the physically delivered position or timing of presented stimuli, simultaneously judging whether they are from the same source or not. Several experimental results on the perception of spatial unity and the ventriloquism effect can be explained comprehensively if the subjects in the experiments are regarded as Bayesian observers who try to accurately locate the stimulus. Moreover, by adaptively changing the inner representation of the Bayesian observer in terms of experience, we show that our model reproduces perceived spatial frame shifts due to the audiovisual adaptation known as the ventriloquism aftereffect.
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| J COGNITIVE NEUROSCIENCE | NEURAL COMPUTATION | MIT PRESS JOURNALS |