Moving Sounds Enhance the Visually-Induced Self-Motion Illusion (Circular Vection) in Virtual Reality
Artikel i vetenskaplig tidskrift, 2009

While rotating visual and auditory stimuli have long been known to elicit self-motion illusions ("circular vection"), audiovisual interactions have hardly been investigated. Here, two experiments investigated whether visually induced circular vection can be enhanced by concurrently rotating auditory cues that match visual landmarks (e. g., a fountain sound). Participants sat behind a curved projection screen displaying rotating panoramic renderings of a market place. Apart from a no-sound condition, headphone-based auditory stimuli consisted of mono sound, ambient sound, or low-/high-spatial resolution auralizations using generic head-related transfer functions (HRTFs). While merely adding nonrotating (mono or ambient) sound showed no effects, moving sound stimuli facilitated both vection and presence in the virtual environment. This spatialization benefit was maximal for a medium (20 degrees x 15 degrees) FOV, reduced for a larger (54 degrees x 45 degrees) FOV and unexpectedly absent for the smallest (10 degrees x 7.5 degrees) FOV. Increasing auralization spatial fidelity (from low, comparable to five-channel home theatre systems, to high, 5 degrees resolution) provided no further benefit, suggesting a ceiling effect. In conclusion, both self-motion perception and presence can benefit from adding moving auditory stimuli. This has important implications both for multimodal cue integration theories and the applied challenge of building affordable yet effective motion simulators.

perception

psychophysics

vection

Measurement

locomotion

virtual reality

eye

induction

rotation

spatial sound

self-motion simulation

Human Factors

nystagmus

environments

field

posture

Experimentation

Audiovisual interactions

presence

Författare

B. E. Riecke

Max Planck-institutet

Simon Fraser University

Alexander Väljamäe

Chalmers, Bygg- och miljöteknik, Teknisk akustik, Rumsakustik

J. Schulte-Pelkum

Max Planck-institutet

ACM Transactions on Applied Perception

1544-3558 (ISSN) 1544-3965 (eISSN)

Vol. 6 2 7 (artno)-

Ämneskategorier

Strömningsmekanik och akustik

DOI

10.1145/1498700.1498701

Mer information

Senast uppdaterat

2018-02-21