When what you see is what you hear: Auditory-visual integration and presence in virtual environments
Paper in proceeding, 2007

In this paper, it is hypothesized that consistency across modalities in terms of matching the visual space to the auditory space is important for the sense of presence. An experiment was carried out where thirty participants were exposed to four conditions having different degrees of auditory-visual consistency (one purely visual and three auditory-visual). A presence questionnaire was used after exposure to measure participants’ sensations. Although participants rated the auditory-visual conditions as inducing significantly higher presence than the condition with only visual information, no differences in presence ratings between the three auditory-visual conditions were found. However, participants’ rankings of their sensed presence in all conditions revealed that there might be such differences. Moreover, the results show that sound in general has a significant effect on VE users’ sense of presence.

multimodal VE

virtual acoustics

Presence

auralization

auditory-visual integration

Author

Pontus Larsson

Chalmers, Civil and Environmental Engineering, Applied Acoustics

Daniel Västfjäll

Chalmers, Civil and Environmental Engineering, Applied Acoustics

Pierre Olsson

Chalmers, Architecture

Mendel Kleiner

Chalmers, Civil and Environmental Engineering, Applied Acoustics

Proceedings of the 10th Annual International Workshop on Presence, October 25-27, 2007, Barcelona, Spain

11-18
10-0-9792217-1-4 (ISBN)

Subject Categories

Applied Psychology

Fluid Mechanics and Acoustics

ISBN

10-0-9792217-1-4

More information

Created

10/8/2017