Efficient and Practical Audio-Visual Rendering for Games using Crossmodal Perception
90 views · Published 2 March 2016 · 3:06 · Indexed 7 October 2026
Channel: Nicolas Bonneel · 2016 · Music
Published at i3D 2009 D. Grelaud, N. Bonneel, M. Wimmer, M. Asselot, G. Drettakis http://www-sop.inria.fr/reves/Basilic/2009/GBWAD09/crossmodalI3D09.pdf Interactive applications such as computer games, are inherently audio visual, requiring high-quality rendering of complex 3D audio soundscapes and graphics environments. A frequent source of audio events is impact sounds, typically generated with physics engines. In this paper, we first present an optimization allowing effi- cient usage of impact sounds in a unified audio rendering pipeline, also including prerecorded sounds. We also exploit a recent result on audio-visual crossmodal perception to introduce a new level-ofdetail selection algorithm, which jointly chooses the quality level of audio and graphics rendering. We have integrated these two techniques as a comprehensive crossmodal audio-visual rendering pipeline in a home-grown game engine, thus demonstrating the potential utility of our approach.
More from this channel
-
0:25
Time Lapse, Antibes
-
0:22
IMG_00940.avi
-
0:26
Vancouver LiveCity Yaletown line
-
3:01
Coeur de Pirate - Comme des enfants - Vancouver 2010
-
4:32
Proxy-Guided Texture Synthesis for Rendering Natural Scenes
-
4:27
iFly Hollywood
-
3:36
Paraclete XP Tunnel Camp, Feb. 2011
-
4:44
Displacement Interpolation Using Lagrangian Mass Transport