
The Library
Maintaining frame rate perception in interactive environments by exploiting audio-visual cross-modal interaction
Tools
Hulusić, Vedad, Debattista, Kurt, Aggarwal, Vibhor and Chalmers, Alan (2011) Maintaining frame rate perception in interactive environments by exploiting audio-visual cross-modal interaction. The Visual Computer, Volume 27 (Number 1). pp. 57-66. doi:10.1007/s00371-010-0514-2 ISSN 0178-2789.
Research output not available from this repository.
Request-a-Copy directly from author or use local Library Get it For Me service.
Official URL: http://dx.doi.org/10.1007/s00371-010-0514-2
Abstract
The entertainment industry, primarily the video games industry, continues to dictate the development and performance requirements of graphics hardware and computer graphics algorithms. However, despite the enormous progress in the last few years, it is still not possible to achieve some of industry's demands, in particular high-fidelity rendering of complex scenes in real-time, on a single desktop machine. A realisation that sound/music and other senses are important to entertainment led to an investigation of alternative methods, such as cross-modal interaction in order to try and achieve the goal of "realism in real-time". In this paper we investigate the cross-modal interaction between vision and audition for reducing the amount of computation required to compute visuals by introducing movement related sound effects. Additionally, we look at the effect of camera movement speed on temporal visual perception. Our results indicate that slow animations are perceived as smoother than fast animations. Furthermore, introducing the sound effect of footsteps to walking animations further increased the animation smoothness perception. This has the consequence that for certain conditions, the number of frames that need to be rendered each second can be reduced, saving valuable computation time, without the viewer being aware of this reduction. The results presented are another step towards the full understanding of the auditory-visual cross-modal interaction and its importance for helping achieve "realism int real-time".
Item Type: | Journal Article | ||||
---|---|---|---|---|---|
Subjects: | B Philosophy. Psychology. Religion > BF Psychology Q Science > QA Mathematics > QA76 Electronic computers. Computer science. Computer software |
||||
Divisions: | Faculty of Science, Engineering and Medicine > Engineering > WMG (Formerly the Warwick Manufacturing Group) | ||||
Library of Congress Subject Headings (LCSH): | Perception, Human-computer interaction | ||||
Journal or Publication Title: | The Visual Computer | ||||
Publisher: | Springer | ||||
ISSN: | 0178-2789 | ||||
Official Date: | January 2011 | ||||
Dates: |
|
||||
Volume: | Volume 27 | ||||
Number: | Number 1 | ||||
Page Range: | pp. 57-66 | ||||
DOI: | 10.1007/s00371-010-0514-2 | ||||
Status: | Peer Reviewed | ||||
Publication Status: | Published | ||||
Access rights to Published version: | Restricted or Subscription Access |
Data sourced from Thomson Reuters' Web of Knowledge
Request changes or add full text files to a record
Repository staff actions (login required)
![]() |
View Item |