
The Library
Multi-modal perception for selective rendering
Tools
Harvey, Carlo, Debattista, Kurt, Bashford-Rogers, Thomas and Chalmers, Alan (2017) Multi-modal perception for selective rendering. Computer Graphics Forum, 36 (1). pp. 172-183. doi:10.1111/cgf.12793 ISSN 0167-7055.
|
PDF
WRAP_1271116-wmg-280116-cgfsubmission.pdf - Submitted Version - Requires a PDF viewer. Download (37Mb) | Preview |
Official URL: http://dx.doi.org/10.1111/cgf.12793
Abstract
A major challenge in generating high-fidelity virtual environments (VEs) is to be able to provide realism at interactive rates. The high-fidelity simulation of light and sound is still unachievable in real time as such physical accuracy is very computationally demanding. Only recently has visual perception been used in high-fidelity rendering to improve performance by a series of novel exploitations; to render parts of the scene that are not currently being attended to by the viewer at a much lower quality without the difference being perceived. This paper investigates the effect spatialized directional sound has on the visual attention of a user towards rendered images. These perceptual artefacts are utilized in selective rendering pipelines via the use of multi-modal maps. The multi-modal maps are tested through psychophysical experiments to examine their applicability to selective rendering algorithms, with a series of fixed cost rendering functions, and are found to perform significantly better than only using image saliency maps that are naively applied to multi-modal VEs.
Item Type: | Journal Article | ||||||||
---|---|---|---|---|---|---|---|---|---|
Subjects: | Q Science > QA Mathematics | ||||||||
Divisions: | Faculty of Science, Engineering and Medicine > Engineering > WMG (Formerly the Warwick Manufacturing Group) | ||||||||
Library of Congress Subject Headings (LCSH): | Virtual reality | ||||||||
Journal or Publication Title: | Computer Graphics Forum | ||||||||
Publisher: | Blackwell Publishing | ||||||||
ISSN: | 0167-7055 | ||||||||
Official Date: | January 2017 | ||||||||
Dates: |
|
||||||||
Volume: | 36 | ||||||||
Number: | 1 | ||||||||
Page Range: | pp. 172-183 | ||||||||
DOI: | 10.1111/cgf.12793 | ||||||||
Status: | Peer Reviewed | ||||||||
Publication Status: | Published | ||||||||
Access rights to Published version: | Restricted or Subscription Access | ||||||||
Funder: | Engineering and Physical Sciences Research Council (EPSRC) | ||||||||
Grant number: | 07001392 |
Request changes or add full text files to a record
Repository staff actions (login required)
![]() |
View Item |
Downloads
Downloads per month over past year