The Library
EV-Eye : Rethinking high-frequency eye tracking through the lenses of event cameras
Tools
Zhao, Grangrong, Yang, Yurun, Liu, Jingwei, Chen, Ning, Shen, Yiran, Wen, Hongkai and Lan, Guohao (2023) EV-Eye : Rethinking high-frequency eye tracking through the lenses of event cameras. In: Thirty-seventh Conference on Neural Information Processing Systems (NeurIPS), 2023, New Orleans, USA, 10-16 Dec 2023 (In Press)
PDF
WRAP-EV-Eye-rethinking-high-frequency-eye-tracking-lenses-event-cameras-23.pdf - Accepted Version Embargoed item. Restricted access to Repository staff only - Requires a PDF viewer. Download (8Mb) |
Abstract
In this paper, we present EV-Eye, a first-of-its-kind large scale multimodal eye tracking dataset aimed at inspiring research on high-frequency eye/gaze tracking. EV-Eye utilizes an emerging bio-inspired event camera to capture independent pixel-level intensity changes induced by eye movements, achieving sub-microsecond latency. Our dataset was curated over a two-week period and collected from 48 participants encompassing diverse genders and age groups. It comprises over 1.5 million near-eye grayscale images and 2.7 billion event samples generated by two DAVIS346 event cameras. Additionally, the dataset contains 675 thousands scene images and 2.7 million gaze references captured by Tobii Pro Glasses 3 eye tracker for cross-modality validation. Compared with existing event-based high-frequency eye tracking datasets, our dataset is significantly larger in size, and the gaze references involve more natural eye movement patterns, i.e., fixation, saccade and smooth pursuit. Alongside the event data, we also present a hybrid eye tracking method as benchmark, which leverages both the near-eye grayscale images and event data for robust and high-frequency eye tracking. We show that our method achieves higher accuracy for both pupil and gaze estimation tasks compared to the existing solution.
Item Type: | Conference Item (Poster) | ||||||
---|---|---|---|---|---|---|---|
Divisions: | Faculty of Science, Engineering and Medicine > Science > Computer Science | ||||||
Official Date: | 22 September 2023 | ||||||
Dates: |
|
||||||
Status: | Peer Reviewed | ||||||
Publication Status: | In Press | ||||||
Date of first compliant deposit: | 10 October 2023 | ||||||
Date of first compliant Open Access: | 10 October 2023 | ||||||
Conference Paper Type: | Poster | ||||||
Title of Event: | Thirty-seventh Conference on Neural Information Processing Systems (NeurIPS), 2023 | ||||||
Type of Event: | Conference | ||||||
Location of Event: | New Orleans, USA | ||||||
Date(s) of Event: | 10-16 Dec 2023 | ||||||
Related URLs: |
Request changes or add full text files to a record
Repository staff actions (login required)
View Item |