Score: 0

A deep learning approach to track eye movements based on events

Published: August 6, 2025 | arXiv ID: 2508.04827v1

By: Chirag Seth, Divya Naiken, Keyan Lin

Potential Business Impact:

Tracks eyes cheaply for better VR/AR games.

This research project addresses the challenge of accurately tracking eye movements during specific events by leveraging previous research. Given the rapid movements of human eyes, which can reach speeds of 300{\deg}/s, precise eye tracking typically requires expensive and high-speed cameras. Our primary objective is to locate the eye center position (x, y) using inputs from an event camera. Eye movement analysis has extensive applications in consumer electronics, especially in VR and AR product development. Therefore, our ultimate goal is to develop an interpretable and cost-effective algorithm using deep learning methods to predict human attention, thereby improving device comfort and enhancing overall user experience. To achieve this goal, we explored various approaches, with the CNN\_LSTM model proving most effective, achieving approximately 81\% accuracy. Additionally, we propose future work focusing on Layer-wise Relevance Propagation (LRP) to further enhance the model's interpretability and predictive performance.

Page Count
7 pages

Category
Computer Science:
CV and Pattern Recognition