3D Selection Vault

Eye-gazed selection

A ray follows the user's eye gaze and selects the object being looked at.

How it works

An eye tracker casts a ray along the gaze direction. The fixated object is selected after a dwell time or on a button press.

Papers

• Ferran Argelaguet, Carlos Andujar (2013). A survey of 3D object selection techniques for virtual environments. Computers & Graphics doi:10.1016/j.cag.2012.12.003
• V. Tanriverdi, R. J. K. Jacob (2000). Interacting with eye movements in virtual environments. ACM CHI doi:10.1145/332040.332443
• Nathan Cournia, John D. Smith, Andrew T. Duchowski (2003). Gaze- vs. hand-based pointing in virtual environments. CHI '03 extended abstracts on Human factors in computer systems - CHI '03 doi:10.1145/765978.765982
• Matthias Weise, Raphael Zender, Ulrike Lucke (2019). A Comprehensive Classification of 3D Selection and Manipulation Techniques. Proceedings of Mensch und Computer 2019 doi:10.1145/3340764.3340777
• Ruijia Chen, Tianyi Zhang, Sanbrita Mondal, Yukang Yan, Yuhang Zhao (2026). Head, Gaze, or Finger? Comparing Object Selection Techniques in Augmented Reality for People with Low Vision. arXiv preprint 2607.06778 doi:10.48550/arXiv.2607.06778
• Robert J. K. Jacob (1990). What You Look At Is What You Get: Eye Movement-Based Interaction Techniques. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '90), pp. 11–18 doi:10.1145/97243.97246
• Katsumi Minakata, John Paulin Hansen, I. Scott MacKenzie, Per Bækgaard, Vijay Rajanna (2019). Pointing by Gaze, Head, and Foot in a Head-Mounted Display. Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications (COGAIN @ ETRA '19) doi:10.1145/3317956.3318150
• Jonas Blattgerste, Patrick Renner, Thies Pfeiffer (2018). Advantages of Eye-Gaze over Head-Gaze-Based Selection in Virtual and Augmented Reality under Varying Field of Views. Proceedings of the Workshop on Communication by Gaze Interaction (COGAIN '18) doi:10.1145/3206343.3206349
• Aunnoy K Mutasim, Anil Ufuk Batmaz, Wolfgang Stuerzlinger (2021). Pinch, Click, or Dwell: Comparing Different Selection Techniques for Eye-Gaze-Based Pointing in Virtual Reality. ACM Symposium on Eye Tracking Research and Applications (ETRA '21 Short Papers) doi:10.1145/3448018.3457998
• Joong-Jae Lee, Jung-Min Park (2020). 3D Mirrored Object Selection for Occluded Objects in Virtual Environments. IEEE Access 8, 200259-200274 doi:10.1109/ACCESS.2020.3035376
• Zhimin Wang, Jingyi Sun, Mingwei Hu, Maohang Rao, Weitao Song, Feng Lu (2024). GazeRing: Enhancing Hand-Eye Coordination with Pressure Ring in Augmented Reality. IEEE International Symposium on Mixed and Augmented Reality (ISMAR), 534-543 doi:10.1109/ISMAR62088.2024.00068
• Becky Spittle, Maite Frutos-Pascual, Chris Creed, Ian Williams (2023). A Review of Interaction Techniques for Immersive Environments. IEEE Transactions on Visualization and Computer Graphics doi:10.1109/tvcg.2022.3174805