3D Selection Vault

Gaze Position Guided Selection

Also known as Gaze Beam Guided selection

Pinching places an indicator where the user is looking at a fixed depth; the pinching hand then moves it remotely through the scene, objects nearer than it turn transparent, and releasing the pinch selects the object closest to it.

How it works

On a HoloLens 2 with added eye cameras, the indicator appears on the gaze ray 2 m away and is moved in 3D by remote hand motion, including in depth, so occluding objects can be skipped. It is the selection step of the authors' Gaze Position Guided and Gaze Beam Guided interactions, which differ only in how the selected object is then moved. With 15 participants in a heavily occluded scene, it took about half the selection time of gaze-plus-pinch selection and produced far fewer selections of occluders.

Papers

• Yiwei Bao, Jiaxi Wang, Zhimin Wang, Feng Lu (2023). Exploring 3D Interaction with Gaze Guidance in Augmented Reality. IEEE Conference on Virtual Reality and 3D User Interfaces (VR), 22-32 doi:10.1109/VR55154.2023.00018