Look&MidAir

Also known as Two-Phase Technique (MR)

Eye gaze aims a narrow cone and opening the index finger pre-selects what it covers; the candidates are copied into a list in front of the user, and touching the right copy with the hand selects it, keeping the arm low in the first phase.

How it works

A 2° cone follows the eye gaze. Half-opening the non-dominant index finger shows it and fully opening it pre-selects every object it intersects; closing the hand cancels, and with a single candidate it is selected at once. Otherwise the candidates are copied into a list 60 cm in front of the user, linked to the originals, and the user touches the intended copy with the dominant hand (mid-air). On a HoloLens 2 with 12 participants it took 3.41 s against 9.65 s for the arm raycasting of HoloLens 2 and 4.31 s for the microgesture variant Look&Micro, with lower reported fatigue.

Papers

Adrien Chaffangeon Caillet, Alix Goguey, Laurence Nigay (2023). 3D Selection in Mixed Reality: Designing a Two-Phase Technique To Reduce Fatigue. IEEE International Symposium on Mixed and Augmented Reality (ISMAR) doi:10.1109/ISMAR59233.2023.00095