Look&Micro

Also known as Gaze + microgesture selection

Eye gaze aims a narrow cone and opening the index finger pre-selects what it covers; thumb taps on the index finger then step a cursor through the candidates, shown both in the scene and as a list, and straightening the finger selects.

How it works

The first phase is shared with Look&MidAir: a 2° cone follows the eye gaze, half-opening the non-dominant index finger shows it and fully opening it pre-selects the objects it intersects, while closing the hand cancels. With one candidate, it is selected at once. Otherwise a red cursor, linked between the objects in the scene and copies listed 60 cm in front, is moved by tapping the thumb on the index finger's top or middle phalanx, and straightening the index validates. Microgestures were sensed with a pressure-and-flex glove. Against HoloLens 2 arm raycasting (12 participants) it took 4.31 s vs 9.65 s with lower fatigue; Look&MidAir took 3.41 s.

Papers

Adrien Chaffangeon Caillet, Alix Goguey, Laurence Nigay (2023). 3D Selection in Mixed Reality: Designing a Two-Phase Technique To Reduce Fatigue. IEEE International Symposium on Mixed and Augmented Reality (ISMAR) doi:10.1109/ISMAR59233.2023.00095