3D Selection Vault

Ray&Racket

Hand-tracking version of Conductor: one hand points a ray, the other holds a plane, and the target on the ray closest to the plane is selected.

How it works

The dominant hand's ray picks candidate targets; a plane held in the non-dominant hand acts as a depth indicator, and the candidate closest to it (within a 1 cm margin, or in front of it) is selected with a pinch. Built as a baseline for Gaze&Racket.

Papers

• Uta Wagner, Matthias Albrecht, Andreas Asferg Jacobsen, Haopeng Wang, Hans Gellersen, Ken Pfeuffer (2024). Gaze, Wall, and Racket: Combining Gaze and Hand-Controlled Plane for 3D Selection in Virtual Reality. Proceedings of the ACM on Human-Computer Interaction 8(ISS), Article 534 doi:10.1145/3698134