Freehand Multi-object Selection (Crossing / Cone-casting)
Also known as Crossing Selection (CR), Cone-casting Selection (CC), Multi-Finger mode switching
A hand ray selects single objects with a normal pinch, and a slightly different pinch switches to group selection, where the user either sweeps the ray across objects (crossing) or captures all objects inside a resizable cone.
How it works
Default selection is a hand ray confirmed by a thumb-index pinch. Group selection is triggered by a mode-switching gesture: tapping the thumb on the index PIP joint (Finger Segment), a thumb-middle pinch (Multi-Finger), or rotating the wrist over 90° while pinching (Wrist Orientation). In Crossing Selection the user holds the gesture and every object the ray (resizable into a cylinder) touches is toggled until release; in Cone-casting Selection one gesture toggles every object inside a cone whose size is set by dragging the other index finger along a slider on the hand. Re-selecting a selected object deselects it. In a study (N=18, Meta Quest Pro) on clustered targets 2.5 m away, crossing was faster and needed fewer actions than cone-casting; mode gestures performed alike, Multi-Finger was preferred and Wrist Orientation disliked.
Papers
- Rongkai Shi, Yushi Wei, Xuning Hu, Yu Liu, Yong Yue, Lingyun Yu, Hai-Ning Liang (2024). Experimental Analysis of Freehand Multi-object Selection Techniques in Virtual Reality Head-Mounted Displays. Proceedings of the ACM on Human-Computer Interaction 8 (ISS) doi:10.1145/3698129