3D Selection Vault

On-Body Bézier Selection

Also known as Bend It, Aim It, Tap It, Forearm disambiguation

Bending the index finger curves the selection ray as a Bézier curve, and the four objects closest to the curve are shown on the other forearm, where the user taps the right one.

How it works

With Quest 2 hand tracking, the left index finger's flexion (fingertip-to-wrist distance) sets the curvature of a quadratic Bézier curve from the wrist, and wrist rotation changes its bending direction. Bending the right middle finger activates the curve and straightening it locks the result. The four objects nearest the curve (or a straight ray) are projected onto the left forearm and the user touches one with the right hand. A 2 × 2 study (24 participants, 64 objects) crossed Bézier vs straight ray with forearm vs mid-air selection: the forearm step reduced errors and physical demand and was preferred; the Bézier curve helped reach occluded targets but was slower.

Papers