3D Selection Vault

3D Mirrored Object Selection

Also known as 3D mirror selection

The objects along the gaze ray are shown again in a virtual 3D mirror next to the gaze point, seen from another angle with the occluders removed, so a hidden target can be picked in the mirror by dwelling on it.

How it works

Built for a 55-inch stereoscopic display with a Tobii eye tracker and a gamepad. The gaze ray collects every object it passes through, and a virtual camera at an angle renders them into a mirror plane beside the gaze point; objects between the camera and the candidates are culled, and the mirror follows the gaze direction. The shoulder buttons step through the candidates along the depth axis or move the mirror, a dwell on the target in the mirror selects it, and another button cancels. Study 1 (21 participants) against gaze selection with navigation: 7.99 s vs 18.54 s and 0.8% vs 12.3% errors; study 2 (13 participants, mixed shapes) 9.15 s vs 24.8 s.

Papers

• Joong-Jae Lee, Jung-Min Park (2020). 3D Mirrored Object Selection for Occluded Objects in Virtual Environments. IEEE Access 8, 200259-200274 doi:10.1109/ACCESS.2020.3035376