3D Selection Vault

Smartphone Slice-Plane Selection

Also known as Intersection-based hybrid selection

In mixed reality, a tracked phone moves a vertical slice plane through a point cloud and casts a peephole onto it; the points in the peephole are mirrored on the phone screen and selected by tapping.

How it works

Built for a Varjo XR-4 with a tracked Pixel phone. A vertical 2D plane cuts through the data, and the user moves it in depth in one of three ways: moving the phone (Move), tilting it (Tilt) or swiping on the screen (Touch), each with a clutch while the screen is touched. The phone raycasts a 75 × 34 cm peephole onto the plane, and its contents are shown on the phone so points can be tapped directly. A feasibility study (18 participants, 75 or 150 points, Borg exertion) found Touch the least tiring and Tilt the most; accidental selections caused by overlap between clutching and tapping meant no performance comparison was reported.

Papers