3D Selection Vault

Situated Lasso Selection

Also known as Embedded lasso, Front-facing canvas lasso

In passthrough AR in a supermarket, the user draws a lasso with a controller ray to select many physical products at once, either directly on the shelf fronts (embedded) or on a canvas in front of their face.

How it works

Invisible digital twins are aligned with the real shelves and products. In the Embedded variant, the ray draws on canvases pre-placed over each shelf front and products are tested against the polygon along the canvas normal. In the Front Facing Canvas variant, a canvas appears 1 m in front of the head when the trigger is pressed and products are tested from the eye position, so the user must stand still. Products count as selected when at least half of nine sample points on their front face fall inside the polygon, and selected ones get a green outline. Controller-anchored, hybrid and head-following variants were built but not studied. In a small study (8 participants, Quest 3S) the Embedded variant scored higher on usability (SUS 94 vs 89) and lower on workload.

Papers