3D Selection Vault

Tiltcasting

A smartphone tilted in the air controls a virtual plane that slices through a 3D scene on a large display; targets are touched on the phone.

How it works

The orientation of the phone positions a selection plane in the scene. Objects intersected by the plane appear on the phone's screen, where the user taps the intended one, so occluded objects become reachable.

Papers

• Krzysztof Pietroszek, James R. Wallace, Edward Lank (2015). Tiltcasting: 3D Interaction on Large Displays Using a Mobile Device. ACM Symposium on User Interface Software & Technology (UIST) doi:10.1145/2807442.2807471
• Jan Leusmann (2021). A Literature Review on Distant Object Selection Methods. Master's thesis, University of Stuttgart doi:10.18419/opus-12060
• Yuan Chen, Junwei Sun, Qiang Xu, Edward Lank, Pourang Irani, Wei Li (2021). Global Scene Filtering, Exploration, and Pointing in Occluded Virtual Space. Human-Computer Interaction – INTERACT 2021, LNCS 12936, 156-176 doi:10.1007/978-3-030-85607-6_11