Head-mounted Augmented Reality for Guided Surface Reflectance Capture
Abstract
In this project, we explore the design of a system for helping users capture surface reflectance functions with a head-mounted augmented reality (AR) device and a hand-held controller. We supplement a standard 6-DOF controller with a mountable light source that we track during capture. Users begin by using the controller to select a surface region for capture. We then record images through the head-mounted camera while guiding the user’s control of the hand-held light source with real-time feedback through the AR display. Our system provides a simple and efficient way to capture information about surface reflectance in the wild.
Harald Haraldsson, Søren Skovsen, Ser-Nam Lim, Steve Marschner, Serge Belongie, Abe Davis. Head-mounted Augmented Reality for Guided Surface Reflectance Capture. CVPR Workshop on Computer Vision for Augmented and Virtual Reality, 2020.
PDF | Video | CV4ARVR Workshop
Controller mount designed by Matt Freed
