ReRun: Enabling Multi-Perspective Analysis of Driving Interaction in VR

Abstract

Rerun is a software system to support post-facto analysis in simulation research. In this submission, we show it working inside a multiplayer driving simulator. Rerun is built in Unity 3D and captures the virtual behavior of participants and their interactions with virtual objects. These recorded behaviors can then be played back from any perspective in the virtual space. This is useful in multi-agent interaction studies because researchers can sift through scenarios carefully from each participant's perspective or even from an outside observer's perspective. This enables a fine-grained understanding of implicit and explicit signaling between participants and other human or AI-controlled agents.

David Goedicke, Harald Haraldsson, Navit Klein, Lunshi Zhou, Avi Parush, and Wendy Ju. 2023. ReRun: Enabling Multi-Perspective Analysis of Driving Interaction in VR. In Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction (HRI '23). Association for Computing Machinery, New York, NY, USA, 889–890. https://doi.org/10.1145/3568294.3580211