← All projects

VR Human-Robot Search Team Testbed

A Unity and Meta XR simulation for studying embodied trust calibration as participants work with robot teammates to search rooms, gather evidence, and identify a target location.

Manuscript in progress · Target journal: International Journal of Human–Computer Interaction.

A repeatable VR study environment for human-robot teaming.

The testbed places participants in a virtual multi-building search task where they coordinate with robot partners, inspect room evidence, update rationales, and make a final location decision.

The system combines Unity VR interaction, Meta XR deployment, Python WebSocket logging, an AWS bridge, speech interfaces, gaze/eye tracking, decision timing, robot recommendations, and trust survey workflows.

Virtual search space and robot partners

Exterior view of the VR search environment with two buildings and robot partners
Virtual search environment with two buildings, task entry point, and robot teammates.
Interior VR clue room with table, map, documents, and furniture
Interior clue room where participants inspect evidence during the search task.

What the testbed captures

Unity, Meta XR, Python, and AWS

Built for internet-connected headset deployment with backend WebSocket logging and cloud-connected study data capture.

Interaction and trust data

Captures decisions, timing, rationales, recommendation exposure, speech interactions, gaze/eye tracking, and trust survey responses.

Embodied verification

Supports an in-progress manuscript on how participants move from monitoring robot recommendations to relying on them in an embodied task.