top of page

Touching Virtual Worlds with Flying Robots

Heather Culbertson

While modern XR systems can render increasingly convincing virtual worlds, enabling users to physically interact with those worlds remains a fundamental challenge. This talk presents a progression of research exploring autonomous flying robots as encounter-type haptic devices that deliver force feedback wherever and whenever interaction occurs. Beginning with the question of whether a single nano-quadcopter can produce meaningful touch sensations, I will describe how our work evolved to collaborative multi-drone systems capable of rendering stronger and more expressive haptic feedback, and ultimately to a flyable joystick that seamlessly transitions between autonomous flight and handheld interaction. Throughout the talk, I will discuss both the engineering challenges, including safety, force generation, and control, and the user studies demonstrating how these systems improve the realism and immersion of virtual experiences.

Abstract

While modern XR systems can render increasingly convincing virtual worlds, enabling users to physically interact with those worlds remains a fundamental challenge. This talk presents a progression of research exploring autonomous flying robots as encounter-type haptic devices that deliver force feedback wherever and whenever interaction occurs. Beginning with the question of whether a single nano-quadcopter can produce meaningful touch sensations, I will describe how our work evolved to collaborative multi-drone systems capable of rendering stronger and more expressive haptic feedback, and ultimately to a flyable joystick that seamlessly transitions between autonomous flight and handheld interaction. Throughout the talk, I will discuss both the engineering challenges, including safety, force generation, and control, and the user studies demonstrating how these systems improve the realism and immersion of virtual experiences.

Bio

Heather Culbertson is an Associate Professor of Computer Science and Biomedical Engineering at the University of Southern California. Her research focuses on designing haptic systems for virtual reality and human-robot interaction that create natural, realistic touch experiences. She received her PhD in the Department of Mechanical Engineering and Applied Mechanics at the University of Pennsylvania. Her awards include the NSF CAREER Award, IEEE Technical Committee on Haptics Early Career Award, MassRobotics Rising Star in Robotics Award, and the Ershaghi Faculty Mentorship Award.

© 2023 The International Conference on Holodecks

bottom of page