Proactive Safe Human-Robot Interaction
Overview:
As robots become more common in industrial manufacturing, social, and home environments, it is imperative that they seamlessly and safely collaborate with humans. This would allow us to take advantage of the speed and precision of robots as well as the flexibility of humans for completing tasks.
In this project, we aim to enable robots with two capabilities. First, to proactively collaborate with humans instead of passively reacting to the human's actions, and second to stay safe around the human while accounting for multiple possible intentions the human may have.
Proactive Decision Making Around Humans

In this line of work, we focus on enabling a robot to condition its predictions of the human's actions on its own plan. This allows the robot to choose a plan that proactively considers the human's future reaction. The model we propose in this work, called Model-Based Conditional Behavior Prediction, ultimately enables the robot to either influence the human collaborator towards more efficient goals, or automatically switch to staying out of the human's way if they are not influenceable. In a user study, people tend to prefer interacting with our proactive controller in a collaborative goal-reaching task.
Multimodal Safe Control Around Humans

On top of being able to predict the human collaborator's future intentions, we need a method that can still stay safe around the human when we are uncertain about their intentions. In this work, we introduce a modification to the Safe Set Algorithm (SSA) that is compatible with keeping a Guassian Mixture Model (GMM) as the uncertainty model of the human. This means the robot is both uncertain about what the human's goal is and how they will move to reach that goal. Our proposed method,called the Multimodal Safe Set Algorithm (MMSSA), guarantees safety up to a desired probability without making the robot overly conservative.
Publications:
-
[C72] Towards Proactive Safe Human-Robot Collaborations via Data-Efficient Conditional Behavior Prediction
Ravi Pandya, Zhuoyuan Wang, Yorie Nakahira and Changliu Liu
IEEE International Conference on Robotics and Automation, 2024
-
[C66] Multimodal Safe Control for Human-Robot Interaction
Ravi Pandya, Tianhao Wei and Changliu Liu
American Control Conference, 2024
Research portfolio
2023–Now
Prompt-to-Product: Unleashing Creativity with AI and Robots
CMU Manufacturing Futures Institute
2023–Now
Humanoid Robots: Safety and Dexterity
2023–Now
Neural-Symbolic Robotics: Learning and Reconfiguring Task Structure
2022–Now
Toward Lifelong Safety of Autonomous Systems in UIE
National Science Foundation
2025–2026
PerSEVE (Perception by Segmentation, Extensible Visual Ecosystem)
Advanced Robotics for Manufacturing Institute
2024–2026
Koopman Theory for Robot Learning and Control
2023–2025
State-wise Safe and Robust Reinforcement Learning for Continuous Control
2021–2025
Real-Time Systems for Human-Robot Interaction and Industrial Metaverse
Siemens
2023–2024
Enhancing and Verifying the Robustness of Learning-based Systems
The Boeing Company
2019–2024
Automatic Onsite Grinding of Large Complex Surfaces
Advanced Robotics for Manufacturing Institute
2022–2023
Proactive Safe Human-Robot Interaction
CMU Manufacturing Futures Institute
Current project
2020–2022
Safe Uncaged Industrial Robots
Ford Motor Company
2020–2021
Hierarchical Motion Planning for Efficient and Provably Safe HRI
Amazon Research Award
2019–2021
6DoF Robot Assembly Station of Consumer Electronic Production
Efort
2019
Adaptable Behavior Prediction for Autonomous Driving
Holomatic
2012–2018
Past Projects