TY - GEN
T1 - Occlusion-Aware Crowd Navigation Using People as Sensors
AU - Mun, Ye Ji
AU - Itkina, Masha
AU - Liu, Shuijing
AU - Driggs-Campbell, Katherine
N1 - This project was supported in part by the Ford-Stanford Alliance and a gift from Mercedes-Benz Research & Development North America, and in part by the National Science Foundation under Grant No. 2143435.
PY - 2023
Y1 - 2023
N2 - Autonomous navigation in crowded spaces poses a challenge for mobile robots due to the highly dynamic, partially observable environment. Occlusions are highly prevalent in such settings due to a limited sensor field of view and obstructing human agents. Previous work has shown that observed interactive behaviors of human agents can be used to estimate potential obstacles despite occlusions. We propose integrating such social inference techniques into the planning pipeline. We use a variational autoencoder with a specially designed loss function to learn representations that are meaningful for occlusion inference. This work adopts a deep reinforcement learning approach to incorporate the learned representation into occlusion-aware planning. In simulation, our occlusion-aware policy achieves comparable collision avoidance performance to fully observable navigation by estimating agents in occluded spaces. We demonstrate successful policy transfer from simulation to the real-world Turtlebot 2i. To the best of our knowledge, this work is the first to use social occlusion inference for crowd navigation. Our implementation is available at https://github.com/yejimun/PaS_CrowdNav.
AB - Autonomous navigation in crowded spaces poses a challenge for mobile robots due to the highly dynamic, partially observable environment. Occlusions are highly prevalent in such settings due to a limited sensor field of view and obstructing human agents. Previous work has shown that observed interactive behaviors of human agents can be used to estimate potential obstacles despite occlusions. We propose integrating such social inference techniques into the planning pipeline. We use a variational autoencoder with a specially designed loss function to learn representations that are meaningful for occlusion inference. This work adopts a deep reinforcement learning approach to incorporate the learned representation into occlusion-aware planning. In simulation, our occlusion-aware policy achieves comparable collision avoidance performance to fully observable navigation by estimating agents in occluded spaces. We demonstrate successful policy transfer from simulation to the real-world Turtlebot 2i. To the best of our knowledge, this work is the first to use social occlusion inference for crowd navigation. Our implementation is available at https://github.com/yejimun/PaS_CrowdNav.
UR - http://www.scopus.com/inward/record.url?scp=85168660186&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85168660186&partnerID=8YFLogxK
U2 - 10.1109/ICRA48891.2023.10160715
DO - 10.1109/ICRA48891.2023.10160715
M3 - Conference contribution
AN - SCOPUS:85168660186
T3 - Proceedings - IEEE International Conference on Robotics and Automation
SP - 12031
EP - 12037
BT - Proceedings - ICRA 2023
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2023 IEEE International Conference on Robotics and Automation, ICRA 2023
Y2 - 29 May 2023 through 2 June 2023
ER -