Integrating Uncertainty-Aware Human Motion Prediction Into Graph-Based Manipulator Motion Planning


Journal article


Wansong Liu, Kareem A. Eltouny, Sibo Tian, Xiao Liang, Minghui Zheng
IEEE/ASME transactions on mechatronics, 2024

Semantic Scholar ArXiv DBLP DOI
Cite

Cite

APA   Click to copy
Liu, W., Eltouny, K. A., Tian, S., Liang, X., & Zheng, M. (2024). Integrating Uncertainty-Aware Human Motion Prediction Into Graph-Based Manipulator Motion Planning. IEEE/ASME Transactions on Mechatronics.


Chicago/Turabian   Click to copy
Liu, Wansong, Kareem A. Eltouny, Sibo Tian, Xiao Liang, and Minghui Zheng. “Integrating Uncertainty-Aware Human Motion Prediction Into Graph-Based Manipulator Motion Planning.” IEEE/ASME transactions on mechatronics (2024).


MLA   Click to copy
Liu, Wansong, et al. “Integrating Uncertainty-Aware Human Motion Prediction Into Graph-Based Manipulator Motion Planning.” IEEE/ASME Transactions on Mechatronics, 2024.


BibTeX   Click to copy

@article{wansong2024a,
  title = {Integrating Uncertainty-Aware Human Motion Prediction Into Graph-Based Manipulator Motion Planning},
  year = {2024},
  journal = {IEEE/ASME transactions on mechatronics},
  author = {Liu, Wansong and Eltouny, Kareem A. and Tian, Sibo and Liang, Xiao and Zheng, Minghui}
}

Abstract

There has been a growing utilization of industrial robots as complementary collaborators for human workers in remanufacturing sites. Such a human–robot collaboration (HRC) aims to assist human workers in improving the flexibility and efficiency of labor-intensive tasks. In this article, we propose a human-aware motion planning framework for HRC to effectively compute collision-free motions for manipulators when conducting collaborative tasks with humans. We employ a neural human motion prediction model to enable proactive planning for manipulators. Particularly, rather than blindly trusting and utilizing predicted human trajectories in the manipulator planning, we quantify uncertainties of the neural prediction model to further ensure human safety. Moreover, we integrate the uncertainty-aware prediction into a graph that captures key workspace elements and illustrates their interconnections. Then, a graph neural network (GNN) is leveraged to operate on the constructed graph. Consequently, robot motion planning considers both the dependencies among all the elements in the workspace and the potential influence of future movements of human workers. We experimentally validate the proposed planning framework using a 6-degree-of-freedom manipulator in a shared workspace where a human is performing disassembling tasks. The results demonstrate the benefits of our approach in terms of improving the smoothness and safety of HRC. A brief video introduction of this work is available as the supplemental materials.