Contact-consistent visual object pose estimation for contact-rich robotic manipulation tasks
Article publication date: 20 May 2022
Issue publication date: 19 July 2022
The purpose of this paper is to estimate the contact-consistent object poses during contact-rich manipulation tasks based only on visual sensors.
The method follows a four-step procedure. Initially, the raw object poses are retrieved using the available object pose estimation method and filtered using Kalman filter with nominal model; second, a group of particles are randomly generated for each pose and evaluated the corresponding object contact state using the contact simulation software. A probability guided particle averaging method is proposed to balance the accuracy and safety issues; third, the independently estimated contact states are fused in a hidden Markov model to remove the abnormal contact state observations; finally, the object poses are refined by averaging the contact state consistent particles.
The experiments are performed to evaluate the effectiveness of the proposed methods. The results show that the method can achieve smooth and accurate pose estimation results and the estimated contact states are consistent with ground truth.
This paper proposes a method to obtain contact-consistent poses and contact states of objects using only visual sensors. The method tries to recover the true contact state from inaccurate visual information by fusing contact simulations results and contact consistency assumptions. The method can be used to extract pose and contact information from object manipulation tasks by just observing the demonstration, which can provide a new way for the robot to learn complex manipulation tasks.
The research is jointly funded by Major Innovation Engineering Project of Shandong Province (2019JZZY010128) and Fundamental Research Funds for the Central Universities (N2104008 and N2003003).
Tian, Z., Cheng, H., Du, Z., Jiang, Z. and Wang, Y. (2022), "Contact-consistent visual object pose estimation for contact-rich robotic manipulation tasks", Assembly Automation, Vol. 42 No. 4, pp. 397-410. https://doi.org/10.1108/AA-10-2021-0128
Emerald Publishing Limited
Copyright © 2022, Emerald Publishing Limited