Simultaneous Hand-Eye/Robot-World/Camera-IMU Calibration

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

10 Scopus Citations
View graph of relations


  • Ming Liu


Original languageEnglish
Pages (from-to)2278-2289
Journal / PublicationIEEE/ASME Transactions on Mechatronics
Issue number4
Online published11 Aug 2021
Publication statusPublished - Aug 2022


The problem of calibrating an extrinsic parameter between a camera and an inertial measurement unit (IMU) using an industrial robotic manipulator has been studied. This generates a result of hand-eye/robot-world/camera-IMU calibration in a simultaneous fashion. The developed method is free of inertial integration over time and, thus, is robust to uncertain IMU biases. It is derived that the problem can be solved via a simultaneous optimization of hand-eye/robot-world/camera-IMU transformations. The resulted optimization is highly nonconvex on the special Euclidean group, and we give globally optimal solutions. Experiments verify that the proposed method is capable of estimating accurate calibration parameters. Comparative studies between representatives show the global optimality of the proposed method. The new simultaneous method is capable of conducting calibration of a robot/camera/IMU combination. The designed method guarantees the global optimality; thus, the accuracy is ensured. The developed globally optimal solutions will also be computationally efficient on modern industrial computers. Finally, we show that the proposed method can give accurate calibration results for a stereo/IMU sensor combination.

Research Area(s)

  • Camera-IMU calibration, hand-eye calibration, industrial robotic manipulator, nonconvex optimization, pose estimation

Citation Format(s)

Simultaneous Hand-Eye/Robot-World/Camera-IMU Calibration. / Wu, Jin; Wang, Miaomiao; Jiang, Yi et al.
In: IEEE/ASME Transactions on Mechatronics, Vol. 27, No. 4, 08.2022, p. 2278-2289.

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review