Asymptotic trajectory tracking of manipulators using uncalibrated visual feedback

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

67 Scopus Citations
View graph of relations



Original languageEnglish
Pages (from-to)87-98
Journal / PublicationIEEE/ASME Transactions on Mechatronics
Issue number1
Publication statusPublished - Mar 2003


To implement a position-based visual feedback controller for a manipulator, it is necessary to calibrate the homogeneous transformation matrix between its base frame and the vision frame besides intrinsic parameters of the vision system. The accuracy of such a calibration greatly affects the control performance. Substantial efforts must be made to obtain a highly accurate transformation matrix. In this paper, we propose an adaptive visual feedback controller for manipulators when the homogeneous transformation matrix is not calibrated. It is assumed that the vision system can measure the three dimensional position and orientation of the manipulator in real-time. Based on an important observation that the unknown transformation matrix can be separated from the visual Jacobian matrix, we propose an adaptive algorithm, similar to the model-based adaptive algorithm, to estimate the unknown matrix on-line. The use of the proposed visual feedback controller greatly simplifies the implementation of a manipulator-vision workcell. This controller is especially useful when such a pre-calibration is not possible. It is proved by Lyapunov approach that the motion of the manipulator approaches asymptotically to the desired trajectory. Simulations and experimental results are included to demonstrate performance of this adaptive visual feedback controller.

Research Area(s)

  • Adaptive algorithm, Homogeneous transformation matrix, Manipulators, Trajectory tracking, Visual feedback