Hand-Eye Calibration
In this tutorial, you will perform the automatic hand-eye calibration in the eye-to-hand setup.
|
The hand-eye calibration establishes the transformation relationship between the camera and robot reference frames (that is camera extrinsic parameters). With this relationship, the object pose determined by the vision system can be transformed into that in the robot reference frame, which guides the robot in performing its tasks. |
Preparation before Calibration
In this section, you will install the calibration board, adjust camera parameters, and save and pre-calibration configurations.
Prepare the Materials Required for Calibration
The automatic hand-eye calibration in the ETH setup needs to use the calibration board.
Please prepare the calibration board according to the following requirements:
-
Ensure that the circles of the calibration board are clearly visible and without obvious scratches, and the board does not suffer from deformations.
-
In the ETH setup, mount the robot-specific bracket for calibration board onto the robot flange, and then mount the calibration board onto the bracket. Make sure that the calibration board is attached securely, and that the board is parallel to the XY plane of the robot flange frame.
If an undetachable gripper is connected to the robot flange, you can attach the calibration board directly to the gripper.
Check the Point Cloud Quality of the Calibration Board (Optional)
| The point cloud quality of the calibration board will affect the accuracy of hand-eye calibration. Check the point cloud quality of the calibration board to ensure the accuracy and reliability of the calibration results. The calibration process includes the step of checking the point cloud quality of the calibration board. You can also check the point cloud quality of the calibration board before starting the calibration to save time. |
-
Place the calibration board at the center of the working plane within the camera’s field of view.
-
Open the Mech-Eye Viewer software, select the camera used by the project and adjust camera parameters.
-
Adjust the 2D parameters to ensure that the overall 2D image is not too dark, and each calibration circle is clearly visible.
Normal Overexposed Underexposed 
-
Adjust the 3D parameters to ensure that each calibration circle on the calibration board is complete and visible.
If the on-site ambient lights are not ideal and affect the quality of 2D images and point clouds, you can use shading or supplemental light to improve the lighting conditions.
Point cloud complete Point cloud incomplete Point cloud incomplete 
-
Complete Pre-calibration Checks
Before calibration, confirm that the following checks have been completed:
Pre-calibration Configuration
-
In Mech-Vision, click theCamera Calibration button on the toolbar to open the Configuration before Calibration window.
-
After confirming that pre-calibration checks are completed, click I’ve finished all checks, and then click Next.
-
In the Select how to calibrate window, select the New calibration radio button, and then click the Next button.
-
In the Select calibration task window, confirm that the robot model is “ABB_IRB6700_150_3_20”, and then click the Next button.
-
In the Select camera setup window, select the Eye to hand radio button, and then click the Next button.
-
In the Calibration method and robot control window, select Automatic and Standard Interface, and then click the Calibrate button. The Calibration (Eye to Hand) window will be prompted.
Till now, you have completed the pre-calibration configuration and can start the calibration procedure.
Calibration Procedure
Connect to a Camera
-
In the Connect to Camera step, find the camera to connect in the Detected Cameras list, and click
.
-
After the camera is connected, click the Capture once or Capture live button.
-
In the right Image viewer panel, ensure that the captured 2D image and point cloud meet the calibration requirements and click the Next button on the bottom bar.
|
If the captured image does not meet the calibration requirements, you need to open the Mech-Eye Viewer software to adjust the 2D and 3D exposure parameters and re-capture images. |
Mount Calibration Board & Check Intrinsic Parameters
-
In the Mount calibration board & check intrinsic parameters step, select the calibration board model for the Standard calibration board model parameter according to its model nameplate in the 1 Select calibration board area.
-
In the 2 Check calibration board position and point cloud quality area, read carefully the requirements on the calibration board position and point cloud quality, and then click the Capture live button. The Capture live button will turn into Stop capturing and detect position.
-
Move the robot carrying the calibration board to an appropriate position, ensuring the calibration board is fully within the red frame, and the distance between the calibration board and the camera is as close to the recommended value as possible.
-
Ensure that the 2D image and depth map of the calibration board meet the requirements, and then click the Stop capturing and detect position button.
If the captured images do not meet the requirements, click Open Mech-Eye Viewer button to open the Mech-Eye Viewer software, adjust the 2D and 3D exposure parameters and re-capture images. Please note that you need to change the Parameter group parameter to “calib” first.
-
In the 3 Check intrinsic parameters area, click the Check intrinsic parameters button.
-
Confirm the results of the camera intrinsic parameter check.
-
If the camera intrinsic parameter check passes, click the OK button in the prompted window, and then click the Next button on the bottom bar.
-
If the intrinsic parameter check fails, adjust the calibration circle detection parameters by drawing aid circles, window=_blank, or modifying detection parameters, window=_blank, and then click the Recheck intrinsic parameters button.
-
| If the camera still cannot pass the intrinsic parameter check after the above operations, the intrinsic parameters of the camera may be problematic and need to be corrected, or contact Mech-Mind Technical Support. |
Connect to the Robot
-
(Optional) In the Connect the robot step, click the Start interface service button. The button will turn intoWaiting for the robot to connect.... If the Standard Interface Communication option on the toolbar was previously enabled, this step is not necessary.
-
On the robot teach pendant, select the automatic calibration program according to Robot Automatic Calibration, teach the start point and run the program.
After the program is started, the log message “Entering the calibration process, please start the calibration in Mech-Vision” will be printed in the Console log panel. -
Return to Mech-Vision, confirm that “Connected” status message is displayed in the Connect the robot area, and click the Next button.
Set Robot Path
-
In the Set robot path step, set the Height span parameter in the 1 Set height span of calibration poses area.
The Height span parameter should be set according to the recommended working distance range of the camera and the size of the robot’s working space.
-
Click the Auto-generate button, and click the OK button in the prompted window Auto align robot path to camera frame.
This operation will slightly move the robot and capture images. The whole process may take 10 to 15 seconds. Please ensure that the motion path is safe. In case of emergency, please tap the emergency stop button on the robot teach pendant to stop the robot immediately. -
In the prompted Calibrate window, click the OK button.
-
In the right Scene viewer panel, confirm that waypoints are reasonable and will not collide with obstacles.
-
Click the Generate motion path based on path parameters button and then click the Next button on the bottom bar.
Obtain Images and Poses
-
In the Obtain Images and Poses step, click the Start calibration button.
-
Read the safety window carefully and click the OK button.
-
Wait until the robot finishes moving along the preset path and the camera finishes capturing images on all waypoints. In the right Image viewer panel, all the captured images are displayed.
Please stay away from the robot working area to keep safe. -
After all images are captured, click the OK button in the prompted window.
-
Confirm that the collected calibration data meets the data requirements, and then click the Next button on the bottom bar.
If the requirements are not met, please manually move the robot (through the teach pendant or Mech-Viz), enable the Add more images manually option in the 3 Auxiliary tool, and click the Add images and record flange poses button to add the calibration board image and enter the robot flange pose.
Calculate Extrinsic Parameters
-
In the Calculate extrinsic parameters step, click the Calculate extrinsic parameters button in the 1 Calculate extrinsic parameters and check results area.
-
In the prompted window indicating calibration success, click the OK button.
-
Click the Save button on the bottom bar. In the prompted Save Calibration Files dialog box, click the OK button. The camera calibration result will be automatically saved in the “calibration” directory of the project.
For details on how to validate the calibration results, please refer to Validate Calibration Results.
Now you have completed the hand-eye calibration in the eye-to-hand setup.