Manual Calibration in the Eye-to-Hand Setup (Four-Axis Robots - Using Multiple Random Calibration Board Poses Method)

This how-to guide introduces how to complete the manual calibration for four-axis robots using the multiple random calibration board poses method in the eye-to-hand (ETH) setup.

Preparation before Calibration

Before hand-eye calibration, you need to finish the following preparations:

Construct the Vision System

Construct the Mech-Mind Vision System by referring to the section Vision System Hardware Setup.

You need to use Mech-Eye Viewer, Mech-Vision and Mech-Viz during hand-eye calibration. Please ensure that they have been installed and are running the latest versions.

Prepare the Materials Required for Calibration

The hand-eye calibration in the ETH setup needs to use the calibration board.

Please prepare the calibration board according to the following requirements:

  • Ensure that the circles of the calibration board are clearly visible and without obvious scratches, and the board does not suffer from deformations.

  • In the ETH setup, mount the robot-specific bracket for calibration board onto the robot flange, and then mount the calibration board onto the bracket. Make sure that the calibration board is attached securely, and that the board is parallel to the XY plane of the robot flange frame.

    If an undetachable gripper is connected to the robot flange, you can attach the calibration board directly to the gripper.

In addition, before calibration, move the robot to the starting point for calibration.

Check the Point Cloud Quality of the Calibration Board (Optional)

The point cloud quality of the calibration board will affect the accuracy of hand-eye calibration. Check the point cloud quality of the calibration board to ensure the accuracy and reliability of the calibration results. The calibration process includes the step of checking the point cloud quality of the calibration board. You can also check the point cloud quality of the calibration board before starting the calibration to save time.
  1. Place the calibration board at the center of the working plane within the camera’s field of view.

  2. Open the Mech-Eye Viewer software, select the camera used by the project and adjust camera parameters.

  3. Adjust the 2D parameters to ensure that the overall 2D image is not too dark, and each calibration circle is clearly visible.

  4. Adjust the 3D parameters to ensure that each calibration circle on the calibration board is complete and visible.

    If the on-site ambient lights are not ideal and affect the quality of 2D images and point clouds, you can use shading or supplemental light to improve the lighting conditions.

  5. Make sure that the point cloud quality of the calibration board is up to standard after completing the preceding steps.

    Normal Overexposed Underexposed

    2D image

    normal-2d

    overexposure-2d

    underexposure-2d

    Point cloud

    normal-3d

    overexposure-3d

    underexposure-3d

Complete Pre-calibration Checks

Please refer to Pre-calibration Checks and complete the following checks:

  • Confirm that the robot base is mounted securely.

  • Confirm that the camera mounting frame and camera are mounted securely.

  • Confirm that the calibration board is mounted securely at the end of the robot (ETH).

  • Confirm that the absolute accuracy of the robot meets the requirements for use.

  • Verify robot model parameters.

  • Confirm that the camera is warmed up.

Configuration before Calibration

  1. Open Mech-Vision, and click the Camera Calibration button in the toolbar. The Configuration before Calibration window will be prompted.

  2. After confirming that Pre-calibration checks are completed, click I’ve finished all checks, and then click Next.

    calib preset confirm checks
  3. In the Select how to calibrate window, select the New calibration radio button, and then click the Next button.

    calib preset new
  4. In the Select calibration task window, select Hand-eye calibration for custom robot from the drop-down list box, specify the Robot Euler angle convention parameter, select the robot coordinate system type, and then click the Next button.

    calib preset manual select task
  5. In Select a robot type for calibration window, select the 4-axis robot (SCARA, Palletizer) radio button, and then click the Next button.

    calib preset manual select 4 axis
  1. In the Select camera setup window, select the Eye to hand radio button, and then click the Next button.

    calib preset eth
  2. In the Select how to collect data window, select the Multiple random calibration board poses, and then click the Calibrate button. The Calibration (Eye to Hand) window will be prompted.

    calib preset manual select randompose

Till now, you have completed the pre-calibration configuration and can start the calibration procedure.

Calibration Procedure

Connect to Camera

  1. In the Connect to camera step, select the camera to connect in the Camera ID list, and then click the connect camera icon button or double-click the camera entry to connect to it.

    calib connect camera
  2. After the camera is connected, click the Capture once or Capture live button.

    calib image capture
  3. In the Image viewer panel, ensure that the camera can capture images normally and click the Next button on the bottom bar.

Mount Calibration Board & Check Intrinsic Parameters

  1. In the Mount calibration board & check intrinsic parameters step, select the calibration board model for the Standard calibration board model parameter according to its model nameplate in the 1 Select calibration board area.

    calib select calib board
  2. In the 2 Check calibration board position and point cloud quality area, read carefully the requirements on the calibration board position and point cloud quality, and then click the Capture continually button. The Capture continually button will turn into Stop capturing and detect position.

  3. Move the robot carrying the calibration board to an appropriate position, ensuring the calibration board is fully within the red frame, and the distance between the calibration board and the camera is as close to the recommended value as possible.

    calib install calib board
    If the calibration is performed under Standard Interface communication, you should modify the calibration start point in the calibration program.
  4. Please ensure that the 2D image and depth map of the calibration board meet the requirements, and then click the Stop capturing and detect position button.

    If the captured images do not meet the requirements, click Open Mech-Eye Viewer button to open the Mech-Eye Viewer software, adjust the 2D and 3D exposure parameters and re-capture images. Please note that you need to change the Parameter group parameter to “calib” first.

  5. In the 3 Check intrinsic parameters area, click the Check intrinsic parameters button.

  6. Confirm the results of the camera intrinsic parameter check.

    • If the camera intrinsic parameter check passes, click the OK button in the prompted window, and then click the Next button on the bottom bar.

      calib check intri pass
    • If the camera intrinsic parameter check fails, adjust detection parameters by drawing aid circles or manually adjusting the calibration circle detection parameters, and then click the Recheck intrinsic parameters button.

Draw an Aid Circle

  1. To draw an aid circle, click the Draw an aid circle button.

  2. In the right Image viewer panel, right-click the calibration board image, clear the Fit to window checkbox, press the Ctrl key and drag the roller to adjust the image to a suitable size.

  3. Move the mouse pointer to the cross center point of the calibration circle, press the left mouse button and make the aid circle completely include the calibration circle and then release it.

    calib adjust blob
  4. Click the Recheck intrinsic parameters button, and confirm that the camera intrinsic parameter check passes.

Manually Adjust Detection Parameters

To manually adjust detection parameters, click Calibration circle detection parameters (advanced), adjust parameter settings and click the Recheck intrinsic parameters to confirm whether the camera intrinsic parameter check passes.

If the calibration circles are still not detected, please adjust the camera settings according to the on-site operating conditions.

Obtain Images and Poses

  1. In the Obtain Images and Poses step, control the robot to move to different calibration points and then click the Add images and record flange poses button.

    calib manual randomposes add poses
    After moving the robot to different calibration points, please record the pose of each point in the robot program for easy retrieval during re-calibration.
  2. In the prompted window, enter the robot flange pose.

    calib manual add flange pose
    Please create a new local file (.txt or .xlsx) to save the input robot flange poses for easy entry during re-calibration.
  3. Repeat the above steps until the added calibration points meet the data requirements. Then click the Next button on the bottom bar.

Calculate Extrinsic Parameters

  1. In the Calculate extrinsic parameters step, click the Calculate extrinsic parameters button in the 1 Calculate extrinsic parameters and check results area.

    calib calculate extri randompose 4 axis
  1. In the prompted window indicating calibration success, click the OK button.

  2. Follow the instructions on correcting the Z-value in extrinsic parameters in the 2 Auxiliary tool area to calculate the Z-value compensation in extrinsic parameters.

    Due to the lack of degrees of freedom in rotation in four-axis robots, the captured images during calibration may lack the images for calibration board rotation. After calibration, you need to correct the Z-value in extrinsic parameters.
  3. Click the Save button on the bottom bar. In the prompted Save Calibration Files dialog box, click the OK button. The camera calibration result will be automatically saved in the “calibration” directory of the project.

    calib save calib result

Till now, the calibration process is completed.

Validate Calibration Results

This section provides methods for quickly validating calibration results.

View Error Point Cloud in Point Cloud Viewer

After calculating the camera extrinsic parameters, please perform the following operation:

  1. In the Calculate extrinsic parameters step, view the error point cloud in the right Point cloud viewer panel after the calibration calculation is complete.

    The error point cloud shows the deviation between the calculated value and the actual value of the circles on the calibration board. For the detailed description, please refer to Error Point Cloud Description.
  2. Confirm that the calibration accuracy meets the project’s requirements. Find the error value with the 100% percentage to get the rough calibration accuracy.

For example, the calibration accuracy in the image below is within ±2.5 mm (using the method of multiple random calibration board poses to collect calibration data).

check error point cloud randompose

Roughly Check Coincidence Degree between the Point Cloud of the Robot and the Robot Model in Scene Viewer

After calculating the camera extrinsic parameters, please perform the following operation:

  1. After calibration, move the robot arms into the field of view of the camera.

  2. In the Calculate extrinsic parameters step, click the Capture by camera button in the 2 Auxiliary tool area. This operation triggers the camera to capture images.

  3. In the right Scene viewer panel, visually check coincidence degree between the point cloud of the real robot and the robot model.

    If the point cloud of the robot roughly coincides with the robot model, the calibration is successful.

    check coincidence degree arm

Use the Extrinsic Parameter Accuracy Validation Tool to Validate Extrinsic Parameters

For high-precision scenarios (within ±2mm), this method should be used to thoroughly validate the extrinsic parameters.

In the Calculate extrinsic parameters step, click Extrinsic parameter accuracy to open the tool. Please refer to the tool’s guidance to validate the extrinsic parameter accuracy and generate the final evaluation report.

If the calibration accuracy does not meet the requirements, you can click the Check report on extrinsic parameter calibration button to view the results of Euler angle convention check, camera accuracy check, and robot absolute accuracy check.

eth calib auto extri calib report
  • If the camera accuracy in the report does not meet the requirements, please follow the recommendation to troubleshoot the camera accuracy errors.

  • To evaluate the robot’s absolute accuracy and extrinsic parameter accuracy, you can click Robot absolute accuracy and repeatability and Extrinsic parameter accuracy in the 2 Auxiliary tool area.

  • If the calibration results still do not meet the accuracy requirements after addressing issues suggested in the extrinsic parameter calibration report, please refer to the Calibration Result Analysis section for improvement.

Change the Extrinsic Parameter File

If the camera’s extrinsic parameter file has been used by a Mech-Vision project, you need to change the extrinsic parameter file used by the Mech-Vision project to a new one after you finish the hand-eye calibration.

  1. Select the Capture Images from Camera Step.

    change calibration parameter group
  2. In the Step Parameters panel, click change calibration parameter group icon of the Calibration Parameter Group parameter, and select the newly calibrated extrinsic parameter file.

We Value Your Privacy

We use cookies to provide you with the best possible experience on our website. By continuing to use the site, you acknowledge that you agree to the use of cookies. If you decline, a single cookie will be used to ensure you're not tracked or remembered when you visit this website.