Manual Hand-Eye Re-Calibration in the Eye-to-Eye Setup

This how-to guide introduces how to complete the manual hand-eye calibration in the eye-to-eye (ETE) setup.

Preparation before Calibration

Prepare the Materials Required for Calibration

The hand-eye calibration in the ETE setup needs to use the calibration board. Please prepare the calibration board according to the following requirements:

  • Ensure that the circles of the calibration board are clearly visible and without obvious scratches, and the board does not suffer from deformations.

  • In the ETE setup, mount the robot-specific bracket for calibration board onto the robot flange, and then mount the calibration board onto the bracket. Make sure that the calibration board is attached securely, and that the board is parallel to the XY plane of the robot flange frame.

    If an undetachable gripper is connected to the robot flange, you can attach the calibration board directly to the gripper.

In addition, before calibration, move the robot to the starting point for calibration, that is, the bottom middle of the overlapped area of the two cameras’ field of view.

Adjust the Effect of Calibration Board’s Point Cloud

  1. Open Mech-Eye Viewer to adjust camera parameters.

  2. Adjust the 2D parameters to make sure that the 2D image of the calibration board is clear and neither overexposed nor underexposed.

  3. Adjust 3D parameters to make sure that the point clouds of the circles on the calibration board are complete and have clear contours. It is recommended to set Surface Smoothing and Outlier Removal to Normal in the Point Cloud Processing section to reduce the point cloud fluctuation range.

  4. Make sure that the images and point cloud of the calibration board are up to standard after completing the preceding steps.

    Normal Overexposed Underexposed

    2D image

    normal-2d

    overexposure-2d

    underexposure-2d

    Point cloud

    normal-3d

    overexposure-3d

    underexposure-3d

Pre-calibration Configuration

  1. Open Mech-Vision, click the Camera Calibration (Standard) button in the toolbar. The Configuration before Calibration window will be prompted.

  2. In the Select how to calibrate window, select the New calibration radio button, and then click the Next button.

  3. In the Select calibration task window, select Hand-eye calibration for custom robot from the drop-down list box, specify the Robot Euler angle convention parameter, select the robot coordinate system type, and then click the Next button.

  4. In Select a robot type for calibration window, select a robot type among 6-axis robot, 4-axis robot (SCARA, Palletizer) or 5-axis robot or other types radio button, and then click the Next button.

  5. In the Select camera setup window, select the Eye to hand radio button, and then click the Next button.

  6. In the Select how to collect data window, select the Multiple random calibration board poses , and then click the Calibrate button. The Calibration (Eye to Eye) window will be prompted.

Till now, you have completed the pre-calibration configuration and can start the calibration procedure.

Calibration Procedure

Connect to Camera

  1. In the Connect to camera step, select the secondary camera to connect in the Detected cameras list, and then click the connect camera icon button or double-click the camera entry to connect to it.

    calibration ete connect camera ete
  2. Repeat the preceding step to connect to the primary camera. After the primary camera is connected, the calibration ete master camera icon will be displayed before the camera ID.

    To switch the primary camera, select a camera, and then click the Set as main button.

  3. After the camera is connected, click the Capture live or Capture once button.

    calibration ete image capture ete
  4. In the Image viewer panel, ensure that the camera can capture images normally and click the Next button on the bottom bar.

    In this step, the 2D image and depth map are captured only for the primary camera. To confirm the effects of the images captured by the secondary camera, you can switch it to the primary camera, and switch the original primary camera back to the primary camera after confirming.

Mount Calibration Board & Check Intrinsic Parameters

  1. In the Mount calibration board & check intrinsic parameters step, select the calibration board model for the Standard calibration board model parameter according to its model nameplate in the 1 Select calibration board area.

    eth calib manual select calib board random pose
  2. In the 2 Check calibration board position and point cloud quality area, read carefully the requirements on the calibration board position and point cloud quality, and then click the Capture live button. The Capture live button will turn into Stop capturing and detect position.

  3. Control the robot to move the calibration board to the proper position (in the red rectangle), and ensure that the 2D image and depth map of the calibration board meet the requirements, and then click the Stop capturing and detect position button.

    eth calib manual install calib board random pose

    If the captured images do not meet the requirements, click Open Mech-Eye Viewer button to open the Mech-Eye Viewer software, adjust the 2D and 3D exposure parameters and re-capture images. Please note that you need to change the Parameter group parameter to “calib” first.

  4. In the 3 Check intrinsic parameters area, click the Check intrinsic parameters button.

  5. Confirm the results of the camera intrinsic parameter check.

    • If the camera intrinsic parameter check passes, click the OK button in the prompted window, and then click the Next button on the bottom bar.

      eth calib manual check intri pass
    • If the camera intrinsic parameter check fails, adjust detection parameters by drawing aid circles or manually adjusting the calibration circle detection parameters, and then click the Recheck intrinsic parameters button. If the intrinsic parameter check still fails, please contact Technical Support.

Draw Aid Circle

  1. To draw an aid circle, click the Draw an aid circle button.

  2. In the right Image viewer panel, right-click the calibration board image, clear the Fit to window checkbox, press the Ctrl key and drag the roller to adjust the image to a suitable size.

  3. Move the mouse pointer to the cross center point of the calibration circle, press the left mouse button and make the aid circle completely include the calibration circle and then release it.

    eth calib manual adjust blob
  4. Click the Recheck intrinsic parameters button, and confirm that the camera intrinsic parameter check passes.

Manually Adjust Detection Parameters

To manually adjust detection parameters, click Calibration circle detection parameters (advanced), adjust parameter settings and click the Recheck intrinsic parameters button to confirm whether the camera intrinsic parameter check passes.

Collect Images and Flange Poses

  1. In the Collect images and flange poses step, select the Save images checkbox (selected by default, recommended). If you do not need to save images of calibration boards, clear this checkbox.

    eth calib manual add image pose random pose
  2. Control the robot to move to different calibration points and then click the Add an image and record flange pose button.

    Please refer to the calibration point poses recorded during the project deployment phase for the robot’s movement calibration.
  3. In the prompted window, enter the robot flange pose.

    eth calib manual add pose random pose
  4. Confirm that the number of the currently recognized calibration circles meets the requirements, and then click the Next button on the bottom bar.

Calculate Extrinsic Parameters

  1. In the Calculate extrinsic parameters step, click the Calculate extrinsic parameters button.

    eth calib manual calculate extri random pose
  2. In the prompted window indicating calibration success, click the OK button.

    eth calib manual confirm calib result
  3. Click the Save button on the bottom bar. In the prompted Save Calibration Files dialog box, click the OK button. The camera calibration result will be automatically saved in the “calibration” directory of the project.

  • In the Collect images and poses step, the software will capture calibration images for the two cameras at the same time and collect the pose data. You can switch the camera in the Calibration image and pose list panel to view the calibration board images and calibration circle data collected for each camera.

  • In the Calculate extrinsic parameters step, the software will calculate the extrinsic parameters for both cameras, and the pose relationship between the two cameras.

Till now, the calibration process is completed.

Calculate Pose Relationship between Cameras from the Calibrated Extrinsic Parameters Directly

After calibrating the extrinsic parameters of the two cameras separately, you can use the ETE calibration procedure to directly calculate the pose relationship between the two cameras.

To do so, follow these steps:

  1. Open Mech-Vision, and click the Camera Calibration (Standard) button in the toolbar. The Configuration before Calibration window will be prompted.

  2. In the Select how to calibrate window, select the New calibration radio button, and then click the Next button.

    calibration calib preset new
  3. In the Select calibration task window, select Hand-eye calibration for custom robot from the drop-down list box, specify the Robot Euler angle convention parameter, select the robot coordinate system type, and then click the Next button.

    calibration calib preset select robot other
  4. In Select a robot type for calibration window, select a robot type among 6-axis robot, 4-axis robot (SCARA, Palletizer) or 5-axis robot or other types radio button, and then click the Next button.

    calibration ete calib preset select robot type
  5. In the Select camera setup window, select the Eye to eye radio button, and then click the Next button.

    calibration ete calib preset ete
  6. In the Select how to collect data window, select the Use calibrated extrinsic parameters for calculation, choose two camera’s extrinsic parameter files, and then click the Calibrate button. The Calibration (Eye to Eye) window will be prompted.

    calibration ete calib preset ete calculate
  7. In the Connect to camera step, select the camera to connect in the Camera ID list, and then click the connect camera icon button to connect to it.

  8. Repeat the preceding step to connect to the second camera, and then click the Next button on the bottom bar.

  9. In the Calculate extrinsic parameters step, click the Calculate extrinsic parameters button.

    calibration ete calcualte extri param ete quick

After the camera extrinsic parameters have been calculated, you can view the fused point cloud in the Point cloud viewer panel.

Change the Extrinsic Parameter File

After hand-eye calibration, it is necessary to change the extrinsic parameter file used in the current Mech-Vision project to a new one.

  1. Select the Capture Images from Camera Step.

    change calibration parameter group
  2. In the Step Parameters panel, click change calibration parameter group icon of the Camera Calibration Parameters parameter, and select the newly calibrated extrinsic parameter file.

Check the Fusion Effect of the Calibration in the ETE Setup Using a Mech-Vision Project

You can build a project as shown in the following figure. Note that the “Trigger Control Flow Given No Output” and “Trigger Control Flow Given Output” options in Execution Flags area should be selected.

calibration ete ete project

Execute the single Step “Merge Point Clouds” to display the fused point cloud. The point cloud output after merging is the fused whole point cloud, as shown in the figure below. You can click the upper left corner View as Whole| 1 | 2 to switch point clouds.

calibration ete converged poin cloud

We Value Your Privacy

We use cookies to provide you with the best possible experience on our website. By continuing to use the site, you acknowledge that you agree to the use of cookies. If you decline, a single cookie will be used to ensure you're not tracked or remembered when you visit this website.