Inspection and Maintenance
On-site equipment needs to be checked according to the inspection standards. Within the specified period, use the correct methods to inspect the hardware and software of the vision system to detect potential faults early and perform timely maintenance and adjustments.
Category | Item | Inspection | Inspection Frequency |
---|---|---|---|
Camera enclosure |
Check whether the camera has collided with other things |
Once a day |
|
Camera cables |
Check whether camera cables are aging |
Once a day |
|
Check whether connections at both ends of the camera cables are secure |
Once a day |
||
Check whether cables are bent, twisted, or worn |
Once a day |
||
Camera mounting frame |
Visually observe whether the camera mounting frame shows any signs of deformation or movement and whether the connecting bolts are loose |
Once every two weeks |
|
IPC |
Check whether the IPC is placed in a well-ventilated environment |
Once every week |
|
Restart the IPC |
Once every week |
||
Peripheral devices of the IPC |
Check for any looseness at the cable interfaces |
Once every week |
|
Network switch |
Check whether the network switch works normally |
Once every week |
|
Robot base |
Check whether the robot base is shaking |
Once every six months |
|
Robot zero position |
Check if the zero position of the robot is offset |
Once every six months |
|
Camera intrinsic parameters |
Check whether the camera intrinsic parameters have degraded |
Once every six months |
|
Camera extrinsic parameters |
Check whether the camera extrinsic parameters have degraded |
Once every six months |
Camera and Accessory Inspection
Camera enclosure
The camera enclosure is a crucial structure that protects the internal precision components and maintains the camera’s sealed condition. It requires regular daily maintenance and care. The recommended inspection frequency is once a day.
Collision of the camera can be assessed by visually inspecting for any dents, deformations, or scratches on its exterior. If a collision has occurred, you need to check whether the accuracy of the intrinsic and extrinsic parameters have changed using the software. If so, you should stop using it to ensure safety, and the camera should be replaced or the extrinsic parameters should be re-calibrated as soon as possible. (For specific procedures on checking intrinsic and extrinsic parameters, please refer to the “Camera Intrinsic and Extrinsic Parameter Inspection” section.)
Camera cables
Camera cables include the power cable and the Ethernet cable. The power cable provides the stable voltage required for the 3D camera, while the Ethernet cable ensures a stable data transmission environment for communication between the 3D camera and the IPC. Both need to be inspected regularly as part of daily maintenance. The recommended inspection frequency is once a day.
It is necessary to regularly check whether cables are aging and the connections at both ends of the camera cables are secure. If the cables run through a robot dresspack, in addition to checking the connections at both ends, you should also check whether the cables show signs of bending, twisting, or wear according to the wear of dresspacks. If any issues are found, please contact Mech-Mind to change cables.
Disconnect the power supply if the camera will not be used for an extended period of time. |
Camera mounting frame
Camera mounting frame is a crucial mounting structure for the 3D camera. The stability of the frame directly affects the accuracy of the 3D camera’s extrinsic parameters, so it needs to be inspected regularly. The recommended inspection frequency is once every two weeks.
You can determine if the camera is securely mounted by visually observing whether the camera mounting frame shows any signs of deformation or movement and whether the connecting bolts are loose. If the inspection fails, you need to check whether the accuracy of the intrinsic and extrinsic parameters have changed using the software. If so, you should stop using it to ensure safety, and the extrinsic parameters should be re-calibrated as soon as possible. (For specific procedures on checking intrinsic and extrinsic parameters, please refer to the “Camera Intrinsic and Extrinsic Parameter Inspection” section.)
IPC and Network Switch Inspection
-
3D vision software is installed on the IPC, and the IPC’s status directly affects the performance and computation time of the vision software. To ensure that the IPC can run smoothly, it is necessary to perform daily inspections regularly. The recommended inspection frequency is once every week.
-
Network switch and Ethernet cables are used for network connections between hardware. Regular inspections can help reduce network communication failures. The recommended inspection frequency is once every week.
-
Peripheral devices of the IPC: Key components include the IPC power supply, Ethernet cables, and license dongles; non-key components include keyboard and mouse cables, and HDMI video cables. To ensure stable operation of the IPC, regularly check for any looseness at the cable interfaces. The recommended inspection frequency is once every week.
-
It is recommended to place the IPC in a well-ventilated environment and regularly restart the IPC to ensure that it can run more stably. Ensure that the IPC is not placed in a confined or small space, and avoid placing unrelated items on its surface. The cooling vents of the IPC must remain unobstructed, and there should be at least a 5 cm clearance around the IPC to prevent overheating. The recommended inspection frequency is once every week.
Robot Inspection
The robot is the execution mechanism of the workflow, and its accuracy directly affects picking accuracy.
-
Robot base: Check whether the robot base is shaking. If so, stop using the robot, re-secure the foundation, and re-calibrate the extrinsic parameters. The recommended inspection frequency is once every six months.
-
Robot zero position: Robot zero-point offset can cause changes in robot accuracy. Please check the zero position by referring to the operation guide of the current robot. If there is a zero-point offset in the robot, stop using it, and re-calibrate the zero position, and the extrinsic parameters. The recommended inspection frequency is once every two months.
Camera Intrinsic and Extrinsic Parameter Inspection
For camera software, primarily check its intrinsic and extrinsic parameters. The two parameters will affect the accuracy of vision recognition. The recommended inspection frequency is once every two months. (Checking the intrinsic and extrinsic parameters of the camera requires using vision software. Please operate under the guidance of a technician.)
In addition, please preheat the camera before checking the camera’s intrinsic and extrinsic parameters. The camera cannot effectively guarantee the accuracy of point cloud reconstruction until thermal balance is reached. Please use one of the following methods to warm up the camera:
|
Intrinsic Parameter Check Method
Place the calibration board directly below the camera, ensuring the distance between the board and the camera is as close to the camera’s focal length as possible. The calibration board should be as parallel as possible to the underside of the camera, and then proceed with the software operations.
-
Open the Mech-Vision software, select the project, click the Camera Calibration button, select New calibration, and then click the Next button.
-
After confirming that pre-calibration checks are completed, click I’ve finished all checks, and then click Next.
-
Select the robot model based on the site conditions and then click the corresponding button.
-
Select the camera’s mounting method (choose Eye to Hand if the camera is mounted on a fixed frame, or Eye in Hand if it is mounted on the robot), and then click the corresponding button.
-
In the Connect to camera step, select the corresponding camera→Click the “connect” button→Capture once. Then click the Next button after confirming that the 2D image and depth map of the camera are normal.
-
In the Mount Calibration Board & Check Intrinsic Parameters step, select the corresponding calibration board model (the model is labeled on the board), and click Capture live, ensuring that the calibration board is within the red frame in the right-side view. Then, click the Stop capturing and detect position button.
-
Click Check intrinsic parameters.
If the detection is successful, it will display as shown below. If the intrinsic parameter error exceeds the normal range, the displayed information will turn red. In this case, you will need to investigate the issue and recalibrate the camera’s intrinsic parameters.
If a detection failure occurs as shown below, click OK, and then proceed with the operation of drawing an aid circle.
-
If the intrinsic parameter check fails, you can draw an aid circle: Click the “Draw an aid circle” button→Use the mouse to draw a circle around a white dot on the right-side calibration board→Click “Check again”.
Extrinsic Parameter Check Method (Only Applicable When the Robot Has a Model)
You can roughly check extrinsic parameters by checking the coincidence degree between the point cloud of the robot and the robot model. For high-precision scenarios (within ±2mm), you can use the extrinsic parameter accuracy validation tool to thoroughly validate the extrinsic parameters.
Roughly Check Coincidence Degree between the Point Cloud of the Robot and the Robot Model (ETH)
-
Move the robot body (its fifth axis is recommended) into the camera’s field of view.
-
Open Mech-Vision, and click the Camera Calibration button in the toolbar.
-
In the Configuration before Calibration window, select Load calibration parameters in the Select how to calibrate step, select Continue working on the calibrated camera in the Select calibration usage step, select Re-calibrate extrinsic parameters in the Select calibration task step, and then click the Calibrate button.
-
In the Calculate extrinsic parameters step of the Calibration window, click the Capture by camera button in the 2 Auxiliary tool area. This operation will trigger the camera to capture images.
-
In the right Scene viewer panel, visually check coincidence degree between the point cloud of the real robot and the robot model.
If the point cloud of the robot roughly coincides with the robot model, the calibration is successful.
Roughly Check Coincidence Degree between the Point Cloud of the Robot and the Robot Model (EIH)
-
Move the robot end effector to a position where the camera can capture the robot base.
-
Open Mech-Vision, select the project in the project list, and then click the Camera Calibration button in the toolbar.
-
In the Configuration before Calibration window, select Load calibration parameters in the Select how to calibrate step, select Continue working on the calibrated camera in the Select calibration usage step, select Re-calibrate extrinsic parameters in the Select calibration task step, and then click the Calibrate button.
-
In the Calculate extrinsic parameters step of the Calibration window, click the Capture by camera button in the 2 Auxiliary tool area. This operation will trigger the camera to capture images.
-
In the right Scene viewer panel, visually check coincidence degree between the point cloud of the real robot and the robot model.
If the point cloud of the robot roughly coincides with the robot model, the calibration is successful.
Use the Extrinsic Parameter Accuracy Validation Tool to Validate Extrinsic Parameters
For high-precision scenarios (within ±2mm), this method should be used to thoroughly validate the extrinsic parameters.
-
Open Mech-Vision, and click the Camera Calibration button in the toolbar.
-
In the Configuration before Calibration window, select Load calibration parameters in the Select how to calibrate step, select Continue working on the calibrated camera in the Select calibration usage step, select Re-calibrate extrinsic parameters in the Select calibration task step, and then click the Calibrate button.
-
In the Calculate extrinsic parameters step of the Calibration window, click the Calculate extrinsic parameters button.
-
In the 2 Auxiliary tool area, click Extrinsic parameter accuracy to open the extrinsic parameter accuracy validation tool.
-
Please refer to the tool’s guidance to validate the extrinsic parameter accuracy and generate the final evaluation report.