Getting Started Tutorial: Vision-Guided Robotic Picking of Metal Parts (Standard Interface Communication)
In this tutorial, you will learn how to deploy a simple 3D vision-guided robotic application of picking small metal parts in the Standard Interface communication mode.
Application Overview
-
Camera: Mech-Eye PRO M camera, mounted in eye to hand (ETH) mode
-
Robot: YASKAWA_GP8
-
Workpiece: track links (made of metal)
-
End tool: gripper
-
Used software: Mech-Vision 1.7.4, Mech-Viz 1.7.4, Mech-Center 1.7.4, and Mech-Eye Viewer 2.1.0
-
Communication mode: Standard Interface communication
If you are using a different camera model, robot brand, or workpiece than in this example, please refer to the reference information provided in the corresponding steps to make adjustments. |
How to Deploy a Vision-Guided Robotic Application?
The deployment of the vision-guided robotic application can be divided into five phases, as shown in the figure below:
The following table describes the five phases of deploying a vision-guided robotic application.
No. | Phase | Description |
---|---|---|
1 |
Vision system hardware setup |
Install and connect hardware of the Mech-Mind Vision System. |
2 |
Robot communication setup |
Load the robot Standard Interface program and the configuration files to the robot system and set up the communication between the vision side and the robot. |
3 |
Hand-eye calibration |
Perform the automatic hand-eye calibration in the eye-to-hand setup, to establish the transformation relationship between the camera reference frame and the robot reference frame. |
4 |
Workpiece locating |
Use the “General Workpiece Recognition” case project to calculate the workpiece poses and output the vision result. |
5 |
Pick and place |
Prepare a robot pick-and-place program that allows the robot to pick and place workpieces under the guidance of the obtained vision result. |
Next, follow subsequent sections to complete the application deployment.