Picking
The ultimate goal of deploying a 3D vision–guided application is to achieve successful picking. In this phase, you need to build a robot-picking workflow so that the robot can pick objects accurately based on vision results.
Depending on the different robot communication modes selected, the way to build the workflow also varies, as shown in the figure below.
| If the project requires a high picking accuracy, ensure a good picking accuracy of the application during deployment according to the guidance in Topic: Improving Picking Accuracy. |
Build the Picking Workflow in the Standard Interface Communication Mode
If you have chosen to use the Standard Interface communication mode, you need to write a robot picking program for the robot side so that the robot can perform picking tasks under the vision guidance. Mech-Mind offers Standard Interface example programs for supported robots, and you can refer to those programs to write your robot picking program.
When Standard Interface communication is used, the cooperation between Standard Interface and the vision system can be divided into three categories according to the created project and the output result of the vision system:
The following sections introduce the three types of cooperation in detail.
Get Vision Result with Mech-Vision
This mode is used when the robot or PLC triggers the Mech-Vision project and obtains the vision result from Mech-Vision through the Standard Interface commands.
Project to create |
Mech-Vision project |
|---|---|
Result output by the vision system |
Vision result, which can contain one or more vision points, each including pose, label, etc.
|
| The vision result is output by the “Procedure Out” Step of the Mech-Vision project. Note that the Port Type parameter of the “Procedure Out” Step should be set to Predefined (vision result) or Custom. |
The general workflow of using this mode is as follows:
-
The robot or PLC triggers the Mech-Vision project to run through a Standard Interface command.
-
The vision system runs the Mech-Vision project and outputs the vision result.
-
The robot or PLC obtains the vision result through a Standard Interface command.
-
The robot picks under the guidance of the vision result.
You need to write a robot or PLC program to implement the above process. Mech-Mind provides abundant example programs for supported robots or PLCs. Among these example programs, the first one follows the above process. In addition, you can refer to other example programs for more extended functions. For more information about writing robot or PLC programs, refer to Standard Interface Communication.
Get Planned Path from Mech-Viz
This mode is used when the robot or PLC triggers the Mech-Viz project and obtains the planned path from Mech-Viz through the Standard Interface commands.
Project to create |
Mech-Viz and Mech-Vision projects |
|---|---|
Result output by the vision system |
Planned path, consisting of a series of waypoints, each containing data such as robot pose, label, motion type, velocity, etc.
|
|
The general workflow of using this mode is as follows:
-
The robot or PLC triggers the Mech-Viz project to run through a Standard Interface command.
-
The vision system runs the Mech-Viz project and outputs the planned path. When running the Mech-Viz project, Mech-Viz will call the Mech-Vision project to obtain the vision result and then plan the robot motion path based on the vision result.
-
The robot or PLC obtains the planned path through a Standard Interface command.
-
The robot picks under the guidance of the planned path.
You need to write a robot or PLC program to implement the above process. Mech-Mind provides abundant example programs for supported robots or PLCs. The second example program follows the above process. In addition, you can refer to other example programs for more extended functions. For more information about writing robot or PLC programs, refer to Standard Interface Communication.
Get Planned Path from Mech-Vision
This mode is used when the robot or PLC triggers the Mech-Vision project and obtains the planned path from Mech-Vision through the Standard Interface commands.
Project to create |
Mech-Vision project |
|---|---|
Result output by the vision system |
Planned path, consisting of a series of waypoints, each containing data such as robot pose, label, motion type, velocity, etc.
|
|
The general workflow of using this mode is as follows:
-
The robot or PLC triggers the Mech-Vision project to run through a Standard Interface command.
-
The vision system runs the Mech-Vision project and outputs the planned path.
-
The robot or PLC obtains the planned path through a Standard Interface command.
-
The robot picks under the guidance of the planned path.
You need to write a robot or PLC program to implement the above process. Mech-Mind provides abundant example programs for supported robots or PLCs. The third example program follows the above process. In addition, you can refer to other example programs for more extended functions. For more information about writing robot or PLC programs, refer to Standard Interface Communication.
Build the Picking Workflow in the Master-Control Communication Mode
If you have chosen to use the Master-Control communication mode, you can build the robot picking workflow (that is the Mech-Viz project) in a graphical manner in Mech-Viz.
1 Build a Project |
Understand the general process of building a Mech-Viz project. |
|
2 Model Preparation |
Please use the Model Editor to create the tool, object, and scene models for the Mech-Viz project, which will be used in 3D simulation and collision detection. |
|
3 Configuration of the Project Resources |
Import your object model and configure the object. You can configure attributes such as Workobject symmetry and Picking relaxation to improve the success rate of object picking. |
|
Import the tool model and configure the tool. You need to adjust the position and size of the tool model as well as the control logic of the tool. |
||
Configure the objects in real scenarios to make the scene in the software closer to the real scenario, which facilitates collision detection and path planning. |
||
4 Simulation and Improvement |
Configure the collision detection to prevent the robot from colliding during its movement so that a planned path without collision will be output for the robot. |
|
Plan history records the whole process of path planning from Mech-Viz and displays the collision results in a visualized way. You can refer to the fixes for planning failures to troubleshoot. |