Target Object Selection and Recognition
After point cloud preprocessing, select one or more objects from the target object editor for recognition.
|
The visualization window of the “Target object selection and recognition” process displays the object center points. If you want to view the pick points, click Next to view them in the visualization window of the “General settings” process. |
|
If an external service is used to trigger the Mech-Visionproject to run, it is recommended to close the “3D Target Object Recognition” tool before triggering the project. If a project is triggered to run when the “3D Target Object Recognition” tool is open, the content in the visualization window and the recognition result below will not be updated after option switching. Follow these steps:
After completing the above operations, switch the visualization options again to view the recognition result and visualization output normally. |
Select Target Object
Follow these tips to update the target object in the target object editor to this tool, and then select the target object to recognize.
-
If there are no target objects in the target object editor, select the operation workflow to create a target object. After configuring and saving the target object, click Update target object.
-
If there are configured target objects in the target object editor, you can just click Update target object.
Use Deep Learning (Optional)
In practical projects, when the target object to be recognized is made of highly reflective material, there may be missing point cloud data of the object, or when the camera is mounted too far away, the point cloud quality may be poor. In such cases, enabling Assist recognition with deep learning is a good choice for performing object recognition with the help of deep learning.
|
-
Import a deep learning model package.
Click Model package management tool to import a deep learning model package. For detailed instructions, see Import the Deep Learning Model Package.
-
Select the deep learning model package.
After the model package is imported, you can select it in the drop-down menu below the button.
-
Set the ROI (2D).
Click Set ROI, set the ROI in the pop-up window, and enter the ROI name for deep learning inference.
-
Configure inference.
Click Configure inference and set a confidence threshold in the pop-up window. The results with a confidence level above this threshold will be retained during deep learning–assisted recognition.
-
Set the font size.
Use this parameter to set the font size of the text displayed in the deep learning result on the left. Set this parameter according to the actual requirement.
-
Set the dilation parameter (optional).
This parameter is used to increase the mask area for the deep learning algorithm. When the size of the mask is smaller than that of the target object, there will be defects in the extracted point cloud, especially the edge point cloud. Therefore, it is recommended to enable Dilation to expand the mask to avoid missing data in the extracted point cloud.
After enabling Dilation, set the Kernel size according to the actual requirement. The larger the kernel size, the stronger the dilation effect.
Adjust Recognition Parameters
-
For more information about the parameters in the Basic mode, please refer to the parameter description in Basic Tuning Level of the “3D Matching” Step.
-
For more information about the parameters in the Advanced mode, please refer to the parameter description in Advanced Tuning Level of the “3D Matching” Step.
Check Recognition Result
After setting the above parameters, click Run Step or Run project to view the running result.
After target object recognition, click Next to enter the “General settings” process.