Generate Point Cloud Model Based on Common 3D Shapes, and Configure Pick Point Manually

In this workflow, you can create a common 3D shape to directly generate a point cloud model and create a target object. This workflow is suitable for scenarios where the shapes of the target objects to be recognized are relatively regular, matching cylinder or cuboid.

On the homepage of the target object editor, click Select under the Create common 3D shape workflow, and set the target object name, 3D shape, and geometric parameters to enter the configuration process. The overall configuration process is shown in the figure below.

Edit model: Edit the generated point cloud model, including the configurations for the point cloud display and calibration of the object center point, to ensure better performance of the subsequent matching task.
Set pick point: Add pick points or the pick point array on the point cloud model which is already edited.
Set collision model (optional): Generate the collision model for collision detection during path planning.

The following sections provide detailed instructions on the configuration.

Edit Point Cloud Model

The generated point cloud model should be edited for better performance in the subsequent matching task.

Configure Point Cloud Display Settings

By configuring Point cloud display settings, you can view different types of point cloud models, i.e., the models of all point clouds, surface point cloud only, and edge point cloud only, for the current target object and edit the point cloud model according to actual requirements. You can also change the display color of the point cloud model and view relevant reference information, such as that of the pseudo-textured point cloud.

Calibrate Object Center Point

The tool can automatically calculate the object center point. If you need to calibrate the object center point, select the calculating method under Calibrate center point by application, and click Start calculating.

Method	Introduction	Operation
Re-calculate by using original center point	The default calculation method. Calculate the object center point according to the original object center point and features of the target object.
Calibrate to center of symmetry	Calculate the object center point according to the object’s symmetry. After calculating the symmetry of the current model, the object center point will be set to the center of symmetry. There may be deviations in the calculation. If deviations occur, please adjust manually.
Calibrate to center of feature	Calculate the object center point according to the selected Feature type and the set 3D ROI.	Select the Feature type according to the geometric features of the object, and the tool will calculate the object center point according to the feature type. (Optional) Enable Use 3D ROI. After the 3D ROI is set for the target object, the tool will automatically calculate the object center point according to the features of the target object in the 3D ROI.

Method

Introduction

Operation

Re-calculate by using original center point

The default calculation method. Calculate the object center point according to the original object center point and features of the target object.

Calibrate to center of symmetry

Calculate the object center point according to the object’s symmetry.
After calculating the symmetry of the current model, the object center point will be set to the center of symmetry. There may be deviations in the calculation. If deviations occur, please adjust manually.

Calibrate to center of feature

Calculate the object center point according to the selected Feature type and the set 3D ROI.

Select the Feature type according to the geometric features of the object, and the tool will calculate the object center point according to the feature type.
(Optional) Enable Use 3D ROI. After the 3D ROI is set for the target object, the tool will automatically calculate the object center point according to the features of the target object in the 3D ROI.

Configure Point Cloud Model

To better use the point cloud model in the subsequent matching task and enhance matching accuracy, the tool provides the following two options for configuring the point cloud model. You can enable the Configure point cloud model switch as needed.

Avoid False Matches

Once Avoid false matches is enabled, more matching attempts will be made based on the settings to obtain matching results with higher confidence. However, more matching attempts will lead to longer processing time.

Two methods to avoid false matches are offered, i.e., Auto-calculate unlikely poses and Configure symmetry manually. See the table below for more information.

Method	Introduction	Operation
Auto-calculate unlikely poses	Poses that may cause false matches will be calculated automatically. In subsequent matches, poses that successfully match these poses will be considered unqualified and filtered out.	ClickCalculate unlikely poses to calculate potentially mismatched poses. If you think a pose in the list will not cause a false match, you can click the × sign to remove it from the list.
Configure symmetry manually	For rotationally symmetric target objects, configuring the rotational symmetry of the point cloud model can prevent the robot’s end tool from unnecessary rotations when it is holding the target object. This increases the success rate of path planning and reduces the time required for path planning, allowing the robot to move more smoothly and swiftly.	Select the symmetry axis by referring to Rotational Symmetry of Target Objects, and then set the Order of symmetry and Angle range.

Method

Introduction

Operation

Auto-calculate unlikely poses

Poses that may cause false matches will be calculated automatically. In subsequent matches, poses that successfully match these poses will be considered unqualified and filtered out.

ClickCalculate unlikely poses to calculate potentially mismatched poses.
If you think a pose in the list will not cause a false match, you can click the × sign to remove it from the list.

Configure symmetry manually

For rotationally symmetric target objects, configuring the rotational symmetry of the point cloud model can prevent the robot’s end tool from unnecessary rotations when it is holding the target object. This increases the success rate of path planning and reduces the time required for path planning, allowing the robot to move more smoothly and swiftly.

Select the symmetry axis by referring to Rotational Symmetry of Target Objects, and then set the Order of symmetry and Angle range.

When Auto-calculate unlikely poses is selected, for the option to take effect in the subsequent matching, you need to configure the relevant parameters in the used matching Steps. See the following for details.

If the “3D Matching” Step is used, go to Avoid False Matches Adjust Poses, and select Filter out unlikely poses in the drop-down menu. This parameter will appear when the parameter tuning level is set to Advanced or Expert.
If the “3D Target Object Recognition” Step is used, go to Avoid false matches Adjust poses in the “Target object selection and recognition” process, and select Filter out unlikely poses. This parameter will appear when the Advanced mode switch is turned on.

Set Weight Template

In the target object recognition process, setting a weight template can enhance the accuracy of matching results by emphasizing the selected features for recognition. Weight templates are typically used to distinguish the orientation of the target object, and the set weight template will affect the matching results. The procedures to set a weight template are as follows.

A weight template can only be set when the Point cloud display settings is set to Display surface point cloud only.

Click Edit template.
In the visualization area, hold and press the right mouse button to select a part of the features on the target object. The selected part, i.e., the weight template, will be assigned more weight in the matching process.

By holding Shift and the right mouse button together, you can set multiple weighted areas in a single point cloud model.
Click Apply to complete setting the weight template.

For the configured weight template to take effect in the subsequent matching, go to the “Model Settings” parameter of the “3D Matching” Step, and select the model with properly set weight template. Then, go to “Pose Filtering” and turn on the switch Consider Weight in Result Verification. The “Consider Weight in Result Verification” parameter will appear after the “Parameter Tuning Level” is set to Expert.

Now the editing of the point cloud model is completed. You can click Next to set the pick point for the point cloud model.

Set Pick Point

Adjust Pick Point

By default, the pick point list displays the added pick points, the origin of which is the object center point. Changing the object center point will influence the pick points.

If you need to adjust the pick point, for example, delete and hide it, you can hover the cursor over the ? icon to the right of Pick point list to view the instructions. You can also set relevant values under Pick point settings, or drag the pick point to an appropriate position in the visualization area on the left.

Set Pick Point Array

When the target object is symmetrical, you can set the pick point array based on the object center point according to actual needs. Setting the pick point array can prevent the robot’s end tool from unnecessary rotations during picking. This increases the success rate of path planning and reduces the time required for path planning, allowing the robot to move more smoothly and swiftly. The procedures for setting are as follows.

Under “Pick point settings,” click Generate next to Pick point array.
Refer to Rotational Symmetry of Target Objects to select the axis of symmetry, and then set the Order of symmetry and Angle range.

Add Picking Configuration

If a tool has been configured in the “Path Planning” Step or Mech-Viz, you can enable the tool in the tool list to preview the relative position between the tool and the pick point. Once the tool is enabled, you can preview the relative position between the tool and the pick point, helping to determine if the pick point is set appropriately.

If you have modified the tool configurations in the “Path Planning” Step or Mech-Viz, save the changes to update the tool list.

Click Save to save the configurations for the target object. To set the collision model, click Next.

Set Collision Model (Optional)

The collision model is a 3D virtual object used in collision detection for path planning. You can configure the following settings on the collision model according to the actual situation.

Select Collision Model Generating Mode

The tool automatically recommends the collision model generating mode based on the current configuration workflow. The recommended mode for this case is Use common 3D shape. A collision model will be generated based on the selected common 3D shape for collision detection. Collision models generated by this method have low accuracy. However, the collision detection speed can be fast.

Configure Symmetry of Held Target Object

Refer to Rotational Symmetry of Target Objects to select the axis of symmetry, and then set the Order of symmetry and Angle range.

Now, the collision model settings are completed. Click Save to save the target object to Solution folder\resource\workobject_library. Then the target object can be used in subsequent matching Steps.