3D Coarse Matching (Multiple Models)

Function

Use multiple models to roughly match objects in the scene, and output the coarsely calculated candidate poses of the target objects.

Usage Scenario

This Step calculates the original poses of objects in the scene by using multiple models. It is an extensive version of the 3D Coarse Matching Step and their parameter tuning methods are similar.

This Step should be used in multi-model scenarios to distinguish workpieces of different types. This Step is usually followed by 3D Fine Matching (Multiple Models) to obtain accurate poses.

Input and Output

3d coarse matching multiple models input and output

Parameter Description

Model Settings

The path of model file and pick point file.

Model File (Required)

Default value: model.ply

Instruction: The path of 3D model file, the construction process can refer to the complete point cloud model stitching document. You can enter multiple file paths. Please use semicolons to divide different file paths.

Geo Center Point File (Required)

Instruction: The geometric center file in JSON format. You can enter multiple file paths. Please use semicolons to divide different file paths.

Example: Ensure that the files entered under each parameter are in the same order, meaning that the Model File has the same path order as the Geometric Center File, as shown in the figure below. Different files are separated by “;”.

3d coarse matching multiple models input path

Cloud Orientation Calculation

Point Orientation Calc Mode

Default setting: Origin

List of options Description

Origin

Use the original normal of the input point cloud directly.

StandardMode

Use the CPU to recalculate the normal direction of the input point cloud, which is recommended when the model does not have the normal direction. The k points nearest to the target were searched, and principal component analysis (PCA) is used to obtain the minimum feature vector as the normal direction of the point.

EdgeTangent

The tangent direction of the input edge point cloud is calculated as the normal direction. Objects whose outer contours are mirror images of each other can be distinguished. It is recommended to match edge point clouds of flat objects.

EdgeNormal

Calculate the normal direction of the input edge point cloud, and use the tangential direction of the point as the normal direction, which is recommended for matching the edge point cloud of a flat object.

When using the EdgeTangent or EdgeNormal methods, ensure that each edge point cloud does not contain multiple objects; in other words, each object point cloud is separated.

Number of Searching Points

Default value: 10

Instruction: This parameter is used to adjust the number of adjacent points in the direction of the computed point, which is the value of K in StandardMode mode.

Processor Type

Default value: SurfaceMatchingEasyMode

List of Values: SurfaceMatchingEasyMode, SurfaceMatching

Instruction: The algorithm is categorized into two modes based on the ease of use. Both modes include the Result Visualization parameter group. As shown in the figure below, the front-side model and the back-side model will be used for the matching. Parameters in SurfaceMatchingEasyMode will be introduced first.

SurfaceMatchingEasyMode algorithm: The adjustable parameters module is Speed Controller and Output Settings.

SurfaceMatching algorithm: The adjustable parameters module is Sample Settings, Voting Settings, and Pose Verification Settings.

3d coarse matching multiple models input cloud

SurfaceMatchingEasyMode

Speed Control

Main Speed Controller

Default value: 2

Instruction: This parameter is used to adjust the algorithm speed. When the value is increased, the algorithm speed becomes faster, but the matching accuracy decreases. Its effect is more obvious than Secondary Speed Controller. The valid range of this parameter is 1–6.

Example of adjustment: as shown in the figure below. The left figure shows the result when this value is 2 , and the right figure shows the result when this value is 6. It is obvious that the matching accuracy decreases after adjustment.

3d coarse matching multiple models main speed comparison 1
3d coarse matching multiple models main speed comparison 2
Secondary Speed Controller

Default value: 10

Instruction: This parameter is used to adjust the algorithm speed. When the value is increased, the algorithm speed becomes faster, but the matching accuracy decreases. Its effect is weaker than Main Speed Controller. The valid range of this parameter is 1–20.

Example of adjustment: as shown in the figure below. The figure on the left shows the result when this value is 10 , and the figure on the right shows the result when this Value is 15. It can be seen that the matching accuracy decreases after adjustment, but the influence is less than that of the main speed control parameters.

3d coarse matching multiple models secondary speed comparison 1
3d coarse matching multiple models secondary speed comparison 2

Output Settings

Maximum Number of Detected Poses in Each Point Cloud

Default value: 3

Instruction: This parameter is used to estimate the number of matching outputs per point cloud. The larger the value, the more matches are generated.

Example of adjustment: as shown in the figure below. The left picture shows the result when the parameter is 1, and the right picture shows the result when the parameter is 3.

3d coarse matching multiple models number of output comparison

SurfaceMatching

Sample Settings

Enable Automatic Downsampling

Default value: Selected

Instruction: This parameter is used to determine whether to use automatic downsampling. If it is selected, the sampling interval parameter of point cloud template will be automatically adjusted according to the expected points of the model after sampling.

Expected Point Number of Sampled Model

Default value: 1000

Instruction: This parameter is used to adjust the number of points of the sampling point cloud. It is effective when Enable Automatic Downsampling is selected, and the number of points of the point cloud is close to this value. The smaller this value is, the fewer points of sampling point cloud are, resulting in the lower accuracy of pose estimation.

Max Point Number of Sampled Model

Default value: 4000

Instruction: This parameter is used to set the maximum number of points in the point cloud model after downsampling. It sets an upper limit for the number of points in our point cloud model after downsampling. If the matching effect or matching speed is not ideal, this parameter is recommended to be increased.

Max Point Number of Sampled Scene

Default value: 3000

Instruction: This parameter is used to set the maximum number of points in the point cloud after the field point cloud downsampling. It sets an upper limit for the number of points in the field point cloud after the field point cloud downsampling. If the matching effect or matching speed is not ideal, this parameter is recommended to be increased.

Sampling Interval

Default value: 10.000 mm

Instruction: This parameter is used to adjust the maximum distance between points in the sampling point cloud. The unit is millimeters. When the sampling interval of point cloud model is smaller than the minimum sampling interval, the minimum sampling interval is used as the actual sampling interval. The larger the value is, the less point clouds are used for calculation after sampling, the lower the matching accuracy and the lower the algorithm execution time.

Example of adjustment: as shown in the figure below. The left picture shows the result when the parameter is 0.01, and the right picture shows the result when the parameter is 0.02.

3d coarse matching multiple models sample interval
Min Sampling Interval

Default value: 3.000 mm

Instruction: This parameter is used to calculate the sampling interval. The unit is millimeters. It is effective when the value of Enable Automatic Downsampling is selected. If the calculated sampling interval is smaller than this value, this value will be used as the actual sampling interval.

Voting Settings

Distance Quantification

Default value: 1

Instruction: The value for the quantification of the distance between points. As Distance between Two Points = Distance Quantification × Sampling Interval, the larger the value is, the larger the distance, and the less precise the result tends to be.

Angle Quantification

Default value: 60

Instruction: The value for the quantification of the angle between two vectors. As Angle between Two Vectors = 2 × 3.14 / Angle Quantification, increasing the parameter’s value will reduce the matching accuracy.

Max Vote Ratio

Default value: 0.8

Instruction: This parameter sets the threshold for the proportion of the number of votes to the maximum number of votes. The number of votes corresponding to each pose will be obtained in the previous steps, and the maximum number of votes multiplied by this parameter will get a threshold. When the number of votes of a pose is greater than this threshold, the corresponding pose will be retained for clustering operation. The smaller the value, the more likely it is to find an accurate match, but the running time increases. The valid range of this parameter is 0–1.

Reference Point Step

Default value: 5

Instruction: This parameter is used to adjust the selection step of the reference point. The step size is taken as an interval sampling point from the point cloud. When the value is larger, the interval sampling points are fewer, and the execution speed is faster, but the matching accuracy is reduced.

Referred Point Step

Default value: 1

Instruction: This parameter is used to adjust the selection step of the referred point. The step size is taken as an interval sampling point from the point cloud. When the value is larger, the interval sampling points are fewer, and the execution speed is faster, but the matching accuracy is reduced.

  • A reference point and a referred point make up a point pair. The larger the sampling step, the fewer referring points and referred points after downsampling, the fewer the point pairs, and the faster the execution.

  • Reference point is the sampling point on the matching model. Referred point is the sampling point not on the matching model.

Clustering Settings

Cluster Ratio

Default value: 0.1

Instruction: This parameter is used to adjust the proportion of the number of poses used for clustering to the total computed poses. Any pose will be given a score during the calculation, and all poses will be sorted according to the score. This parameter determines how much of the pose is used for clustering, A value of 0.1 means that the top 10% pose is taken as the pose for clustering. The larger the value, the more likely it is to find an accurate match, but the running time increases accordingly.

Threshold of Angle Difference

Default value: 15

Instruction: This parameter is used to adjust the size of the Angle increment in the clustering process. In the final calculation result, the same object may calculate multiple poses, which determines the increment of the Angle parameter when the poses with very close parameters are fused. The larger the parameter is, the pose with large Angle difference will be fused into the final result, and the matching accuracy will decrease.

Threshold of Distance Difference

Default value: 0.02

Instruction: This parameter is used to adjust the size of the Distance increment in the clustering process. In the final calculation result, the same object may calculate multiple poses, which determines the increment of the Distance parameter when the poses with very close parameters are fused. The larger the parameter is, the pose with large Angle difference will be fused into the final result, and the matching accuracy will decrease.

Output First N Clusters with High Scores

Default value: 5

Instruction: This parameter is used to take the top N results with the highest score from the multiple matching results obtained after clustering adjustment as the final result.

Pose Verification Settings

Use Pose Verification

Default value: Selected

Instruction: This parameter determines whether pose validation is used. When the parameter is selected, all cluster parameters are invalid. Pose validation and clustering are two different methods for verification and screening of final matching results, which cannot be used simultaneously.

Marked Margin

Default value: 1

Instruction: This parameter is used to control the size of the verification area during pose verification. A single voxel is a unit. When the value is increased, the mark area used to verify the pose becomes larger, and more points are included to verify the final result, thus reducing the matching accuracy.

Voxel Length

Default value: 3

Instruction: The space where the point cloud is located is divided into a 3D grid, and the parameter is the size of the smallest unit of the 3D grid. When the value is increased, the box selection range becomes larger and there are more selected points for pose verification. In this case, the algorithm speed becomes faster, but the matching accuracy decreases.

Maximum Number of Detected Poses in Each Point Cloud

Default value: 3

Instruction: For SurfaceMatching algorithm, this parameter has the same effect as for SurfaceMatchingEasyMode algorithm. Only results are compared here.

Example of adjustment: The left side of figure below is the result when the parameter value is 3, and the right side is the result when the parameter value is 1.

3d coarse matching multiple models number of output

Results Visualization

Show Sampled Model Cloud

Default value: Unselected

Instruction: This parameter is used to display the downsampled point cloud model.

Show Sampled Scene Cloud

Default value: Unselected

Instruction: This parameter is used to display the downsampled field point cloud.

Show Matching Results

Default value: Selected

Instruction: This parameter is used to display the matched model and field point cloud.

We Value Your Privacy

We use cookies to provide you with the best possible experience on our website. By continuing to use the site, you acknowledge that you agree to the use of cookies. If you decline, a single cookie will be used to ensure you're not tracked or remembered when you visit this website.