Topics: Common Issues with “3D Matching”

You are currently viewing the documentation for version 2.0.0. To access documentation for other versions, click the "Switch Version" button located in the upper-right corner of the page.

■ To use the latest version, visit the Mech-Mind Download Center to download it.

■ If you're unsure about the version of the product you are using, please contact Mech-Mind Technical Support for assistance.

This section introduces how to troubleshoot matching issues caused by incorrect normals of the point cloud model and inconsistent reference frame of the point cloud to be matched.

Matching Problems Caused by Incorrect Normals in Point Cloud Models

Starting from Mech-Vision 2.0.0, the matching process has strict requirements on the normals of point cloud models. When the normals of a point cloud model are incorrect, it directly leads to matching failure. The following sections introduce the two abnormalities and their corresponding solutions.

Incorrect Normals Occur When Using STL Model to Generate Point Cloud Model

  • Symptom

    After the STL model was imported into the target object editor, some areas of the model were displayed in black, which usually indicates incorrect normals. Normally, the model should be rendered evenly

    The table below shows examples of models with correct and incorrect normals.

    Correct normals of the point cloud model Incorrect normals of the point cloud model

    correct model 1

    incorrect model 1

    correct model 2

    incorrect model 2

  • Solution

    If the normals of the STL model are incorrect, you can use the “STL Model Normal Correction Tool” to repair the STL model.

    For instructions on downloading and using the “STL Model Normal Correction Tool,” refer to Correct Normals of STL Model.

Incorrect Normals or Tangents Occur After Using Steps to Generate Point Cloud Models

  • Symptom

    The edge point cloud model contains abnormal normals or tangents after being processed by Steps such as “Point Cloud Clustering,” “Get Highest-Layer Clouds,” etc.

    Correct normals of the edge point cloud model Incorrect normals of the edge point cloud model

    correct model normal step

    incorrect model normal step

    Correct tangents of the edge point cloud model Incorrect tangents of the edge point cloud model

    correct model tangential step

    incorrect model tangential step

  • Solution

    It is recommended to use the point cloud model generated by the Step directly for matching.

Matching Problems Caused by Inconsistent Reference Frame between Point Cloud Model and Point Cloud to Be Matched

When using the “3D Matching” Step, it is recommended to use the point cloud in the camera reference frame as the point cloud model, and ensure that the point cloud to be matched input to the “3D Matching” Step matches the reference frame of the point cloud model.

If the reference frame of the point cloud model does not align with that of the point cloud to be matched, the matching process will either fail or produce incorrect results. The specific issues are described below.

Remove Overlapped Poses Feature Filters Out Correct Matches

Once the “Remove Overlapped Poses” feature is enabled, when the overlap ratio between the point cloud of the target object in the camera reference frame and other point clouds above it exceeds the threshold, the pose of the overlapped target object will be removed.

However, in some cases, the correct matching result may be filtered out. The specific symptom is described as follows.

  • Symptom

    After enabling the “Remove Overlapped Poses” feature in the “3D Matching” Step, the correct matching results were filtered out.

  • Possible Cause

    When the point cloud of the target object is in the camera reference frame, and the point cloud to be matched is in the robot reference frame, and there are multiple fine matching results, the correct matching results are filtered out.

  • Solution

    During matching, ensure that the point cloud input to the “3D Matching” Step shares the same reference frame as the point cloud model.

Wrong or No Matching Result after Adjusting “Angle Threshold”

If the point cloud model generated by the STL model is used for matching, you can remove the invisible parts of the point cloud model by adjusting the Model Preprocessing  Angle Threshold parameter in the “3D Matching” Step to improve matching speed and accuracy. This parameter is under the Expert tuning level.

However, adjusting the “Angle Threshold” may also lead to incorrect matching results or no matching results. The specific symptom is described below.

  • Symptom

    When Angle Threshold was set to 180°, the matching was successful. After adjusting the Angle Threshold, the matching results differed greatly from those before the adjustment, and the matching was incorrect.

    Angle Threshold: 180° Angle Threshold: 135°

    angle threshold before

    angle threshold after

  • Possible Cause

    The reference frame of the point cloud model and that of the target object was inconsistent.

  • Solution

    During matching, ensure that the point cloud input to the “3D Matching” Step shares the same reference frame as the point cloud model.

Matching Problems Caused by Point Cloud Loss on Inner Wall of Ring-Type STL Model

  • Symptom

    When using Mech-Vision 2.x to generate a point cloud model based on the STL model of the ring, the point cloud model did not contain the point cloud of the inner wall of the ring, which reduced the confidence of the matching result.

    inner wall of ring effect
  • Solution

    This issue does not exist in Mech-Vision 1.8, so you can generate a complete ring point cloud with Mech-Vision 1.8 and use the “Read Point Cloud V2” Step in Mech-Vision 2.x to read the point cloud model for matching.

Is this page helpful?

You can give a feedback in any of the following ways:

We Value Your Privacy

We use cookies to provide you with the best possible experience on our website. By continuing to use the site, you acknowledge that you agree to the use of cookies. If you decline, a single cookie will be used to ensure you're not tracked or remembered when you visit this website.