Introduction to Labeling Tools

You are currently viewing the documentation for the latest version (3.0.0). To access a different version, click the "Switch version" button located in the upper-right corner of the page.

■ If you are not sure which version of the product you are currently using, please feel free to contact Mech-Mind Technical Support.

You can use labeling tools to label the images and hence provide data for deep learning training.

Please create labels of corresponding classes according to the needs of the current project before using labeling tools.

Polygon Tool

The Polygon Tool can draw polygon labels with more vertices, which is suitable for objects of complex shapes.

  1. Click the Polygon Tool icon tools introduction polygon icon (or press P on the keyboard).

  2. Click the first position (vertex) in the selection region, then click the second one, third one, etc., to draw the labels, and right-click to finish. (At least three vertices are required.)

  3. If multiple label classes are created, colors corresponding to different label classes should be selected.

Ellipse Tool

Use more vertices to make elliptical selections. This tool is suitable for elliptical objects.

  1. Right-click the Polygon Tool icon tools introduction polygon icon and then click the Ellipse Tool icon tools introduction oval icon (or press L on the keyboard).

  2. Long press the left mouse button in the selection region, move it in any direction, and then release the left mouse button to finish the ellipse selection.

  3. If multiple label classes are created, colors corresponding to different label classes should be selected.

Rectangle Tool

The Rectangle Tool can be used to draw rectangular labels, which is suitable for rectangular objects.

  1. Right-click the Polygon Tool icon tools introduction polygon icon and then click the Rectangle Tool icon tools introduction rectangle icon (or press R on the keyboard).

  2. Long press the left mouse button in the selection region, move it in any direction, and then release the left mouse button to finish the rectangular selection.

  3. If multiple label classes are created, colors corresponding to different label classes should be selected.

Smart Labeling Tool

The Smart Labeling Tool can be used to automatically select the objects in the image. When multiple objects in an image have large color differences and are scattered, you can use the Smart Labeling Tool to conveniently label the objects in the image.

Currently, the Smart Labeling Tool can work in two modes, and it will automatically switch between them according to the actual situation. Users do not need to manually select a mode.

  • Standard mode (GPU): In this mode, the Smart Labeling Tool has robust labeling capabilities. This tool will automatically switch to the standard mode if the running device has a GPU, with available GPU memory of at least 2.5 GB, and there is no project undergoing training or validation.

  • Lite mode (CPU): In this mode, the Smart Labeling Tool has basic labeling capabilities. This tool will automatically switch to the lite mode if the running device has no GPU, or the available GPU memory is less than 2.5 GB, or there is a project undergoing training or validation.

Steps

  1. Click the Smart Labeling Tool icon tools introduction smart labeling icon (or press A on the keyboard).

  2. Move the cursor in the selection region and then click the object to be labeled.

    • If the selection cannot completely cover the object, click the uncovered part to expand the selection area.

    • If the selection covers the areas outside the object, right-click these areas to reduce the selection area.

  3. Click Apply in the upper-left corner of the selection region.

When the objects differ greatly in colors and have clear contours, it is recommended that you label multiple objects at a time and click Apply. If the objects are not obviously distinct, it is recommended to label one at a time.

Labeling Settings

You can click the settings icon labelling settings in the upper-left corner of the selection region to configure parameters for the Smart Labeling Tool. The smart labeling settings take effect for labels that are created after the settings are confirmed.

  • Contour vertex density: Specifies the density of vertices on the contour. Valid values: Standard and Sparse.

    • Standard: Generates more vertices for labels, providing higher precision when manually fine-tuning the contour.

    • Sparse: Generates fewer vertices for labels, suitable for objects with regular shapes that do not require fine-tuned labeling.

Pre-trained Labeling Tool

After you validate a model, you can import new image data to the current module and use the pre-trained labeling feature to perform auto-labeling based on this model.

The pre-trained labeling feature is available only when the current module contains validated models.

The Pre-trained Labeling Tool can be used only on the following two types of data:

  • Unlabeled data

  • Automatically labeled data (images with a yellow triangle at the front of the image number)

  • The Pre-trained Labeling Tool can only label images that are not manually labeled. If you need to use the Pre-trained Labeling Tool on manually labeled images, you must clear these labels first.

  • Data after a manual adjustment will have the yellow triangle marker removed. The data will be no longer available for pre-trained labeling and VFM labeling.

The pre-trained labeling feature can significantly reduce the cost of manual labeling. However, the accuracy of the results depends on the model that you use. We recommend that you train a high precision model before you use the pre-trained labeling feature.

You can use the Pre-trained Labeling Tool in one of the following three methods:

  • Method 1: Pre-trained labeling button

    1. On the upper part of the image list, click the Pre-trained labeling button. All images in the image list will be labeled by using the Pre-trained Labeling Tool.

    2. After the labeling process is finished, you can view a yellow triangle in the upper left corner of the sequence number of the labeled images.

  • Method 2: Pre-trained labeling option

    1. In the image list, select one or more images that you need to label.

    2. Right-click the images and select Pre-trained labeling, the labeling process starts. After the labeling process is finished, you can view a yellow triangle in the upper left corner of the sequence number of the labeled images.

  • Method 3: Pre-trained Labeling Tool

    1. In the labeling toolbar, right-click the Smart Labeling Tool icon tools introduction smart labeling icon, and then click the Pre-trained Labeling Tool icon tools pre labeling tool icon (or press D on the keyboard).

    2. On the upper part of the image, click Start labeling, and the Pre-trained Labeling Tool will start to label the image. After the labeling process is finished, you can view a yellow triangle in the upper left corner of the sequence number of the image.

  • If you clear all labels of an image, the yellow triangle before it will be cleared.

  • In the Classification module, if you modify the class labels of an image, the yellow triangle before it will be cleared.

Labeling Settings

You can click the settings icon labelling settings in the upper-left corner of the selection area to configure parameters for the Pre-trained Labeling Tool. The pre-trained labeling settings take effect for labels that are created after the settings are confirmed.

  • Contour vertex density: Specifies the density of vertices on the contour. Valid values: Standard and Sparse.

    • Standard: Generates more vertices for labels, providing higher precision when manually fine-tuning the contour.

    • Sparse: Generates fewer vertices for labels, suitable for objects with regular shapes that do not require fine-tuned labeling.

VFM Labeling Tool

Mech-DLK incorporates the visual foundation models (VFMs) developed by Mech-Mind. You can use the VFM Labeling Tool powered by the VFMs to quickly label datasets.

The VFM Labeling Tool can be used only on the following two types of data:

  • Unlabeled data

  • Automatically labeled data (images with a yellow triangle at the front of the image number)

  • To use the VFM Labeling Tool, the available GPU memory on the current device must be greater than 6 GB; otherwise, the model conversion may fail.

  • The VFM Labeling Tool can only label images that are not manually labeled. If you need to use the VFM Labeling Tool on manually labeled images, you must clear these labels first.

  • Data after a manual adjustment will have the yellow triangle marker removed. The data will be no longer available for pre-trained labeling and VFM labeling.

  • The first time you use VFM Labeling Tool, it may take a few minutes for the tool to get ready, please be patient.

You can use the VFM Labeling Tool in one of the following three methods:

  • Method 1: VFM labeling button

    1. On the upper part of the image list, click the VFM labeling button. All images in the image list will be VFM-labeled.

    2. After the labeling process is finished, you can view a yellow triangle in the upper left corner of the sequence number of the labeled images.

  • Method 2: VFM labeling option

    1. In the image list, select one or more images that you need to label.

    2. Right-click the images and select VFM labeling, the labeling process starts. After the labeling process is finished, you can view a yellow triangle in the upper left corner of the sequence number of the labeled images.

  • Method 3: VFM Labeling Tool

    1. In the labeling toolbar, right-click the Smart Labeling Tool icon tools introduction smart labeling icon, and then click the VFM Labeling Tool icon tools super labeling tool icon (or press S on the keyboard).

    2. On the upper part of the image, click Start labeling, and the VFM Labeling Tool will start to label the image. After the labeling process is finished, you can view a yellow triangle in the upper left corner of the sequence number of the image.

After the labeling is completed, Mech-DLK will generate a label class named "model_label" for the labels created by the VFMs.

If you want to modify VFM Labeling Settings, please follow these steps:

  1. In the labeling toolbar, right-click the Smart Labeling Tool icon tools introduction smart labeling icon, and then click the VFM Labeling Tool icon tools super labeling tool icon.

  2. Click the settings icon labelling settings on the upper area of the selection area.

  3. In the window of VFM Labeling Settings, you can modify the VFM labeling results.

Labeling Settings

You can click the settings icon labelling settings in the upper-left corner of the selection region to configure parameters for the VFM Labeling Tool. The VFM labeling settings take effect for labels that are created after the settings are confirmed.

  • Contour vertex density: Specifies the density of vertices on the contour. Valid values: Standard and Sparse.

    • Standard: Generates more vertices for labels, providing higher precision when manually fine-tuning the contour.

    • Sparse: Generates fewer vertices for labels, suitable for objects with regular shapes that do not require fine-tuned labeling.

  • Label confidence: Filters labels with confidence higher than this value. Confidence indicates the accuracy of the labeling results. The higher the confidence, the more accurate the labeling results are.

    Setting the confidence too high may result in a lower number of displayed labels.

  • Max num of labeling objects: Specifies the maximum number of labels.

Template Tool

You can use the Template Tool to set an existing selection as a template. After setting, you can use this template to rapidly label contours and objects with the same pose.

It is suitable for scenarios where there are multiple neatly arranged objects of the same type in an image, which can improve labeling efficiency.

tools introduction seal

  1. Click the Template Tool icon tools introduction seal icon (or press C on the keyboard).

  2. Click the region that needs to be set as the template.

  3. Move the template to the object that you need to select, adjust the angle of the template to make it fit the object, and then click it.

    • Coarse adjustment: Press and hold the Shift key and then scroll the mouse wheel.

    • Fine adjustment: Adjust the Rotation angle parameter.

During labeling, press and hold the Ctrl key and click the selection to switch the template. You can also click Replace template and then click the selection to achieve the same purpose.

Mask Tool

If there are some irrelevant parts that may interfere with model training, you can use the Mask Tool to cover such parts. The masked parts will not be involved in training. It is recommended to set a distinct color for the mask.

The Mask Tool supports different mask modes. You can choose whether the mask takes effect only on the current image or on all images as required.

You can choose among the following three mask tools built in the software according to actual needs.

Mask Polygon Tool

  1. Click the Mask Polygon Tool icon tools introduction mask polygon icon (or press Shift + P on the keyboard).

  2. Set “Fill” for the mask.

  3. Click the first position (vertex) in the selection area, then click the second one, third one, etc., to draw the labels, and right-click to finish.

Mask Brush Tool

  1. Right-click the Mask Polygon Tool icon tools introduction mask polygon icon, and then click the Mask Brush Tool icon tools introduction mask pen icon (or press Shift+B on the keyboard).

  2. Set the “Fill” of the mask and adjust the slider to determine the brush size.

  3. Press and hold the left mouse button in the selection area, move in any direction, and then release the left mouse button to finish the drawing.

Mask Lasso Tool

  1. Right-click the Mask Polygon Tool icon tools introduction mask polygon icon, and then click the Mask Lasso Tool icon tools introduction mask lasso icon (or press Shift+N on the keyboard).

  2. Set “Fill” for the mask.

  3. Press and hold the left mouse button in the selection area and move in any direction to form closed shapes with the starting point.

Mask Mode

Mask modes are divided into Single image mask and Global mask.

  • Single image mask: The mask is only valid in the current image. Copy and batch-paste single image masks by following these steps:

    1. Use the Mask Tool to draw a single image mask.

    2. Click the Select Tool icon tools introduction select icon(or press F on the keyboard).

    3. In the labeling region, right-click the mask to be copied and click Copy (or press Ctrl+C on the keyboard); in the target image, right-click and select Paste (or press Ctrl + V on the keyboard). You can also select multiple target images in the image list, right-click and select Paste Mask(s) to paste them in batches.

  • Global mask: The mask applies to all images.

Mask Eraser Tool

The Mask Eraser Tool can be used to erase the masks.

  1. Click the Mask Eraser Tool icon tools introduction mask eraser icon (or press Shift + E on the keyboard).

  2. Press and hold the left mouse button in the selection area and move in any direction.

    Adjust the slider to change the eraser size.

ROI Tool

You can use the ROI Tool to set the region of interest.

Setting the ROI can avoid interferences from the background.

  1. Click the ROI Tool icon tools introduction roi icon (or press O on the keyboard).

  2. Adjust the ROI frame in the selection region.

  3. Click the application icon tools introduction OK in the lower-right corner of the ROI to apply the current ROI or click the close icon tools introduction cancel to disable the ROI Tool.

  4. Click the Reset button in the upper left corner of the image to reset the ROI.

Select Tool

The Select Tool supports coarse and fine-tuning labeling.

  • Roughly adjust labeling

    You can use the Select Tool to zoom, select, move, resize, rotate, etc.:

    1. In the labeling toolbar, click the Select Tool icon tools introduction select icon (or press F on the keyboard).

    2. You can perform operations such as scaling, selecting, moving, and roughly adjusting labels:

      • Place the cursor in the selection area of the image and use the mouse wheel to scroll forward to zoom in and scroll backward to zoom out.

      • Move the cursor in the selection region and then click the selections to be processed. Select multiple selections by pressing and holding the Ctrl key.

      • Right-click and drag in the selection area to select all labels within the selected area.

        Adjust size

        tools introduction select1

        Rotation

        tools introduction select2

        Move

        tools introduction select3

  • Finely fine-tune labeling contours

    When the labeling is completed and the vertices cannot be adjusted directly, you can use the Select Tool to fine-tune the label:

    1. In the labeling toolbar, click the Select Tool icon tools introduction select icon (or press F on the keyboard) to select the label to be adjusted.

    2. Adjust the contour in one of the following three ways according to actual situation. Please ensure that the selected area closely aligns with the object contour.

      • Place the mouse cursor on a vertex of the contour. When the cursor turns into the hand cursor tools introduction smart labeling change2, long-press the left mouse button and drag the vertex to adjust the contour.

      • Place the mouse cursor on a vertex of the contour. When the cursor turns into the hand cursor tools introduction smart labeling change2, click the right mouse button to delete the vertex.

      • Place the mouse cursor on the contour. When the cursor turns into the cross cursor tools introduction smart labeling change1, click the left mouse button to add a vertex.

Is this page helpful?

You can give a feedback in any of the following ways:

We Value Your Privacy

We use cookies to provide you with the best possible experience on our website. By continuing to use the site, you acknowledge that you agree to the use of cookies. If you decline, a single cookie will be used to ensure you're not tracked or remembered when you visit this website.

  • Preference
  • I accept
  • I don't accept