Introduction to Labeling Tools

You can use labeling tools to label the images and hence provide data for deep learning training.

You can choose among the following labeling tools built in the software according to actual needs.

Please create labels of corresponding classes according to the needs of the current project before using labeling tools.

Polygon Tool

The Polygon Tool can draw polygon labels with more vertices, which is suitable for objects of complex shapes.

  1. Click tools introduction polygon icon (or press P on the keyboard).

  2. Click the first position (vertex) in the selection region, then click the second one, third one, etc., to draw the labels, and right-click to finish. (At least three vertices are required.)

  3. If multiple label classes are created, colors corresponding to different label classes should be selected.

After labeling, use the Select Tool to select a label and adjust the label by the following methods.

  • Click the label edges to increase the number of vertices.

  • Right-click a vertex to delete it.

  • Long press the left mouse button and drag the vertex in any direction to modify the label shape.

Ellipse Tool

Use more vertices to make elliptical selections. This tool is suitable for elliptical objects.

  1. Right-click tools introduction polygon icon and then click tools introduction oval icon (or press L on the keyboard).

  2. Click the first position (vertex) in the selection region, and then continue clicking. An elliptical label should have at least six vertices.

  3. If multiple label classes are created, colors corresponding to different label classes should be selected.

After labeling, use the Select Tool to select the label and then long press the left mouse button to drag the vertex in any direction and thus modify the label shape.

Rectangle Tool

The Rectangle Tool can be used to draw rectangular labels, which is suitable for rectangular objects.

  1. Right-click tools introduction polygon icon and then click tools introduction rectangle icon (or press R on the keyboard).

  2. Long press the left mouse button in the selection region, move it in any direction, and then release the left mouse button to finish the rectangular selection.

  3. If multiple label classes are created, colors corresponding to different label classes should be selected.

Smart Labeling Tool

The Smart Labeling Tool can be used to automatically select the objects in the image. When multiple objects in an image have large color differences and are scattered, you can use the Smart Labeling Tool to conveniently label the objects in the image.

Currently, the Smart Labeling Tool can work in two modes, and it will automatically switch between them according to the actual situation. Users do not need to manually select a mode.

  • Standard mode (GPU): In this mode, the Smart Labeling Tool has robust labeling capabilities. This tool will automatically switch to the standard mode if the running device has a GPU, with available GPU memory of at least 2.5 GB, and there is no project undergoing training or validation.

  • Lite mode (CPU): In this mode, the Smart Labeling Tool has basic labeling capabilities. This tool will automatically switch to the lite mode if the running device has no GPU, or the available GPU memory is less than 2.5 GB, or there is a project undergoing training or validation.

Steps

  1. Click tools introduction samrt labeling icon (or press A on the keyboard).

  2. Move the cursor in the selection region and then click the object to be labeled.

    • If the selection cannot completely cover the object, click the uncovered part to expand the selection area.

    • If the selection covers the areas outside the object, right-click these areas to reduce the selection area.

  3. Click Apply in the upper-left corner of the selection region.

You can use the Select Tool to fine-tune the labeled contour by the following steps:

  1. Use the Select Tool to select the label to be adjusted.

  2. Adjust the contour in one of the following three ways according to actual situation. Please ensure that the selected area closely aligns with the object contour.

    1. Place the mouse cursor on a vertex of the contour. When the cursor turns into tools introduction samrt labeling change2, long-press the left mouse button and drag the vertex to adjust the contour.

    2. Place the mouse cursor on a vertex of the contour. When the cursor turns into tools introduction samrt labeling change2, click the right mouse button to delete the vertex.

    3. Place the mouse cursor on the contour. When the cursor turns into tools introduction samrt labeling change1, click the left mouse button to add a vertex.

When the objects differ greatly in colors and have clear contours, it is recommended that you label multiple objects at a time and click Apply. If the objects are not obviously distinct, it is recommended to label one at a time.

Labeling Settings

You can click the Settings button in the upper-left corner of the selection region to configure parameters for the Smart Labeling Tool. The smart labeling settings take effect for labels that are created after the settings are confirmed.

  • Show contour: Configures the display method for labels.

    • Disabled: Displays the bounding box of the labels.

    • Enabled: Displays the original contour of the labels.

  • Contour vertex density: Specifies the density of vertices on the contour. Valid values: Standard and Sparse.

    • Standard: Generates more vertices for labels, providing higher precision when manually fine-tuning the contour.

    • Sparse: Generates fewer vertices for labels, suitable for objects with regular shapes that do not require fine-tuned labeling.

Pre-trained Labeling Tool

After you validate a model, you can use the Pre-trained Labeling Tool to automatically label a single image.

  1. In the labeling toolbar, right-click tools introduction samrt labeling icon, then click tools pre labeling tool icon (or press D on the keyboard) to select the Pre-trained Labeling Tool.

  2. In the upper part of the image, click Start labeling to enable the automatic labeling.

After the labeling process is finished, you can view a yellow triangle in the upper left corner of the sequence number of the image.

VFM Labeling Tool

You can use the VFM Labeling Tool to quickly label datasets that are not yet labeled.

  1. In the labeling toolbar, right-click tools introduction samrt labeling icon, then click tools super model labeling tool icon (or press S on the keyboard) to select the VFM Labeling Tool.

  2. In the upper part of the image, click Start labeling to enable the automatic labeling.

After the labeling process is finished, you can view a yellow triangle in the upper left corner of the sequence number of the image.

Labeling Settings

You can click the Settings button in the upper-left corner of the selection region to configure parameters for the VFM Labeling Tool. The VFM labeling settings take effect for labels that are created after the settings are confirmed.

  • Show contour: Configures the display method for labels.

    • Disabled: Displays the bounding box of the labels.

    • Enabled: Displays the original contour of the labels.

  • Contour vertex density: Specifies the density of vertices on the contour. Valid values: Standard and Sparse.

    • Standard: Generates more vertices for labels, providing higher precision when manually fine-tuning the contour.

    • Sparse: Generates fewer vertices for labels, suitable for objects with regular shapes that do not require fine-tuned labeling.

  • Label confidence: Filters labels with confidence higher than this value. Confidence indicates the accuracy of the labeling results. The higher the confidence, the more accurate the labeling results are.

    Settings the confidence too high may result in a lower number of displayed labels.
  • Max num of labeling objects: Specifies the maximum number of labels.

Mask Tool

If there are some irrelevant parts that may interfere with model training/inference, you can use the Mask Tool to cover such parts. The masked parts will not be involved in training/inference.

You can choose among the following three mask tools built in the software according to actual needs.

Mask Polygon Tool

  1. Click tools introduction mask polygon icon (or press Shift + P on the keyboard)

  2. Set Mask fill.

  3. Click the first position (vertex) in the selection area, then click the second one, third one, etc., to draw the labels, and right-click to finish.

Mask Brush Tool

  1. Right-click tools introduction mask polygon icon and then click tools introduction mask pen icon (or press Shift + B on the keyboard)

  2. Set Mask fill and Brush size.

  3. Long press the left mouse button in the selection area, move in any direction, and then release the left mouse button to finish the drawing.

Mask Lasso Tool

  1. Right-click tools introduction mask polygon icon and then click tools introduction mask lasso icon (or press Shift + N on the keyboard)

  2. Set Mask fill.

  3. Long press the left mouse button in the selection area and move in any direction to form closed shapes with the starting point.

Mask Eraser Tool

The Mask Eraser Tool can be used to erase the masks.

  1. Click tools introduction mask eraser icon (or press Shift + E on the keyboard)

  2. Long press the left mouse button in the selection area and move in any direction.

    Adjust the slider to change the eraser size.

Template Tool

You can use the Template Tool to set an existing selection as a template. After setting, you can use this template to rapidly label contours and objects with the same pose.

It is suitable for scenarios where there are multiple neatly arranged objects of the same type in an image, which can improve labeling efficiency.

tools introduction seal
  1. Click tools introduction seal icon (or press C on the keyboard).

  2. Click the region that needs to be set as the template.

  3. Move the template to the object that you need to select, adjust the angle of the template to make it fit the object, and then click it.

    • Coarse adjustment: Press and hold the Shift key and then scroll the mouse wheel.

    • Fine adjustment: Adjust the Rotation angle parameter.

During labeling, press and hold the Ctrl key and click the selection to switch the template. You can also click Replace template and then click the selection to achieve the same purpose.

ROI Tool

You can use the ROI Tool to set the region of interest.

Setting the ROI can avoid interferences from the background.

  1. Click tools introduction roi icon (or press O on the keyboard).

  2. Adjust the ROI frame in the selection region.

  3. Click the tools introduction OK button in the lower right corner of the ROI to save the setting, or click the tools introduction cancel button to disable the ROI Tool.

  4. Click the Reset button in the upper left corner of the image to reset the ROI.

Select Tool

You can use the Select Tool to select, move, and adjust the selections.

  1. Click tools introduction select icon (or press F on the keyboard).

  2. Move the cursor in the selection region and then click the selection to be processed.

  • Select multiple selections by pressing and holding the Ctrl key.

  • Right-click and drag in the labeling area to select all labels within the selected area.

Adjust size

tools introduction select1

Rotation

tools introduction select2

Move

tools introduction select3

We Value Your Privacy

We use cookies to provide you with the best possible experience on our website. By continuing to use the site, you acknowledge that you agree to the use of cookies. If you decline, a single cookie will be used to ensure you're not tracked or remembered when you visit this website.