Instructions for Pick Anything Projects

For pick anything projects, since there is no single model that can be applied to all objects of varying types and shapes, deep learning algorithms are needed to estimate pick points.

Create a New Typical Application Project

Click Typical Applications ‣ New Typical Application Project in the menu bar or New Typical Application Project in the toolbar to open the following window.

../../../../../_images/select_scene_5.png

  1. Select Pick Anything.

  2. Name the project.

  3. Click on icon_selectfilepath_deploymentguidance to select a folder to save the project (it is recommended to create an empty folder), then click Create Project.

Preparation

Camera Calibration

The purpose of camera calibration is to obtain the configurtaion file of the camera and determine the spacial relationship between the robot and the camera.

Click Camera Calibration (Standard) in the toolbar to calibrate the camera.

../../../../../_images/standard_calibration3.png

You can also go to Camera ‣ Camera Calibration ‣ Standard to calibrate the camera.

../../../../../_images/standard_calibration_1.png

Please refer to Camera Calibration - Standard Mode for detailed instructions.

Camera Configuration

Before using the camera to capture images, please select the Capture Images from Camera Step, and configure Camera ID, Camera Calibration Parameters, IP Address, and other parameters in the Step Parameters panel. Please refer to Capture Images from Camera for detailed instructions.

../../../../../_images/camera_configuration3.png

Running and Debugging

Hint

While running the project, please use a port number between 60000 and 65535 (including 60000 and 65535).

After successfully running and debugging the project, if you need to save the on-site data for future reference, or if you find that certain part of the project is not performing well and would like to improve the project structure or parameter settings in an off-site situation, the Data Storage and Data Playback tools can be very useful.

Prerequisites for using the Data Playback tool:

  1. A project file in which the project can run correctly without errors.

  2. On-site source data gathered during the whole period while running the project, including 2D color images, depth maps, camera parameter file. Please refer to Data Storage for instructions on how to save the data.