Multi Pick Palletizing

Function

This Step can automatically calculate multi-pick strategies based on the target pallet pattern and the arrangement of incoming boxes, aiming to improve palletizing efficiency. It is worth noting that this Step does not generate pallet patterns; instead, it requires selecting other palletizing Steps that can configure pallet patterns in the Step Parameters to obtain actual pallet pattern information. In the process of the whole workflow, this Step is mainly used to generate palletizing path, and calculate multi-pick strategies.

Usage Scenario

This Step applies to palletizing scenarios for most cases.

The example project is provided to help you learn more about multi-pick palletizing. For the example project, you can go to File > New > Example projects > Box palletizing > Multi-Pick Palletizing in the software.

Parameter Description

Move-Type Step Common Parameters

Send Waypoint

Selected by default to send waypoint poses to the receiver, such as the robot. When this option is unselected, the waypoint pose will not be sent. However, the waypoint will remain in the planned path.

Try Continuously Running through Succeeding Non-Moves

Unselected by default. When non-move Steps, such as Vision Look, Set DO, Check DI, etc., are connected between move-type Steps, the robot’s path planning will be interrupted, and the actual robot will take a short pause, reducing the smoothness of running.

When this option is selected, the project will continue to run without waiting for the current move-type Step to complete execution, and therefore the robot can move in a smooth way without pauses. However, enabling this option may cause the execution of the Step to end prematurely.

Why will this option cause the execution of the Step to end prematurely?

Mech-Viz will send multiple poses simultaneously to the robot when the project is running. When the currently returned JPs of the robot correspond to the last pose sent by Mech-Viz, Mech-Viz will assume that the robot has moved to the last position.

For example, there are 10 move-type Steps in a path, and the pose of the 5th move-type Step is the same as that of the last move-type Step. When the robot moves at low speed, it sends JPs to Mech-Viz when it moves to the 5th move-type Step, Mech-Viz may mistakenly determine that the robot has finished the move-type Steps and prematurely ends the Steps since the poses of the 5th move-type Step and the last move-type Step are the same in the path.

Do Not Check Collision with Placed Workobject

Unselected by default, namely that the collision with the already placed objects will not be detected. When this option is selected, the collisions between the robot, end tool, and placed objects will be detected.

In palletizing scenarios, the two possible cases of error are as follows:

  1. When the robot is placing a carton, the robot may come into light contact with the placed cartons while no deformation will be caused. After Mech-Viz detects this collision in simulation, it will plan other positions for placing the carton, and therefore a full stack cannot be formed.

  2. Usually, the TCP of a suction cup is inside the suction cup model instead of on the surface of it. Under this circumstance, the suction cup may be embedded in the model of the picked carton in the simulation of picking, while the software does not detect the collision between the end tool and the picked object. After the robot places the object and the carton model turns into an object model in the scene, a collision between the suction cup and the carton will be detected and the palletizing cannot be completed.

When this option is selected, no collision between the robot, end tool, and the placed object will be detected, and the above two cases of errors can be avoided.

Point Cloud Collision Detection Mode

Select the proper mode according to the requirement of the on-site situation. Usually, the default setting Auto can be used. Do not check collision mode can be used in move-type Steps before the robot picks the object, and Check collision mode can be used after the robot picks the object.

Auto

Default setting. Collision with point cloud is checked only for the “Vision Move” Step and the “Relative Move” Step that depends on the “Vision Move” Step, but not for all move-type Steps.

Do not check collision

Point cloud collisions for all move-type Steps will not be detected.

Check collision

Point cloud collisions for all move-type Steps will be detected.

When Collisions  Collision detection configuration  Detect collision between point cloud and others is switched on, Mech-Viz will detect collisions between the robot model, end tool model, and point cloud when planning the path. By default, the collisions between the robot and the target objects will be detected during picking and placing. When there are point cloud outliers, non-exiting collisions will be detected, which leads to errors in path planning.
Ignore Workobject Symmetry

This parameter will only take effect when Waypoint type of the Step is set to Workobject pose.

None

Default setting, i.e., do not disable symmetry on any axis.

Around workobject frame Z axis

Only disable symmetry on Z-axis of the workobject reference frame.

Around workobject frame X&Y axis

Disable symmetry on X-axis and Y-axis of the workobject reference frame.

Around all axes

Once the object symmetry is disabled, the robot will place the objects strictly according to the workobject poses.

In some special cases, objects are not pickable due to their peculiar poses. Setting Rotational symmetry under Workobjects  Workobject Configuration in Resources may solve this problem. Candidate poses of the recognized workobjects will be calculated according to the set rotational symmetry angle. When Mech-Viz plans to pick workpieces, if the default pose is not feasible for picking, the candidate poses will be tried. As the candidate poses calculated based on the settings of Rotational symmetry are different from the original poses output from Mech-Vision, the consistency of the objects’ place poses cannot be guaranteed.
Plan Failure Out Port

Once this parameter is selected, a “Plan failure” exit port will be added to the Step.

During the planning process, planning is carried out along the branch after the “Success” exit port. If the planning fails in the current Step, the branch process after the “Planning failure” exit port will be executed.

Held Workobject Collision Detection Settings

Do Not Check Collision with Scene Object/Robot

Unselected by default. Once this option is selected, the collisions between the held workobject with the scene objects or robot will not be detected, and therefore the calculation workload of collision detection will be reduced, the planning speed can be increased, and the cycle time can be shortened. It is usually enabled in the first one or two move-type Steps after the robot picks the object.

Please enable this option cautiously as there may be collision risks.

When Detect collision between held workobject and others under Collision detection configuration  Configuration on held workobject is enabled, the software will detect whether the model of the held object collides with the models of the scene objects and the robot.

In palletizing projects, the calculated carton dimensions have millimeter-level errors with the actual dimensions, and frictions between cartons may occur during picking but no collisions will occur. For some move-type Steps that will obviously not cause collisions, detecting such collisions only adds to the calculation workload and planning time, and consequently extending the cycle time. In palletizing projects, enabling Do Not Check Collision with Scene Objects does not affect the collision detection between the held carton and the placed cartons. This option can be enabled when there are scene objects under the stack to avoid failure of finding the palletizing solution.

Do Not Check Collision with Point Cloud

Unselected by default. Once this option is selected, the collisions between the held workobject with the point clouds in the scene will not be detected, and therefore the calculation workload of collision detection will be reduced, the planning speed can be increased, and the cycle time can be shortened.

  • When both Detect collision between held workobject and others under Collision detection configuration  Configuration on held workobject and Configuration on point cloudDetect collision between point cloud and others are enabled, the software will detect whether the model of the held workobject will collide with the point cloud in the scene.

  • When Mech-Vision sends the point cloud and object model to Mech-Viz, the point cloud and the object model are fitted together. After the robot picks the object, the model moves along the planned path, and the collision between the model of the held workobject and the point cloud will occur.

  • It is known that the model of the held workobject will have false collisions with the point cloud. Detecting such collisions unnecessarily adds to the calculation workload and extends the planning time.

Prior Corner

This parameter specifies the corner of the pallet on which the materials are palletized first, and the position of this prior corner will be changed with the pallet pose.

Parameter Description Illustration

OO

The pallet corner closest to the origin of the robot reference frame.

angle oo

OY

Based on the reference corner OO, the pallet corner that is in the positive Y direction of the robot reference frame.

angle oy

XY

Based on the reference corner OO, the pallet corner that is in the positive Y and X directions of the robot reference frame.

angle xy

XO

Based on the reference corner OO, the pallet corner that is in the positive X direction of the robot reference frame.

angle xo

The position of this prior corner is determined when the pallet is not rotated.

No Symmetry

Once this parameter is selected, the rotational symmetry setting of the workobject will not take effect in the process of palletizing.

Revise to Ideal Pallet Pattern

Once this parameter is selected, the software will adjust the collision models of all the boxes after the palletizing is completed so that they can correspond to the desired box positions of the target pallet pattern.

Matching Deviation Threshold

When placing the box group, each placed box may deviate from the target position. This parameter specifies the maximum allowable deviation between the actual and expected position on the XY-plane. When the deviation between the box and the target position exceeds this threshold, the software will determine that the match has failed. In short, it is used to determine the maximum error allowed in 2D coordinates.

multi pick palletizing match

(Dashed lines indicate target positions, and the green ones indicate boxes)

Save and Load Pallet Info

Once this option is enabled, the current palletizing status can be recorded, which is helpful for resuming production and continuing palletizing after a power outage or production stop. Once a JSON file is selected from File Path of Pallet Info, the pallet pattern information will be recorded in the file.

File Path of Pallet Info

Click icon_path to select the JSON file that records the pallet pattern information.

Selected Offline Pallet

The Multi-Pick Palletizing Step cannot generate pallet pattern. Instead, it works depending on the pallet pattern provided by other palletizing Steps (Such as Predefined Pallet Pattern, Custom Pallet Pattern, and Mixed Case Palletizing).

You can drag other palletizing Steps to the workflow and set the pallet pattern. Select the corresponding Steps in the right drop-down menu of this parameter, and the Multi-Pick Palletizing Step will use the pallet pattern information provided by this Step.

multi pick palletizing offline

Basic Move Settings

Some of the trajectories during box palletization are shown in the figure below.

alt

alt

alt

alt

  • P0: reference point; P1: intermediate point; P2: entry point; P3: adjustment point; P4: placement point.

  • P0-P1: intermediate point segment; P1-P2: entry segment; P2-P3: adjustment segment; P3-P4: placement segment.

Motion type

Joint move

Joint motion, which guides the robot to move in a curved path. It is less likely to reach singularities in the path for joint motion.
This motion type is applicable to scenarios where the requirement of path accuracy is not strict and the robot moves in a large space.

Linear move

Linear motion, which guides the robot to move linearly.
This motion type is applicable to scenarios where there is a strict requirement for path accuracy, such as welding, gluing, and certain types of picking.

Singularity Avoidance

When the motion type is Linear move, enabling this function can simulate linear move by joint move with multiple segments, thus reducing singularity problems to a certain extent.

Parameters Setting

Limit to Motion Segments Specific Number No Limit

Feature

Simulate linear move using joint move with a user-specified number of segments.

The software calculates the number of segments needed to simulate linear move.

Advantages

  • The waypoints are more evenly distributed and the number is controlled.

  • Applicable to Standard Interface communication.

  • The success rate of path planning is higher.

  • Only move to the required number of waypoints.

Disadvantages

  • If the number of motion segments is set too much, the robot will jam and slow down.

  • Setting the number of segments manually may slightly increase the probability of avoidance failure.

  • The waypoints may be unevenly distributed.

  • Not available for Standard Interface communication.

Parameter Description

Number of Segments

When the Limit to Motion Segments is set to Specific Number, it refers to the number of joint motion segments specified by the user.

Max Position Deviation

The maximum allowable deviation of the new multi-segment joint motion path from the original linear motion path. The greater the max position deviation, the higher the success rate of singularity avoidance, and the lower the similarity between the actual trajectory and the straight line.

Max Angle Deviation

The maximum allowable angular deviation of the new multi-segment joint motion path from the original linear motion path. The greater the max angle deviation, the higher the success rate of singularity avoidance, and the lower the similarity between the actual trajectory and the straight line.

Velocity & Acceleration

Velocity and acceleration determine how fast the robot can move. Usually, the set acceleration should be lower than the velocity. When the set acceleration is higher than the velocity, the robot will move in a choppy way.

The velocities of Vision Move and its prior and subsequent Steps should be relatively low to ensure that the objects can be picked steadily.
Blend radius

Usually, the default setting can be used.

  • The blend radius refers to the distance between the target point and the point where the robot starts to turn. The larger the blend radius, the more smoother the robot motion transitions are. If the robot moves in a relatively small space, please set the blend radius to a smaller value.

  • If the robot moves in a relatively large space without obstacles and the distance between two consecutive path segments is long, please set the blend radius to a larger value.

We Value Your Privacy

We use cookies to provide you with the best possible experience on our website. By continuing to use the site, you acknowledge that you agree to the use of cookies. If you decline, a single cookie will be used to ensure you're not tracked or remembered when you visit this website.