Rotate Poses to Directions with Symmetry Constraint