Find Correspondence between Poses and Offsets