ok, our mistake was teaching 3 point calibration for the grid frame. The grid we have uses a fiducial so we needed to train the frame using a 4 point calibration. The camera also automatically detects the fiducial and sets it as the origin.
That seemed to have fixed the problem.