I have the same trouble when zeroing a new pistol. I usually fire a couple rounds then check target, adjust rear sight, fire a couple more, check target, if bullet holes are going wrong way, adjust...