Here's how I lined up that pesky pin. I know it doesn't like to go back in.
I tapped a bundle of round, tapered toothpicks into the hole. This holds the pin holes in perfect alignment. Then I just tapped the pin right in. The toothpicks all came out and the pin went right in. It was easy.