I thought that OP actuall meant to swap the door as well, surely, if you plan to just swap an outside sheet and keep the frame, it will have to be primed, painted, clearcoated.... Then, given the age of the paint on the car, it will be too obvious that door had been repainted. Most reasonable resolution - get a nice door in same color and swap.