Our 65 Caravel
had the same problem. I found that the pin was stuck in the part of the hinge attached to the door, and so the pin was turning in the part of the hinge attached to the coach, and had worn those holes to the point where the door fit almost as bad as yours. Oil holes had been drilled in the hinge at every point on both sides of the hinge pin, but the pin was still stuck in the door side. I removed the pin, not an easy job as it was pretty stuck, and removed the door. I tapped out the oil holes on the upper front side of the door side of the hinge, and the back side of the lower coach side of the hinge. I inserted set screws. I then put it all back together. Then I tightened all of the set screws. That placed the upper end of the pin rearward, and the lower end of the pin forward, putting the door in the middle of the opening, where it belongs. Now the door turns on the pin rather than the pin turning in the coach part of the hinge.
I don't have any pictures of this, however I am headed to the trailer this morning and will take a photo or two and post them later today.