I agree with vajeep, check your pin. If it is the type that is "bent over" to form the "handle" that you grab to install or remove the pin, then , yes, that type will revolve or wallow around and cause that type of wear. Get a new straight pin the correct size to solve the problem.
One bazillion fish
1991 34' 60th Aniversary Limited Edition #008
2007 Chevy 2500 HD Duramax/Allison
One big parade float & a 40' Wells Cargo 5th wheel trlr.
"Wake each morning & Smile at the GREAT DAY you about to experience"