Yes, it is threaded. It may be worn unevenly enough that adjusting it by turning is not feasible. You can replace it since the pin is not that expensive as these things go. It's hardened so turning it down on a lathe is not that easy.
You would also want to check the bolt on the back side of the box that holds the flat plate up against the box.