Take a look at this post - Here
Ultradog shows in the first picture the part that hooks to your
pump and the splined end that slides into the adapter on the pulley.
A little further down they show the adapter.
In perfect shape, it would just slide out.
If you have something else on that shaft that won't pull out the
front maybe it is a different type or something home made?
Can you post a picture of it?