Seems like it would be an electrical problem with the starter. Probably the brushes or the copper that they ride on.
You can take off the circular band that goes around the starter to take a look at the brushes and contacts. Maybe you can get in there with a screw driver and get it to move a little. Then hit the starter button to see if it will take off.