Yes it could be the brake is worn out. Could be a lot of things. It also might just need adjustment. Adjustment of the PTO brake however is actually accomplished by adjusting the PTO clutch.
The clutch pack operation and the brake operation are inseparably inter related in there.
I'd first check and adjust the PTO clutch.