I have used a small stone like Old does. I also usually flip the knotter up and use a Dremmil with a small stone in it. You can really touch up a dull knife in less than a minute.
I also have a set of stones that will fit my die grinder. They work too but the Dremmil is lighter and easier to wrok with.