I wouldn't worry too much about it personally. Brush out what you can with a stiff brush. Flush with diesel. Then just change the oil and filter frequently for a few rounds once you get it running.
On the first oil change you might want to pull the cover and scoop out any crud around the pump screen, just in case there's a lot.