Wash them in 1 gallon of water and 1 cup of H2O2. It'll come off.
A formal 2 part bud wash would make the world of difference and not only wash off PM, but would disinfect them, get rid of dust, hairs, mites and bugs, and any other nasties that land on them.