I use these for cleaning any surface:
They're 3M brand and you can buy them at any parts store. I forget what they're called. They're very soft but they are excellent at cleaning gasket surfaces. I've always used them with a pneumatic die grinder like pictured, but now that I have a dremel I might give that a shot.