Depends what you're doing. You can squirt a little directly on the item you're cleaning. Sometimes I put a bit on a paper towel or magic eraser and scrub with that.
Careful with the Dremel. You might try a brass bristled brush first. I recently got a package of three at a dollar store. They look a lot like a toothbrush with metal bristles.