I guess you can use non-polar...

However, given that a bipolar capacitor will not have the ripple rejection properties that a polarized will I'm surprised there aren't any problems...

Maybe you got a bad new cap, it can happen...

Also: it's probably not out of the realm of possibilities that this could be an Analog board issue, maybe voltage is low, maybe a capacitor has gone bad one that guy...