If you are worried that the capacitors themselves are emitting audible noise, I think you can relax. It is much more likely that the inductors/transformers are making sounds. If the windings are a bit loose, or the core isn't well locked down, they'll vibrate and make noise.
Defective capacitors can indirectly cause noise in audio circuits through a variety of mechanisms, but for the capacitors themselves to emit noise is unusual.
Defective capacitors can indirectly cause noise in audio circuits through a variety of mechanisms, but for the capacitors themselves to emit noise is unusual.