At risk of sounding like a broken record, yes, replace the caps in the power supply. Usually the big bulk filter on the input is ok, but the smaller electrolytics in the output section will usually be bad. If that doesn't solve the problem there could be something else wrong, but most of the time it will. When the filter capacitors fail, the output gets really noisy/spiky instead of being a smooth steady voltage.