Caps indeed.

Check the DC filtering caps (the big one(s)), also measure the PSU startup-resistors (if any) while you're at it.