I had the same problem, but I used long legs on the caps to I could bend them so now the cap rests against the heat sink. It still works fine in this condition.

Personally, I'm leaving it for now until I can get new caps later, this way I know that the PSU works.