Let's take a better look at this:

I read what unity said in the forum above, and it looks like I put the cap polarity in the same as the others. I reverted it, same result. If you take all load off, such as floppy and hard drive, it stays on if you are holding the power button. Once you plug something to the graphics card or add a hard drive, it dies. Hold the power again and it ticks, chimes, ticks, chimes...

I do have a Q700 coming next month, so I will see what happens if I swap PSUs.