It is unlikely to be IIfx logic board caps as the IIfx seems to have all tantalum caps and no electrolytic. Still, it seems that something is preventing the power-on circuitry from "latching". If you have the skill, I'd look at the power-on circuitry schematic (I think it's available at Gamba's site?) and try to determine what is essential to keeping the machine on, after the button has been pressed and released.
My off the cuff guess is something in the power supply unit, as there's very little to go wrong on the logic board in the IIfx.