I agree, always better to use the power button but if that method is not working then use the rocker on/off switch on the back of the PSU.
The PSU sounds like it is "past its use by date" meaning that it is having issues like a short somewhere, it's surging power dricectly to the motherboard like continuous peak power.