With the power disconnected, if they are present, disconnect all components such as hard drive, video card, etc. Take out RAM. Take out CMOS coin battery and press power button to clear BIOS settings.
Now just plug in the power cable. Does it turn on and stay on? If Yes then one of the components is defective. Install one at a time until it shuts off as you describe above.
Did that help?