Well, I don't like your tech. Check the diagnostic LEDs when it goes down to help isolate the problems. Put a heavy load on the GPU by playing uTube videos on it.
UPDATE
the diagnostic LEDs are to the right of the RAM slots.
LED #1
Indicates that the trickle voltage from the power supply has been detected by the main • logic board. This LED will remain ON whenever the iMac (24-inch) is connected to a working AC power source. The LED will remain on even when the computer has been shut down or put to sleep. The LED will turn off only if the AC power source is disconnected or the power supply is faulty.
LED #2
Indicates that the main logic board has detected proper power from the power supply when • the computer is turned on. This LED will be ON when the computer is turned on and the power supply is working correctly.
LED #3
Indicates that the computer and the video card are communicating. This LED will be ON • when the computer is communicating properly with the video card. If LEDs 1 and 2 are ON and you heard the startup sound, but LED 3 is OFF, then the video card might be installed incorrectly or need replacement.
LED #4
Indicates that the computer and the LCD display panel are communicating. This LED will be • ON when the computer is turned on and video signal is being generated. If the LED is ON and there is no image on the LCD display panel, the LCD display panel or inverter might be installed incorrectly or need replacement.
UPDATE
Well this is really not what you want as a first project but here's the guides along with a list of the tools you need to start with the power supply: iMac Intel 27" EMC 2546 Power Supply Replacement