Haha guilty of that too sometimes.
Exactly the way I was thinking but without the relay. I was going to unsolder the Mosfet, take a wire from the gate pin to the mosfet thats on a external board that then allows you to use the 24V with the loveliness of PWM! Also gets rid of that ticking from a relay!