For the gauge to register anything, yes, of course the engine would need to be on... otherwise it'll sit at zero just as if it were unplugged.
You could try wiring in a 10 Ohm or 25 Ohm rheostat in series with the ground/signal wire for the gauge and see how it responds as you turn the knob.
__________________
If something breaks or you need to contact a member of the administration please post HERE. Unless it's a private or administration matter please post it on the forum. It benefits no one else if car related questions aren't posted for future users and takes away from the time I'm able to spend helping on the rest of the forum.
If you're so inclined I'm always more than happy to accept tips via PayPal. 
Tip Jar ---> 
|