Hi,
You don't need to remove the heater return fitting at the rear of the head. Must be something else not removed or not undone. Have you removed the thermostat housing at the front?
I had a lot of problems with that heater return fitting at the back seized solid. If you do remove it when the heads off and need to replace it remember to order all thee parts from Toyota.
Bill UK