I don't stir until I add colorant/scent, although sometimes I will need to to help it cool, and I can tell with the finished bar that it's not as smooth.
If you're concerned about a smooth pour with HP, add a bit of honey, use beer for the liquid, or add about 2% Sodium Lactate to the soap...