@Jennifer, the orange is from the honey and is quite normal - the colour will reduce over the next few days. To lower the heat from the honey in your next batch, you could use Irish Lass's technique of adding the honey to the cooled lye water (it will go orange and heat back up again - soap once it's cooled again).
The ammonia smell from the goats milk will also reduce during the cure.
It might be worth keeping the soap for a couple of weeks to see if it settles down and the smell and colour cures out.