Goat = one goat.
Goat's = possessive; belonging to one goat.
Goats = more than one goat.
Goats' = possessive; belonging to more than one goat.
Goat's Milk = possessive; the milk of one goat. Unless you're milking your own goat (as in your only goat) this is, IMO, wrong. If you're...