I've tried twice to make a bar with a sugar scrub component, but it seems the sugar melts. I've tried melt and pour with olive oil base and with goat milk base. Last time I added a lot of sugar and waited til soap was already thickening and same result: no sugar granules.Any suggestions?