Looking at the pic you shared, I'd also say whatever colorant mixture you used to make the colored soap layers made those bits softer than the white bits. Did you use more water or oil in those parts and not account for the extra fluids? Anyways, when your cutter went through the colored layers, it looks like that soap didn't cut cleanly and smeared onto the cutter. That made a messy cut even worse.