Yup, ricing is just cosmetic. This is actually a common issue with florals. I know when I started soaping 15 years ago (geez!) that was the "rule". That you held back your "superfatting oil" (I used 5% sweet almond) and added that and the FO at trace. That was THE RULE. Now that - and a lot of other soaping things - are more like suggestions. I think the idea was that if the fragrance caused a problem, then you could quickly put it in the mold. You can try some things to help stop or at least lessen ricing.
Soap cooler.
Try adding your FO to your oils, then adding the lye. (sometimes this works, sometimes this makes things worse.)
Blend soap until just emulsion then add FO. You might also blend the FO with a bit of carrier oil or even water, then blend that with the just-emulsified soap batter.
If none of these work:
1) Hot process
2) Tweak your recipe to use more slow tracing oils.