No oils are allergy free, people can be allergic to just about anything. That being said, nut oils and shea are some of the more common oils that cause allergic reactions.
This is why you need to label your soaps with everything that is in them, even if giving as gifts, people should know what they contain.