What % is the olive oil to the whole batch? How much superfat did you do?
If the olive oil is only a small % of the total and you had a higher superfat, you may be ok.
If the olive oil is a large % of the total oils, take it out of the mold, grate it or chop it up, please wear gloves if you are touching the soap, add the olive oil and hot process it in a crock pot. It may not look like you wanted it to but it will be usable. I did this to a beautiful purple ball soap with a white background. I realized I misread the recipe and was short by 10 oz of oil...it was only a 28 oz batch total so it was a big difference. I had to chop it, add the oil and do the same.