You are still going to need a good 3-6 months cure time with that much olive...or I would, anyway.
My memory is horrid these days, so please forgive me if I asked this already, but you have an objection to using animal fats?
At any rate, I would look to do something vaguely like this:
Palm/tallow/lard 50-60%
OO/other liquid oils- no more than 20-30%
CO/PKO 5-15%
Castor Oil 5%
By having the palm/tallow/lard be the largest portion of the soap, you get a good hard bar that does not take forever to cure. CO for the bubbles, castor to stabilize the lather, liquid oils for the conditioning.
If you must have the butter, lower the liquid oils and the palm/tallow/lard portion about equally.