hi fran,
yes, i too have found that my olive oil soap has a unique smell... i actually find it quite unpleasant. i make unscented soap, so there's no essential or fragrance oil to cover it up. i dislike the smell so much i have actually decided to stop using olive oil altogether. and extra virgin olive oil smells worse than refined olive oil.
when i first started making soap, i used oo in all of my batches, so i just thought that's how handmade soap smelled. but after moving onto other oils, i realised it's the olive oil giving off that funky smell.