yellow soap. colour too yellow

My soap recipe has a high olive oil content, other oils used are coconut oil ,shea butter & castor oil. I like to colour some soaps with ***. Dioxide plus one other colour but I find the white portion always comes out slightly yellow because of the colour of the olive oil. How can I get round...