Most natural scents fade, and that's probably why fragrance oils are so popular.
Ive had better luck grinding spices into oils as well as infusing, such as star anise. I put about 2 handfuls into 1-1.5lbs of oil, let them infuse on a low heat overnight, blended them, left them for a few hours...