If it smells sour, it could be going bad. I would let it sit for a couple of weeks after you strain it just to make sure it doens't grow anything in there. I personally have not gotten a scent to transfer from the infusion to the soap. Others have said they have though, you might see how they infuse.
I really like orange and patchouli, patchouli and cedar and one blend I did that I save for perfume now is, Lemon, Rosewood, Ylang Ylang, black pepper, patchouli, cedar, ginger and geranium.
ETA: I store my soaps after 2 weeks in cardboard boxes. I don't over crowd them so the they still get air unlike a rubermaid type of box. I do that for space reasons. I can only cure about 500 bars on my racks now and after 2 weeks need the space. If you have the space, cure for as long as you want in the open air.