Do you have a forced air furnace?We can't get around pulling in outside air, as we have a wood stove. Even closed up, there are leaks. If we run a fan blowing out upstairs to pull cool in downstairs, there is often a hint of "wood stove" smell in the living room.
If you set it to recirc you could filter the air in the house.