Don't put the vent hole where the fan itself will pull fresh air in directly. Vent should be installed in off-kilter way.
What kind of thermostat are you using? You say temp holds steady, just lower the thermostat temp. If you are thinking of just using a certain wattage bulb and then adjusting...