Before you do anything--calibrate your hygrometer. It's unlikely that it's off by 20%, but it is also unlikely that it is completely right. Put a cup of wet salt (texture of wet sand--NOT dissolved) in a ziplock bag with the hygrometer (not touching--use a large bag) and leave it over night. It should read 75% but if it doesn't (and it probably won't), make a note of how much it is off by. Then you will always add or subtract that amount to get the correct reading.
Taking action before you calibrate might cause more harm than good. But do it soon, because you don't want your eggs running at too high a humidity for long.
Where are you located? What is your ambient humidity (i.e., would you consider your area a high humidity area, low, or somewhere in between)? If your normal humidity is very high, then you may not need water in the incubator at all, and in that case, I would go ahead and take it out until after you calibrate, at which point you'll make necessary adjustments. But if you live in a dry area, leave the water in until after you calibrate.
Good luck!
