You can buy a standalone hygrometer. Many people here seem to buy an extra one if the incubator already has one built in. You will want to calibrate it.
The humidity will drop when the reservoir runs dry. Might be hard to tell if the humidity isn't real stabile. You might fill the reservoir then run it until you see the humidity drop. That would tell you how long you can go without refilling.