One of those battery operated puck lights works great for this purpose. Turn it on a hour before 'roost time' then turn it off when you lock up after dark.
How big is "the actual coop", in feet by feet?
Looks pretty small....and dark.
More pics, showing inside of coop and windows/ventilation, might enlighten us.