I'm surprised they did not go back inside
mine go in and out and in and out all day when it's cold and windy, sometimes it's even half and half and the birds inside will be pecking at the window looking at the birds outside. You could put the food and water inside on the really nasty days (just remove it overnight) and then they would find the inside more tempting and likely spend more time there.
