Hi, and welcome to BYC! I think a roof is a must, if you want to keep your chickens longer that a week or two. Also, I have a 6ft. high fence all the way around my run, and a couple of the hens can fly out with no problem, and they're considered heavy breeds. I think your chickens will be happier with a roof over them, especially in one of those downpours!