Yep, rats are most likely always around in some numbers. Mice too. I keep poison out almost all the time.
Keep rat poison outside the run in a secured way so rats/mice can get it but pets & the chicken cant. Set some snap traps the same way, rat & mouse size, with peanut butter for bait.