Actually, breeding season is such a short period of time that pulling out the breeding females and do the matings is only a month or two of the year. I don't think you'll have any issues.
I pulled out some females for conditioning in a separate place and taking to the Nationals in Knoxville. They were out of their main group for well over 3 weeks, all told. No issues upon their return.
BTW, crowding and boredom is the #1 issue in most of these negative situations. But all you folks already know that.