Of course I am going to keep breeding to the highest level because that is what makes me happy. I still might cringe a little to make a difficult decision. Especially one I might regret later. I am just worried my flock might not have enough diversity.
With 20+ hens/pullets and 4 cocks/cockerels you should have enough diversity even though they are related (full siblings, half siblings, cousins, etc.). Poultry genetics can withstand a fair amount of inbreeding unlike mammal genetics.