By knocking her down in the pecking order, it's not going to cause one of the others being picked on, is it? I "get" that they have pecking orders but i just don't want them to hurt each other...
Do as you wish but in the realm of the chicken there is always a top dog, and that means that the remainder of your flock are underdogs.
Has the hen being picked at molted yet? They usually start molting in the neck area.