If he's attacking you, that's a problem. Try taking a stick in with you and shoving him away in whenever he starts to seem aggresive. It might help to put him in his place-- it worked with on of our cockerels.
Is it just one pullet with the RIR cockerel? He could be over-mating her and she...