Give it time.
If the cockerel and remaining hens are getting along OK, I'd not worry.
Has he mounted them yet, did they submit?
I wonder if he's old enough to mate, 4mo is right on the cusp of sexual maturity.
Could be the stress of the flock mates being gone and adding the new cockerel that...