You could try finding another rooster or some larger hens that are more assertive to keep him in line and just have two flocks or you could look into rehoming him. It sounds like he has some attitude issues though, so I would probably not trust him around small children.