If you are seeking advice, I would either get about 6 more standard sized hens so your rooster has a flock to manage, or I'd get rid of him and focus on your Silkies. If you keep him, I'd keep him and the larger birds separate from your Silkies. See how it goes. I have had an Ameraucana rooster and he was mean, mean, mean! My best day was when a hawk got him. I recently ended up with a rooster from McMurray's hatchery (he was a freebie), but he's a very sweet laced buff Polish. Beautiful! He also regards me as dominant - although I do occasionally have to remove him from a hen in my presence. He doesn't try much, though. He's NEVER tried to do anything aggressive with any of us at all, but then, I don't have small children. I do NOT handle him, but neither do I ignore him - I talk to and feed all of my birds - they view me as the provider of meal worms and other wonderful treats. My worst offenders are my leghorns - they are so curious and "pushy". I had one fly up and grab the bag of treats out of my hand because I was not feeding them fast enough! She got a swat for her trouble and hasn't done it since.
So, whatever you do, make sure YOU and your children are going to be able to have fun with, and enjoy your chickens! It's no fun having to "look over your shoulder" for an unpredictable rooster!