Can he turn on you? Absolutely. All roos are capable of that (and hens...I've had a few...) That said, I've owned 3 Silkie roos and all of them have turned on me.
This situation has to be handled right away, else it will never be solved. Aggressive roosters need guidance. In my opinion, there is no way to get rid of the behavior, just manage it a little better. Whatever you do, NEVER hit, kick, smack, etc a chicken. They see you only as an advesary and will fight back until they cannot any longer, and you're capable of doing more harm to him than he is too you, spurs and beak or no. Birds naturally try to never show weakness. That sort of violence will only result in an injured or dead animal that was only acting on instinct and hormones.
Every time my boy feels like picking a fight (only when he feels very daring), I pick him up and walk around with him, usually carrying him up in the air, tilted to his side a little bit. He may struggle, but if you are restraining him without hurting him, there's little chance he will bite or fight back when subdued. When he is not longer struggling, I place him on the ground and hold him down on his side until he is not struggling again. Be firm but gentle. Then, quickly let go. He will either fight back again, in which case repeat until he gets the message. Or, he will walk away with a little less pride. But DO NOT walk away first. Wait until he does. Roosters fight dirty, and will attack when their opponent is least expecting it. By turning away first you are giving the message that you are submitting. Let him be the one to make the first move.
Messing with his mating and domineering habits may work now, but be prepared for worse. 2 out of 3 of my Silkies were too much for me to handle (I had little patience) but the 3rd I find very essential to my flock. He will protect his girls very well (chase away the medling ducks looking to steal food that was never theirs) and always on the lookout for outsiders. He will never really accept his place below me but there are qualities about him I treasure more than his attitude. I simply warn strangers to not to get in his way if they don't want trouble.