Were these quail raised together? Do you have other tuxedos?
I have a trio of two sisters with a tuxedo roo - the girls were downright scared of him for the fist week or so after introducing them although he never pecked at or chased them - he just went straight to offering them food the moment he saw them.
None of my other introductions have been like that - the girls have just accepted the males right away. So I think, to a quail, the tuxedo coloration is very different and could be cause for them to reject him. My tuxedo roo was also chased and pecked by his own sons when I didn't remove them before they matured.
In general buttons should be kept in pairs - or at least with only one male in each enclosure that has females. Otherwise fighting, chasing, pecking and unnecessary stress will happen. The girls are probably rejecting him due to his color, the fact that he's not at his best right now and because they've seen that he's at the bottom of the pecking order. If you remove him and one hen from the original enclosure so the hen can no longer see alternative, more 'attractive' males, and keep the two separated by a layer of wire for 1-2 weeks to allow him to fully heal and the two to get used to each other, then you might still get a hen to accept him.
You might also be able to house him with the silver that seems to accept him, once he's healed, as long as you keep the two alone with no females in sight. In any case I'd get the flock separated either in an all male and an all female group or in pairs or trios to avoid further issues.