It's more complex than that, so allow me to elaborate on this.
Sex linked barring and Sex linked Dermal Inhibitor are linked close to each other, but not that close(the only research I was able to find said a distance of about 10 map unit/centiMorgan which equates to about 10% chance of cross over) now 10% is something a backyard breeder could work with(10% on females so 5% chance total of chicks hatched).
The sexing of chicks sired by Silkie males over hens with Dermal Inhibitor can be quite high, males having light skin and females having black skin, but this goes out of the windows when you use a Ayam Cemani Rooster over hen with Dermal inhibitor(for example a Cream Legbar Hen) You will see males with dark skin also. So there is something that inhibit sex linked Dermal Inhibitor.
Here is such a chick
View attachment 3155159
Also there are multiple Barring mutations already studied, so it could be a combination of the breaking of the B-Id linkage or the Inhibition of the Id expression by other genes, Heterozygous recessive white is known to boost dermal expression on White Silkie Rooster/Id hen crosses(at least to show Dark Pigments on Shank color)