With the silver/gold duckwings, yes, the color of the various sexes does matter. It works like this. Silver hen x Red cock = Golden cockerels and red pullets. Silver cock x red pullet = Golden cockerels, silver pullets. Golden cock x red hen = 50/50 split golden/red cockerels, and 50/50 split silver/red pullets. Golden cock x silver pullet = 50/50 split golden/silver cockerels, 50/50 split red/silver pullets. Silver is sex linked color, just like barring. There is no golden female. Some hens appear to be golden, these are IMHO wheaten/wildtype heterozygotes (crosses).
Blue works the same as in any other breed of poultry, and the sexes don't matter.