In grays, whether silver or gold duckwing, I do not expect to see any feather differences between sexes until they are pushing 4 weeks old. Then look for feathers on back that lack pattern and appear darker on males. Females will have a much more even pattern on back and body as a whole. Then be looking for smokey grey feathers coming in on breast. Generally before feathers become evident, males pull ahead in terms of comb development. It takes a group to see that pattern play out early so you know what to look for. There will be inaccuracy with using comb so early.
A gold duckwing stag I have could not be sexed based on feathering until he was pushing 8 weeks old as color development is big timed delayed in some. He will look a lot like yours except gold duckwing rather than silver duckwing yours are likely to be, and he will have blue legs while I bet yours will have willow legs.
When you have a small number of chicks, odd decent all will be one sex or another by chance alone. I have had two broods of seven where each had only one male just within the last two months.