I would definitely wait until at least they're 12 weeks. I had a hard time sexing mine as well but my female (who now lives with my mom) is 17 weeks old and still has yet to grow a comb.
And my cockerel crowed for the first time around 12 weeks - that's usually an indication lol.y