In your second set of pictures, you are correct and the top is female, the bottom male.
In the bottom picture - look at the feathers just in front of his tail - the feathers that are long and flowing, kind of like long hair - they are also pointy at the end. These are called saddle feathers - they only grow on male chickens (look at your female and she only has short, round feathers in the "saddle" area). A cockerel (male under a year - rooster is a male over a year of age) start growing saddle feathers generally around 12 weeks of age - some do a bit sooner and some a bit later.
Thank you!! Any guesses on the age of the black hen. Do I need to get layer feed soon, or is it going to be a while?
on the first set the comb of what we thought was the female was half a gin bigger on the one we were sure was a male, and smaller on the one we thought was a female, that's why we weren't sure. How do you tell so we know next time?
Also, on your first two pics... They are getting very intense red coloration over the shoulders, back, and wings and their color is very "splotchy". Hens tend to have fairly bland, even coloration all over. The big, red comb is also a factor that indicates cockerel.