Yes, you want the silver factor because that is not dominant white, (nor if I understand things not recessive white either). You definitely do not want to use dominant white as it covers up stuff like barring in the visible bird and dominates all other color/patterns so males and females are identical white. I'm seeing recessive white can do that to in the first generation, but have things crop up in the second generation.
The only way to truly see what the genetics of a bird is to carefully breed it to see the outcome.
If the hen were white dominant, all the chicks would be white (with maybe a speck or two black here and there).
If the hen were recessive white, I'm seeing the chicks coming out black...but if she had barring hidden underneath that white, then you would get black barred males...or simply half of them black with white head dots (male and female) and half red (male and female)....which is probably what happened now that I think a bit more on the possibilities.
If she were silver, you would have had the RSL's you were going for, males yellow/gold with the females red/gold.
That is of course assuming the issue is with the hen...the RIR roo might not be as pure as you thought as well...then it becomes a crap shoot as to what you get with all the extra genes mixing through the Punnett squares.
My best guess with my current knowledge,
LofMc