I believe egg production IS affected. But that doesn't make for a seriously lousy layer. . . Not even my Polish are "lousy layers" even though they're deemed to have a poor laying habit, and are only "ornamental." But, with birds like, say, Tolbunt Polish - Their lack of egg production makes up for in other ways, such as their worth and their beauty. Plus, that's why you always have other birds around to make up for the production, like my Marans, Ameraucanas, and Araucanas.
I like a challenge, and I like a breed in which I have to focus on both quality of egg and physical bird, but not exactly quantity of egg - That's a hatchery's job.
I think that if I had an amazing hen, who only laid eggs every now and then, . . . She's still worth it.
When it comes to breeding, there's always, in my opinion, having to be the "layer hens" and the "breeding hens" - The layer hens are the lower quality but still make the grade you call for, so they give eating eggs. Then there's the breeding hens - The girls who may or may not lay well, but who cares. . . Their eggs are primarily for hatching or selling.
I have plenty enough "layer-grade" Ameraucanas, Araucanas, Marans, and simply hatchery quality hens to make up for my "pick of the flock's" egg production.