It definitely could be the problem. Substrate has played a big role in one of my trays of meal worms this past year. I got hold of a 50lb sack of wheat mill run. It's a highly nutritious, yet inexpensive by-product of milling white flour.
I hatched some meal worm eggs in it, and six months later, the larvae had grown to nearly an inch and three-quarters in length, twice as fat as normal ones, and they didn't pupate for six months, at which time only a few went into the pupa stage. Only a few of those made it to adult beetles, and those had no wings and never had any vitality, soon dying.
It alarmed me at first, but I quickly saw the advantage of keeping a few trays of mill run to grow huge larvae for the chickens, while keeping the rest of the larvae in wheat bran so they would pupate and perpetuate my worm colony. Win, win!