Not sure about how long should, but I just do it until they can eat other things. I have gone 2 weeks with cornish Xs and then introduced smaller grains, like wheat, rice and cracked corn and introduced greens at about that time also. The sooner I can get them on whole grains and grass, the sooner I will save on feed.
I recently started passing all my grains through a handcrank mill on a coarse setting and using that in place of started feed. I figure it cost about 30 cents a LB for starter and 10 cents a LB for whole grains and I figure starter is really a large percentage of grain anyway. Fortunately I haven't killed one yet.
Grass is free, except the trouble to collect and the chickens love it, so there...