It depends. If you have too many in a small area then yes, it will soon be a dirt lot. If they have plenty of room or if you rotate pasture then no, they will not kill the grass.
They actually prefer to browse on tree's, bushes, weeds etc. if they are available.