It's up to you to decide. But the longer you wait to collect eggs after the hens deposit them, the greater the risks are of damage. Too many eggs accumulating in a nest increases the likelihood of breakage as a hen gets on and off the pile and deposits her own egg.
It also increases the risk that a hen might be tempted to break into the eggs and become an egg eater. Once a hen adopts this habit, it's very hard to break.
Most of us collect eggs each day. I collect several times a day because I've seen my share of breakage when I let them accumulate.