Four days apart isn't too awkward. I've done staggered hatches before that have been much more complicated, and still had a reasonably good hatch rate. If I were you, I'd monitor humidity/moisture loss as carefully as possible in order to make sure that neither batch of eggs is losing too much or too little moisture, and hold off on lockdown with the first batch of eggs as long as possible. Maybe stop turning them on day 18 just like normal, but wait till day 20 to bump up the humidity. If your incubation humidity has been okay up till then, raising it a couple of days late for the first eggs and a couple of days early for the second eggs shouldn't do any harm at all. When you bump up the humidity on day 20 for the first eggs, you can stop turning the second set and go into proper lockdown with all of them.
Opening the bator to take out the first lot of chicks while the second lot are still hatching poses a slight risk of shrinkwrapping some of them, but as long as you keep your humidity up high and get in and out as quickly as possible, you shouldn't have too many problems. Personally, I don't worry about shrinkwrapping chicks by doing this, as in many staggered hatches and many openings and closings of the bator door mid-hatch, I've yet to shrinkwrap a chick. That's not to say you'd be as lucky, just that it's maybe not as big of a risk as most people think it is. Good luck with your hatch!