Here is an article on assisted hatching that might be helpful...
https://www.backyardchickens.com/articles/step-by-step-guide-to-assisted-hatching.64660/
I'd help this little guy out of the egg, if it pipped yesterday morning, there's a problem.
As for the lice, I would wait until her eggs hatch and then begin treatment on all of them, coop and nest box.