I second aarts suggestion: A walk in coop has Lots of advantages!
but to answer your question, If I were building a coop from scratch, I'd insulate it.
Sandwiching insulation between the walls in the coop that you are planning to build seems to be a good idea.