YES YES SO YES!!!What I do is turn off the heating pad at around four weeks. And my temps are much colder than yours, 50s during the day and 30s at night. The chicks continue to sleep in the heating pad cave for a few nights in the coop without it being turned on. Fully feathers chicks do not need heat, unless it's waaay below freezing. I brood my chicks right outside in the run, by the way, so they've already been acclimatized to cold temps.
MHP transitions them to sleeping in the coop, and after they've become accustomed to the coop as home and have learned how to go in at night from their run, I then teach them how to roost. Usually by six weeks they've got that wired.
You do need wood shavings or straw in the coop. It cushions their dismount from the perches and prevents feet injuries. It also absorbs poop so they aren't slipping and sliding around in the stuff.