I wouldn't take it off at night. They have to get use to it. Leave it on till you see that their feathers are growing back in. If the roosters continue to mate and pull their feathers out, you have to decide on what you want...naked chickens or less/no roosters.
Hope this helps..If I remember correctly, I read an article in the BYC bi-monthly magazine several months ago that a lady used her husbands very expensive duct tape to make a saddle for her hens. I beleive that she left the tape saddle on until it actually ( or mostly) fell off teh hens. By then the new feathers were growing in and the area of skin was healed. I was actually thinking about doing the same as I have a few hens that are scratched up quite a bit. I would use a gaffers duct tape or a black duct tape first. Weird but I sounds like it would work.