The feathers and other parts left over from processing can go into the compost. I was surprised that it didn't smell. It was covered well and buried. I suppose you could just throw in some dirt if you didn't have enough compost volume.
You could just bury it in the garden also, to enrich the soil.
The bones, neck and feet make a rich stock. You can also throw in the head, but I have a problem with seeing that floating around in the pot on the stove. It's sad enough seeing the feet in there!
This benefit to organic gardening may be a stretch... but since I started free-ranging my girls I am much more careful about what goes in the yard. No pesticides, roundup, etc. This will help protect the soil and wildlife in my little part of the world. Having chickens has made me more aware of how my actions in my yard can make a big impact, for good or bad.