Are the feathers themselves bleeding? Like from the tube,core in the center of the feather itself? If so, it's probably a "blood feather" and you can stop the bleeding by pulling the remanent of the feather.
If that's the case, and it stops the bleeding, I don't know why you'd remove him...