A possibility is an ingrown feather cyst. With those, you can use a sterilized needle to dig around under the skin to look for a feather. These may have pus inside.
A peck wound can also cause an abscess that might contain solid cheesy pus. Cysts can be common, as well as tumors.