It is possible you may need more females. He may be overdoing it mating with two females.
I think it is recommended to keep 1 male to 3-4 females to avoid too many feathers being pulled during mating.
I could be wrong though. You may want to wait for someone more experienced to reply. But...