Go into pen with your bucket without feed in it. Walk about, even allow rooster to check out contents. If need be get another bucket to sit on. Allow him a few minutes to give up on exploring / pushing you for eats. Then get some and poor it into feeder. I spend a lot of time around mine without immediate reward of feed for vary same reason. Groups interacting with me only when feed applied most likely to be problematic.
