I must be really lucky so far, because both my male and female are really nice. They don't want me to hold them or anything but they love to lay down next to me and nibble on my hair or clothing. I've finally stopped them from nibbling on my shoelaces ... sorta... now they come up to my front...
I would give it more time. Maybe you can start by making him a pen in the middle of all your other animals. Maybe he is being aggressive to them because he's scared of them?