I know this may sound silly, but my best advice would be to not handle him...yet. I have found that if you try and handle them and interact before they understand your intentions, they will continue to get scared. Start off with going up to him to give him food, then find a food that he really likes and hand feed him that and other scraps. Then he will understand your intentions and you can slowly start handling him. When you do start handling him, do it in short amounts and when you let him go, leave him be and give him food. This way you're taking away the thing that he's scared of (you) and giving him something he likes (food). He will also start to associate you handling him with getting food afterwards. This is how we tamed our two year old untamed golden pheasant.