I love my goats too!
We have always had them, and there has been many bucks that I loved too!
But I did kind of learn the hard way that loving and playing with them to much doesn't end very well.
If he does start to get nasty, a smooth stick whacked across the side of his nose works wonders!
I don't like doing it, but if that makes the difference between being able to keep him, or having to get rid of him, I think its worth it.
Afterwards, just moving toward him with a stick makes him forget about butting me.
(And yes, I am thinking of you, Balen!)