Honestly, if someone asked me to get rid of all of my animals...that would kill the relationship right there. Animals are my life. However, if the person I have a relationship with or marry has medical issues with the animals, or something else very serious like that, I would definitely make other arrangements to deal with it. Animals are not more important that people or their needs, but animals ARE my need...and others have to respect that.
Now of course this is the way I feel and your situation might be different. People companionship is important, but if your life will be miserable without your animals, even if you are with the one you love, that doesn't seem like very much of a life to me.
My advice? Talk to your husband one on one. Find out what the real issues are and see if there is something you can do about it. Then work from there.