It would be best if separate him with his new companion for a while so they can bond.
When I added a new gander to my goose/duck flock, he did try to mate with the larger ducks that I had and ignored the lone female goose without a mate. But wouldn't you know, once the ducks were separated he...