A bad worm infection could definitely cause him to be a little off balance. The worms are taking all of his nutrients, so it’s kind of like if you’ve ever been super hungry or had low blood sugar and felt a bit woozy. I would treat first as
@Wyorp Rock suggested, and if after he’s treated and has had a little while to re-nourish himself he’s still a bit wobbly, then start looking at other possible causes.
Edit: while I mostly agree with
@Wyorp Rock, Safeguard (specifically that for goats) and Valbazen are both effective against tapeworms in poultry.