You have them all in one pen?
I'd pull the kits out for now, then bring them back in the evening and see who tries to hop in and nurse the kits.... Or just watch them carefully and see who tries to nurse. You could try flipping your does over and looking for reddish swollen teats full of milk... Not really sure what else to suggest. This is why I don't do colonies. :|
