Yes, really, a daily diet that contains more than 30% protein can cause health problems. A handful of kitten food every now and then should be okay though.
Note that kitten food is way too high in protein for ducks and other fowl... I think most are around 40%. Diets in excess of 30% protein are not recommended for poultry.