Can you rule out any toxins being the cause? If so, then it is vitamin deficiency. Is the duck around decaying materials, or unhygienic conditions?
How old is the baby duck?
What are you feeding, what type of feed, is it medicated? If so stop the medicated feed and give vitamins+electrolute solution like pedialyte with vitamin E, nutridrench, and selenium.