That looks like the umbilical and remnants of the yolk. I would leave the duckling in the incubator, as well as offer some nutri-drench or other electrolyte water. If none is available, make a sugar-water solution and offer that.
I'm sure others will jump in and offer better advice, this is...