It is carrying around an unabsorbed egg yolk sack. It probably hatched a little early, and thus did not completely absorb the yolk into its body.
In most cases, the egg sack will dry up and fall off fairly quickly. I have had several birds with this problem, and they all survived.