Some geese breeds have "lobes", typically one or two, that hang down from their abdomen. In Chinese geese, a single lobe may appear during laying season (and is normal). Is this what you're seeing? A photo would help to confirm.
My geese like to eat dirt, too, and I suspect that there may be...