Once aberrant behavior is started it generally continues. Very common for adult geese, especially singletons, to adopt ducklings or goslings. It's a very different behavior than that expressed by immature birds.
Give them more space and very likely the problem will go away. They are overcrowded and bored, and there is not enough space for the ducklings to get away.