I have chickens - ducks - and geese together and had very few problems, but they have room to get away from each other.
You said 5 chickens, but I didn't see how many ducks?
Also I would lean towards moving them all in at once - will the ducks still be able to free range during the day?