Oh they should be fine for a little swim. Use room temperature water and just deep enough for them to paddle...about chest high roughly. Don't be surprised if you get a scuba duckie in the bunch...
This was my scuba duckie at 11 days old
You can see how high the water in their first pool...