My 2 year old loves the water too. His clinic said he can swim anywhere. They said they prefer the (salt water)beach because it does wonders for the lungs, but anywhere is fine (assuming it's not stagnant). And it's great exercise and great for the lungs.
Edited to add: They do however say to avoid hot tubs.
Edited to add: They do however say to avoid hot tubs.