According to my rav, a man and woman may be in the same body of water together, provided they are both dressed appropriately.
Since a husband is allowed to see his wife dressed in non-tzanua clothing, wouldn’t it follow that he is allowed to swim with her?