“unmarried couples publicly living together”
Nothing halachically wrong with a non-Jewish opposite sex couple living together. Prior to matan Torah, men would take a wife in the marketplace and the couple just start living together — no ceremony required.