"They'd assume something was wrong in the marriage."