"If mere infidelity were enough to ruin a marriage,"