"Maybe that caused trouble, but we were drifting apart anyhow."