"It wouldn't work between us."