"I wouldn't have said anything if I'd known you'd stop seeing her."