"I wasn't thinking about what's best for you and Harry."