"I felt bad, but it was time to start pulling away."