"You're the father of my children, but they're the ones that pull you back."