"I didn't tell you that she didn't want kids because she didn't want me to."