"I've been trying so hard not to fight with him."