"I have a lot more to lose than you do. My marriage, my family."