"If they want to be a problem, they'll have to answer to me."