"I'm not saying you have to ask my permission,"