"I haven't been the biggest friend of the administration."