"I don't want the State of the Union overshadowed by some asylum dispute."