"They would no longer be one of "us.""