"The point is, we're not allowed to have you in this building."