"But we can't ask Shirley to let him back in."