"Leave whenever they want? We're talking about elderly and infirm people here."