"But the new neighbors don't know us well enough"