"But I think the town is losing some of its charm."