"They're destroying the town's past."