"All I said was, this town is not good for her,"