"Gloria and I would walk to our polling place"