"It'll cost us too much politically."