"You'll lose your female fan base."