"If you don't start saying no,"