The NLP community has cared about data “before it was cool”. On the other hand, as the community of ML/AI practitioners grows there is a growing interest in bigger, faster models which learn from huge amounts of data. But is it really true that “there is no data like more data?” I will make the point for a more data-oriented approach to NLP and for developing strategies to adapt our models to use-case specific scenarios.