Cornelia Hammer, Ms. Diane C Kostroch, and Mr. Gabriel Quiros-Romero
Big data are part of a paradigm shift that is significantly transforming statistical agencies, processes, and data analysis. While administrative and satellite data are already well established, the statistical community is now experimenting with structured and unstructured human-sourced, process-mediated, and machine-generated big data. The proposed SDN sets out a typology of big data for statistics and highlights that opportunities to exploit big data for official statistics will vary across countries and statistical domains. To illustrate the former, examples from a diverse set of countries are presented. To provide a balanced assessment on big data, the proposed SDN also discusses the key challenges that come with proprietary data from the private sector with regard to accessibility, representativeness, and sustainability. It concludes by discussing the implications for the statistical community going forward.
For the latest thinking about the international financial system, monetary policy, economic development, poverty reduction, and other critical issues, subscribe to Finance & Development (F&D). This lively quarterly magazine brings you in-depth analyses of these and other subjects by the IMF’s own staff as well as by prominent international experts. Articles are written for lay readers who want to enrich their understanding of the workings of the global economy and the policies and activities of the IMF.