Skip to main content

Data Resources for International Development: Citation and Replication

A compilation of development data and indicators, at both the macro- and micro- levels.

Citation and Replication

Proper documentation of sources is a key component of scholarly research, and the need for documentation is no less important for data sources than for bibliographic sources. It is vital that scholars in the social sciences and elsewhere who use quantitative data in their work be clear and explicit as to the sources for their data. This is in part because of the importance of replication in the sciences - in principle, your analysis must be capable of being replicated by other scholars so as to better-assess the soundness of your work, which requires that those other scholars have access to the data used in your original analysis.

Greater transparency in sources also encourages greater accountability in research and increases confidence that the data used in your work are suited for the questions you are asking, which in turn will make others more confident in whatever conclusions your research presents. In addition, thorough documentation of data sources makes it easier for scholars to assess whether sources used in your research are appropriate for use in their own work.

More generally, the scholarly community is placing a growing emphasis on greater transparency in and documentation of data sources, to the point where some scholarly journals even require authors to submit their data to archives where others can download them. We have also included examples of data availability policies from different journals in different fields as examples of how different fields choose to operationalize disciplinary norms of transparency in empirical research.


http://www.icpsr.umich.edu/files/ICPSR/enewsletters/iassist.html - This guide will help you figure out how to cite your data in a way that is informative and useful to others. See http://www.icpsr.umich.edu/icpsrweb/content/datamanagement/citations.html and https://youtu.be/xTUiefaq128 for additional information on and discussion of data citation, including its benefits for both collectors/producers of data and users of data.

http://www.esrc.ac.uk/files/funding/guidance-for-grant-holders/data-citation-what-you-need-to-know/ - This .pdf on data citation from the UK's Economic and Social Research Council is another guide to help you figure out how to cite your data in transparent and useful ways. See http://www.esrc.ac.uk/funding/guidance-for-grant-holders/data-citation/ for additional discussion from the ESRC on the need for data citation.

https://www.ineteconomics.org/perspectives/blog/economics-needs-replication - "Economics Needs Replication" - a commentary on the need for transparency in data sources and processing in Economics.

http://media.wix.com/ugd/fa8393_d55bef088ac44830bd194b5f80190479.pdf - "Openness in Political Science: Data Access and Research Transparency": A symposium published in PS: Political Science & Politics in January of 2014 that articulates the need for greater transparency in research practices, for both quantitative and qualitative data.

http://doi.org/10.1177/0049124107306658 - "Introduction to the Special Section on Replication and Data Access " - an introduction to a symposium in Sociological Methods & Research on replication of quantitative research in Sociology.

http://dx.doi.org/10.1093/toxsci/kfv330 - "More than Manuscripts: Reproducibility, Rigor, and Research Productivity in the Big Data Era" - a commentary in Toxiological Sciences that argues in favor of two things: (1) providing both data underlying publications and the code which transforms and analyzes those data to produce the results in those publications, and (2) treating data and code as citable contributions to science in their own right. The commentary was co-authored by Dr. Lance Waller in Emory's School of Public Health.

http://journals.plos.org/plosone/s/data-availability - "Data Availability:" The Public Library of Science's collection of journals "require authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception."

http://dx.doi.org/10.1126/science.1257891 - "Raising the Bar:" Science "has established (...) a Statistical Board of Reviewing Editors (SBoRE), consisting of experts in various aspects of statistics and data analysis, to provide better oversight of the interpretation of observational data" as part of its process for reviewing manuscripts submitted for publication. See http://www.sciencemag.org/authors/science-editorial-policies for additional information about Science's data-availability policies.

http://www.nature.com/authors/policies/availability.html - "Availability of Data, Material, and Methods:" Nature has likewise established a policy on the availability of data and methods for replication of findings in published articles.

https://youtu.be/wleSZ8PnCD0 - "The Importance of Transparency and Reproducibility in the Social Sciences" - A presentation from the ICPSR's Summer Program on Quantitative Methods about the need for and benefits from transparency in empirical research.

http://www.theguardian.com/news/datablog/2011/jul/28/data-journalism - "Data Journalism at the Guardian: What Is It and How Do We Do It?" - The Guardian newspaper is a first-rate practitioner of data journalism and has much practical advice on how to do data journalism well. It also has a nice visualization of its workflow for prepping data for stories. Their key, and very valuable, insight: working with data is "80% perspiration, 10% great idea, 10% output".

Data Services

Robert O'Reilly, Ph.D's picture
Robert O'Reilly, Ph.D
Contact:
404-727-6129 (P)

roreill@emory.edu

Emory Center for Digital Scholarship (ECDS)

Woodruff Library, 3rd Floor

ECDS Hours: Monday-Friday, 9:00AM-5:00PM

We help researchers with locating quantitative data and with cleaning and preparing data for analysis.
Website / Blog Page
© Emory University Libraries - 540 Asbury Circle, Atlanta, Georgia 30322