Resource Library

The BITSS Resource Library contains resources for learning, teaching, and practicing research transparency and reproducibility, including curricula, slide decks, books, guidelines, templates, software, and other tools. All resources are categorized by i) topic, ii) type, and iii) discipline. Filter results by applying criteria along these parameters or use the search bar to find what you’re looking for.

Know of a great resource that we haven’t included or have questions about the existing resources? Email us!

  • Topic

  • Type

  • Discipline

183 Results

Researсh Ethics: History & Principles Data Management and De-identification+

Written by Lily Mayer, this infographic is a helpful introduction to the history and basic principles of research ethics.

Social Science Reproduction Platform Economics+

The Social Science Reproduction Platform crowdsources and catalogs attempts to assess and improve the computational reproducibility of social science research. Instructors can use the SSRP in applied social science courses at the graduate or undergraduate levels to teach fundamental concepts, methods, and reproducible research practices. Get started by creating a free account and browsing some of the completed reproductions! Instructors can start by reviewing the guide for instructors, which contains tips and resources for teaching and grading reproductions using the platform.

Read More →

A template README for social science replication packages Data Management and De-identification+

The template README follows best practices as defined by a number of data editors at social science journals. A full list of endorsers is listed in Endorsers. The most recent version is available at https://social-science-data-editors.github.io/template_README/. Specific releases can be found at https://github.com/social-science-data-editors/template_README/releases. The template README is available in a variety of formats, including HTML (best for reading), LaTeX, Word, PDF, and Markdown.

Read More →

TIER Protocol 4.0 Data Management and De-identification+

The TIER Protocol specifies the contents and organization of reproduction documentation for a project involving computations with statistical data.

Lab Manual for Jade Benjamin-Chung’s Lab Data Management and De-identification+

This is a lab manual for students and staff working with Jade Benjamin-Chung at Stanford University. Its goal is to support collaborative, transparent, and reproducible workflows and it contains guidance on tools and good practices in communications, coding, version control, and data sharing, among others. It also features an internal replication process that increases reproducibility by identifying and resolving errors prior to publication.
Read More →

ResearchBox Data Management and De-identification+

ResearchBox offers an easy way to share and access scientific content, such as data, code, pre-registrations, and study materials. Uploaded files are organized into “Bingo Tables” that allow readers to easily find & access available files (e.g., researchbox.org/15). Among many features, ResearchBox provides:

  • One-click downloads
  • Instantaneous file-previews
  • Codebooks for every dataset
  • Integration with AsPredicted.org
Read More →

Open Research Calendar Data Management and De-identification+

Open Research Calendar is an open-source community tool that collates information on worldwide events related to open science and research.

Development Research in Practice : The DIME Analytics Data Handbook Data Management and De-identification+

“Development Research in Practice” leads the reader through a complete empirical research project, providing links to continuously updated resources on the DIME Wiki as well as illustrative examples from the Demand for Safe Spaces study. The handbook is intended to train users of development data on how to handle data effectively, efficiently, and ethically. See an accompanying online course here.

Read More →

An Introduction to Open Science Interdisciplinary+

This presentation by Felix Schönbrodt gives an overview of the motivation for open science and an introduction to the research tools and practices commonly associated with open science. The slides are can be re-used and distributed under the CC BY license.

Reproducible Data Science with Python Data Visualization+

Written by Valentin Danchev, “Reproducible Data Science with Python” is a textbook that uses real-world social data sets related to the COVID-19 pandemic to provide an accessible introduction to open, reproducible, and ethical data analysis using hands-on Python coding, modern open-source computational tools, and data science techniques. Topics include open reproducible research workflows, data wrangling, exploratory data analysis, data visualization, pattern discovery (e.g., clustering), prediction & machine learning, causal inference, and network analysis.

 

Read More →

Framework for Open and Reproducible Research Training (FORRT) Data Management and De-identification+

FORRT is a pedagogical infrastructure designed to recognize and support the teaching and mentoring of open and reproducible science tenets in tandem with prototypical subject matters in higher education. FORRT also advocates for the opening of teaching and mentoring materials as a means to facilitate access, discovery, and learning to those who otherwise would be educationally disenfranchised.

 

Read More →

Data Sharing and Replication ReproducibilityTransparency

Find slides from a presentation by Garret Christensen titled “Data Sharing and Replication: Enabling Reproducible Research”.

Analysis Plans in Economics EconomicsPre-Analysis Plans

Find slides from a presentation by Benjamin Olken titled “Analysis Plans in Economics”.

Data Adaptive Pre-Specification Statistics and Data Science

Find slides from a presentation by Maya Petersen titled “Data Adaptive Pre-Specification for Experimental and Observational Data”.

Perspectives from Biomedical Research Health Sciences+

Find slides from a presentation by Maya Petersen titled “Pre-Registration, Pre-analysis, and Transparent Reporting: Perspectives from biomedical research”.

Protocols That Work MethodologySocial Science

Find slides from a presentation by Nick Adams titled “Protocols That Work”.

Pre-Analysis Plans (French) Pre-Analysis Plans

Find slides from a presentation by Zachary Tsala Dimbuene titled “Pre-Analysis Plans (French)”.

Implementing an RTR Strategy Issues with transparency and reproducibility

Find slides from a presentation by Arnaud Vaganay titled “Implementing an RTR Strategy”.

Drafting RTR Guidelines Issues with transparency and reproducibility

Find slides from a presentation by Arnaud Vaganay titled “Drafting RTR Guidelines”.

Gates Open Research Interdisciplinary

Find slides from a presentation by the Center for Effective Global Action (CEGA) titled “Gates Open Research”.

Data Citations module Data Management and De-identification+

Created by the Federal Reserve Bank of St. Louis, this module introduces students to the key elements of data citations. See also related modules for Data Literacy.

Handbook on Using Administrative Data for Research and Evidence-Based Policy Data Management and De-identification+

Co-edited by Shawn Cole, Iqbal Dhaliwal, Anja Sautmann, and Lars Vilhuber and published by J-PAL’s Innovations in Data and Experiments for Action Initiative (IDEA), this handbook includes case studies of large-scale randomized evaluations using private and national government administrative data, and technical guidance to support partnerships with governments, nonprofits, or firms to access data and pursue cutting-edge, policy-relevant projects.

Read More →

Survey of Registered Reports Editors Interdisciplinary+

Between December 15, 2017 and January 31, 2018, BITSS surveyed the editors of 76 academic journals which at the time, accepted submissions in the Registered Report (RR) format. Find summary statistics of the results in this document.

CRediT (Contributor Roles Taxonomy) InterdisciplinaryTransparent Reporting

CRediT (Contributor Roles Taxonomy) is high-level taxonomy, including 14 roles, that can be used to represent the roles typically played by contributors to scientific scholarly output. The roles describe each contributor’s specific contribution to the scholarly output.

Comparison of multiple hypothesis testing commands in Stata Economics+

In this post on the Development Impact blog, David McKenzie (World Bank) compares various Stata packages used for multiple hypothesis testing adjustments and discusses settings where each package is best applied.

Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Educational Expansion Epidemiology+

Created by Catalyst Melissa Sharp, this is an open-source repository for epidemiological research methods and reporting skills for observational studies, structured based on the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement. Use it to discover new methods and reporting guidelines and contribute through the GitHub repository (https://github.com/sharpmel/STROBECourse/).

Read More →

Data for Development Impact (Resource Guide) Data Management and De-identification+

“Data for Development Impact: The DIME Analytics Resource Guide” is intended to serve as an introduction to the primary tasks required in development research, from experimental design to data collection to data analysis to publication. It serves as a companion to the DIME Wiki and is produced by DIME Analytics.

Read More →

Open Science Module for Behavioral Science graduate course Economics+

Instructors Kelly Zhang (MIT GOV/LAB) and Chaning Jang (Busara) integrated a module on research transparency and the use of pre-analysis plans as part of the Behavioral Science in the Field course designed for graduate students who use behavioral science games as part of their research.