Archives: Project

Holds our Projects and Project specific data

Best Practices of Openness for African Researchers and Research Transparency Workshops at Three Social Science Conferences

Locations: LSE-Africa Summit, London School of Economics, London, UK; Population Association of America, Chicago, IL; University of Dschang, Cameroon; UNU-MERIT, Maastricht, Netherlands This project will communicate best practices for openness and reproducibility in research. We will hold a workshop for African researchers at the University of Dschang in Cameroon, focusing on sensitizing…

Improving transparency of complex interventions through the facilitation of process evaluation training

Locations: National University of Ireland, Galway (NUIG), Health Behaviour Change Research Group (HBCRG) Process evaluation is a way of investigating how well an intervention, programme or treatment was implemented as intended. It is crucial for facilitating transparency in the development, conduct and reporting of interventions in numerous research fields, including psychology, social science and…

Research Transparency in the Social Sciences Workshop, Second Edition

Location: University of Kinshasa (The Democratic Republic of the Congo) Research Transparency is gaining attention in the scientific community around the world, including the United States, European countries, and Anglophone countries in sub-Saharan Africa; yet the concept is quite a “new world” in Francophone Africa. In my efforts to advance the movement in…

Introducing open science to researchers and policymakers

Locations: New Delhi, India; Lausanne, Switzerland; London, England; Delft, Netherlands This project involved a number of workshops, seminars, a summer school, and public testimony at the UK Parliamentary Office of Science and Technology inquiry on research integrity. Events reached over 250 students, researchers, faculty, librarians, and policymakers. Arnaud also served as a…

Disseminating Research Transparency in Perú, Bolivia, and Chile

Locations: Peru; Bolivia; Chile (final locations TBA) The goal of this project is to bring to the attention of the academic communities in Peru, Bolivia, and Chile the recent developments in science regarding transparency and openness. This will be done in a two-fold format. First, a seminar-style talk will present the key…

Introducing the Transparent and Reproducible Research Paradigm in Ugandan Higher Institutions of Learning

Locations: Universities across Uganda (final locations TBA) The concept of transparent and reproducible research is not known, nor appreciated, by researchers in Uganda and many other developing countries. There is usually delayed adoption of new knowledge and technologies in developing countries because of the slower flow of information in these regions. The…

Creating Pedagogical Materials to Enhance Research Transparency at UCSD

This project involved creating a teaching module by the Policy Design and Evaluation Lab (PDEL) at UC San Diego (UCSD). The module is intended for use in graduate-level social science methodology courses—including those in political science, economics, sociology, and psychology—at UCSD and beyond. It covers the main causes of the credibility crisis…

MetaLab: Paving the way for easy-to-use, dynamic, crowdsourced meta-analyses

Aggregating data across studies is a central challenge in ensuring cumulative, reproducible science. Meta-analysis is a key statistical tool for this purpose. The goal of this project is to support meta-analysis using MetaLab, an interface and central repository. MetaLab supports collaborative hosting and the creation of dynamic meta-analyses based entirely on open…

Publication Bias and Editorial Statement on Negative Findings

The introduction of confidence at 95 percent or 90 percent has led the academic community to accept more easily starry stories with marginally significant coefficients than starless ones with insignificant coefficients. In February 2015, the editors of eight health economics journals sent out an editorial statement encouraging referees to accept studies that:…

Transparency and Reproducibility in Economics Research

There is growing interest in research transparency and reproducibility in economics and other fields. We survey existing work on these topics within economics and discuss the evidence suggesting that publication bias, inability to replicate and specification searching remain widespread problems in the discipline. We next discuss recent progress in this area, including…

Conservative Tests under Satisficing Models of Publication Bias

Publication bias leads consumers of research to observe a selected sample of statistical estimates calculated by producers of research. We calculate critical values for statistical significance that undo the distortions created by this selection effect, assuming that the only source of publication bias is file drawer bias. These adjusted critical values are…