Mar 31, 2017  –  Mar 31, 2017  |  London

Catalyst Workshop at LSE Africa Summit

Catalyst: Elise Wang Sonne (UNU-MERIT)
Workshop: Research Transparency and Reproducibility in the Social Sciences | LSE Africa Summit 2017 Research Conference
Description The aim of this workshop is to train the next generation of social science researchers in tools and practices to enhance the transparency, reproducibility, and openness of their research. It will cover the following aspects:
  • Conceptual and emerging issues in the practice and ethics of research;
  • Overview of issues that make research unreliable;
  • Theory and implementation of Pre-analysis Plans;
  • Transparent data management; and
  • Data sharing & statistical analysis using STATA and R.
Apr 4, 2017  |  Berkeley, CA

Meet and Greet with Phillip Cohen

Most social scientists want our research to be relevant, to reflect as well as interact with the social actors for whom it is relevant; we want it to be efficient, to maximize collaboration and exchange, and to make the most of our limited resources; and we want it to be accessible, to be read and debated by a wide audience beyond our disciplinary boundaries and university walls. These challenges seem more acute now than at any time in recent memory. And yet our scholarly communication system, especially journal publishing, remains mired in the structures of the past – moving too slowly and costing too much – which impedes the quality, quantity, efficiency, and responsiveness of our research. Open scholarship is a broad response to these deficiencies. In this presentation, Philip Cohen will make a case for open scholarship -- and the use of preprints and working papers in particular -- through the SocArXiv project, a new open-source, open-access, non-profit archive for social science research, modeled after arXiv in math and physics.

At this meet and greet, Philip will give a brief presentation, which will be followed by time for questions, comments, and discussion.

Speaker:  Philip N. Cohen, professor of sociology at the University of Maryland and director of SocArxiv.
Apr 19, 2017  |  Merced, California

Transparency + Reproducibility Workshop at UC Merced

There is growing interest in research transparency and reproducibility across the social sciences. As part of the UC Merced Political Science professionalization seminar series, this workshop will introduce political science graduate students to the tools social scientists can use to make their research more reproducible. We will cover recent methodological progress in this area, including study registration, pre-analysis plans, disclosure standards, and open sharing of data and materials, drawing on experiences in economics, political science, and psychology, as well as other social sciences. We will also demo workflow-related software developments that help a researcher make their work more reproducible, particularly version control and dynamic documents, which can accurately track all changes made to code and make one’s entire analysis reproducible with a single click. Questions? Contact Alex Theodoridis: alexandertheodoridis[at]gmail[dot]com
Apr 26, 2017  |  Barcelona

Transparency + Reproducibility Workshop at IMEBESS 2017

Background: This workshop kicks off the Fourth International Meeting on Experimental and Behavioural Social Sciences (IMEBESS) in Barcelona, Spain, organized by the Nuffield Centre for Experimental Social Sciences (CESS). The workshop was organized in part by BITSS Catalyst David Klinowski. Description: This one-day workshop will provide an overview of open research practices, as well as hands-on training in tools for managing a reproducible workflow. We will discuss the increasing relevance of these practices in the social sciences, including their endorsement by researchers, journal editors, and funding agencies. Participants will learn strategies and tools for managing research workflow, preparing and submitting pre-registrations and pre-analysis plans, and effectively sharing material with collaborators and the scientific community. Topics to be covered include:
  • Challenges to credibility and reproducibility including publication bias and p-hacking
  • Hands-on training with the AEA registry and OSF
  • Registering studies and preparing pre-analysis plans
  • Dynamics Documents in Stata and R
  • Version Control with Git/Github
May 3, 2017  –  May 4, 2017  |  Cuernavaca, Morelos

Transparency + Reproducibility Workshop at INSP, Cuernavaca

Background: The Instituto Nacional de Salud Pública (INSP) is a leading academic institution and hub for researchers in Mexico conducting research on public health issues, including obesity, chronic non-communicable diseases, substance abuse, and many more. Established over 26 years ago, INSP currently works with an array of stakeholders ranging from Governments, NGOs, and funding agencies, and has a commitment of accountability and transparency to the general public. With seven research centers, INSP recognizes the need for research transparency to enhance the rigor and quality of their research output, as this research provides the basis for public policy. This commitment includes providing resources to support researchers to use study registries to register their trials, generate better process documentation, prepare pre-analysis plans, use version control and data sharing platforms, and ensure that de-identified data and associated code are ready to be made public.

Description: BITSS and INSP will partner to develop and deliver a workshop on research transparency that caters to the needs of the research community involved in conducting high-quality research in Mexico. The proposed workshop is a small yet significant step to i) generate awareness among users and contributors of the health science research and ii) provide a platform to share tools and resources to assist in improving transparency in research within the community of practitioners and academicians.

Workshop Objectives:
  • Improve understanding of the importance of research transparency in order to motivate the need for transparency and replicability in social science research. In the interest of achieving wider reach, the audience will include institutions and associated stakeholders, practicing and/or commissioning research in Mexico.
  • Facilitate transparency in research. This workshop provides an opportunity for greater collaboration in using tools and systems that can increase transparency and integrity of research, such as version control and dynamic documents.
Workshop Structure:
Day 1 will focus on improving awareness around issues pertaining to transparency in research, and how to overcome challenges by integrating new tools and solutions into researchers’ workflows.
Day 2 will focus on additional tools and resources to conduct transparent research with an objective to facilitate the adoption of these tools within the research and practitioner community. Specific tools include:
  • Pre-registration with the AEA registry and the Open Science Framework;
  • Version control with Git and GitHub; and
  • Dynamic documents with Stata (using Markdoc).
Pre-requisites: Participants will have significant experience with statistical programming packages such as R or Stata, though those who use other packages may benefit as well.

Language: Workshop lectures and materials will be presented in English.
Jun 7, 2017  –  Jun 9, 2017  |  Berkeley, CA

Research Transparency and Reproducibility Training (RT2) – Berkeley, CA

Taught by: Edward Miguel (Introduction, Pre-registration and Pre-analysis Plans),  Sean Grant  and Arnaud Vaganay (Transparent Reporting and Disclosure), Courtney Soderberg (Replication), Solomon Hsiang (Meta-Analysis), Erica Baranski (OSF and Hands-On Registration), Danae Roumis (Data Managment and De-Identification), Garret Christensen (Version Control and Dynamic Documents), Fiona Burlig (pcpanel), Dan Benjamin (Genoeconomics), and more to come! Description Led by the Berkeley Initiative for Transparency in the Social Sciences (BITSS), this Research Transparency and Reproducibility Training (RT2) provides participants with an overview of cutting-edge mechanisms for transparent and reproducible social science research. The curriculum is taught by academic leaders in the transparency movement, and there will be space for collaborative work and hands-on skill building. Participants can expect to finish the program with a thorough overview and understanding of best practices for open, reproducible research, allowing them to remain in the vanguard of new scientific frontiers. They are encouraged to bring existing research questions and ideas based on their own interests and seek support and feedback from instructors and other attendees. Formerly known as the Summer Institute, RT2 will include more hands-on sessions incorporating new tools to facilitate research transparency. In addition to interactive sessions, participants will also be provided a Reading Packet prior to their arrival. We expect the number of applications to far exceed the number of available spaces for this workshop. With this in mind, BITSS aims to select 30-35 participants that represent a balance across disciplines, gender, and experience levels, as well as participants who are likely to have sustained impact on improving research transparency and reproducibility education and practice at their host institutions. Eligibility The workshop is designed for researchers across the social science spectrum, from economics to political science, psychology, and other related disciplines. Ideal candidates include: (i) graduate or post-graduate students (ii) junior faculty, (iii) staff from research organizations interested in using these methods, and (iv) journal editors or research funders curious about the implications for their work. Diversity in terms of background and academic discipline is encouraged. Application Process To apply, click on the ‘Registration’ tab at the top of this page and follow the listed instructions. Supporting Material Please include the following in the Supporting Material section of the application:
  • Curriculum Vitae or Resume
  • Cover Letter including a) why you are interested in the workshop, b) how you might use what you learn to improve transparency practices of other social scientists, c) whether you will need financial support to attend the institute, and d) your current professional status.
  • Letter of Reference (optional)
Fee There are no tuition fees for this workshop. BITSS has funds to support participants' travel to and accommodation in Berkeley. Application Deadline The closing date for applications is March 31, 2017. BITSS faculty and staff will then select 30-35 applicants for acceptance to RT2. Notifications of acceptance will be sent no later than April 10, 2017.
Jun 28, 2017  |  San Diego

BITSS Paper Session at 92nd Annual WEAI

BITSS has organized two paper sessions on Day 4 of the 92 Annual Western Economics Association International Conference in San Diego, Ca. Topics will include meta-analysis, publication bias, data sharing, and research transparency, featuring work by several SSMART grant recipients. Speakers will include Garret Christensen (BITSS, BIDS), Abel Brodeur (University of Ottawa), Elliott Collins (UC Berkeley), Taisuke Imai (Caltech), Chishio Furukawa (MIT), and Mauricio Romero (UC San Diego).