June 12-13 – Catalyst Jun Wong and colleagues Coly Elhai and Dominic Russel will host the Pre-doctoral Research in Economics (PRE) 2021 virtual workshop, which provides an introduction to pre-doctoral education opportunities and research practices for transparency and reproducibility. The workshop looks to lower the barriers that may keep many promising young scholars from pursuing research careers and contribute towards building a more talented, diverse, and inclusive population of economists and quantitative social scientists. Find the workshop agenda and more information here.
Apply using this form by Friday, May 21. Students from traditionally underrepresented backgrounds are especially encouraged to apply.
Jun. 2, online — At 3-5 pm PT, BITSS, the AEA Data Editor, and the Research Division of the Federal Reserve Bank of St. Louis will host a joint workshop at the Tenth Annual AEA Conference on Teaching and Research in Economic Education (CTREE). The workshop will give an overview of the evolving landscape of reproducibility standards in economics, teach foundational skills in data literacy for reproducibility, demonstrate a curricular module for conducting and reporting reproductions, and discuss opportunities for instructors, students, and researchers to contribute to these ongoing efforts. Learn more and register here.
May 21, 2021 — BITSS Project Scientist Fernando Hoces de la Guardia will present the Social Science Reproduction Platform (SSRP), currently in beta, as part of the Spring 2021 “Instruction in Reproducible Research” webinar series hosted by Project TIER. The webinar series will include nine other presentations exploring the educational purposes of teaching students transparent and reproducible methods of quantitative data analysis. See the program and register here.
Feb. 23, 2021 — Fernando Hoces de la Guardia gave a presentation on Open Policy Analysis (OPA) as part of a webinar organized by Métodos em Pauta (Federal University of Pernambuco, Brazil), an academic initiative on inference in political science and related fields. Watch the presentation (in Spanish) here.
Feb. 23, 2021 — BITSS Faculty Director Ted Miguel chaired a panel titled “Increasing Rigor, Reproducibility, Transparency, and Dissemination” as part of the Science of Behavior Change Capstone Conference organized by the National Institutes of Health Feb. 22-23, 2021. The panel featured the following presentations:
Reimagining science as truly open and inclusive, Alison Ledgerwood, University of California, Davis
An open science behavior change model from theory to practice, Brian Nosek, Center for Open Science
The art of open science: Imitation, inspiration, and innovation, Chaning Jang, The Busara Center for Behavioral Economics
Don Moore and Leif Nelson (Haas School of Business, UC Berkeley) offer “Improving (Our) Science: Replication, Reporting, and Openness”, an online course that is open for registration to PhD students interested in open science. The goal of the course is to learn about the newest standards for scientific openness, and how they influence the reporting and interpretation of empirical evidence. Learn more in the course syllabus here.
Jan. 7-8, 2021, online — BITSS held its 9th Annual Meeting on January 7-8, 2021. The BITSS Annual Meeting brings together actors from academia, scholarly publishing, and policy to share novel research and discuss efforts to improve the credibility of social science by advancing research transparency, reproducibility, rigor, and ethics. Read More →
Dec. 14, 2020, online — Katie Hoeberling gave a lightning talk titled “Advancing Computational Reproducibility in the Social Sciences: Creating and using digital reproduction records as pedagogical tools” as part of the 2020 Conference of the Joint Roadmap for Open Science Tools (JROST). Find the full program here. Slides from Katie’s presentation are here.
Nov. 10, online — At 11 am PT, Katie Hoeberling and Fernando Hoces de la Guardia will give a presentation titled “Advancing Computational Reproducibility in the Social Sciences: Creating and Using Digital Reproduction Records as a Pedagogical Tool” as part of the Fall 2020 Virtual Membership Meeting of the Coalition for Networked Information. Learn more and find the schedule here.
Oct. 6, online — Fernando Hoces de la Guardia gave a presentation titled “Accelerating Computational Reproducibility in Economics: Guidelines and a Crowdsourcing Platform” as part of the Development Lunch seminar series organized by the Department of Economics, UC Berkeley. Read More →
Oct. 15, online — BITSS Project Scientist Fernando Hoces de la Guardia gave a presentation titled “Research Transparency: Challenges and Solutions” (in Spanish) as part of a seminar organized by the Center for Research in Applied Economics at the University of Talca, Chile. Read More →
Sep. 21-25, 2020, online — BITSS held its Research Transparency and Reproducibility Training (RT2) online. RT2 provides participants with an overview of tools and practices for transparent and reproducible social science research. The program is developed and delivered by leading academic researchers from across the social sciences and will provide participants with opportunities for collaborative work and skills-building. Participants were able to exchange feedback and receive support from instructors through daily online discussion forums. Following the training, BITSS also facilitated RT2 “office hours,” where participants met individually with instructors and received guidance on their research questions and ideas.
Jul. 28, online –In a webinar hosted by the Center for Open Science (COS), Andrew Foster, Editor in Chief at the Journal of Development Economics, Irenaeus Wolff, a guest editor for Experimental Economics, and BITSS Sn. Program Associate Aleksandar Bogdanoski discussed their experiences with implementing the Registered Reports format in economics, its reception by the authors, and lessons learned since adoption. Read More →
June 27, online — BITSS hosted two virtual sessions on research reproducibility at the 95th Annual Conference of the Western Economic Association International (WEAI). The sessions presented resources and lessons learned from the Accelerating Computation Reproducibility in Economics (ACRE) project led BITSS and AEA Data Editor Lars Vilhuber. Read More →
Apr. 3, 2020, online — As part of the Weekly Talks by Leaders in Research Transparency series hosted by Project TIER, Soazic Elise Wang Sonne discussed her experience organizing open science capacity-building workshops in Sub-Saharan Africa and Europe. As a BITSS Catalyst, she has trained 500+ scholars in South Africa, Cameroon, Niger, and Kenya.
Apr. 1, 2020, online — BITSS and the AEA Data Editor Lars Vilhuber hosted a short webinar to discuss recent efforts to improve transparency and reproducibility in economics, including pre-publication verification of computational reproducibility in AEA journals and the Accelerating Computational Reproducibility in Economics (ACRE) project.
Catalyst Diego Aycinena and colleagues from the Rosario Experimental and Behavioral Economics Lab (REBEL) will host the Bogotá Experimental Economics Workshop (BEEC) on January 9-11, 2020. Read More →
BITSS held its eighth Annual Meeting on December 13, 2019, at UC Berkeley. The event brought together stakeholders from academia, scholarly publishing, and policy to share knowledge and discuss the evolving movement toward research transparency and efforts to strengthen the standards of openness and integrity in the social sciences.
BITSS and the Stanford Immigration Policy Lab (IPL) hosted a one-day ideation workshop titled “Unlocking the File Drawer” at UC Berkeley on December 12. The workshop convened an interdisciplinary group of researchers, funders, journal editors, design specialists, and research administrators to explore integrating approaches to improving the tracking of funded research outputs, with special consideration for projects that yield null results.
BITSS and the Berkeley Institute for Data Science (BIDS) will host a panel on journal reproducibility policies and practices 3:00 pm – 4:00 pm on Dec. 11 at the BIDS office space at Doe Library, UC Berkeley. The panel will discuss perspectives and experiences at journals in economics, statistics, and the physical and health sciences, as well as resources to support reproducibility available to the UC Berkeley community and beyond. Read More →
Catalyst Sean Grant represented BITSS at “Rigor, Reproducibility, and Transparency (RRT) at the Interdisciplinary Interface”, a workshop organized by the School of Public Health, at Indiana University-Bloomington on October 2-4, 2019. The workshop will include high-level discussions in small group settings and will begin identifying priorities and infrastructure needs for a coordinated and interdisciplinary set of research training activities for promoting RRT in science.
BITSS Faculty Director Edward Miguel will give a Departmental Seminar titled “Research Transparency & Reproducibility in Economics and Beyond” at 4:10-5:30 p.m. on Sep 25 at the Sibley Auditorium, Bechtel Engineering Center. Read More →
BITSS hosted its Research Transparency and Reproducibility Training (RT2) in Washington DC, September 11-13, 2019.
RT2 provides participants with an overview of tools and best practices for transparent and reproducible social science research. The curriculum is developed and delivered by academic leaders in the open science movement and there is space for collaborative work and hands-on skill-building. Participants are encouraged to bring their own research questions and ideas to seek support and feedback from instructors and other attendees.
“Transparency, Reproducibility, and Credibility of Economics Research” is a research symposium hosted collaboratively by the World Bank Development Impact Evaluation (DIME) group, BITSS, the International Initiative for Impact Evaluation (3ie), The Abdul Latif Jameel Poverty Action Lab (J-PAL), and Innovations for Poverty Action (IPA) on September 10, 2019 at the World Bank Headquarters in Washington, D.C.
Hosted by the Center for Open Science on Jul 30, 2019, the “Local Grassroots Networks” webinar featured insights from international panelists currently nurturing culture change in research among their local communities.
Catalyst Sho Tsuji hosted a workshop titled “Introducing Meta-Analytic Methods for Psychological Sciences” on July 8, 2019 as part of the Society for the Improvement of Psychological Science (SIPS) 2019 Meeting in Rotterdam, the Netherlands.
BITSS will exhibit at the 94th Annual Conference of the Western Economic Association International (WEAI) in San Francsico, CA on June 28th-July 2nd, 2019. Visit us in the conference registration area to learn about our latest work in supporting research and training for transparency and reproducibility in economics.
BITSS is partnering with the East Africa Social Science Translation (EASST), a CEGA initiative, to host a Research Transparency and Reproducibility Workshop on July 23 as part of the 8th Annual EASST Summit at Sarova Panafric in Nairobi, Kenya on July 22-23, 2019.
Elaine Toomey and colleagues organized the NUI Galway Open Science Week on April 8-12, 2019, the first of its kind in Ireland. The event brought together researchers, academics, educators, policymakers and members of the public to highlight and showcase what open science is, and how it can be achieved. As part of the Open Science Week, the organizers also hosted “Open Science in Health Research”, a two-day introductory workshop for early career researchers on April 11-12, 2019 at the School of Psychology, National University of Ireland Galway. Learn more here.
In collaboration with the World Bank’s Development Impact Evaluation (DIME) group and the Innovations in Big Data Analytics program, BITSS will host a one-day workshop on reproducible research in Washington, D.C., on March 1, 2019. Read about the workshop in this post published on the World Bank Data blog.
Kweku Opoku-Agyemang will give a presentation titled “Using Blockchain for Scientific Transparency” at this year’s Annual Meeting of the American Association for the Advancement of Science (AAAS) in Washington, D.C., on February 15, 2019. Read More →
Catalyst Diego Aycinena and colleagues from the Rosario Experimental and Behavioral Economics Lab (REBEL) will host the Bogotá Experimental Economics Workshop (BEEW) on January 8-10, 2019. Read More →
Christina Bergmann will give a week-long course on “Effect sizes and meta-analyses: Tools for cumulative, robust experimental science” as part of the Winter School of the Netherlands Graduate School of Lingustics in Amsterdam, the Netherlands, on January 7-11, 2019. Read More →
Despite growing interest in forecasting and predictions across a number of fields, there is currently neither a centralized platform to collect predictions, nor consensus on best practices. To address this issue, BITSS will host a workshop on Forecasting Social Science Research Results on December 11, 2018, in coordination with the 2018 Annual Meeting.
Led by Stefano DellaVigna (UC Berkeley) and Eva Vivalt (Australian National University), the workshop will bring together academic leaders from across disciplines to share knowledge, present recent research on forecasting, and chart a path for the future. The workshop will also serve as a venue for discussing the design of a shared platform to facilitate the collection and cataloging of forecasts for the broader research community.
Contact Katie Hoeberling at khoeberling@berkeley.edu with any questions about this event.
BITSS held its seventh Annual Meeting on December 10, 2018 at the David Brower Center in Berkeley, California. The event brings together stakeholders from academia, scholarly publishing, and policy to share knowledge and discuss the evolving movement toward research transparency and efforts to strengthen the standards of openness and integrity in the social sciences. Read More →
Catalyst Ada Gonzales-Torres led a short course on Transparent, Open, and Reproducible Research for PhD students at the European University Institute (EUI), in Florence, Italy. Read More →
Sho Tsuji will be giving invited presentations at McGill University, including MetaLab: Language Acquisition Meta-Analyzed on October 31, and Meta-analytic methods for infant and language studies: An introduction on November 1, 2018.
BITSS Postdoctoral Scholar Fernando Hoces de la Guardia held a workshop on research transparency and reproducibility tools and practices in Quito, Ecuador on October 2, 2018. The audience consisted of researchers from the Inter-American Development Bank and a team of local researchers.
BITSS held its Research Transparency and Reproducibility Training (RT2) in Los Angeles, CA, September 5-7, 2018.
RT2 provides participants with an overview of tools and best practices for transparent and reproducible social science research. The curriculum is developed and delivered by academic leaders in the open science movement and there is space for collaborative work and hands-on skill building. Participants are encouraged to bring existing research questions and ideas based on their own interests to seek support and feedback from instructors and other attendees.
Catalysts Idrissa Ouedraogo and Vedaste Ndizera will hold a workshop at the Pan African University Institute of Governance, Humanities and Social Sciences on transparency, reproducibility and open science research methods.
Catalyst Ben Marwick (University of Washington) will host six workshops in Southeast Asia. The curriculum includes open methods, open access, open data, and an introduction to R for social scientists. All materials and pre-training instructions are available here.
2015 recipient of the Leamer-Rosenthal Prize for Open Social Science and BITSS Catalyst J. Scott Long is holding a week-long workshop at the ICPSR Summer Program in Quantitative Methods of Social Science Research. See below or visit the ICPSR website for more details.
Catalyst Jose Manuel Magallanes will hold a short course at the Pontificia Universidad Católica de Chile School of Governement on using various computational tools for carrying out reproducible research in interdisciplinary teams.
Catalyst Jose Manuel Magallanes will hold a short course at the School of Governement on using various computational tools for carrying out reproducible research in interdisciplinary teams.
Demand for evidence-based policy is growing, but so is recognition that limited transparency in social science research has contributed to what many have called a crisis of reproducibility and credibility.
With this 5-week, self-paced Massive Open Online Course (MOOC), you can explore the causes of limited transparency in social science research, as well as tools to make your own work more open and reproducible.
BITSS held its Research Transparency and Reproducibility Training (RT2) in Los Angeles, CA, September 5-7, 2018.