Badges for Reproducibility and Open Science
This page gives a brief summary of work in progress on a project to develop a badge that can be earned by following some of the current best practices in the field, such as the Guidelines we are developing.
UW Green Laboratories. This program encourages staff, faculty, and students to make their laboratories and workplaces more sustainable.
Mozilla Science Lab Contributorship Badges to acknowledge diverse contributions to a scholarly publication.
- Have a low-stakes program to raise the visibility on campus of people doing reproducible research and open science,
- Provide some simple incentives to working reproducibly and in the open,
- Get researchers who are new to these ideas onto a trajectory of improvement,
- Communicate to people the key principles and tools for reproducible research and open science,
- Collect exemplars for others to follow and display them in a manner that is easy to browse,
- Award Bronze, Silver, Gold levels based on cumulative history of following best practices for code and data.
A first pass at a badge submission form was created using Google forms during a Mozilla Code Sprint in June, 2015, along with a description and point system. A shinyapp was also created to present the information submitted in a form others can browse, but the data submitted is no longer in the system.
This submission form was tested out both among eScience researchers and with some volunteers from NYU and Berkeley at the 2015 Moore/Sloan Data Science Environments Summit. The consensus was that the form was cumbersome and required too much pasting of data from elsewhere.
Subsequent discussions led to various ideas that have not yet been implemented:
Organize data collection for some sets of data by publication rather than splitting up links to the paper, to the data, to the code in different sections. One possible outline was posted in this issue. An inviting and easy to use form needs to be designed.
Make it possible for users to update their information if they want to earn more points, rather than having to start from scratch in the form. This can be done with Google forms (by saving a URL), but long term it would be better to have some sort of authentication. Can this be done using existing login credentials such as GitHub or ORCID?
Scrape metadata automatically from users’ ORCID account rather than having to cut and paste data about publications or data repositories.
Design a good way of presenting the data collected so that people can browse and learn about how others share their data and code.
Use the Mozilla Open Badges infrastructure?