Event Description

Event description:

Reproducibility is a fundamental principle of research, and crucial in scientific disciplines such as climate research which impact decision and policy making and, eventually, our daily lives. This does not only apply to experimental and empirical research, but also to research relying on software and simulations. In the past decade or so, the so-called replication crisis has led to a number of initiatives and networks which address issues with computational reproducibility. One such initiative is the ReproHack community and hub.

The Institute of Computing for Climate Science (ICCS) Research Software Engineers (RSE) team is organising a ReproHack for the climate research community. A ReproHack is an event where the participants come together to reproduce computational key results of research papers which have been submitted for this purpose before the event. This provides a number of benefits for both the participants and the authors of the papers:

• The participants learn hands-on about research reproducibility and software best practices. Going back to their own codes and research after the event they will be aware how they can improve their practices.

• The participants will also have the experience of working in a team with an unfamiliar code. Less experienced programmers can see how experienced coders approach the task, and gain confidence talking about their thought processes and problems.

• The paper authors receive feedback on the reproducibility of their papers as well as the code, which helps them improve. This is particularly useful if they submit papers which have not yet been published, as they can incorporate the feedback.

By joining our event, you agree to abide by our Code of Conduct

Two ways to get involved:

Nominate a paper

We invite nominations for papers that have both associated code and data publicly available. We also encourage analyses based on open source tools as we cannot guarantee participants will have access to specialised licenced software.

See list below for paper associated with this event or browse the full list of submitted papers. You can also consult our author guidelines for more information.

Review and reproduce a paper

Join us at the hack to dig into exciting science, learn more about reproducibility, working with other people’s code and data and more! Have a look at the participant guidelines for more information.

Agenda

Associated papers

• The Polar Transition from Alpha to Beta Regions Set by a Surface Buoyancy Flux Inversion

  Authors: Romain Caneill Fabien Roquet Gurvan Madec Jonas Nycander

  DOI:  10.1175/JPO-D-21-0295.1

  Submitted by rcaneill      

    Mean reproducibility score:   0.0/10   |   Number of reviews:   1

  ---

  Why should we attempt to reproduce this paper?

  I tried hard to make it reproducible, so hopefully this paper can serve as an example on how reproducibility can be achieved. I think that being reproducible with only few commands to type in a terminal is quite an achievment. At least in my field, where I usually see code published along with paper, but with almost no documentation on how to rerun it.

  Tags: Python snakemake Numerical modelling Ocean

• Revisiting the zonally asymmetric extratropical circulation of the Southern Hemisphere spring using complex empirical orthogonal functions

  Authors: Elio Campitelli, Leandro Díaz, Carolina Vera

  DOI:  10.1007/s00382-023-06780-0

  Submitted by eliocamp      

    Mean reproducibility score:   1.0/10   |   Number of reviews:   1

  ---

  Why should we attempt to reproduce this paper?

  I used a lot of different tools and strategies to make this paper easily reproducible at different levels. There's Docker container for the highest level of reproducibility, and package versions are managed with renv. The data used in the paper is hosted on Zenodo to avoid long queue times when downloading from the Climate Data Store and future-proof for when it goes away and checksumed before using it.

  Tags: R Docker climate

• Southern Ocean deep mixing band emerges from a competition between winter buoyancy loss and upper stratification strength

  Authors: Romain Caneill, Fabien Roquet, and Jonas Nycander

  DOI:  10.5194/egusphere-2023-2404

  Submitted by rcaneill      

    Mean reproducibility score:   2.6/10   |   Number of reviews:   8

  ---

  Why should we attempt to reproduce this paper?

  I tried as hard as possible to make it reproducible, which it is on my computer. I would be happy to see if this still works on other computers. Moreover, by allowing easy reproducibility, I hope that other people may easily build research on top of this work.

  Tags: Python snakemake Ocean physical oceanography apptainer oceanography