Papers



Submit a Paper!

Browse ReproHack papers

  • Revisiting the zonally asymmetric extratropical circulation of the Southern Hemisphere spring using complex empirical orthogonal functions

    Authors: Elio Campitelli, Leandro Díaz, Carolina Vera
    DOI: 10.1007/s00382-023-06780-0
    Submitted by eliocamp      
      Mean reproducibility score:   1.0/10   |   Number of reviews:   1
    Why should we attempt to reproduce this paper?

    I used a lot of different tools and strategies to make this paper easily reproducible at different levels. There's Docker container for the highest level of reproducibility, and package versions are managed with renv. The data used in the paper is hosted on Zenodo to avoid long queue times when downloading from the Climate Data Store and future-proof for when it goes away and checksumed before using it.

    Tags: R Docker climate
  • PlanGAN: Model-based Planning With Sparse Rewards and Multiple Goals

    Authors: Henry Charlesworth and Giovanni Montana
    Submitted by gmontana74      
      Mean reproducibility score:   10.0/10   |   Number of reviews:   1
    Why should we attempt to reproduce this paper?

    This paper proposes a probabilistic planner that can solve goal-conditional tasks such as complex continuous control problems. The approach reaches state-of-the-art performance when compared to current deep reinforcement learning algorithms. However, the method relies on an ensemble of deep generative models and is computationally intensive. It would be interesting to reproduce the results presented in this paper on their robotic manipulation and navigation problems as these are very challenging problems that current reinforcement learning methods cannot easily solve (and when they do, they require a significantly larger number of experiences). Can the results be reproduced out-of-the-box with the provided code?

  • REMoDNaV: robust eye-movement classification for dynamic stimulation

    Authors: Asim H. Dar, Adina S. Wagner, Michael Hanke
    DOI: https://doi.org/10.3758/s13428-020-01428-x
    Submitted by adswa    
      Mean reproducibility score:   7.0/10   |   Number of reviews:   3
    Why should we attempt to reproduce this paper?

    In theory, reproducing this paper should only require a clone of a public Git repository, and the execution of a Makefile (detailed in the README of the paper repository at https://github.com/psychoinformatics-de/paper-remodnav). We've set up our paper to be dynamically generated, retrieving and installing the relevant data and software automatically, and we've even created a tutorial about it, so that others can reuse the same setup for their work. Nevertheless, we've for example never tried it out across different operating systems - who knows whether it works on Windows? We'd love to share the tips and tricks we found to work, and even more love feedback on how to improve this further.

  • Investigation into the annotation of protocol sequencing steps in the sequence read archive

    Authors: Alnasir, Jamie, and Hugh P. Shanahan.
    Submitted by hub-admin  

    Why should we attempt to reproduce this paper?

    Metadata annotation is key to reproducibility in sequencing experiments. Reproducing this research using the scripts provided will also show the current level of annotation in years since 2015 when the paper was published.

    Tags: Python SQL
  • The role of conidia in the dispersal of Ascochyta rabiei

    Authors: Khaliq, I., Fanning, J., Melloy, P. et al.
    DOI: 10.1007/s10658-020-02126-2
    Submitted by hub-admin    

    Why should we attempt to reproduce this paper?

    I suggested a few papers last year. I’m hoping that we’ve improved our reproducibility with this one, this year. We’ve done our best to package it up both in Docker and as an R package. I’d be curious to know what the best way to reproduce it is found to be. Working through vignettes or spinning up a Docker instance. Which is the preferred method?

    Tags: R Docker
  • Growth Dynamics of Independent Gametophytes of Pleurosoriopsis makinoi ( Polypodiaceae)

    Authors: Atsushi Ebihara, Joel H. Nitta, Yurika Matsumoto, Yuri Fukazawa, Marie Kurihara, Hitomi Yokote, Kaoru Sakuma, Otowa Azakami, Yumiko Hirayama, Ryoko Imaichi
    Submitted by joelnitta    
      Mean reproducibility score:   10.0/10   |   Number of reviews:   1
    Why should we attempt to reproduce this paper?

    It uses the drake R package that should make reproducibility of R projects much easier (just run make.R and you're done). However, it does depend on very specific package versions, which are provided by the accompanying docker image.

    Tags: R Docker Drake
  • Population structure and phenotypic variation of Sclerotinia sclerotiorum from dry bean (Phaseolus vulgaris) in the United States

    Authors: Kamvar ZN, Amaradasa BS, Jhala R, McCoy S, Steadman JR, Everhart SE
    DOI: 10.7717/peerj.4152
    Submitted by hub-admin    
      Mean reproducibility score:   6.0/10   |   Number of reviews:   1
    Why should we attempt to reproduce this paper?

    This paper is reproduced weekly in a docker container on continuous integration, but it is also set up to work via local installs as well. It would be interesting to see if it's reproducible with a human operator who knows nothing of the project or toolchain.

    Tags: R make Docker
  • Bayesian determination of the effect of a deep eutectic solvent on the structure of lipid monolayers

    Authors: "McCluskey, Andrew R. and Sanchez-Fernandez, Adrian and Edler, Karen J. and Parker, Stephen C. and Jackson, Andrew J. and Campbell, Richard A. and Arnold, Thomas
    DOI: DOI https://doi.org/10.1039/C9CP00203K
    Submitted by hub-admin    
      Mean reproducibility score:   8.5/10   |   Number of reviews:   2
    Why should we attempt to reproduce this paper?

    I believe this represents the only example of a reproducible paper from scattering data collected at Diamond Light Source (UK) and the Institute Laue-Langevin (France)

    Tags: Python make

Search for papers

Filter by tags

Python R GDAL GEOS GIS Shiny PROJ Galaxies Astronomy HPC Databases Binder Social Science Stata make Computer Science Jupyter Notebook tidyverse emacs literate earth sciences clumped isotopes org-mode geology eyetracking LaTeX Git ArcGIS Docker Drake SVN knitr C Matlab Mathematica Meta-analysis swig miniconda tensorflow keras Pandas SQL neuroscience robotics deep learning planner reiforcement learning Plasma physics Hybrid-PIC EPOCH Laser Gamma-ray X-ray radiation Petawatt Fortran plasma PIC physics Monte Carlo Atomistic Simulation LAMMPS Electron Transport DFT descriptors interatomic potentials machine learning Molecular Dynamics Python scripting AIRSS structure prediction density functional theory high-throughput machine-learning RNA bioinformatics CFD Fluid Dynamics OpenFOAM C++ DNS Mathematics Droplets Basilisk Particle-In-Cell psychology Stan Finance SAS Replication crisis Economics Malaria consumer behavior number estimation mental arithmetic psychophysics Archaeology Precipitation Epidemiology Parkrun Health Health Economics HTA plumber science of science Zipf networks city size distribution urbanism literature review Preference Visual Questionnaire Mann-Whitney Correlation Conceptual replication Cognitive psychology Multinomial processing tree (MPT) modeling #urbanism #R k-means cluster analysis city-regions Urban Knowledge Systems Topic modelling Planning Support Systems Software Citation Quarto snakemake Numerical modelling Ocean climate physical oceanography apptainer oceanography All tags Clear tags

Key

  Associated with an event
  Available for general review
  Public reviews welcome