Papers



Submit a Paper!

Browse ReproHack papers

  • Mental Health and Social Contact During the COVID-19 Pandemic: An Ecological Momentary Assessment Study

    Authors: Eiko I. Fried, Faidra Papanikolaou, Sacha Epskamp
    DOI: 10.31234/osf.io/36xkp
    Submitted by hub-admin    
      Mean reproducibility score:   8.0/10   |   Number of reviews:   3
    Why should we attempt to reproduce this paper?

    Currently submitted paper on COVID19 on mental health. Unique clinical data (time series during the pandemic onset) & methods, hopefully fun to work on. Possibly too boring / easy to reproduce given my data & code? Not sure.

    Tags: R
  • Statistical analysis of coverage error in simple global temperature estimators

    Authors: K Cowtan, P Jacobs, P Thorne, R Wilkinson
    Submitted by hub-admin    

    Why should we attempt to reproduce this paper?

    To see whether we did a good enough job in providing data and methods, and to check how the code has aged with respect to current libraries.

    Tags: Python
  • The Impact of Sound-Bite Journalism on Public Argument

    Authors: Rinke, E. M.
    DOI: 10.1111/jcom.12246
    Submitted by emrinke    
      Mean reproducibility score:   10.0/10   |   Number of reviews:   1
    Why should we attempt to reproduce this paper?

    - This paper is a good example of a standard social science study that is (I hope!) fully reproducible, from main analysis, to supplementary analyses and figures. - I have not yet received any external feedback w.r.t. its reproducibility, so would be interested to see if I have overlooked any gaps in the reproduction workflow that I anticipated.

  • Where should new parkrun events be located? Modelling the potential impact of 200 new events on socio-economic inequalities in access and participation

    Authors: Schneider PP, Smith RA, Bullas AM, Bayley T, Haake SS, Brennan A, Goyder E
    Submitted by hub-admin    
      Mean reproducibility score:   7.0/10   |   Number of reviews:   3
    Why should we attempt to reproduce this paper?

    If all went right, the analysis should be fully reproducible without the need to make any adjustments. The paper aims to find optimal locations for new parkruns, but we were not 100% sure how 'optimal' should be defined. We provide a few examples, but the code was meant to be flexible enough to allow potential decision makers to specify their own, alternative objectives. The spatial data set is also quite interesting and fun to play around with. Cave: The full analysis takes a while to run (~30+ min) and might require >= 8gb ram.

  • Modality switch effects emerge early and increase throughout conceptual processing: Evidence from ERPs

    Authors: Bernabeu, P., Willems, R. M., & Louwerse, M. M.
    Submitted by hub-admin    

    Why should we attempt to reproduce this paper?

    Open data and reproducibility was important in this project.

    Tags: R
  • Evaluation of the ‘Irish Rules’: The Potato Late Blight Forecasting Model and Its Operational Use in the Republic of Ireland

    Authors: Cucak, M., Sparks, A., Moral, R.D.A., Kildea, S., Lambkin, K. and Fealy, R.
    Submitted by hub-admin  
    Number of reviews:   2
    Why should we attempt to reproduce this paper?

    It is a rare find of full reproducibility in the field of plant disease epidemiology.

    Tags: R
  • Quantitative analysis of spectroscopic Low Energy Electron Microscopy data: High-dynamic range imaging, drift correction and cluster analysis

    Authors: Jong T.A. de, Kok, D.N.L, Torren A.J.H. van der, Schopmans H., Tromp R.M., Molen S.J. van der & Jobst J.
    Submitted by hub-admin  
    Number of reviews:   2
    Why should we attempt to reproduce this paper?

    Low Energy Electron Microscopy (LEEM) is a somewhat specific form of electron microscopy used to study surfaces and 2D materials. In this paper we describe a set of data processing techniques applied to LEEM and adapted to the peculiarities of LEEM. This is combined with a parallelized Python implementation using Dask in separate notebooks. So if you are interested in microscopy, image analysis, clustering of experimental physics data or parallel Python, this paper should be interesting to you.

    Tags: Python
  • Explicit (but not implicit) environmentalist identity predicts pro-environmental behavior and policy preferences

    Authors: Brick, C., & Lai, C. K.
    DOI: 10.1016/j.jenvp.2018.07.003
    Submitted by hub-admin    
      Mean reproducibility score:   6.0/10   |   Number of reviews:   1
    Why should we attempt to reproduce this paper?

    The results of the individual studies (4) could be interpreted in support for the hypothesis, but the meta-analysis suggested that implicit identification was not a useful predictor overall. This conclusion is an important goalpost for future work.

  • Determination of the fundamental absorption and optical bandgap of dielectric thin films from single optical transmittance measurements

    Authors: A. Tejada, L. Montañez, C. Torres, P. Llontop, L. Flores-Escalante, F. De Zela, A. Winnacker, and J. A. Guerra
    Submitted by hub-admin    

    Why should we attempt to reproduce this paper?

    We propose a simple method to retrieve optical constants from single optical transmittance measurements, in particular in the fundamental absorption region. The construction of needed envelopes is arbitrary and will depend on the user. However, the method should still be robust and deliver similar results.

  • Cell Contractility Facilitates Alignment of Cells and Tissues to Static Uniaxial Stretch

    Authors: Rens, E. G., & Merks, R. M. H.
    Submitted by hub-admin    
      Mean reproducibility score:   1.0/10   |   Number of reviews:   2
    Why should we attempt to reproduce this paper?

    This paper shows a fun and interesting simulation result. I find it (of course) very important that our results are reproducible. In this paper, however, we did not include the exact code for these specific simulations, but the results should be reproducible using the code of our previous paper in PLOS Computational Biology (Van Oers, Rens et al. https://doi.org/10.1371/journal.pcbi.1003774). I am genuinely curious to see if there is sufficient information for the Biophys J paper or if we should have done better. Other people have already successfully built upon the 2014 (PLOS) paper using our code; see e.g., https://journals.aps.org/pre/abstract/10.1103/PhysRevE.97.012408 and https://doi.org/10.1101/701037).

    Tags: C Matlab
  • Use of significance test logic by scientists in a novel reasoning task

    Authors: Morey and Hoekstra
    Submitted by hub-admin    
      Mean reproducibility score:   9.5/10   |   Number of reviews:   2
    Why should we attempt to reproduce this paper?

    The format of the paper is a bit unusual: it is contained, and compiled as, an R package. Although this would seem, on its face, to make it easier to reproduce, it is an open question how obvious it will be. I wonder to what extent people reproducing the results would prefer this to simple R scripts.

    Tags: R
  • Don't Hold My Data Hostage - A Case For Client Protocol Redesign

    Authors: Mark Raasveldt and Hannes Mühleisen:
    Submitted by hub-admin    
      Mean reproducibility score:   1.0/10   |   Number of reviews:   1
    Why should we attempt to reproduce this paper?

    We made a huge effort to ensure the paper is reproducible. But is it?

    Tags: Python
  • Algorithm configuration data mining for CMA evolution strategies

    Authors: Sander van Rijn, Hao Wang, Bas van Stein, Thomas Bäck
    DOI: 10.1145/3071178.3071205
    Submitted by sjvrijn    
      Mean reproducibility score:   10.0/10   |   Number of reviews:   1
    Why should we attempt to reproduce this paper?

    The original data took quite a while to produce for a previous paper, but for this paper, all tables and figures should be exactly reproducible by simply running the jupyter notebook.

  • Social-evaluative threat: Stress response stages and influences of biological sex and neuroticism

    Authors: Poppelaars, E. S., Klackl, J., Pletzer, B., Wilhelm, F. H., & Jonas, E.
    DOI: 10.1016/j.psyneuen.2019.104378
    Submitted by hub-admin    
      Mean reproducibility score:   3.0/10   |   Number of reviews:   1
    Why should we attempt to reproduce this paper?

    This is a small dataset with a lot of missing data, so it's quite challenging to produce reliable results. It uses multiple imputation to fill the missing data, so it would be interesting to see whether the results hold up when this is redone. However, since the multiple imputation takes a couple of hours to run (on a decent laptop), the final multiply imputed data is also included. Additionally, multiply imputed data needs a different statistical analysis approach, which you can get familiar with.

    Tags: R
  • Supercurrent-induced Majorana bound states in a planar geometry

    Authors: André Melo, Sebastian Rubbert, Anton R. Akhmerov.
    DOI: 10.21468/SciPostPhys.7.3.039
    Submitted by andre_melo    
      Mean reproducibility score:   8.7/10   |   Number of reviews:   3
    Why should we attempt to reproduce this paper?

    We've tried to make it as easy as possible to reproduce. There's some fun physics on the paper and it's all done with Python!

    Tags: Python
  • Comparing theory-driven and data-driven attractiveness models using images of real women’s faces

    Authors: Holzleitner et al.
    Submitted by hub-admin    

    Why should we attempt to reproduce this paper?

    Complex analyses over multiple variables. In press, so we can still fix errors ahead of publication!!

    Tags: R
  • model4you: An R Package for Personalised Treatment Effect Estimation

    Authors: Seibold, H., Zeileis, A. and Hothorn, T., 2019
    DOI: 10.5334/jors.219
    Submitted by hub-admin    
      Mean reproducibility score:   9.0/10   |   Number of reviews:   1
    Why should we attempt to reproduce this paper?

    I guess it could be a cool learning experience. The paper is written with knitr, uses a seed, is part of the R package it describes, was openly written using version control (SVN, R-Forge) and is available in an open access journal (@up_jors).

    Tags: R LaTeX SVN knitr
  • Open Trade Statistics

    Authors: Pachá (Mauricio Vargas Sepúlveda)
    Submitted by hub-admin    

    Why should we attempt to reproduce this paper?

    The focus of the project is reproducibility. Here we show the differences to access data compared to similar initiatives: https://ropensci.org/blog/2019/05/09/tradestatistics/. Also, similar projects have obscure parts, while our exposes the code from raw data downloading to dashboard creation.

    Tags: R Shiny
  • Growth Dynamics of Independent Gametophytes of Pleurosoriopsis makinoi ( Polypodiaceae)

    Authors: Atsushi Ebihara, Joel H. Nitta, Yurika Matsumoto, Yuri Fukazawa, Marie Kurihara, Hitomi Yokote, Kaoru Sakuma, Otowa Azakami, Yumiko Hirayama, Ryoko Imaichi
    Submitted by joelnitta    
      Mean reproducibility score:   10.0/10   |   Number of reviews:   1
    Why should we attempt to reproduce this paper?

    It uses the drake R package that should make reproducibility of R projects much easier (just run make.R and you're done). However, it does depend on very specific package versions, which are provided by the accompanying docker image.

    Tags: R Docker Drake
  • PREPRINT: Using digital epidemiology methods to monitor influenza-like illness in the Netherlands in real-time: the 2017-2018 season

    Authors: Schneider P, Van Gool C, Spreeuwenberg P, Hooiveld M, Donker GA, Barnett DJ, Paget J
    Submitted by hub-admin  
    Number of reviews:   4
    Why should we attempt to reproduce this paper?

    This preprint is an attempt to reproduce Google Flu Trend in the Netherlands. The whole paper + code is meant to be easily reproducible and transferable to other countries and/or areas. If you are familiar with time series data, lasso regression and cross validation, the analysis should be straight forward. If anyone is interested, I could also provide influenza data for other European countries.

    Tags: R