Review of
"Raincheck: A new diachronic series of rainfall maps for Southwest Asia over the Holocene"

Review of "Raincheck: A new diachronic series of rainfall maps for Southwest Asia over the Holocene"

Submitted by pburgum  

May 19, 2022, 1:53 p.m.

Lead reviewer


Review team members

jeremykendal pburgum

Review Body


Did you manage to reproduce it?
Partially Reproducible
Reproducibility rating
How much of the paper did you manage to reproduce?
7 / 10
Briefly describe the procedure followed/tools used to reproduce it

We used R, following the instructions provided in the supplementary information.

Briefly describe your familiarity with the procedure/tools used by the paper.

Somewhat familiar. Some of us have experience with R, some do not.

Which type of operating system were you working in?
Windows Operating System
What additional software did you need to install?

A few R packages. On linux, these required some additional package installations.

What software did you use


What were the main challenges you ran into (if any)?

It was not entirely clear how to input the data, notably 'MEstation.csv' and 'WMOdata'. An instruction said to strip '\r\n', but '\n' was needed instead.

What were the positive features of this approach?

Very transparent using the data from original sources. The instructions were very clear.

Any other comments/suggestions on the reproducibility approach?

It may be useful to also include data that is already filtered to make it more quick to reproduce the outputs.


Documentation rating
How well was the material documented?
8 / 10
How could the documentation be improved?

Some of the instructions that were included in the data availability statement perhaps could have been included in the supplementary pdf to make it more clear.

What do you like about the documentation?

The instructions in the supplementary information are very clear and easy to follow (aside from the few issues above).

After attempting to reproduce, how familiar do you feel with the code and methods used in the paper?
9 / 10
Any suggestions on how the analysis could be made more transparent?


Reusability rating
Rate the project on reusability of the material
10 / 10
Permissive Data license included:  
Permissive Code license included:  

Any suggestions on how the project could be more reusable?

Any final comments

We were not able to fully reproduce the results in the time frame.