Review of "Does ethnic density influence community participation in mass participation physical activity events?"

Submitted by PatriZa

Nov. 10, 2022, 2:05 p.m.

Lead reviewer

PatriZa

Review team members

FriPre

Review Body

Reproducibility

Did you manage to reproduce it?

Partially Reproducible

Reproducibility rating

How much of the paper did you manage to reproduce?

7 / 10

Briefly describe the procedure followed/tools used to reproduce it

We used R studio to reprocude the results and followed the steps mentioned at the webpage:

Installation

Install rStudio
Clone this repository git clone https://github.com/ScHARR-PHEDS/DoPE_Public.git
Open DoPE_Public.Rproj in rStudio
Run install.packages("renv") in the R terminal
Run renv::restore() in the R terminal

Running the code

Source:
    R\src1_data_proc.R Purpose: To clean data ready for analysis Outputs: a single .csv file.
    R\src2_analysis.R Purpose: Undertake statistical analysis
    Outputs: Regression tables and visuals

Results

Stargazer gave the usual error message and we and tried to use the workaround at https://gist.github.com/alexeyknorre/b0780836f4cec04d41a863a683f91b53 but that did not work. However, the stargazer function worked when we defined the df outside of it.

The remainder of the code worked well but we got different numbers in the descriptions statistics and regression outputs than presented in the paper. For example, number of finishers was 34,753 instead of 32,844.

Briefly describe your familiarity with the procedure/tools used by the paper.

We were very familiar with R studio and the methods used in the paper except with the "renv"-package.

Which type of operating system were you working in?

Windows Operating System

What additional software did you need to install?

Nothing

What software did you use

What were the main challenges you ran into (if any)?

When installing the packages with "renv," the "terra"-package led to an error. We solved this problem by deleting it from "renv.lock".

We also tried to reproduce the findings in MacOS 12.6, but there the installation procedure was even more difficult. The problem was solved by building the project anew and not cloning it from Github. (Which was easy.) The other problems were the same as for Windows except there was no error message shown in stargazer.

What were the positive features of this approach?

R is an amazing software to reproduce the results. The codes were easy to understand.

Any other comments/suggestions on the reproducibility approach?

Documentation

Documentation rating

How well was the material documented?

10 / 10

How could the documentation be improved?

The documentation was good enough. Maybe one could describe how "renv" works, but one can also easily google that information.

What do you like about the documentation?

The documentation was easy to understand and follow.

After attempting to reproduce, how familiar do you feel with the code and methods used in the paper?

10 / 10

Any suggestions on how the analysis could be made more transparent?

Reusability

Reusability rating

Rate the project on reusability of the material

10 / 10

Permissive Data license included:

Permissive Code license included:

Any suggestions on how the project could be more reusable?

Licence for data was only mentioned on the website https://wellcomeopenresearch.org/articles/5-9/v2 but not on Github.

Any final comments

(1) On the website https://wellcomeopenresearch.org/articles/5-9: The link in "Software availability: Source code available from: https://github.com/ bitowaqr/DoPE" does not work, because there is a space in it.

(2) On https://github.com/ScHARR-PHEDS/DoPE_Public: It is said: "Run install.packages("renv") in the R terminal" However, that's a command that you run in the console.

(3) Warning for future: library(rgdal) gives the warning message "Please note that rgdal will be retired during 2023, plan transition to sf/stars/terra functions using GDAL and PROJ"