Review of
"Mental Health and Social Contact During the COVID-19 Pandemic: An Ecological Momentary Assessment Study"

Review of "Mental Health and Social Contact During the COVID-19 Pandemic: An Ecological Momentary Assessment Study"

Submitted by janeyeo11  

June 29, 2024, 9:52 p.m.

Lead reviewer

janeyeo11

Review Body

Reproducibility

Did you manage to reproduce it?
Partially Reproducible
Reproducibility rating
How much of the paper did you manage to reproduce?
7 / 10
Briefly describe the procedure followed/tools used to reproduce it

Reproducing the paper required us to download the R-studio and the relevant libraries. The experiment was run with a detailed procedure and implemented in R using several relevant libraries. More specifically, a set of libraries including ‘gg- plot2‘, ‘dplyr‘, ‘mlVAR‘, ‘qgraph‘, ‘bootnet‘, ‘reshape‘, and ‘viridis‘ was used.

Briefly describe your familiarity with the procedure/tools used by the paper.

We only learned basics of R- programming and were not experts using this language. When error appears, we took some time to solve it. But luckily, at the end, we were managed to reproduce most of the results in this paper.

Which type of operating system were you working in?
Windows Operating System
What additional software did you need to install?

We do not need to install extra software.

What software did you use

R studio

What were the main challenges you ran into (if any)?

Installing the correct version of libraries and the libraries and packages were occupying large memory space and it took some time to install them.

What were the positive features of this approach?

We were able to notice the error immediately, despite the large number of code, because the code were run line by line.

Any other comments/suggestions on the reproducibility approach?

The error that we first met is loading the network_orthogonal.Rdata. It seems like the data is missing. But there was a code actually generate the network orthogonal data, that is needed for further process. However, error appears again due to the function cholmod_factor_ldetA. This function is not provided by the package. We tried to look for the correct library with the package ‘matrix’ but it was a failure. With this error, the network graph is not able to be reproduced.


Documentation

Documentation rating
How well was the material documented?
8 / 10
How could the documentation be improved?

It can be improved for transparency in the analysis with detailed metadata to elaborate the data further and help in interpretation and use. The data numbering started at 2 instead of 1, causing confusion and making it seem like a code might be missing.

What do you like about the documentation?

The documentation are well-structured. R code have commented lines that make comprehension easier, and the road between functions is well marked.

After attempting to reproduce, how familiar do you feel with the code and methods used in the paper?
8 / 10
Any suggestions on how the analysis could be made more transparent?

Providing annotations or references in the code that point to specific parts of the paper in which each analysis is described. It would be easier, by adding description that refer the data to the corresponding code.


Reusability

Reusability rating
Rate the project on reusability of the material
7 / 10
Permissive Data license included:  
Permissive Code license included:  

Any suggestions on how the project could be more reusable?


Any final comments

It would be good, if a README file is given, that conclude all the data and code, which can give us a direction before starting the review.