Review of
"Measuring the impact of COVID-19 vaccine misinformation on vaccination intent in the UK and USA"

Review of "Measuring the impact of COVID-19 vaccine misinformation on vaccination intent in the UK and USA"

Submitted by likith333  

Nov. 10, 2022, 2:31 p.m.

Lead reviewer

likith333

Review Body

Reproducibility

Did you manage to reproduce it?
Partially Reproducible
Reproducibility rating
How much of the paper did you manage to reproduce?
8 / 10
Briefly describe the procedure followed/tools used to reproduce it

We downloaded the entire folder from github and used the jupyter notebooks to reproduce the results.

Briefly describe your familiarity with the procedure/tools used by the paper.

We are quite familiar with Python, Pandas and Jupyter notebooks

Which type of operating system were you working in?
Windows Operating System
What additional software did you need to install?

None

What software did you use

Pycharm

What were the main challenges you ran into (if any)?
  • Absence of the raw data file (.txt file)
  • Installing Pystan
  • Environment conflicts
  • Delete index functions
  • Dependency on Pandas version
What were the positive features of this approach?
  • The notebooks were very well documented
  • Readme files were well documented
Any other comments/suggestions on the reproducibility approach?
  • Providing a requirements.txt

Documentation

Documentation rating
How well was the material documented?
10 / 10
How could the documentation be improved?

From our perspective, It is well documented

What do you like about the documentation?
  • It is well documented
After attempting to reproduce, how familiar do you feel with the code and methods used in the paper?
6 / 10
Any suggestions on how the analysis could be made more transparent?
  • Please provide the raw data file (.txt file)

Reusability

Reusability rating
Rate the project on reusability of the material
2 / 10
Permissive Data license included:  
Permissive Code license included:  

Any suggestions on how the project could be more reusable?
  • Do not hard code utility functions
  • Utilities should be more modular
  • Scope for providing input variables


Any final comments
  • Give us the raw data file (.txt)