Review of
"The Impact of Sound-Bite Journalism on Public Argument"

Review of "The Impact of Sound-Bite Journalism on Public Argument"

Submitted by HPlatte  

Aug. 30, 2022, 2:22 p.m.

Lead reviewer

HPlatte

Review Body

Reproducibility

Did you manage to reproduce it?
Fully Reproducible
Reproducibility rating
How much of the paper did you manage to reproduce?
10 / 10
Briefly describe the procedure followed/tools used to reproduce it

The results of the paper were fully reproducible with the data & code provided. I used Stata 17 for the replication, the results where the same when using version 17 or setting it back to 14 (as in the original analysis). There were no edits to the code necessary (except for setting the working directory).

Briefly describe your familiarity with the procedure/tools used by the paper.

I am quite familiar with Stata, but have little knowledge of the applied methods. Therefore, I cannot judge whether these make sense.

Which type of operating system were you working in?
Windows Operating System
What additional software did you need to install?

None

What software did you use

Stata 17 (14)

What were the main challenges you ran into (if any)?

Assigning the results of the Stata output to the edited table in the paper.

What were the positive features of this approach?

The graphs where 100% reproducible with the code provided. Even the results mentioned in a footnote where reproducible.

Any other comments/suggestions on the reproducibility approach?

It would be nice to be also able to see also data coding and editing that led to the 'clean' data provided for the replication. But obviously that is a lot of work and requires a very different level of transparency, as this code tends to be very messy.


Documentation

Documentation rating
How well was the material documented?
10 / 10
How could the documentation be improved?

The comments in the code are very helpful to assign the numbers in the Stata output to the results in the paper. However, it still takes quite some time to do this.

What do you like about the documentation?

Very helpful comments in the code, full replication of the graphs, everything works well.

After attempting to reproduce, how familiar do you feel with the code and methods used in the paper?
8 / 10
Any suggestions on how the analysis could be made more transparent?

Well, I just run the code, but that does not mean I am familiar with the methods now.


Reusability

Reusability rating
Rate the project on reusability of the material
9 / 10
Permissive Data license included:  
Permissive Code license included:  

Any suggestions on how the project could be more reusable?


Any final comments

Thanks for uploading one of the few social science papers on reprohack and the great code! I learned a lot about doing nice graphs in stata.