To boldly claim
- Caroline Ash
The data should speak for themselves, but writers want a broad swathe of readers to appreciate the significance of the signal they interpret in complex, noisy data, whereas editors want authors to be both concise and to acknowledge the limitations of the data. Analyzing more than 1000 psychology papers, DeJesus et al. found that student readers were most influenced by the amount of generic language used in research summaries. However, phrases like “juvenile male offenders are deficient in emotion processing” tell us nothing about sample size, variations in ethnicity, reason for incarceration, educational achievement, and so on. The risk is that generic language glosses over exceptions to a general rule and distracts from the limitations of the data. Unrepresentative claims can become magnified through the lenses of press releases, reportage and, not least, by editorial summaries like this, in high-profile journals. The consequences may cause harm.
Proc. Natl. Acad. Sci. U.S.A. 116, 18370 (2019).
Link to Science here:
https://science.sciencemag.org/content/365/6459/twil