Skip to main content
Proceedings of the National Academy of Sciences of the United States of America logoLink to Proceedings of the National Academy of Sciences of the United States of America
letter
. 2014 Feb 27;111(13):E1160. doi: 10.1073/pnas.1400112111

Signal or noise, a statistical perspective

Johnny Padulo a, Nicola Maffulli b,c, Luca Paolo Ardigò d,1
PMCID: PMC3977304  PMID: 24578511

Best practices about the appropriate use of statistical tools in sport and clinical sciences are increasingly being fostered. For the sake of science, the interpretation of the result of an experiment is the central key, which features the interpretation of the phenomenon. Recently, an interesting article in PNAS (1) shows that musical agency reduces perceived exertion during strenuous physical performance. Considering the experimental approach and data analysis, we also perceived this phenomenon as intriguing. However, the methodology approach requires stronger certainty because science must first reduce uncertainties to interpret effectively the collected results. We will discuss some points in this letter to clarify the question of “signal” and “noise.” In the study in question, the age range was wide (18–59 y): a different maturation level significantly affects the perceived exertion (2). The two to three different conditions were counterbalanced, but administering all of them during the same day, albeit at different times (3), could have caused an uncontrolled fatigue effect. Not all measures (1) have been verified in terms of measurement reliability (4). This point is crucial, because the authors only report laboratory spirometer VO2 accuracy. Given the physiological–psychological translational nature of this study, the experimental design is rather complex, making replication difficult. We agree that the “ratio” approach is fascinating, but, because the original results are not provided, the study repeatability is impaired. Considering the psycho-physical nature of the Borg scale, its poor accuracy (5), and the related documented relationship with age (2), the high variability featured in the study results of Fritz et al. seems to reflect more interindividual variability (noise) than the effect of a potential neuro-physiological phenomenon (signal).

Footnotes

The authors declare no conflict of interest.

References

  • 1.Fritz TH, et al. Musical agency reduces perceived exertion during strenuous physical performance. Proc Natl Acad Sci USA. 2013;110(44):17784–17789. doi: 10.1073/pnas.1217252110. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Chen MJ, Fan X, Moe ST. Criterion-related validity of the Borg ratings of perceived exertion scale in healthy individuals: A meta-analysis. J Sports Sci. 2002;20(11):873–899. doi: 10.1080/026404102320761787. [DOI] [PubMed] [Google Scholar]
  • 3.Atkinson G, Reilly T. Circadian variation in sports performance. Sports Med. 1996;21(4):292–312. doi: 10.2165/00007256-199621040-00005. [DOI] [PubMed] [Google Scholar]
  • 4.Hopkins WG. Measures of reliability in sports medicine and science. Sports Med. 2000;30(1):1–15. doi: 10.2165/00007256-200030010-00001. [DOI] [PubMed] [Google Scholar]
  • 5.O’Neill ME, Cooper KA, Mills CM, Boyce ES, Hunyor SN. Accuracy of Borg’s ratings of perceived exertion in the prediction of heart rates during pregnancy. Br J Sports Med. 1992;26(2):121–124. doi: 10.1136/bjsm.26.2.121. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from Proceedings of the National Academy of Sciences of the United States of America are provided here courtesy of National Academy of Sciences

RESOURCES