Skip to main content
British Journal of Sports Medicine logoLink to British Journal of Sports Medicine
. 2005 Aug;39(Suppl 1):i64–i69. doi: 10.1136/bjsm.2005.019620

Reproducibility of computer based neuropsychological testing among Norwegian elite football players

T Straume-Naesheim, T Andersen, R Bahr
PMCID: PMC1765313  PMID: 16046358

Abstract

Background: Head injuries account for 4–22% of all football injuries. The rate of brain injuries is difficult to assess, due to the problem of defining and grading concussion. Thus computerised testing programs for cognitive function have been developed.

Objective: To assess the reliability of a computerised neuropsychological test battery (CogSport) among Norwegian professional football players.

Methods: Norwegian professional football league players (90.3% participation) performed two consecutive baseline Cogsport tests before the 2004 season. CogSport consists of seven different subtasks: simple reaction time (SRT), choice reaction time (ChRT), congruent reaction time (CgRT), monitoring (MON), one-back (OBK), matching (Match) and learning (Learn).

Results: There was a small but significant improvement from repeated testing for the reaction time measurements of all seven subtasks (SRT: 0.7%, ChRT: 0.4%, CgRT: 1.2%, MON: 1.3%, OBK: 2.7%, Match: 2.0%, Learn: 1.1%). The coefficient of variation (CV) ranged from 1.0% to 2.7%; corresponding intraclass correlation coefficients ranged from 0.45 (0.34 to 0.55) to 0.79 (0.74 to 0.84). The standard deviation data showed higher CVs, ranging from 3.7% (Learn) to 14.2% (SRT). Thus, the variance decreased with increasing complexity of the task. The accuracy data displayed uniformly high CV (10.4–12.2) and corresponding low intraclass correlation coefficient (0.14 (0.01 to 0.26) to 0.31 (0.19 to 0.42)).

Conclusion: The reproducibility for the mean reaction time measures was excellent, but less good for measures of accuracy and consistency. Consecutive testing revealed a slight learning effect from test 1 to test 2, and double baseline testing is recommended to minimise this effect.

Full Text

The Full Text of this article is available as a PDF (141.7 KB).

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. Andersen T. E., Arnason A., Engebretsen L., Bahr R. Mechanisms of head injuries in elite football. Br J Sports Med. 2004 Dec;38(6):690–696. doi: 10.1136/bjsm.2003.009357. [DOI] [PMC free article] [PubMed] [Google Scholar]
  2. Aubry M., Cantu R., Dvorak J., Graf-Baumann T., Johnston K., Kelly J., Lovell M., McCrory P., Meeuwisse W., Schamasch P. Summary and agreement statement of the First International Conference on Concussion in Sport, Vienna 2001. Recommendations for the improvement of safety and health of athletes who may suffer concussive injuries. Br J Sports Med. 2002 Feb;36(1):6–10. doi: 10.1136/bjsm.36.1.6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Collie A., Darby D., Maruff P. Computerised cognitive assessment of athletes with sports related head injury. Br J Sports Med. 2001 Oct;35(5):297–302. doi: 10.1136/bjsm.35.5.297. [DOI] [PMC free article] [PubMed] [Google Scholar]
  4. Collie A., Maruff P., McStephen M., Darby D. G. Psychometric issues associated with computerised neuropsychological assessment of concussed athletes. Br J Sports Med. 2003 Dec;37(6):556–559. doi: 10.1136/bjsm.37.6.556. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Collie Alexander, Maruff Paul, Darby David G., McStephen Michael. The effects of practice on the cognitive test performance of neurologically normal individuals assessed at brief test-retest intervals. J Int Neuropsychol Soc. 2003 Mar;9(3):419–428. doi: 10.1017/S1355617703930074. [DOI] [PubMed] [Google Scholar]
  6. Collie Alexander, Maruff Paul, Makdissi Michael, McCrory Paul, McStephen Michael, Darby David. CogSport: reliability and correlation with conventional cognitive tests used in postconcussion medical evaluations. Clin J Sport Med. 2003 Jan;13(1):28–32. doi: 10.1097/00042752-200301000-00006. [DOI] [PubMed] [Google Scholar]
  7. Collins Michael W., Field Melvin, Lovell Mark R., Iverson Grant, Johnston Karen M., Maroon Joseph, Fu Freddie H. Relationship between postconcussion headache and neuropsychological test performance in high school athletes. Am J Sports Med. 2003 Mar-Apr;31(2):168–173. doi: 10.1177/03635465030310020301. [DOI] [PubMed] [Google Scholar]
  8. Delaney J. Scott, Lacroix Vincent J., Leclerc Suzanne, Johnston Karen M. Concussions among university football and soccer players. Clin J Sport Med. 2002 Nov;12(6):331–338. doi: 10.1097/00042752-200211000-00003. [DOI] [PubMed] [Google Scholar]
  9. Downs D. S., Abwender D. Neuropsychological impairment in soccer athletes. J Sports Med Phys Fitness. 2002 Mar;42(1):103–107. [PubMed] [Google Scholar]
  10. Echemendia R. J., Putukian M., Mackin R. S., Julian L., Shoss N. Neuropsychological test performance prior to and following sports-related mild traumatic brain injury. Clin J Sport Med. 2001 Jan;11(1):23–31. doi: 10.1097/00042752-200101000-00005. [DOI] [PubMed] [Google Scholar]
  11. Falleti Marina G., Maruff Paul, Collie Alexander, Darby David G., McStephen Michael. Qualitative similarities in cognitive impairment associated with 24 h of sustained wakefulness and a blood alcohol concentration of 0.05%. J Sleep Res. 2003 Dec;12(4):265–274. doi: 10.1111/j.1365-2869.2003.00363.x. [DOI] [PubMed] [Google Scholar]
  12. Green P., Rohling M. L., Lees-Haley P. R., Allen L. M., 3rd Effort has a greater effect on test scores than severe brain injury in compensation claimants. Brain Inj. 2001 Dec;15(12):1045–1060. doi: 10.1080/02699050110088254. [DOI] [PubMed] [Google Scholar]
  13. Guskiewicz Kevin M., Marshall Stephen W., Broglio Steven P., Cantu Robert C., Kirkendall Donald T. No evidence of impaired neurocognitive performance in collegiate soccer players. Am J Sports Med. 2002 Mar-Apr;30(2):157–162. doi: 10.1177/03635465020300020201. [DOI] [PubMed] [Google Scholar]
  14. International Symposium on Concussion in Sport. Abstracts. Br J Sports Med. 2001 Oct;35(5):367–377. doi: 10.1136/bjsm.35.5.367. [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. Iverson Grant L., Lovell Mark R., Collins Michael W. Interpreting change on ImPACT following sport concussion. Clin Neuropsychol. 2003 Nov;17(4):460–467. doi: 10.1076/clin.17.4.460.27934. [DOI] [PubMed] [Google Scholar]
  16. Kirkendall D. T., Jordan S. E., Garrett W. E. Heading and head injuries in soccer. Sports Med. 2001;31(5):369–386. doi: 10.2165/00007256-200131050-00006. [DOI] [PubMed] [Google Scholar]
  17. Lovell Mark R., Collins Michael W., Iverson Grant L., Field Melvin, Maroon Joseph C., Cantu Robert, Podell Kenneth, Powell John W., Belza Mark, Fu Freddie H. Recovery from mild concussion in high school athletes. J Neurosurg. 2003 Feb;98(2):296–301. doi: 10.3171/jns.2003.98.2.0296. [DOI] [PubMed] [Google Scholar]
  18. Lovell Mark R., Collins Michael W., Iverson Grant L., Johnston Karen M., Bradley James P. Grade 1 or "ding" concussions in high school athletes. Am J Sports Med. 2004 Jan-Feb;32(1):47–54. doi: 10.1177/0363546503260723. [DOI] [PubMed] [Google Scholar]
  19. Macciocchi S. N. "Practice makes perfect:" retest effects in college athletes. J Clin Psychol. 1990 Sep;46(5):628–631. doi: 10.1002/1097-4679(199009)46:5<628::aid-jclp2270460514>3.0.co;2-v. [DOI] [PubMed] [Google Scholar]
  20. Makdissi M., Collie A., Maruff P., Darby D. G., Bush A., McCrory P., Bennell K. Computerised cognitive assessment of concussed Australian Rules footballers. Br J Sports Med. 2001 Oct;35(5):354–360. doi: 10.1136/bjsm.35.5.354. [DOI] [PMC free article] [PubMed] [Google Scholar]
  21. Matser E. J., Kessels A. G., Lezak M. D., Jordan B. D., Troost J. Neuropsychological impairment in amateur soccer players. JAMA. 1999 Sep 8;282(10):971–973. doi: 10.1001/jama.282.10.971. [DOI] [PubMed] [Google Scholar]
  22. Matser J. T., Kessels A. G., Jordan B. D., Lezak M. D., Troost J. Chronic traumatic brain injury in professional soccer players. Neurology. 1998 Sep;51(3):791–796. doi: 10.1212/wnl.51.3.791. [DOI] [PubMed] [Google Scholar]
  23. Matser J. T., Kessels A. G., Lezak M. D., Troost J. A dose-response relation of headers and concussions with cognitive impairment in professional soccer players. J Clin Exp Neuropsychol. 2001 Dec;23(6):770–774. doi: 10.1076/jcen.23.6.770.1029. [DOI] [PubMed] [Google Scholar]
  24. Müller R., Büttner P. A critical discussion of intraclass correlation coefficients. Stat Med. 1994 Dec 15;13(23-24):2465–2476. doi: 10.1002/sim.4780132310. [DOI] [PubMed] [Google Scholar]
  25. Rutherford Andrew, Stephens Richard, Potter Douglas. The neuropsychology of heading and head trauma in Association Football (soccer): a review. Neuropsychol Rev. 2003 Sep;13(3):153–179. doi: 10.1023/a:1025525613477. [DOI] [PubMed] [Google Scholar]
  26. Stuss D. T., Stethem L. L., Hugenholtz H., Picton T., Pivik J., Richard M. T. Reaction time after head injury: fatigue, divided and focused attention, and consistency of performance. J Neurol Neurosurg Psychiatry. 1989 Jun;52(6):742–748. doi: 10.1136/jnnp.52.6.742. [DOI] [PMC free article] [PubMed] [Google Scholar]
  27. Tysvaer A. T. Head and neck injuries in soccer. Impact of minor trauma. Sports Med. 1992 Sep;14(3):200–213. doi: 10.2165/00007256-199214030-00006. [DOI] [PubMed] [Google Scholar]

Articles from British Journal of Sports Medicine are provided here courtesy of BMJ Publishing Group

RESOURCES