Skip to main content
PMC home page
Journal of Neurology, Neurosurgery, and Psychiatry logoLink to Journal of Neurology, Neurosurgery, and Psychiatry
. 2001 Nov;71(5):643–651. doi: 10.1136/jnnp.71.5.643

The neurobehavioural rating scale-revised: sensitivity and validity in closed head injury assessment

S McCauley 1, H Levin 1, M Vanier 1, J Mazaux 1, C Boake 1, P Goldfader 1, D Rockers 1, M Butters 1, D Kareken 1, J Lambert 1, G Clifton 1
PMCID: PMC1737597  PMID: 11606677

Abstract

OBJECTIVES—To investigate the factor structure and psychometric properties of the neurobehavioural rating scale-revised (NRS-R) and to determine its usefulness in clinical trials.
METHODS—A consecutive series of patients sustaining severe closed head injury were evacuated to one of 11 large regional North American trauma centres and entered into a randomised, phase III, multicentre clinical trial investigating the therapeutic use of moderate hypothermia. Acute care personnel were blinded to outcome and outcome personnel were blinded to treatment condition. The Glasgow outcome scale (GOS) was the primary outcome measure. Secondary outcome measures included the disability rating scale (DRS) and the NRS-R.
RESULTS—Exploratory factor analysis of NRS-R data collected at 6 months after injury (n=210) resulted in a five factor model including: (1) executive/cognition, (2) positive symptoms, (3) negative symptoms, (4) mood/affect, and (5) oral/motor. These factors showed acceptable internal consistency (0.62 to 0.88), low to moderate interfactor correlations (0.19 to 0.61), and discriminated well between GOS defined groups. Factor validity was demonstrated by significant correlations with specific neuropsychological domains. Significant change was measured from 3 to 6 months after injury for the total score (sum of all 29 item ratings) and all factor scores except mood/affect and positive symptoms. The total score and all factor scores correlated significantly with concurrent GOS and DRS scores.
CONCLUSIONS—The NRS-R is well suited as a secondary outcome measure for clinical trials as its completion rate exceeds that of neuropsychological assessment and it provides important neurobehavioural information complementary to that provided by global outcome and neuropsychological measures.



Full Text

The Full Text of this article is available as a PDF (179.7 KB).

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. Achté K., Jarho L., Kyykkä T., Vesterinen E. Paranoid disorders following war brain damage. Preliminary report. Psychopathology. 1991;24(5):309–315. doi: 10.1159/000284731. [DOI] [PubMed] [Google Scholar]
  2. Bayless J. D., Varney N. R., Roberts R. J. Tinker toy test performance and vocational outcome in patients with closed-head injuries. J Clin Exp Neuropsychol. 1989 Dec;11(6):913–917. doi: 10.1080/01688638908400944. [DOI] [PubMed] [Google Scholar]
  3. Brooks D. N., McKinlay W. Personality and behavioural change after severe blunt head injury--a relative's view. J Neurol Neurosurg Psychiatry. 1983 Apr;46(4):336–344. doi: 10.1136/jnnp.46.4.336. [DOI] [PMC free article] [PubMed] [Google Scholar]
  4. Brooks N., Campsie L., Symington C., Beattie A., McKinlay W. The five year outcome of severe blunt head injury: a relative's view. J Neurol Neurosurg Psychiatry. 1986 Jul;49(7):764–770. doi: 10.1136/jnnp.49.7.764. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Buschke H., Fuld P. A. Evaluating storage, retention, and retrieval in disordered memory and learning. Neurology. 1974 Nov;24(11):1019–1025. doi: 10.1212/wnl.24.11.1019. [DOI] [PubMed] [Google Scholar]
  6. Carlsson C. A., von Essen C., Löfgren J. Factors affecting the clinical corse of patients with severe head injuries. 1. Influence of biological factors. 2. Significance of posttraumatic coma. J Neurosurg. 1968 Sep;29(3):242–251. doi: 10.3171/jns.1968.29.3.0242. [DOI] [PubMed] [Google Scholar]
  7. Cifu D. X., Keyser-Marcus L., Lopez E., Wehman P., Kreutzer J. S., Englander J., High W. Acute predictors of successful return to work 1 year after traumatic brain injury: a multicenter analysis. Arch Phys Med Rehabil. 1997 Feb;78(2):125–131. doi: 10.1016/s0003-9993(97)90252-5. [DOI] [PubMed] [Google Scholar]
  8. Clifton G. L., Hayes R. L., Levin H. S., Michel M. E., Choi S. C. Outcome measures for clinical trials involving traumatically brain-injured patients: report of a conference. Neurosurgery. 1992 Nov;31(5):975–978. doi: 10.1227/00006123-199211000-00028. [DOI] [PubMed] [Google Scholar]
  9. Clifton G. L., Kreutzer J. S., Choi S. C., Devany C. W., Eisenberg H. M., Foulkes M. A., Jane J. A., Marmarou A., Marshall L. F. Relationship between Glasgow Outcome Scale and neuropsychological measures after brain injury. Neurosurgery. 1993 Jul;33(1):34–39. doi: 10.1227/00006123-199307000-00005. [DOI] [PubMed] [Google Scholar]
  10. Corrigan J. D., Dickerson J., Fisher E., Meyer P. The Neurobehavioural Rating Scale: replication in an acute, inpatient rehabilitation setting. Brain Inj. 1990 Jul-Sep;4(3):215–222. doi: 10.3109/02699059009026170. [DOI] [PubMed] [Google Scholar]
  11. Dombovy M. L., Olek A. C. Recovery and rehabilitation following traumatic brain injury. Brain Inj. 1997 May;11(5):305–318. doi: 10.1080/026990597123467. [DOI] [PubMed] [Google Scholar]
  12. Fedoroff J. P., Starkstein S. E., Forrester A. W., Geisler F. H., Jorge R. E., Arndt S. V., Robinson R. G. Depression in patients with acute traumatic brain injury. Am J Psychiatry. 1992 Jul;149(7):918–923. doi: 10.1176/ajp.149.7.918. [DOI] [PubMed] [Google Scholar]
  13. Foglia J. P., Pollock B. G., Kirshner M. A., Rosen J., Sweet R., Mulsant B. Plasma levels of citalopram enantiomers and metabolites in elderly patients. Psychopharmacol Bull. 1997;33(1):109–112. [PubMed] [Google Scholar]
  14. Gass C. S., Daniel S. K. Emotional impact on trail making test performance. Psychol Rep. 1990 Oct;67(2):435–438. doi: 10.2466/pr0.1990.67.2.435. [DOI] [PubMed] [Google Scholar]
  15. Girard D., Brown J., Burnett-Stolnack M., Hashimoto N., Hier-Wellmer S., Perlman O. Z., Seigerman C. The relationship of neuropsychological status and productive outcomes following traumatic brain injury. Brain Inj. 1996 Sep;10(9):663–676. doi: 10.1080/026990596124089. [DOI] [PubMed] [Google Scholar]
  16. Gualtieri C. T. Buspirone for the behavior problems of patients with organic brain disorders. J Clin Psychopharmacol. 1991 Aug;11(4):280–281. doi: 10.1097/00004714-199108000-00027. [DOI] [PubMed] [Google Scholar]
  17. Hart R. P., Kwentus J. A., Taylor J. R., Harkins S. W. Rate of forgetting in dementia and depression. J Consult Clin Psychol. 1987 Feb;55(1):101–105. doi: 10.1037//0022-006x.55.1.101. [DOI] [PubMed] [Google Scholar]
  18. Heiskanen O., Sipponen P. Prognosis of severe brain injury. Acta Neurol Scand. 1970;46(3):343–348. doi: 10.1111/j.1600-0404.1970.tb05798.x. [DOI] [PubMed] [Google Scholar]
  19. Hilton G., Sisson R., Freeman E. The Neurobehavioral Rating Scale: an interrater reliability study in the HIV seropositive population. J Neurosci Nurs. 1990 Feb;22(1):36–42. doi: 10.1097/01376517-199002000-00009. [DOI] [PubMed] [Google Scholar]
  20. Jennett B., Bond M. Assessment of outcome after severe brain damage. Lancet. 1975 Mar 1;1(7905):480–484. doi: 10.1016/s0140-6736(75)92830-5. [DOI] [PubMed] [Google Scholar]
  21. Jennett B., Snoek J., Bond M. R., Brooks N. Disability after severe head injury: observations on the use of the Glasgow Outcome Scale. J Neurol Neurosurg Psychiatry. 1981 Apr;44(4):285–293. doi: 10.1136/jnnp.44.4.285. [DOI] [PMC free article] [PubMed] [Google Scholar]
  22. Jennett B., Teasdale G., Braakman R., Minderhoud J., Heiden J., Kurze T. Prognosis of patients with severe head injury. Neurosurgery. 1979 Apr;4(4):283–289. doi: 10.1227/00006123-197904000-00001. [DOI] [PubMed] [Google Scholar]
  23. Jennett B., Teasdale G., Braakman R., Minderhoud J., Knill-Jones R. Predicting outcome in individual patients after severe head injury. Lancet. 1976 May 15;1(7968):1031–1034. doi: 10.1016/s0140-6736(76)92215-7. [DOI] [PubMed] [Google Scholar]
  24. Jorge R. E., Robinson R. G., Arndt S. V., Forrester A. W., Geisler F., Starkstein S. E. Comparison between acute- and delayed-onset depression following traumatic brain injury. J Neuropsychiatry Clin Neurosci. 1993 Winter;5(1):43–49. doi: 10.1176/jnp.5.1.43. [DOI] [PubMed] [Google Scholar]
  25. Kant R., Duffy J. D., Pivovarnik A. Prevalence of apathy following head injury. Brain Inj. 1998 Jan;12(1):87–92. doi: 10.1080/026990598122908. [DOI] [PubMed] [Google Scholar]
  26. Levin H. S., High W. M., Goethe K. E., Sisson R. A., Overall J. E., Rhoades H. M., Eisenberg H. M., Kalisky Z., Gary H. E. The neurobehavioural rating scale: assessment of the behavioural sequelae of head injury by the clinician. J Neurol Neurosurg Psychiatry. 1987 Feb;50(2):183–193. doi: 10.1136/jnnp.50.2.183. [DOI] [PMC free article] [PubMed] [Google Scholar]
  27. Mazaux J. M., Masson F., Levin H. S., Alaoui P., Maurette P., Barat M. Long-term neuropsychological outcome and loss of social autonomy after traumatic brain injury. Arch Phys Med Rehabil. 1997 Dec;78(12):1316–1320. doi: 10.1016/s0003-9993(97)90303-8. [DOI] [PubMed] [Google Scholar]
  28. Mulsant B. H., Mazumdar S., Pollock B. G., Sweet R. A., Rosen J., Lo K. Methodological issues in characterizing treatment response in demented patients with behavioral disturbances. Int J Geriatr Psychiatry. 1997 May;12(5):537–547. [PubMed] [Google Scholar]
  29. Oddy M., Coughlan T., Tyerman A., Jenkins D. Social adjustment after closed head injury: a further follow-up seven years after injury. J Neurol Neurosurg Psychiatry. 1985 Jun;48(6):564–568. doi: 10.1136/jnnp.48.6.564. [DOI] [PMC free article] [PubMed] [Google Scholar]
  30. Rappaport M., Hall K. M., Hopkins K., Belleza T., Cope D. N. Disability rating scale for severe head trauma: coma to community. Arch Phys Med Rehabil. 1982 Mar;63(3):118–123. [PubMed] [Google Scholar]
  31. Sultzer D. L., Berisford M. A., Gunay I. The Neurobehavioral Rating Scale: reliability in patients with dementia. J Psychiatr Res. 1995 May-Jun;29(3):185–191. doi: 10.1016/0022-3956(95)00018-z. [DOI] [PubMed] [Google Scholar]
  32. Sultzer D. L., Levin H. S., Mahler M. E., High W. M., Cummings J. L. A comparison of psychiatric symptoms in vascular dementia and Alzheimer's disease. Am J Psychiatry. 1993 Dec;150(12):1806–1812. doi: 10.1176/ajp.150.12.1806. [DOI] [PubMed] [Google Scholar]
  33. Sultzer D. L., Levin H. S., Mahler M. E., High W. M., Cummings J. L. Assessment of cognitive, psychiatric, and behavioral disturbances in patients with dementia: the Neurobehavioral Rating Scale. J Am Geriatr Soc. 1992 Jun;40(6):549–555. doi: 10.1111/j.1532-5415.1992.tb02101.x. [DOI] [PubMed] [Google Scholar]
  34. Sultzer D. L., Mahler M. E., Cummings J. L., Van Gorp W. G., Hinkin C. H., Brown C. Cortical abnormalities associated with subcortical lesions in vascular dementia. Clinical and position emission tomographic findings. Arch Neurol. 1995 Aug;52(8):773–780. doi: 10.1001/archneur.1995.00540320049012. [DOI] [PubMed] [Google Scholar]
  35. Sultzer D. L., Mahler M. E., Mandelkern M. A., Cummings J. L., Van Gorp W. G., Hinkin C. H., Berisford M. A. The relationship between psychiatric symptoms and regional cortical metabolism in Alzheimer's disease. J Neuropsychiatry Clin Neurosci. 1995 Fall;7(4):476–484. doi: 10.1176/jnp.7.4.476. [DOI] [PubMed] [Google Scholar]
  36. Tabaddor K., Mattis S., Zazula T. Cognitive sequelae and recovery course after moderate and severe head injury. Neurosurgery. 1984 Jun;14(6):701–708. doi: 10.1227/00006123-198406000-00010. [DOI] [PubMed] [Google Scholar]
  37. Teasdale G., Jennett B. Assessment of coma and impaired consciousness. A practical scale. Lancet. 1974 Jul 13;2(7872):81–84. doi: 10.1016/s0140-6736(74)91639-0. [DOI] [PubMed] [Google Scholar]
  38. Thomsen I. V. Late outcome of very severe blunt head trauma: a 10-15 year second follow-up. J Neurol Neurosurg Psychiatry. 1984 Mar;47(3):260–268. doi: 10.1136/jnnp.47.3.260. [DOI] [PMC free article] [PubMed] [Google Scholar]
  39. Thomsen I. V. Late psychosocial outcome in severe traumatic brain injury. Preliminary results of a third follow-up study after 20 years. Scand J Rehabil Med Suppl. 1992;26:142–152. [PubMed] [Google Scholar]
  40. Vanier M., Mazaux J. M., Lambert J., Dassa C., Levin H. S. Assessment of neuropsychologic impairments after head injury: interrater reliability and factorial and criterion validity of the Neurobehavioral Rating Scale-Revised. Arch Phys Med Rehabil. 2000 Jun;81(6):796–806. doi: 10.1016/s0003-9993(00)90114-x. [DOI] [PubMed] [Google Scholar]
  41. Vilkki J., Ahola K., Holst P., Ohman J., Servo A., Heiskanen O. Prediction of psychosocial recovery after head injury with cognitive tests and neurobehavioral ratings. J Clin Exp Neuropsychol. 1994 Jun;16(3):325–338. doi: 10.1080/01688639408402643. [DOI] [PubMed] [Google Scholar]
  42. Violon A., De Mol J. Psychological sequelae after head traumas in adults. Acta Neurochir (Wien) 1987;85(3-4):96–102. doi: 10.1007/BF01456104. [DOI] [PubMed] [Google Scholar]

Articles from Journal of Neurology, Neurosurgery, and Psychiatry are provided here courtesy of BMJ Publishing Group

RESOURCES