Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2014 Jun 1.
Published in final edited form as: J Am Acad Child Adolesc Psychiatry. 2013 Apr 24;52(6):599–607.e7. doi: 10.1016/j.jaac.2013.02.015

Identifying Prolonged Grief Reactions in Children: Dimensional and Diagnostic Approaches

Nadine M Melhem 1, Giovanna Porta 2, Monica Walker Payne 3, David A Brent 4
PMCID: PMC3664016  NIHMSID: NIHMS459620  PMID: 23702449

Abstract

Objective

Children with prolonged grief reactions (PGR) have been found to be at increased risk for depression and functional impairment. Identifying and diagnosing PGR in children is challenging, as there are no available dimensional measures with established thresholds and no diagnostic criteria in the DSM-IV. We examine thresholds for the Inventory for Complicated Grief–Revised for Children (ICG-RC) and compare this dimensional approach to the proposed DSM-5 criteria for Persistent Complex Bereavement-Related Disorder. We also identify a screening tool for PGR.

Method

Parentally bereaved children, 8–17 years of age, were assessed at 9, 21, and 33 months after parental death. Receiver Operator Characteristics were used to establish the “best threshold” that would identify children with PGR and evaluate the proposed DSM-5 criteria cross-sectionally and longitudinally.

Results

A score of 68 or higher on the ICG-RC was found to have high sensitivity (0.942) and specificity (0.965) in differentiating cases with PGR from noncases at 9 months. We also identify a 6-item screening tool that consists of longing and yearning for the deceased, inability to accept the death, shock, disbelief, loneliness, and a changed world view. The proposed DSM-5 criteria only correctly identified 20% to 41.7% of cases with PGR at different timepoints.

Conclusions

For the identification of youth at risk for PGR, the dimensional approach outperformed the proposed categorical diagnostic criteria. We propose a brief screening scale that, if validated, can help clinicians identify bereaved children at risk for PGR, and guide the development of prevention and intervention strategies.

Keywords: children, DSM-5, grief, Inventory for Complicated Grief–Revised for Children (ICG-RC), screen

INTRODUCTION

There is increased recognition of a syndrome, which has alternatively been referred to as complicated grief (CG) or prolonged grief (PG), which occurs in about 10% of bereaved adults.111 This syndrome is associated with functional impairment, increased risk for depression, and physical health morbidity; and has a differential clinical response to interventions that specifically target this syndrome.3,4,7,1013 Similar to adults, we found that 10% of children bereaved by sudden parental death have high and sustained prolonged grief reactions (PGR) nearly 3 years after the death.14 PGR was associated with 3-fold increased incidence of depression and worsening in functional impairment at home, school, or with peers over time.14

Despite the accumulating evidence, clinicians and researchers face challenges in the identification, diagnosis, and treatment of at-risk bereaved individuals with PGR. The current edition of the DSM-IV classifies bereavement under the V code used for “other conditions that may be a focus of clinical attention.” In the literature, there are two proposed criteria for PG and CG based on studies of adult bereaved samples.10,11,15 Current DSM-5 modifications include a hybrid of these criteria under Persistent Complex Bereavement-Related Disorder (PCBRD) in Section III, requiring further research, and include specifications for children, which have not been previously validated.16 Thus, it is not clear whether the proposed DSM-5 criteria are readily applicable to children.

In this paper, we examine dimensional approaches to help clinicians and researchers identify bereaved children at risk for PGR. We use the Inventory for Complicated Grief–Revised for Children (ICG-RC) and longitudinal data from the impact of parental death on children and families to establish cut-offs that can differentiate cases with PGR from non-cases early on following bereavement. We also identify key symptoms that, together, provide a screening tool for PGR. Finally, we evaluate diagnostic approaches and the performance of the proposed DSM-5 criteria in identifying PGR in bereaved children.

METHOD

Sample

We have previously reported on our sample of 182 bereaved children, < 18 years of age, who lost a parent to suicide, accident, or sudden natural death.14 In this paper, we address our aims cross-sectionally and longitudinally in 154 of the 182 (84.6%) who had complete data on the ICG-RC at baseline or 9 months (SD=3.8; range 1–19) after the death. Of these, 129 (83.8%) were followed up at 21 months (SD=4.1, range 13–31), and 102 (66.2%) at 33 months (SD=4.5, range 24–43) after parental death. Subjects included (n=154) were less likely to have had a confiding or a supportive conversation with their parent before the death as compared to those with incomplete data on the ICG-RC (n=28) (59% vs. 96%, χ21 = 12, p = .001). The sample was 55.2% male with a mean age of 12.4 years (SD=2.9). The majority of children (93.5%) were biological offspring of the deceased parent (i.e., the proband).

Recruitment

Details on the recruitment and representativeness of the sample were published previously.14,1720 Briefly, deceased parents, or probands, were between the ages of 30 and 60 years, had children 7–18 years old, and died within 24 hours from suicide (n=39), accident (n=23), or sudden natural death (n=45). Bereaved families were recruited via coroner’s reports (37.1%) and newspaper advertisement (62.9%).

The eligibility rate was similar across types of death with 71% of eligible subjects participating. Probands recruited through the coroner’s office and those recruited by advertisement were found similar except for higher rates of alcohol/substance abuse disorders (80% vs. 50.8%, χ21 = 8.0, p = .005; number of variables tested=10, Bonferroni corrected α = 0.005) in coroner’s probands. Finally, the demographic characteristics of the suicides and accidents were similar to those in Allegheny County (metropolitan Pittsburgh).21

Constructing diagnostic criteria

Table 1 presents the proposed DSM-5 criteria for PCBRD and the assessment items that we used to derive the criteria, which were obtained from three sources: ICG-RC; Circumstances of Exposure to Death (CED); and Grief Interview.

Table 1.

Proposed DSM-5 Criteria for Persistent Complex Bereavement-Related Disorder

Persistent Complex Bereavement-Related Disorder Assessment
Criterion A. The person experienced the death of a close family member or close friend at least 12 months ago. In the case of bereaved children, the death may have occurred at least 6 months ago. Parental death
Criterion B. Since the death at least one of the following symptoms is experienced on more days than not and to a clinically significant degree:
1. Persistent yearning/longing for the deceased. In young children, yearning may be expressed in play and behavior including separation–reunion behavior with caregivers Item 5a: I very much miss ….
2. Intense sorrow and emotional pain in response to the death Item 1: The death feels upsetting, overwhelming or devastating
3. Preoccupation with the deceased Item 2: I think about …. so much that it can be hard for me to do the things I normally do
4. Preoccupation with the circumstances of the death. In children, this preoccupation with the deceased may be expressed through the themes of play and behavior and may extend to preoccupation with possible death of others close to them Circumstances of Exposure to Death: Do you think there may have been something that you could have done to help prevent the death?
Criterion C. Since the death at least 6 of the following symptoms are experienced on more days than not and to a clinically significant degree:
Reactive distress to the death:
1. Marked difficulty accepting the death. (Note: in children, this is dependent on the child’s capacity to comprehend the meaning and permanence of death) Item 4: I feel that I cannot accept the death
Item 7: I feel that I cannot believe my ….’s death
2. Feeling shocked, stunned, or emotionally numb over the loss Item 8: I feel shocked over the death
Item 16: I feel like I have become numb since the death
3. Difficulty in positive reminiscing about the deceased Item 3. Memories of …. upset me
4. Bitterness or anger related to the loss Item 6: I feel angry about the death
Item 18: I am bitter over the death
5. Maladaptive appraisals about oneself in relation to the deceased or the death (e.g., self-blame) Circumstances of Exposure to Death: How accountable do you feel for the death?
6. Excessive avoidance of reminders of the loss (e.g., avoiding of individuals, places, or situations associated with the deceased). (Note: in children this may include avoidance of thoughts and feelings regarding the deceased) Item 11. I avoid reminders of ….
Item 12. I avoid reminders that he/she is dead
Social/identity disruption
7. A desire to die in order to be with the deceased Grief Interview: Do you wish you were dead to be with your parent?
8. Difficulty trusting other individuals since the death Item 9. Ever since the death, it is hard for me to trust people
9. Feeling alone or detached from other individuals since the death Item 10. Ever since the death, I feel like I don’t care about other people as much and I don’t feel as close to people I care about as I used to
10. Feeling that life is meaningless or empty without the deceased, or the belief that one cannot function without the deceased Item 14. I feel that life is empty or has no meaning without ….
Item 20. I feel like the future has no meaning or purpose without ….
Item 22. It is difficult for me to imagine life being satisfying without ….
11. Confusion about one’s role in life or a diminished sense of one’s identity (e.g., feeling that a part of oneself died with the deceased) Item 23. I feel that a part of myself died with ….
12. Difficulty or reluctance to pursue interests since the loss or to plan for the future (e.g., friendships, activities) Item 13. Sometimes people who lose a loved one feel that they cannot go back to normal life and be able to make new friends and do new activities. Do you feel that making new friends or doing new activities would be difficult for you?
Criterion D. The disturbance causes clinically significant distress or impairment in social, occupational, or other important areas of functioning CGAS ≤ 70
Criterion E. The bereavement reaction must be out of proportion or inconsistent with cultural, religious, or age-appropriate norms Not assessed

Note:

a

Inventory for Complicated Grief–Revised for Children (ICG-RC) item.

Our modified version of the adult Inventory of Complicated Grief, 22 the ICG-RC, was used to assess grief in children under 18 years of age.17 The ICG-RC was administered as a structured interview in this population. The adult ICG-R was used upon follow-up as children turned 18 years or older. The adult ICG-R consisted of 33 items, of which 28 items were retained after establishing their psychometric properties in children.17,22 Each of the 28 items is scored on a 5-point Likert scale (1=Almost never [less than once a month], 2=Rarely [monthly], 3=Sometimes [weekly], 4=Often [daily], and 5=Always [several times a day]) with an overall score that could range from 28 to 140.

The CED was used to assess the children’s experience surrounding and following the death of their parent.23 The grief interview included questions that were not assessed in the ICG-RC such as the desire to die in order to be with the deceased. Functional status was determined using the Children’s Global Assessment Scale (CGAS)24 or the Global Assessment Scale (GAS) at follow-up.25

Criterion A of the proposed DSM-5 criteria requires children to have experienced the death of a close relative or friend at least 6 months earlier. Our sample consists of parentally bereaved children; however, they were first assessed at an average of 9 months (range 1 to 19) after the death with 73.4% of the sample assessed 6 months or later after the death, and thus meeting criterion A. We also assess the performance of the proposed criteria at 21 months (range 13 to 31) and 33 months (range 24 to 43) after the death when all subjects met criterion A.

Criteria B and C require at least 1 and 6 symptoms, respectively, to be endorsed on more days than not and to a clinically significant degree. We use a cut-off of ≥ 4 on the individual items, which correspond to experiencing the symptom often or always. Some of the symptoms within criteria B and C are captured by more than one item. For these symptoms, we consider a positive response whenever one of the items meets the threshold.

As for criterion D or the impairment criterion, we use a cut-off ≤ 70 on the CGAS or GAS, where lower scores correspond to worse functioning. A score of ≤ 70 corresponds to difficulty in a single area of functioning or more.

Statistical Analyses

We use univariate statistics (chi-square, t-tests, and analysis of variance [ANOVA]) with Bonferroni correction for multiple comparisons. We examined cut-offs on the continuous ICG-RC score using Receiver Operating Characteristic (ROC) analyses to establish the “best threshold” that would distinguish children with PGR. We previously classified grief reactions in children into three distinct trajectories or classes using Latent Class Growth Modeling (LCGM) based on longitudinal data on the ICG-RC. Children in Class 1 showed a rapid resolution of their grief symptoms; those in Class 2 showed a gradual decrease in grief symptoms; and children in Class 3, or cases with PGR, had high and sustained grief symptoms up to 33 months after the death. These classes constitute the “gold standard” for these analyses where subjects in Class 3 are true “cases” and subjects in Class 1 are true “noncases.”14 The “caseness” status of subjects in Class 2 is ambiguous. Although these children were distinct from those with PGR, they were still at increased risk for incident depression and functional impairment compared to noncases.14 Thus, separate ROC analyses were conducted to discriminate Class 3 from Class 1, Class 3 from Class 2, and Class 2 from Class 1. ROC analyses were also conducted to discriminate Class 3 from Classes 1 and 2 combined. We select cut-offs on the ICG-RC as the cut-off at which both sensitivity and specificity were optimal.

We also conducted ROC analyses for each of the 28 items of the ICG-RC to identify items with high sensitivity and specificity at ≥ 4 cut-off, which could be used to screen for PGR. These analyses were conducted at 9, 21, and 33 months after parental death, including and excluding children in Class 2. We do not expect individual items to have high sensitivity in the strict sense; however, we considered any items with sensitivity ≥ 0.5 at any timepoint for inclusion in the ICG-RC Screen.

To evaluate the performance of the proposed DSM-5 criteria in children, we also restricted analyses to cases and non-cases, namely Classes 1 and 3, respectively. We also conducted analyses where we used the established cut-offs on the ICG-RC to determine casesness (≥ 68) and thus included all subjects. To assess criteria B and C, ROC analyses were conducted with the sum of the number of items that meet ≥ 4 cut-off and obtained sensitivity and specificity at the required number of items to meet criteria. We compared differences in sensitivity and specificity by creating matched-sample tables and used the McNemar’s test for paired proportions26 (α=0.01).

RESULTS

ICG-RC cut-offs

ROC analyses resulted with a score of 68 as the cut-off identifying cases with PGR (Class 3) from non-cases (Class 1), with high sensitivity (sens=0.942) and specificity (spec=0.965) (Table 2 and Table S1, available online). This cut-off continued to have high sensitivity and specificity at 21 and 33 months. Similar results were obtained when comparing Class 3 to Classes 1 and 2 combined, although the specificity was lower at 9 months. As ICG-RC scores in Classes 1 and 2 declined at 21 and 33 months, and those in Class 3 remained high, the specificity in discriminating Class 3 from Classes 1 and 2 subjects improved significantly from 0.82 at 9 months to 0.958 (p < 0.001) at 21 months and remained high at 33 months. The cut-off also discriminates subjects in Class 3 from those in Class 2 (sens= 0.962, spec = 0.551), with high sensitivity and specificity that significantly increased over time (Table 2).

Table 2.

Cut-Offs on the Inventory of Complicated Grief–Revised for Children (ICG-RC) to Identify Prolonged Grief Reactions in Children

AUC (SE)a p Cut-off Sensitivity Specificity
ICG-RC scores at 9 months after the death
Class 3b vs. Class 1 0.994 (0.05) <.001 68 0.942 0.965
Class 3b vs. Class 1 and 2 0.934 (0.02) <.001 68 0.962 0.820c
Class 3b vs. Class 2 0.822 (0.05) <.001 68 0.962 0.551d
Class 2b vs. Class 1 0.927 (0.02) <.001 45 0.974e 0.629f
ICG-RC scores at 21 months after the death
Class 3b vs. Class 1 1.00 (0.00) <.001 68 0.908 1.000
Class 3b vs. Class 1 and 2 0.988 (0.09) <.001 68 0.900 0.958c
Class 3b vs. Class 2 0.968 (0.02) <.001 68 0.900 0.889d
Class 2b vs. Class 1 0.959 (0.02) <.001 45 0.934 0.831f
ICG-RC scores at 33 months after the death
Class 3b vs. Class 1 0.996 (0.006) <.001 68 0.801 1.000
Class 3b vs. Class 1 and 2 0.977 (0.02) <.001 68 0.833 0.967c
Class 3b vs. Class 2 0.939 (0.047) .001 68 0.833 0.903d
Class 2b vs. Class 1 0.893 (0.03) <.001 45 0.758e 0.837f

Note:

a

Area Under the Curve (AUC) (Standard Error)

b

Children in this Class are to be discriminated from those in the other Class(es); Significant differences are noted by a superscript letter.

c

p <0.001 for 9 vs. 21 months, p=0.001 for 9 vs. 33 months.

d

p < 0.001 for 9 vs. 21 months, p=0.007 for 9 vs. 33 months.

e

p=0.04 for 9 vs. 33 months.

f

p =0.004 for 9 vs. 21 months, p=0.003 for 9 vs. 33 months.

Screening for PGR

ICG-RC items 5, 7, 8, 21, and 24 were able to discriminate Class 3 from Class 1 with sensitivity ≥ 0.5 at 9, 21, or 33 months (Table 3 and Tables S2–S3, available online). These items had high specificity (> 0.85) except for item 5, which assesses longing and yearning for the deceased, with specificity of 0.69 at 9 months, which increased significantly at 21 (spec=0.76, p = 0.01) and 33 months (spec=0.85, p < 0.001). When comparing Class 3 to Classes 1 and 2 combined, an additional item showed sensitivity ≥ 0.5 at 9 months (item 4, sens=0.57, spec=0.9, area under the curve [AUC]=0.82, p<0.001) (Tables S4–S6, available online). Together, these six items very accurately identified Class 3 from Class 1 using a score of 14 as the cut-off at 9 (sens = 1, spec = 0.692), 21 (sens = 0.95, spec = 0.845), and 33 months (sens = 1, spec = 0.929) (Table 4). The specificity for the ICG-RC Screen’s cut-off increased significantly at 21 (p= 0.003) and 33 (p < 0.001) months compared to 9 months. Similar results were obtained when comparing Class 3 to Classes 1 and 2 combined (Table 4). The ICG-RC Screen showed high internal consistency (Cronbach’s α = 0.82).

Table 3.

Sensitivity and Specificity of Individual Items of the Inventory of Complicated Grief–Revised (ICG-RC) for Children at 9 Months Following Parental Death

Item Freqa Sensb Specc AUCd p
1. The death feels upsetting, overwhelming or devastating 10.6 0.31 0.98 0.93 <.001
2. I think about ….e so much that it can be hard for me to do the things I normally do 6.7 0.35 0.995 0.95 <.001
3. Memories of …. upset me 5.7 0.27 0.99 0.92 <.001
4. I feel that I cannot accept the death 7.6 0.42 0.995 0.90 <.001
5. I very much miss …. 51.4 1.00 0.69 0.91 <.001
6. I feel angry about the death 11.4 0.46 0.97 0.91 <.001
7. I feel that I cannot believe the death 14.3 0.62 0.97 0.91 <.001
8. I feel shocked over the death 12.6 0.69 0.99 0.93 <.001
9. Ever since the death, it is hard for me to trust people 7.6 0.27 0.98 0.84 <.001
10. Ever since the death, I feel like I don’t care about other people as much and I don’t feel as close to people I care about as I used to 2.9 0.15 0.995 0.75 .003
11. I avoid reminders of …. 2.9 0.04 0.98 0.67 .05
12. I avoid reminders that he/she is dead 6.7 0.23 0.98 0.75 .003
13. Sometimes people who lose a loved one feel that they cannot go back to normal life and be able to make new friends and do new activities. Do you feel that making new friends or doing new activities would be difficult for you? 4.8 0.19 0.995 0.86 <.001
14. I feel that life is empty or has no meaning without …. 3.8 0.15 0.995 0.79 .001
15. I hear the voice of….speak to me 1.9 0.05 0.99 0.66 .06
16. I feel like I have become numb (or has no feelings)f since the death 3.8 0.15 0.995 0.78 .001
17. I feel that it is unfair that I should live when he/she died 1.0 0.08 1.00 0.72 .01
18. I am bitter (or angry) over the death 4.9 0.15 0.98 0.90 <.001
19. I feel jealous of others who have not lost someone close 6.7 0.42 1.00 0.79 .001
20. I feel like the future has no meaning or purpose without …. 1.0 0.00 0.99 0.79 .001
21. I feel lonely ever since the death 14.3 0.42 0.96 0.82 <.001
22. It is difficult for me to imagine life being satisfying without …. 4.8 0.15 0.99 0.84 <.001
23. I feel that a part of myself died with …. 9.6 0.42 0.98 0.86 <.001
24. I feel that the death made me see the world differently 20.2 0.50 0.91 0.86 <.001
25. I don’t feel safe since the death 3.8 0.19 0.995 0.72 .01
26. I feel that I don’t have control over things since the death 5.8 0.35 1.00 0.85 <.001
27. I am jumpy or easily startled since the death 2.9 0.08 0.99 0.89 <.001
28. Since the death, my sleep has been disturbed 6.8 0.27 0.99 0.88 <.001

Note: Shaded items constitute the ICG-RC screen. Numbers in bold in the sensitivity column correspond to sens>0.5.

a

Freq=Frequency or % endorsing item at ≥ 4.

b

Sensitivity.

c

Specificity

d

Area under the curve (AUC).

e

“my parent” or the relationship lost.

f

Words between parentheses are for the interviewer to use for younger child.

Table 4.

Cut-Off on the Inventory of Complicated Grief–Revised for Children Screen (ICG-RC Screen) to Screen for Prolonged Grief Reactions in Children

AUC (SE)a p Cut-off Sensitivity Specificity
ICG-RC Screen scores at 9 months after the death
Class 3b vs. Class 1 0.993 (0.06) <.001 14 1.000 0.692c
Class 3b vs. Class 1 and 2 0.930 (0.02) <.001 14 1.000 0.490d
ICG-RC Screen scores at 21 months after the death
Class 3b vs. Class 1 0.975 (0.02) <.001 14 0.950 0.845c
Class 3b vs. Class 1 and 2 0.926 (0.04) <.001 14 0.950 0.647d
ICG-RC Screen scores at 33 months after the death
Class 3b vs. Class 1 0.996 (0.006) <.001 14 1.000 0.929c
Class 3b vs. Class 1 and 2 0.969 (0.02) <.001 14 1.000 0.782d

Note:

a

Area Under the Curve (AUC) (Standard Error).

b

Children in this Class are to be discriminated from those in the other Class(es); Significant differences are noted by a superscript letter.

c

p=0.003 for 9 vs. 21 months, p<0.001 for 9 vs. 33 months.

d

p<0.001 for 9 vs. 21 months, p<0.001 for 9 vs. 33 months, p=0.03 for 21 vs. 33 months

Evaluation of proposed DSM-5 criteria

The proposed DSM-5 criteria correctly identified only 41.7%, 22.2%, and 20% of cases with PGR at 9, 21, and 33 months, respectively (Table 4). However, the criteria had perfect specificity (1.0) at all timepoints. We examined properties of each of the three components (B, C, and D) of the criteria. Criterion B showed high sensitivity at 9 and 21 months, which decreased at 33 months although not statistically significant. However, the specificity of criterion B increased from 9 (spec=0.483) to 21 (spec=0.662, p = 0.02) and 33 (spec=0.73, p < 0.001) months but only significantly at 33 months. Criterion C showed low to moderate sensitivity ranging from 0.2 to 0.417 but high specificity ranging from 0.988 to 1.0. Criterion D had moderate to high sensitivity ranging from 0.615 to 0.833 and high specificity ranging from 0.758 to 0.797. There were no significant differences in sensitivity and specificity among the different timepoints for criteria C and D. We examined a less stringent cut-off for criterion C to require endorsing two or more symptoms, rather than the six required. This resulted in a statistically significant increase in sensitivity at 9 (0.417 vs. 1.0, p = 0.02) and 21 months (0.222 vs. 0.89, p = 0.03), but not at 33 months (0.4 vs. 0.6, p > 0.99). However, using a less stringent cut-off for Criteria C did not alter the overall performance of the criteria at 9 (p = 0.25), 21 (p = 0.25), and 33 (p > 0.99) months. There were no significant differences in specificity for criterion C (9 months, p=0.06; 21 and 33 months, p=0.5) and the overall criteria using less stringent cut-off (p>0.99). Similar results were obtained when using ≥ 68 as the cut-off to define “caseness” (Table S7, available online).

DISCUSSION

We established cut-offs for the ICG-RC and found that a score of 68 or greater, 9 months after the loss of a parent, identifies children with PGR with high sensitivity and specificity. We derived a six-item screening tool, which can help clinicians screen for this condition in bereaved children. This is the first study to evaluate the performance of the currently proposed DSM-5 criteria for PCBRD in children. We found the proposed criteria to have low to moderate sensitivity in identifying children with PGR at 9, 21, and 33 months after parental death, although the specificity was perfect (1.0) at each timepoint.

Although we used the same items to both define “caseness” and evaluate performance of DSM-5 criteria, PGR “caseness” was identified using longitudinal data extending up to three years following parental death, which is a major strength of the study. We also examine the ICG-RC cut-offs, identify a screen, and evaluate the performance of the proposed DSM-5 criteria longitudinally. The limitations of the study include the small number of cases with PGR at 9 (n=13), 21 (n=9), and 33 (n=6) months. However, our sample size is consistent with the 10% incidence of PGR previously reported.14 Given the small number of youth with PGR at 33 months, we interpret results from this follow-up point with caution. Another limitation is that we did not examine themes of play and behavior and whether the child understood the meaning and permanence of death. The DSM-5 criteria modifiers included for children are more applicable to toddlers and very young children. Our sample included children 8 years and older, an age when they understand the meaning and permanence of death. We also did not assess preoccupation with possible death of others close to the child and thus our assessment of the preoccupation with the circumstances of the death item is not optimal. We were not able to evaluate criterion E as we did not assess cultural and religious norms. As for age-appropriate norms, we define “caseness” based on our previously published longitudinal classification of grief in children, which is the first to demonstrate trajectories of grief symptoms in this age group.14 Finally, the generalizability of our sample is limited to children bereaved from sudden parental death and may not extend to those bereaved from other types of death or other types of relationships.

We established that a score of 68 or higher on the ICG-RC 9 months after parental loss indicates that these children are unlikely to recover spontaneously.14 Children, who continue to score 68 or higher around two years after a death, are those with a problematic course of grief or PGR (Class 3). This cut-off had a moderate specificity in distinguishing classes 2 (slow decline) and 3 (no decline) at 9 months. However, at the subsequent two time points, this cut-off more sharply differentiated among the groups, which is expected given that our definition of caseness is based on longitudinal trajectories. However, clinicians cannot and should not wait for almost 2 years to distinguish children’s grief trajectories before they intervene as we have previously found both classes 2 and 3 to be at increased risk for depression and functional impairment.14 Thus, our dimensional approach will help clinicians detect children at risk earlier following bereavement when trajectories of children’s grief reactions could be altered. We also identify a screening tool here, which consists of the items of longing and yearning for the deceased, cannot accept the death, shock, disbelief, loneliness, and a changed world view. These items seem to be the core symptoms of PGR in children that persist beyond the acute grief process. Longing and yearning for the deceased was the most frequently endorsed symptom and showed the lowest specificity at 9 months. This is not surprising as it is normal for bereaved children to long for their parent; however, the persistence of yearning through years 2 and 3 are pathognomonic of PGR. We have administered the ICG-RC and ICG-RC Screen as an interview in children and recommend administering them as such as opposed to self-report. In addition, our first assessment was conducted at an average of 9 months following bereavement and thus it is not clear whether our established cut-offs would have the same predictive ability when used earlier. Future studies are needed to replicate the validity of the ICG-RC and screen as self-reports and the predictive ability of our established cut-offs earlier following bereavement.

The proposed DSM-5 criteria only correctly identified 20 to 41.7% of cases with PGR at the different timepoints. The components of the criteria with low to moderate sensitivity were C and D. We modified criterion C to require at least two symptoms instead of six, which improved its sensitivity at 9 and 21 months and the sensitivity of the overall criteria at 9 months. Thus, we believe criterion C of the proposed DSM-5 criteria to be too stringent for children. Looking at the impairment criterion, or criterion D, the sensitivity tended to increase over time although differences were not significant. PGR caseness in our sample was identified based on longitudinal follow-up of three years following parental death where children showed consistently high ICG-RC scores and increased functional impairment over time. Thus, while some children classified with PGR (38.5%) did not meet criteria for functional impairment (CGAS ≤ 70) at 9 months, they became functionally impaired with time. There were no biases in subjects’ retention based on CGAS scores, in the overall sample and cases with PGR.

In conclusion, the proposed DSM-5 criteria are not sensitive enough to detect PGR in children although these criteria are highly specific. Our dimensional approach outperforms the proposed DSM-5 criteria in identifying children at risk for PGR early on following bereavement. This is consistent with the proposal to incorporate a dimensional component to DSM-5, which would help clinicians in early identification and in monitoring severity and treatment.27 We found bereaved children with PGR to be at increased risk for depression and functional impairment.14 Children bereaved from accident and natural deaths were similar to suicidally-bereaved children in their increased risk for PGR, which is due to the increased rates of psychiatric disorders associated with early parental death.14,18 Since interventions for PGR have not been developed for children, we provide clinicians and researchers with some important tools—a measure and a screening tool with clinical cut-offs that identify children at-risk for PGR early on following bereavement and thus in need for further monitoring, prevention, and intervention efforts.

Supplementary Material

Table 5.

Evaluation of Proposed DSM-5 Criteria for Persistent Complex Bereavement-Related Disorder

9 months after the death Sensitivitya Specificitya Sensitivityb Specificityb
Overall Criteria 0.417 (5/12) 1.000 (83/83) 0.667 (8/12) 0.988 (82/83)
Criterion
 B 1.000 (13/13) 0.483 (42/87)
 C 0.417 (5/12) 0.988 (85/86) 1.000 (12/12) 0.930 (80/86)
 Dc 0.615 (8/13) 0.758 (69/91)
21 months after the death
Overall Criteria 0.222 (2/9) 1.000 (70/70) 0.556 (5/9) 1.000 (70/70)
Criterion
 B 0.900 (9/10) 0.662 (49/74)
 C 0.222 (2/9) 1.000 (72/72) 0.890 (8/9) 0.972 (70/72)
 Dc 0.727 (8/11) 0.797 (63/79)
33 months after the death
Overall Criteria 0.200 (1/5) 1.000 (58/58) 0.200 (1/5) 0.983 (57/58)
Criterion
 B 0.667 (4/6) 0.730 (46/63)
 C 0.400 (2/5) 1.000 (60/60) 0.600 (3/5) 0.967 (58/60)
 Dc 0.833 (5/6) 0.773 (51/66)

Note:

a

Criterion C, at least 6 items endorsed.

b

Criterion C, at least 2 items endorsed.

c

Criterion D or functional impairment is measured by the Children’s Global Assessment Scale (CGAS) ≤ 70.

Clinical Guidance.

  • We introduce the Inventory for Complicated Grief–Revised for Children (ICG-RC), a 28-item instrument to assess grief reactions in children.

  • A cut-off of 68 on the ICG-RC identifies children at risk for prolonged grief reactions (PGR).

  • We derive the ICG-RC Screen, a six-item screening tool for PGR consisting of longing and yearning for the deceased, inability to accept the death, shock, disbelief, loneliness, and a changed world’s view.

  • The dimensional approach, using the ICG-RC, outperforms the proposed DSM-5 criteria for Persistent Complex Bereavement–Related Disorder in identifying children with PGR.

Acknowledgments

This study work was supported by grants R01-MH65368 (D.A.B.) and K01-MH077930 (N.M.M.) from the National Institute of Mental Health (NIMH); and by a Young Investigator Award from the American Foundation for Suicide Prevention (N.M.M.). NIMH and the American Foundation for Suicide Prevention did not participate in the design and conduct of the study; in the collection, management, analysis, and interpretation of the data; or in the preparation, review, or approval of the manuscript.

Footnotes

Supplemental material cited in this article is available online.

Dr. Melhem served as the statistical expert for this research.

Disclosure: Dr. Brent has received royalties from Guilford Press; has or will receive royalties from the Columbia Suicide Severity Rating Scale (C-SSRS) royalties from the electronic self-rated version of the C-SSRS from ERT, Inc.; and has served as an UpToDate Psychiatry Editor.

Dr. Melhem, Ms. Porta, and Ms. Payne report no biomedical financial interests or potential conflicts of interest.

Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final citable form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.

Contributor Information

Dr. Nadine M. Melhem, University of Pittsburgh School of Medicine

Ms. Giovanna Porta, University of Pittsburgh Medical Center

Ms. Monica Walker Payne, University of Pittsburgh Medical Center

Dr. David A. Brent, University of Pittsburgh School of Medicine. University of Pittsburgh Medical Center

References

  • 1.Clayton PJ. Bereavement and depression. The Journal of clinical psychiatry. 1990;51 (Suppl):34–38. [PubMed] [Google Scholar]
  • 2.Prigerson HG, Bierhals AJ, Kasl SV, et al. Complicated grief as a disorder distinct from bereavement-related depression and anxiety: a replication study. The American journal of psychiatry. 1996;153(11):1484–1486. doi: 10.1176/ajp.153.11.1484. [DOI] [PubMed] [Google Scholar]
  • 3.Prigerson HG, Bierhals AJ, Kasl SV, et al. Traumatic grief as a risk factor for mental and physical morbidity. The American journal of psychiatry. 1997;154(5):616–623. doi: 10.1176/ajp.154.5.616. [DOI] [PubMed] [Google Scholar]
  • 4.Horowitz MJ, Siegel B, Holen A, et al. Diagnostic criteria for complicated grief disorder. The American journal of psychiatry. 1997;154(7):904–910. doi: 10.1176/ajp.154.7.904. [DOI] [PubMed] [Google Scholar]
  • 5.Zisook S, Paulus M, Shuchter SR, Judd LL. The many faces of depression following spousal bereavement. Journal of affective disorders. 1997;45(1–2):85–94. doi: 10.1016/s0165-0327(97)00062-1. [DOI] [PubMed] [Google Scholar]
  • 6.Stroebe M, van Son M, Stroebe W, Kleber R, Schut H, van den Bout J. On the classification and diagnosis of pathological grief. Clinical psychology review. 2000;20(1):57–75. doi: 10.1016/s0272-7358(98)00089-0. [DOI] [PubMed] [Google Scholar]
  • 7.Melhem NM, Rosales C, Karageorge J, Reynolds CF, 3rd, Frank E, Shear MK. Comorbidity of axis I disorders in patients with traumatic grief. The Journal of clinical psychiatry. 2001;62(11):884–887. doi: 10.4088/jcp.v62n1108. [DOI] [PubMed] [Google Scholar]
  • 8.Shear K, Monk T, Houck P, et al. An attachment-based model of complicated grief including the role of avoidance. European archives of psychiatry and clinical neuroscience. 2007;257(8):453–461. doi: 10.1007/s00406-007-0745-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Bonanno GA, Neria Y, Mancini A, Coifman KG, Litz B, Insel B. Is there more to complicated grief than depression and posttraumatic stress disorder? A test of incremental validity. Journal of abnormal psychology. 2007;116(2):342–351. doi: 10.1037/0021-843X.116.2.342. [DOI] [PubMed] [Google Scholar]
  • 10.Prigerson HG, Horowitz MJ, Jacobs SC, et al. Prolonged grief disorder: Psychometric validation of criteria proposed for DSM-V and ICD-11. PLoS medicine. 2009;6(8):e1000121.2711304. doi: 10.1371/journal.pmed.1000121. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Shear MK, Simon N, Wall M, et al. Complicated grief and related bereavement issues for DSM-5. Depression and anxiety. 2011;28(2):103–117. doi: 10.1002/da.20780. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Simon NM, Shear KM, Thompson EH, et al. The prevalence and correlates of psychiatric comorbidity in individuals with complicated grief. Comprehensive psychiatry. 2007;48(5):395–399. doi: 10.1016/j.comppsych.2007.05.002. [DOI] [PubMed] [Google Scholar]
  • 13.Shear K, Frank E, Houck PR, Reynolds CF., 3rd Treatment of complicated grief: a randomized controlled trial. JAMA : the journal of the American Medical Association. 2005;293(21):2601–2608. doi: 10.1001/jama.293.21.2601. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Melhem NM, Porta G, Shamseddeen W, Walker Payne M, Brent DA. Grief in children and adolescents bereaved by sudden parental death. Archives of General Psychiatry. 2011;68(9):911–919. doi: 10.1001/archgenpsychiatry.2011.101. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Simon NM, Wall MM, Keshaviah A, Dryman MT, LeBlanc NJ, Shear MK. Informing the symptom profile of complicated grief. Depression and anxiety. 2011;28(2):118–126. doi: 10.1002/da.20775. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.APA. 2012 http://www.dsm5.org/
  • 17.Melhem NM, Moritz G, Walker M, Shear MK, Brent D. Phenomenology and correlates of complicated grief in children and adolescents. Journal of the American Academy of Child and Adolescent Psychiatry. 2007;46(4):493–499. doi: 10.1097/chi.0b013e31803062a9. [DOI] [PubMed] [Google Scholar]
  • 18.Melhem NM, Walker M, Moritz G, Brent DA. Antecedents and sequelae of sudden parental death in offspring and surviving caregivers. Archives of pediatrics and adolescent medicine. 2008;162(5):403–410. doi: 10.1001/archpedi.162.5.403. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Brent D, Melhem N, Donohoe MB, Walker M. The incidence and course of depression in bereaved youth 21 months after the loss of a parent to suicide, accident, or sudden natural death. The American journal of psychiatry. 2009;166(7):786–794. doi: 10.1176/appi.ajp.2009.08081244. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Muniz-Cohen M, Melhem NM, Brent DA. Health risk behaviors in parentally bereaved youth. Archives of pediatrics and adolescent medicine. 2010;164(7):621–624. doi: 10.1001/archpediatrics.2010.101. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Health PDo. http://www.portal.health.state.pa.us/
  • 22.Prigerson HG, Maciejewski PK, Reynolds CF, 3rd, et al. Inventory of Complicated Grief: a scale to measure maladaptive symptoms of loss. Psychiatry research. 1995;59(1–2):65–79. doi: 10.1016/0165-1781(95)02757-2. [DOI] [PubMed] [Google Scholar]
  • 23.Brent DA, Moritz G, Allman CJ, Roth C, Schweers J, Balach L. The validity of diagnoses obtained through the psychological autopsy procedure in adolescent suicide victims: use of family history. Acta Psychiatrica Scandinavica. 1993;87(2):118–122. doi: 10.1111/j.1600-0447.1993.tb03341.x. [DOI] [PubMed] [Google Scholar]
  • 24.Shaffer D, Brasic J, Ambrosini P, Fisher P, Bird HA, Aluwahlia S. A Children’s Global Assessment Scale (CGAS) Archives of General Psychiatry. 1983;40(11):1228–1231. doi: 10.1001/archpsyc.1983.01790100074010. [DOI] [PubMed] [Google Scholar]
  • 25.Endicott J, Spitzer RL, Fleiss JL, Cohen J. The global assessment scale. A procedure for measuring overall severity of psychiatric disturbance. Archives of general psychiatry. 1976;33(6):766–771. doi: 10.1001/archpsyc.1976.01770060086012. [DOI] [PubMed] [Google Scholar]
  • 26.Hawass NE. Comparing the sensitivities and specificities of two diagnostic procedures performed on the same group of patients. The British journal of radiology. 1997;70(832):360–366. doi: 10.1259/bjr.70.832.9166071. [DOI] [PubMed] [Google Scholar]
  • 27.Helzer J, Kraemer H, Krueger R, Wittchen H-U, Sirovatka P, Regier D. Dimensional Approaches in Diagnostic Classification: Refining the Research Agenda for DSM-V. Arlington, VA: American Psychiatric Association; 2008. [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

RESOURCES