Abstract
Objective
To implement comprehensive screening for child behavior and social determinants of health in an urban pediatric practice, and explore rates of referrals, and follow-up for positive screens.
Method
Quality improvement (QI) methodology was used to implement routine screening using an adapted version of the Survey of Well Being of Young Children (SWYC), a child behavior and social screen, for all children ages 6 months to 10 years. Rates of screen administration and documentation were assessed for 18 months. Medical records of a convenience sample (N=349) were reviewed to track referrals and follow-up for positive screens. A secondary analysis explored associations between reported parental concern for their child’s behavior, and both child behavior symptoms and social stressors.
Results
Over 18 months, 2,028 screens were administered. Screening rates reached 90% after introducing a tablet for screening. Provider documentation of screens averaged 62%. In the convenience sample, 28% scored positive for a behavioral problem, and 25% reported at least one social stressor. Of those with positive child behavior or social stressor screens, approximately 80% followed up with their primary medical doctor, and approximately 50% completed referrals to the clinic social worker. Further analysis indicated that referral and follow up rates varied depending on whether the family identified child behavior or social issues. Logistic regression revealed that parental concern was independently associated with child behavior symptoms (p=0.001) and social stressors (p=0.002).
Conclusion
Implementing a comprehensive psycho-social screen is feasible in pediatric primary care, and may help target referrals to address psycho-social health needs.
Keywords: Screening, child behavior concerns, social determinants of health
INTRODUCTION
Up to 20% of children experience behavior problems at least once throughout their childhood,1 and these are sometimes related to social stressors.2 Neuroscience research indicates that social stressors including early childhood toxic stress (stress that affects brain architecture) and other social determinants of health (e.g., poverty, maternal depression and domestic violence) affect the developing brain and children’s mental and physical health trajectories.3 The American Academy of Pediatrics (AAP) endorses addressing behavioral health and social stressors in pediatric primary care, and has made recommendations on when to screen and which tools to use.4,5 However, such routine screening is not yet typical in pediatric primary care.6 Barriers including lack of time, challenges with implementation in busy urban clinics, concern regarding lack of resources for positive screens, and lack of consensus on whether screening alters outcomes, persist.7,8
Despite the known association between behavioral issues and social stressors, screening programs often include only mental health scales, or specific social stressors, rather than comprehensive behavioral and social screens (hereafter referred to as “psycho-social screens”).2,8 Screening for both may help uncover important factors within the child and their environmental context, which may help target referrals more specifically, and ultimately assist with follow up rates and management.
Studies also do not often track rates of referral based on psycho-social screen results,9 or completion of follow up after referrals.10 The studies that exist suggest that follow up after screening remains a challenge.11 For example, one study that utilized the Pediatric Symptom Checklist found that while over 50% of patients who scored positive were referred to behavioral resources, only 18% completed their follow up visits.12 Another review of behavioral visits after universal mental health screening in Massachusetts, revealed a rate of 21.2% for any behavioral visit after screening.13
The goal of this study was to implement universal screening for both behavior and social stressors in a busy urban practice and to explore the effect of this screening on referrals, and completion of follow up appointments. A secondary aim was to explore possible associations between parental concern for their child’s behavior (outcome variable), and predictors including child behavior symptoms as endorsed on the “symptoms checklists” of the screen and social stressors.
METHODS
Study Design
A universal comprehensive psycho-social screen was implemented at all well child visits in a busy urban pediatric practice that is affiliated with a major academic medical center. Quality Improvement methodology was used to implement the screening and establish workflows for documentation and management of positive screens. Data from screens that were collected during the first 18 months (October 2014 – April 2016) were included.
A convenience sample of patients screened during the first 4 months (N=349) was chosen for a review of their medical record to collect data on rates of referrals made and completion of follow up appointments. This was decided based on feasibility of our team to conduct medical record reviews and the fact that follow-up for positive screens was expected to occur within this time frame. This sample included 349 unique families. All duplicate screens (N=10) were excluded. This convenience sample was also used for the secondary aim described above. (Figure 1)
Setting and Population
The study was implemented at the Charles B. Rangel Community Health Center, a primary care site of the New York Presbyterian-Columbia University Medical Center. Ambulatory Care Network (ACN): All ACN sites serve as primary care centers addressing pediatrics, internal medicine, and OB/GYN needs of the surrounding AU3 community members. They are staffed by physicians (attending physicians and resident trainees), medical and psychiatric nurse practitioners, nurses, care coordinators, community health workers, nutritionists, and social workers, among other staff. The Rangel clinic, located in Central Harlem, New York City, serves approximately 6000 pediatric patients per year. Over 90% of patients receive care reimbursement through Medicaid care. Participants All children ages 6 months to 10 years presenting for well visits, and their families, were provided with the universal screen upon check-in for their visit. Infants younger than 6 months were not included because they are routinely provided with a separate screen addressing postpartum depression. Similarly, adolescents aged 11 and older are provided with an adolescent depression screen, and thus were not included in this study to avoid screen burden. Patients who presented for sick/urgent visits were not included as the screen was intended to be part of routine well child care. Families who spoke languages other than English or Spanish were also excluded.
Screening Tool
The Survey of Well Being of Young Children (SWYC) has been validated and endorsed by the AAP as an appropriate psycho-social screen to use in the pediatric primary care setting.14 Three domains from the SWYC were included in our screening tool: parental concern, child behavior symptoms, and social stressors.
Parental concern is assessed with two items that ask about the parents’ concern for their child’s – i) learning/development and ii) behavior. Each of these items is scored on a three-point scale: “not at all”, “somewhat” or “very much” concerned. We considered parental concern for their child’s behavior to be positive if they reported being “somewhat” or “very much” concerned on the second item.
Child behavior symptoms are assessed with age-based child behavior scales for children ages 0–17 months, and 18 months–5 years old that have been adapted and validated against the Pediatric Symptom Checklist15,16 For 6–10-year-old children we used the Pediatric Symptoms Checklist 17 itself as the child behavior scale.
Validated items and scales that address family/social stressors including tobacco use, alcohol/drug use, hunger, domestic violence and the patient health questionnaire-2 (PHQ-2) for maternal/caregiver depression are included, and were attached to the parental concern and behavior checklists for all ages.17 We used standard scoring systems that have been previously described for all of the behavior and social stressor scales except for maternal depression. The PHQ-2 for maternal depression was assigned a cutoff of 2 instead of the more commonly used cutoff of 3 (out of a possible total of 6) given the literature that supports using a lower cutoff in underserved and specifically Hispanic communities.18–20 An overall social stressor score was created by dichotomizing each individual stressor into “positive” or “negative” according to previously established cutoffs, and adding these individual dichotomous scores, except for tobacco, together. Tobacco was not included in this cumulative score as it was thought to carry a different (and unknown) weight compared to the other stressors. For the cumulative social stressor score a total of zero was considered negative, and a total of one or more stressors was considered positive. The psychometric properties for the tools included in the cumulative social stressor score have been described elsewhere.15,16,17
Implementation and Quality Improvement Methodology
All pediatric residents are trained in Quality Improvement methodology as part of their residency curriculum. All residents conduct annual team projects at their outpatient clinic site. There are 12 residents at this clinical site, and each resident spends one month per year on their “ambulatory pediatrics rotation” during which they take a turn leading the project with the guidance of the first author and another trained QI faculty mentor. Throughout the 2014–2016 academic years residents conducted several Plan-Do-Study-Act (PDSA) cycles with the aims of 1) pre-screening at least 50% of all well children ages 6 months to 10 years utilizing our adapted version of the SWYC, and 2) documenting the screen result within the electronic medical record (EMR) 75% of the time. Examples of PDSA cycles included trainings on psycho-social screening, visual reminders/signage to incorporate the screens into well visits, creation of an acronym expander which allowed providers to type a one-word acronym into their note that automatically expanded into an explanation of how to interpret and address the screens, and feedback methods that gave individual providers “report cards” with their rates of documentation of the screens. See Table 1 for a complete list of PDSA cycles. The baseline rate of pre-screening was zero prior to the project, and the goals of 50% (screen administration) and 75% (screen documentation) were informed by previous studies conducted by the first author in the same setting.21
Table 1.
Improvement Area | Improvement Step (see corresponding number in run charts (Figures 1 & 2)) | PDSA interventions |
---|---|---|
Administer SWYC screens with at least 50% of patients / families | ①. Train front desk staff and medical assistants in screen administration | ▪ Attended monthly staff meetings and instructed all front desk staff and medical assistants to do the following: ○Front desk staff: - hand the paper screen available in English and Spanish to all patients who presented for a scheduled well visit - if it was not clear whether a child was presenting for a well visit or follow up visit, the screen was provided - assure that the screens were self-administered - refer families to consult their providers if they had specific questions about the screens ○Medical assistants: - assure screen was completed - collect screens from patients for review by the provider during patient encounter ▪ Shared patient stories to explain importance of screening |
②. Provide feedback to front desk staff on administration rates | ▪ Held monthly meetings with clinic leadership AND representatives from front desk staff and medical assistants ▪ Reviewed run chart data with staff and responded to barriers to screen administration raised by staff |
|
③. Reminded staff about screen administration | ▪ Taped laminated and decorated post-card reminders directly onto monitors at all front desk staff and medical assistant work stations | |
④. Provide verbal reminders at medical home meetings | ▪ Attended weekly medical home meetings (which are attended by ALL clinic staff including front desk, medical assistant, providers, etc.) and briefly reported on status of project at every meeting | |
⑤. Present data publicly | ▪ Posted run charts on bulletin boards throughout clinic | |
⑥. Automated tablet administration | ▪ Trained front desk staff on distributing tablet to patients who presented for well care instead of paper screens | |
Providers document the screen result in a patient’s medical record at least 75% of the time | ⑦. Trained and oriented providers to risk stratification model, and created acronym expander for providers to document screen result in medical record | ◻ Trained providers and presented risk-stratification model at noon conference ◻ Created & spread acronym expander (.bhv) which expanded in record to: “ Behavorial screen positive (score xx). Return to clinic for f/u in 1–3 months. Psychosocial screen positive for substance use/depression/domestic violence. Pt referred to social worker.” |
⑧. Post algorithm for interpreting screens in exam room | ◻ Created a color-coded algorithm with scoring instructions, cutoffs for positive scores, and reminder to act on positive screens, and posted in all exam rooms, provider offices, and conference room | |
⑨. Post reminder signs on exam room computers reminding providers to document screen | ◻ Taped laminated post card reminders that included run chart data directly onto monitors in all exam rooms, provider offices and conference room | |
⑩. Email report cards to providers on their individual documentation rates | ◻ Sent individual data on provider documentation rates to individual providers via email. Included mean and target documentation rates | |
⑪. Print tablet screen results for providers to see | ◻ Began printing individual patient reports from tablet as providers were unable to access results from tablet within Electronic Medical Record. Enlisted help from volunteers to print and hand completed screens to providers in real time, i.e. during their patient encounters | |
⑫. Decision support on how to handle positive screens | ◻ Uploaded electronic resource list with automatic links to resources addressing domains screened for, to all clinic computers ◻ Created acronym expanders for how to manage the most common behavior problems reported; infant sleep issues, tantrums and inattention in school-aged children. |
Based on an existing risk stratification model embedded within our electronic medical record, patients are assigned a risk level (low, medium, and high) using the American Academy of Pediatrics’ definition of children with special healthcare needs. We applied this model, and our work with the national “Moving Healthcare Upstream” initiative, to children with complex psycho-social and medical needs.22 It was recommended that patients with positive screens follow up with their pediatric provider within 1–3 months, which is often sooner than their usual well child care visit frequency. Patients with positive screens were to be seen at ~ 3 months if they were considered low risk, and within 1–2 months if they were higher risk. In our program, risk levels are also utilized for calculating empanelment size of providers as well as for resource allocation for patients with the use of care managers and community health workers.
Pediatric residents were oriented to the risk-stratification model and referral guidelines during one of their weekly resident conferences. The risk-stratification definition also appears each time a provider opens a note in the EMR, as well as in the acronym expander described above.
For referrals to community partners, the clinic social worker assisted with the creation of an electronic referral list that was saved on the desktops of all exam rooms and workstations throughout the clinic. The referral list allowed for direct links to multiple websites that provided information and referral sources to avoid incorrect or outdated referral contact information. Referral sources for all domains on the screens (i.e. child behavior problems, tobacco, substance use, food insecurity, maternal depression and domestic violence) were included in the order that they appear on the screen.
Data Collection, Review & Analysis
Screen administration and documentation rates were assessed for one random week per month for the entire duration of the project (October 2014 – April 2016). This was decided based on feasibility and agreement between the QI mentors that this sampling method was standard for QI methodology. Administration rates were calculated by counting all screens that were collected during the random weeks and dividing by the number of well visits for the corresponding period. Documentation rates were similarly obtained by reviewing records for all children screened during one random week per month and dividing the number of screens documented in the provider’s notes by the number of screens collected.
Referral and follow-up rates were assessed for the convenience sample of patients screened during the first 4 months of the project (N=349). Two research assistants completed the medical record reviews using a codebook and record abstraction form that was jointly created with the first author. Variables collected from the records included demographic data such as race/ethnicity and language, past child medical and developmental/behavioral diagnoses, past social history documented in the chart prior to the screen, whether the patient/family was referred to return to their provider or social work, and whether they completed their referral and follow up appointments. Referral and follow up data was assessed for those with positive screens. Only screens with no missing data could have a total score calculated, and were included in this assessment. If one or more items on the screens were left blank, the entire scale was considered missing. Providers were instructed to complete the screens, including missing items, with the families during their encounters whenever possible. How the existence of missing items might have affected family risk assessment and referrals/management was not specifically assessed in this study.
To evaluate an association between parental concern (dichotomous outcome variable) and predictors, logistic regression was used. Variables considered in the analysis were child behavior symptom score and social stressors (substance use, maternal depression, food insecurity, domestic violence) across ages 6 months to 10 years. Additionally, we explored if there was any statistically significant interaction effect between the predictors.
Columbia University Institutional Review Board approval was obtained for this study.
RESULTS
Demographics for convenience sample
Of the first 349 unique families screened whose medical records were also examined, the majority (45.8%) were in the 18 month – 5-year age range, and the rest were equally divided among the infant (6–17 month) and school age (6–10 year) groups. Gender was equally distributed. Nearly two thirds of this cohort (62.6%) had established child medical comorbidities, 30.3% had a developmental delay documented and 9.8% had a child behavioral/psychiatric comorbidity documented prior to the implementation of routine screening. Most of this sample had their screen completed by mothers (82.5%) and approximately half identified as Hispanic (52.4%) and indicated Spanish as their primary language (51.4%) in their medical record. (Table 2)
Table 2.
Mean age of child (SD) | 4.05 years (2.95) |
---|---|
Age group | |
6–17 months | 26.6% |
18 months – 5 years | 45.8% |
6 – 10 years | 27.5% |
Gender of child | |
Female | 47% |
Child medical co-morbidities | 62.6% |
Child psychiatric co-morbidities | 9.8% |
Developmental delay in child | 30.3% |
Guardian present on day of screening | |
Mother only | 82.5% |
Father only | 3.0% |
Mother and father | 12.4% |
Other | 2.1% |
Race/ethnicity from record | |
Hispanic | 52.4% |
Black (non-Hispanic) | 10.3% |
White (non-Hispanic) | 3.9% |
Multiple or other | 33.4% |
Language preferred | |
Spanish | 51.4% |
English | 43.4% |
Arabic | 1.2% |
Other | 4% |
Screen Administration and Documentation
Screen administration rates ranged from 5 to 90%, reaching the established goal of 50% for 8 out of the 18 months tracked. (Figure 2) Rates reached a low of 5% during one summer month during which clinic staff (including residents, volunteers and the research assistant) were not available to carry the project forward, and reached a high of 90% after an electronic method of administering the screen was implemented using a tablet in the waiting room. Barriers related to screen administration reported by staff included running out of photocopies of the paper screen and not knowing which patients to give it to; for example, children with complex medical conditions were often thought to be ineligible for the screen. Several changes were instituted as a result of this feedback. For example, electronic copies of all screens were spread to all front desk staff, and education was provided regarding the definitions of universal screening, and the fact that all patients presenting for well visits regardless of underlying medical conditions - should receive the screen.
Rates of documentation of the screen in the electronic medical record ranged from 9 to 100%, and reached the goal of 75% for 3 out of the 18 months studied. (Figure 2) Documentation rates were lowest at approximately the same time that screen administration rates reached a high, which is when the electronic/tablet method of administration was trialed. Screens that were entered into the tablet could not be integrated into the electronic medical record automatically, and instead had to be accessed via a separate hospital clinical application. PDSAs utilizing volunteers to access and print the screens for the providers did not change these documentation rates. Finally, other barriers related to documentation that were reported included losing the screens that were completed by families in the waiting room (e.g., families would lose or keep screens on their person and forget to deliver it to their provider), remembering to use the acronym expander or remembering the acronym itself, and not having a standard place in the medical record in which to document. As a result of this feedback, the screens were edited to include instructions for families on “returning the paper screen to the provider” in large font on the bottom of the screen. In addition, EMR note templates were subsequently altered to include specific sections in which to document the results of the screens.
Referrals and Follow Ups
In the convenience sample (N=349), 28% scored positive for a behavioral problem, 25% reported at least one social stressor, and 18% scored positive on both behavioral problems and social stressors. The most common behavior problems reported were; “child has a hard time being with new people” (47.7% of 6–17 month-olds), “child gets upset if things are not done a certain way” (60% of 18 month-5 year-olds), and “child is distracted easily” (52.9% of 6–10 year olds). The most common social stressor disclosed was maternal depression with 9.7% of mothers scoring 2 or more on the PHQ-2.
Overall, 26% of the behavior scales and 21% of the social stressor scales had missing items. The most common missing items on the behavior scales were; “minds being held by others” for 6–17 month-olds, “hard to know what child needs” for 18 month-5 year olds, and “feels hopeless” for 6–10 year-olds. On the social stressor scale, domestic violence and maternal depression had missing items approximately 10–12% of the time, which was ten times the rate of hunger and twice the rate of substance use. Figure 1 depicts referral and follow up rates for positive behavior and social screens.
Behavior
Of all those in the convenience sample (N=349) with a complete adapted SWYC who screened positive for a behavior problem (28% across all ages), only 12.5% had a behavioral problem previously documented in their electronic medical record. Of the 28% who reported a behavior problem, 75% were scheduled to follow up with their primary medical doctor within 3 months. Of those who were scheduled to follow up with their doctor within 3 months, 55.4% would have been due for a well visit based on recommendations by the American Academy of Pediatrics, and thus 44.6% were scheduled to follow-up sooner than this well-visit schedule. Slightly less than 10% of those who reported behavior problems were also referred to the clinic social worker. Of those who were referred, 80% completed their follow up appointment with their primary medical doctor, and 57% completed their social work appointment.
Social stressors
Of those families who reported at least one social stressor on the screen (23% of the convenience sample), less than half (44.4%) had a previous social stressor mentioned in their record. Of those who reported at least one social stressor, 65% were given a follow up appointment with their primary medical doctor within 1–3 months, and 19% were referred to the clinic social worker. Completion rates for these appointments were 83% and 42% respectively.
Sub-Analysis of the Association Between Parent Concern Child Behavior and Social Stressors
Binary logistic regression analysis revealed that after controlling for the social stressors’ covariate (substance use, food insecurity, maternal depression and domestic violence), parental concern for their child’s behavior was significantly associated with child behavior symptoms (p = 0.001). Similarly, after adjusting for child behavior symptoms, parental concern was significantly associated with social stressors (p = 0.002). We explored whether the social stressors’ covariate had any moderator effect on child behavior problems, and found there to be no statistically significant interaction between the effects of these two variables on parental concern. Other co-variates including age, gender or behavioral/medical co-morbidities in the child were not included in the analysis for this paper.
DISCUSSION
Results from this study support the relative feasibility of implementing a combined child behavior and psycho-social screen in low income, resource poor clinics. Quality improvement methodology was useful to integrate the screener into clinic flow without allocating additional human or financial resources. Adding volunteers during one of the PDSA cycles for example, did not improve the workflow, and thus were not maintained. The fact that the self-report screening tool itself is short, relatively easy to interpret, and readily accessible contributed to success in its use without additional personnel. This is consistent with other studies that had success in implementing psycho-social screens.23–25
Administration rates reached a high of 90% after an electronic/tablet method of administering the screens was introduced. This is consistent with data indicating that electronic screening is easy to use, maintains confidentiality, validates parental concerns, and aids in normalizing mental health issues in primary care.24 Patients have also indicated preferences for electronic screening over paper and pencil or in person screening.25 Furthermore, a study comparing electronic vs. in person methods to collect surveys indicated that patients are more likely to disclose sensitive information when it’s administered in an electronic format compared to interviews and paper screens.24 Using a tablet also solves the problem of lost screens. The increase in screening rates that occurred with the electronic method was at the expense of provider documentation, however. Providers had difficulty accessing the screens that were administered via the tablet. It is also possible that the personal interaction that occurs between a provider and their patient in an encounter are somewhat lost when electronic systems (rather than interview or paper and pen) are used to collect information.
The fact that our mean documentation rates did not reach the goal of 75% is consistent with other studies that have demonstrated challenges integrating pre-screens into documentation and referral practices within pediatric primary care.27 Some of our QI approaches including reminders for providers through signage, emailed feedback on personal rates of documentation and printing of electronic screens increased documentation rates, but increases were difficult to sustain. It is not clear whether barriers including lack of time and perceived irrelevance or insufficient relevance to the visit also affected documentation rates. Despite these challenges, efforts to find automated methods to both collect and integrate screen results into the EMR may prove to be essential for increasing administration, patient disclosure and documentation rates. Automated screening also holds promise in combatting common barriers to addressing psychosocial issues including time and stigma. As a result of lessons learned from this QI effort, we are currently implementing widespread automated screening with tablets in our waiting rooms. We are actively working on assuring that screen results are integrated into our EMR to overcome the barriers to provider documentation encountered in this project.
Referrals and Follow Ups
It is notable that over 80% of families who screened positive for a behavioral problem, and over 50% who screened positive for a social stressor on the adapted SWYC did not have prior documentation of such in the child’s record. This reinforces the need to routinely utilize behavioral and social health screening rather than relying on traditional surveillance methods that largely use ad hoc interview as a means to assess for concerns.28
A particular argument against universal screening is that the rates of positive screens would overwhelm the system through more follow up appointments with providers or referrals to social work. Our data indicate that less than 10% of positive behavioral screens and only 19% of positive social stressor screens were referred to our co-located social worker. Patients and families who were not referred to social work could have been given advice or referrals to outside sources from their primary medical doctor, which may be appropriate, especially for low risk situations. For example, primary medical doctors often give parenting advice and referrals to early childhood education to children who present with behavioral concerns, but who did not meet criteria for developmental delays or mental health diagnoses. Our electronic resource list that was uploaded to all desktop computers may have facilitated this practice. Of those who were scheduled to return to their primary medical doctor within 3 months, it was noted that approximately 45% would not have been due for a well-child visit. It is not known whether they were scheduled for the behavior uncovered specifically, or for another reason (example follow up for weight gain or another reason). It is also not known what the outcomes of these visits were. However, these visits did not appear to increase utilization beyond what could be absorbed in a busy urban practice.
Adherence to follow up with the primary medical providers was high in this study (> 80% whether the screen was positive for behavior or social stress). High no-show rates for both primary medical doctor and social work appointments are significant sources of waste within the healthcare system. Factors associated with high-no show rates in the literature include low socio-economic status, being a racial minority, and lack of commercial insurance; 28 all characteristics associated with our patient population. Indeed, data from other low resource, urban clinics have reported no-show rates for medical providers and for behavioral resources, including social work, comparable or higher than our own.28–30 Follow up in this study was achieved without the addition of other adherence-promoting resources. Utilizing a universal screening for behavioral and psychosocial issues might help organize and prioritize making referrals. For example, rather than making immediate referrals to mental health or social service agencies, providers and families may discuss and decide which of the issues found on the screens should be addressed first and how they should be addressed. This matching of referrals to specific needs may help incentivize follow-up for families. Although relatively low, no-shows for psychosocial problems in this study existed, and may have been related to stigma, competing demands or readiness and willingness to accept services. Further studies exploring these factors and interventions to overcome them are needed.
Association Between Child Behavior and Social Stressors
Associations between social stressors including maternal depression for example, and child behavior have long been cited in the literature.31 Our finding that parental concern for their child’s behavior was independently associated with both child behavior symptoms as well as social stressors is confirmatory and interesting. Although we did not find a significant interaction between these two variables, it may be possible that social stressors often drive the parental concern that pediatricians are confronted with, and that even in the absence of diagnosable child behavior problems, parents perceive and report problems. Addressing this complex dynamic in primary care may help alleviate parental concerns in a way that will help them shift focus away from perceived problematic behavior in their child and more towards addressing their social determinants of health when appropriate. The associations between social stressors and the type of referrals offered by providers or completed by families was not assessed in this study and may help guide practices related to psycho-social issues encountered in primary care.
Limitations
Limitations to this study include the fact that it took place at one pediatric clinic and may not be generalizable to other settings. Rates of documentation of behavior problems and social stressors for those who were not screened with the adapted SWYC could not be collected. However, as mentioned for the convenience sample, documentation of issues prior to the screening was lacking in most cases. Similarly, referral and follow up data was not collected for those who did not fully complete or successfully hand in an adapted SWYC screen, and thus it is unknown whether screening is causally related to the relatively high follow up rates found. It is also unknown whether or how incomplete screens impacted providers’ assessments and management of child behavior or social stressors. The fact that follow up data was only collected for the first 4 months of the study, when there may have been unmeasured biases in the administration of the screens (i.e., screens were initially not given to children with complex medical needs), adds an additional limitation in our ability to make inference about referral and follow up rates. We presented initial results on the associations between parental concern for their child’s behavior, and both actual child behavior symptoms and social stressors. We posit that there may be additional associations and possible interactions between these complex variables. However, this analysis was beyond the scope of this paper, and will be the focus of future research.
CONCLUSIONS
This study provides insight into how a comprehensive psycho-social screen that assesses both behavior and social stressors can be implemented in a busy urban pediatric primary care setting. In this setting, administration rates reached a high of 90% but documentation rates proved more challenging. For successful universal screening, efforts should focus on finding automated methods for entering results of self-report screens that are integrated with the electronic medical system. Follow up rates were relatively high, which may suggest that comprehensive screening for child behavior and social stressors may help tailor referrals and engage patients. Associations between parental concern for their child’s behavior and both child behavior symptoms and social stressors were found. Interventions to address these complex associations in primary care, utilizing models such as risk-stratification to match resources to needs, are needed.
Acknowledgements
Mariellen Lane MD & Columbia University Medical Center pediatrics residency training program, Charles Rangel Commiunity Health Center Staff and Doctors Margaret Krause and Hetty Cunningham, Andy Nieto & New York Presbyterian-Ambulatory Care Network, Natalie Cohen MPH
Sources of Funding: Sackler Parent Infant Project
Footnotes
Conflicts of Interest: None
References
- 1.Polanczyk GV, Salum GA, Sugaya LS, et al. Annual Research Review: A meta-analysis of the worldwide prevalence of mental disorders in children and adolescents. J Child Psychol Psychiatry. 2015;56(3):345–365. doi: 10.1111/jcpp.12381 [DOI] [PubMed] [Google Scholar]
- 2.Franke HA. Toxic Stress: Effects, Prevention and Treatment. Children. 2014;1(3):390–402. doi: 10.3390/children1030390 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Shonkoff JP, Garner AS, Benjamin SS, et al. The Lifelong Effects of Early Childhood Adversity and Toxic Stress. Pediatrics. 2012;129(1):e232–e246. doi: 10.1542/peds.2011-2663 [DOI] [PubMed] [Google Scholar]
- 4.Green M Bright Futures: Guidelines for Health Supervision of Infants, Children, and Adolescents. National Maternal and Child Health Clearinghouse, 8201 Greensboro Drive, Suite 600, McLean, VA 22102: (1994). [Google Scholar]
- 5.Foy JM, Kelleher KJ, Laraque D, et al. Enhancing Pediatric Mental Health Care: Strategies for Preparing a Primary Care Practice. Pediatrics. 2010;125(Supplement 3):S87–S108. doi: 10.1542/peds.2010-0788E [DOI] [PubMed] [Google Scholar]
- 6.Kogan MD, Schuster MA, Yu SM, et al. Routine Assessment of Family and Community Health Risks: Parent Views and What They Receive. Pediatrics. 2004;113(Supplement 5):1934–1943. http://pediatrics.aappublications.org/content/113/Supplement_5/1934. [PubMed] [Google Scholar]
- 7.Wissow LS, Brown J, Fothergill KE, et al. Universal Mental Health Screening in Pediatric Primary Care: A Systematic Review. J Am Acad Child Adolesc Psychiatry. 2013;52(11):1134–1147.e23. doi: 10.1016/j.jaac.2013.08.013 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Sheldrick RC, Merchant S, Perrin EC. Identification of developmental-behavioral problems in primary care: a systematic review. Pediatrics. 2011;128(2):356–363. doi: 10.1542/peds.2010-3261 [DOI] [PubMed] [Google Scholar]
- 9.Kuhlthau K, Jellinek M, White G, et al. Increases in Behavioral Health Screening in Pediatric Care for Massachusetts Medicaid Patients. Arch Pediatr Adolesc Med. 2011;165(7):660–664. doi: 10.1001/archpediatrics.2011.18 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Guevara JP, Gerdes M, Rothman B, et al. Screening for Parental Depression in Urban Primary Care Practices: A Mixed Methods Study. J Health Care Poor Underserved. 2016;27(4):1858–1871. doi: 10.1353/hpu.2016.0167 [DOI] [PubMed] [Google Scholar]
- 11.Chisolm DJ, Klima J, Gardner W, et al. Adolescent Behavioral Risk Screening and Use of Health Services. Adm Policy Ment Health Ment Health Serv Res N Y. 2009;36(6):374–380. doi:http://dx.doi.org.ezproxy.cul.columbia.edu/10.1007/s10488-009-0245-8 [DOI] [PubMed] [Google Scholar]
- 12.Hacker K, Arsenault L, Franco I, et al. Referral and Follow-Up After Mental Health Screening in Commercially Insured Adolescents. J Adolesc Health. 2014;55(1):17–23. doi: 10.1016/j.jadohealth.2013.12.012 [DOI] [PubMed] [Google Scholar]
- 13.Hacker KA, Penfold RB, Arsenault LN, et al. Behavioral health services following implementation of screening in Massachusetts Medicaid children. Pediatrics. 2014;134(4):737–746. doi: 10.1542/peds.2014-0453 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Weitzman Carol, and Wegner Lynn. “Promoting Optimal Development: Screening for Behavioral and Emotional Problems.” Pediatrics (2015):peds-2014. [DOI] [PubMed] [Google Scholar]
- 15.Sheldrick RC, Henson BS, Neger EN, et al. The Baby Pediatric Symptom Checklist: Development and Initial Validation of a New Social/Emotional Screening Instrument for Very Young Children. Acad Pediatr. 2013;13(1):72–80. doi: 10.1016/j.acap.2012.08.003 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Parts of the SWYC - Family Questions at Tufts Medical Center. https://www.floatinghospital.org/The-Survey-of-Wellbeing-of-Young-Children/Parts-of-the-SWYC/Family-Questions.aspx. Accessed October 3,
- 17.Conners-Burrow NA, Bokony P, Whiteside-Mansell L, et al. Low-level depressive symptoms reduce maternal support for child cognitive development. J Pediatr Health Care Off Publ Natl Assoc Pediatr Nurse Assoc Pract. 2014;28(5):404–412. doi: 10.1016/j.pedhc.2013.12.005 [DOI] [PubMed] [Google Scholar]
- 18.Cutler CB, Legano LA, Dreyer BP, et al. Screening for maternal depression in a low education population using a two item questionnaire. Arch Womens Ment Health. 2007;10(6):277–283. doi: 10.1007/s00737-007-0202-z [DOI] [PubMed] [Google Scholar]
- 19.Dubowitz H, Feigelman S, Lane W, et al. Screening for Depression in an Urban Pediatric Primary Care Clinic. Pediatrics. 2007;119(3):435–443. doi: 10.1542/peds.2006-2010 [DOI] [PubMed] [Google Scholar]
- 20.Berger-Jenkins E, McCord M, Gallagher T, et al. Effect of routine mental health screening in a low-resource pediatric primary care population. Clin Pediatr (Phila). 1. 2012;51(4):359–365. [DOI] [PubMed] [Google Scholar]
- 21.Whitesell NR, Sarche M, Trucksess C. The Survey of Well-Being of Young Children: Results of a Feasibility Study with American Indian and Alaska Native Communities. Infant Ment Health J. 2015;36(5):483–505. doi: 10.1002/imhj.21526 [DOI] [PubMed] [Google Scholar]
- 22.Moving Health Care Upstream. URL accessed 02/14/2019:https://www.movinghealthcareupstream.org/mhcus-improvement-network/
- 23.Fothergill KE, Gadomski A, Solomon BS, et al. Assessing the Impact of a Web-Based Comprehensive Somatic and Mental Health Screening Tool in Pediatric Primary Care. Acad Pediatr. 2013;13(4):340–347. doi: 10.1016/j.acap.2013.04.005 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Gottlieb L, Hessler D, Long D, et al. A Randomized Trial on Screening for Social Determinants of Health: the iScreen Study. Pediatrics. November 2014:peds.2014–1439. doi: 10.1542/peds.2014-1439 [DOI] [PubMed] [Google Scholar]
- 25.Jasik CB, Berna M, Martin M, et al. Teen Preferences for Clinic-Based Behavior Screens: Who, Where, When, and How? J Adolesc Health. 2016;59(6):722–724. doi: 10.1016/j.jadohealth.2016.08.009 [DOI] [PubMed] [Google Scholar]
- 26.Talmi A, Bunik M, Asherin R, et al. Improving Developmental Screening Documentation and Referral Completion. Pediatrics. 2014;134(4):e1181–e1188. doi: 10.1542/peds.2012-1151 [DOI] [PubMed] [Google Scholar]
- 27.Chung EK, Siegel BS, Garg A, et al. Screening for Social Determinants of Health Among Children and Families Living in Poverty: A Guide for Clinicians. Curr Probl Pediatr Adolesc Health Care. 2016;46(5):135–153. doi: 10.1016/j.cppeds.2016.02.004 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Samuels RC, Ward VL, Melvin P, et al. Missed Appointments: Factors Contributing to High No-Show Rates in an Urban Pediatrics Primary Care Clinic. Clin Pediatr (Phila). 2015;54(10):976–982. doi: 10.1177/0009922815570613 [DOI] [PubMed] [Google Scholar]
- 29.Lin C-L, Mistry N, Boneh J, et al. Text Message Reminders Increase Appointment Adherence in a Pediatric Clinic: A Randomized Controlled Trial. Int J Pediatr. 2016;2016. doi: 10.1155/2016/8487378 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Berkowitz SA, Hulberg AC, Hong C, et al. Addressing basic resource needs to improve primary care quality: a community collaboration programme. BMJ Qual Saf Lond.2016;25(3):164. doi:http://dx.doi.org.ezproxy.cul.columbia.edu/10.1136/bmjqs-2015-004521 [DOI] [PubMed] [Google Scholar]
- 31.van der Waerden Judith, et al. Maternal Depression Trajectories and Children’s Behavior at Age 5 Years. The Journal of Pediatrics. June 2015;166(6):1440–1448. Crossref, doi: 10.1016/j.jpeds.2015.03.002. [DOI] [PubMed] [Google Scholar]