Abstract
Objective
This systematic review evaluated the effectiveness of professional and organizational interventions aimed at improving medical processes, such as documentation or clinical assessments by health care providers, in the care of pediatric emergency department (ED) patients where abuse was suspected.
Methods
A search of electronic databases, references, key journals/conference proceedings was conducted and primary authors contacted. Studies whose purpose was to evaluate a strategy aimed at improving ED clinical care of suspected abuse were included. Study methodological quality was assessed by two independent reviewers. One reviewer extracted the data and a second checked for completeness and accuracy.
Results
Six studies met the inclusion criteria: one randomized (RCT) and one quasi-randomized trial (qRCT), and four observational studies. Study quality ranged from modest (observational studies) to good (trials). Variation in study interventions and outcomes limited between study comparisons. One qRCT supported self-instructional education kits as a means to improve physician knowledge for both physical abuse (mean pre-test score: 13.12, SD 2.36; mean post-test score: 18.16, SD 1.64) and sexual abuse (mean pre-test score: 10.81, SD 3.20; mean post-test score: 18.45, SD 1.79). Modest quality observational studies evaluated reminder systems for physician documentation with similar results across studies. Compared to standard practice, chart checklists paired with an educational program increased physician consideration of non-accidental burns in burn cases (59% increase), documentation of time of injury (36% increase), as well as documentation of consistency (53% increase) and compatibility (55% increase) of reported histories. Decisional flowcharts for suspected physical abuse also increased documentation of non-accidental physical injury (69.5% increase; p<0.0001) and had a similar significant impact as checklists on increasing documentation of history consistency and compatibility (69.5% and 70.0% increases, respectively; p<0.0001) when compared to standard practice. No improvements were noted in these studies for documentation of consultations or current status with child protective services. The introduction of a specialized team and crisis center to standardize practice had little effect on physician documentation, but did increase documentation of child protective services involvement (22.7% increase; p<0.005) and discharge status (23.7% increase; p<0.02). Referral to social services increased in one study following the introduction of a chart checklist (8.6% increase; p=0.018). A recently conducted multi-site RCT did not support observational findings, reporting no significant effect of educational sessions and/or a chart checklist on ED practices.
Conclusions
The small number of studies identified in this review highlights the need for future studies that address care of a vulnerable clinical population. While moderate quality observational studies suggested education and reminder systems increased clinical knowledge and documentation, these findings were not supported by a single randomized trial. The limited theoretical base for conceptualizing change in health care providers and the influence of the ED environment on clinical practice are limitations to this current evidence base.
Introduction
In 2006, almost 3.6 million American children and youth received a child protection service investigation or assessment, with 28.6% of the investigations determining abuse or neglect.1 Canadian data indicate that, in 2003, just under a quarter of a million investigations of alleged child abuse and neglect were conducted with 50% of those investigations being substantiated.2–3 These statistics have been critiqued as under representative of the magnitude of abuse,1–2,4–5 and there remains an opportunity to not only improve the detection of abuse, but also to initiate protective services. Abuse often consists of a series of incidents rather than a single event,6 and cases are reported after several medical evaluations. There is evidence to suggest that 20–30% of children and youth who die from abuse have been seen by health care providers for abusive sequelae before abuse was formally identified.7–8
The emergency department (ED) represents a critical system entry point for crisis-based health care visits. For children and youth who present to the hospital for accidents related to neglect or inflicted injuries, ED personnel may be their first contact and opportunity for initiating protective services.9–13 Abused children and youth have higher rates of ED use before diagnosis compared to other patients, but do not necessarily have distinguishable features to identify them as a ‘high risk’ population for screening.14 Health care providers in the ED are therefore required to rely on their clinical skills and judgment to identify signs and symptoms consistent with abuse. Prior hospital visits which often meet criteria for suspicion of abuse, however, can go unreported or unidentified, or be poorly documented.6,15–17 Factors known to facilitate or impede the assessment and management of child abuse include perceived time demands and obstacles to an effective health care system response, training gaps, as well as concerns with clinical abilities.18–20 Strategies aimed at improving ED clinical practices have been evaluated, but to date, have not been synthesized to formulate quality improvement recommendations. This systematic review evaluated the effectiveness of professional (e.g., educational initiatives) and organizational (e.g., implementation of specialized teams) interventions aimed at improving medical processes, such as documentation or clinical assessments by health care providers, in the care of pediatric ED patients where abuse was suspected.
Methods
Search Strategy
A research librarian, with input from the clinical research team, developed and implemented systematic search strategies using language (English and French) and year (1985 to 2009) restrictions. The search was conducted in 14 high yield electronic databases: MEDLINE®, Ovid MEDLINE® In-Process & Other Non-Indexed Citations, EMBASE, Cochrane Central Register of Controlled Trials, OVID HealthStar, Cochrane Database of Systematic Reviews, Health Technology Assessment Database, Database of Abstracts of Reviews of Effects, ACP Journal Club, PsycINFO®, CINAHL®, SocIndex, ProQuest Theses and Dissertations, and Child Welfare Information Gateway. Reference lists, key journals, and conference proceedings (Canadian Association of Emergency Physicians, Society for Academic Emergency Medicine, American College of Emergency Physicians, Canadian Paediatric Society) were also reviewed. The initial search was conducted in January 2008 and was updated in January 2009. Search terms included abuse, violence, risk or risk factors or risk assessment, emergency health service, “emergency care” or “emergency treatment”; comprehensive strategies used in each database are available from the corresponding author on request.
Study Selection
Two reviewers independently screened the search results. Experimental and observational studies were eligible for review inclusion.21 Studies with the primary purpose of evaluating a strategy aimed at improving processes involved in the clinical care of suspected physical or sexual abuse in the ED were included. Health care providers targeted in the studies had to work with children and youth (≤18 years), and a clinically relevant outcome (i.e., identification of abuse, documentation, referral/involvement of protective services) needed to be reported.
Quality Assessment
The Jadad 5-point scale was used to assess control of bias in randomized controlled trials (RCTs). Points were allocated as follows: randomization (0–2 points), double blinding (0–2 points), and withdrawals/dropouts (0–1point).22 Concealment of allocation was assessed as adequate, inadequate, or unclear using criteria from Schulz et al.23 All other study designs were assessed using methodological criteria developed by Downs and Black.24 Quality was measured by study reporting, external and internal validity, and power, with an assigned maximal quality index (QI) of 29. QI scores of >20 were considered good, 11 to 20 moderate, and <11 poor. Two reviewers (BZ, MH) independently analysed each study’s methodological quality and agreement was quantified with the Kappa statistic.25
Data Extraction and Analysis
Data from the final six studies were extracted using a standardized form that encompassed elements of study characteristics (e.g., language of publication, country), characteristics of the study population; study setting; description of the intervention and comparisons; outcome measures and measurements tools; and, results. Data were extracted by one reviewer and checked for accuracy and completeness by a second reviewer. In the case of unclear or unreported information in the original studies, primary authors were contacted. Heterogeneity in the interventions, outcomes, and unit of analysis precluded the use of meta-analysis to pool and interpret study results; therefore, a descriptive analysis of our findings based on the quality assessment is presented.
Results
The search strategy identified 282 studies as potentially relevant to the review, all of which were assessed for study inclusion by two independent reviewers. As shown in Figure 1, six studies were confirmed for inclusion: one randomized controlled trial (RCT),14 one quasi-randomized trial,26 and four observational studies of various design.27–30 One study was excluded because we could not confirm if it targeted ED-based health care providers.31
Study characteristics and overall study quality are outlined in Table 1. All studies examined the impact of physician oriented strategies to improve assessment and/or care. Studies took place in either the United States (n=4) or United Kingdom (n=2). The age of children and youth cared for by study participants varied. All studies focused on the assessment and treatment of physical abuse; one study also focused on sexual abuse. Studies reviewed the clinical care of children and youth with: (i) any non-accidental injury,28,30 (ii) non-accidental burns27,29 or (iii) unknown.14
Table 1.
Target Patient Population | |||||
---|---|---|---|---|---|
First Author (Country) | Study Design | Sample Size (n): Intervention, Comparison Group(s) | Age | Type of Abuse | Quality Assessment Score |
Guenther 2009 (USA) | Randomized Controlled Trial | Total=1575** Full intervention=543 Partial intervention=473 Comparison=559 |
<36 mo | Physical | 3/5 |
Showers 1991 (USA) | Quasi-Randomized Trial | Total=191* Group 1 (physical abuse kit)=82 Group 2 (sexual abuse kit)=109 |
NR | Physical, Sexual | 16/29 |
Clark 1997 (USA) | Controlled Before-After | Total=302**,± Intervention=215 Comparison=87 |
1 mo-18 yrs | Physical | 19/29 |
Limbos 1998 (USA) | Non-Concurrent (historical) Cohort | Total=73**,± Intervention=29 Comparison=44 |
<18 yrs | Physical | 17/29 |
Benger 2001 (UK) | Controlled Before-After | Total=200**,± Intervention=100 Comparison=100 |
0–6 yrs | Physical | 21/29 |
Benger 2002 (UK) | Controlled Before-After | Total=2000**,± Intervention=1000 Comparison=1000 |
0–5 yrs | Physical | 19/29 |
NR: Not Reported
Sample = health care providers
Sample = patient charts
Non-concurrent sample
Methodological quality of the studies ranged (Table 1). Overall, reviewer agreement on quality was good (κ=.76)29 with reviewer disagreements resolved through consensus. While a randomized design was an overt strength in reducing risk of bias in the review’s one RCT,14 because it is impossible to double-blind studies of provider based interventions, the quality score was limited to a modest maximum of three on the Jadad scale (rather than five; range=one to three). Concealment of allocation was assessed as unclear.23 Using the maximal quality index, scores for the remaining studies on the Downs and Black checklist ranged from 16 (moderate quality) to 21 (good quality) out of a possible 29.26–30 Key methodological strengths for higher quality studies included detailed descriptions of the study design and analyses, inclusion of a representative sample, and adjustment for confounding factors. Lower scores were the result of insufficient study population description, small sample sizes, lack of a control group, and minimal reporting of statistical analyses (Table 1).
Description of Health Care Provider Interventions and Outcomes
An equal number of studies evaluated the impact of a single intervention in changing behaviors27–28 and knowledge26 for physicians compared to a multi-modal intervention.14,29–30 Studies that evaluated educational interventions for physicians examined their impact on knowledge26 and documentation.14,29 While modality differed between these studies, the educational content provided was comparable and included abuse recognition and management (Table 2). The impact on physician behaviors was evaluated using chart appended reminder systems, which included checklists14,27,29 and a decisional flowchart.28 The impact of specialized services (Child Abuse and Neglect Team, Child Crisis Centre) and resident training (a workshop and optional elective) was examined in one study30 with a similar focus on practice behaviors. No studies evaluated the impact of interventions on clinical outcomes (i.e., psychosocial, physical) in children, youth or their families (Table 2).
Table 2.
Author | Intervention | Comparison | Main Outcome Domain(s) | Findings |
---|---|---|---|---|
Guenther 2009 | Three 1-hour didactic educational sessions (full intervention):
Screening checklist:
|
|
Documentation of:
|
GEE models indicated no evidence of significant ED practice change or trend across hospitals (p’s>0.2). |
Showers 1991 | Self-instructional (educational) kit on physical (Group 1) and sexual (Group 2) abuse:
|
|
Physician knowledge:
|
Significant differences in knowledge score for both groups: Group 1 (mean pre-test score 13.12, SD 2.36 vs. mean post-test score 18.16, SD 1.64). Group 2 (mean pre-test score 10.81, SD 3.20 vs. mean post-test score 18.45, SD 1.79). |
Clark 1997 | Burn profile checklist
|
Standard practice (ND) | Referral to social services | Documentation of burn cases referred to social services in intervention (26/215; 12.1%) vs. comparison (3/87; 3.4%) groups (p=0.018). |
Limbos 1998 | Standard practice plus:
|
Standard practice
|
Physician documentation:
|
Significant improvement in the documentation of the involvement of child protective services: intervention (29/29; 100%) vs. comparison (34/44; 77.2%) groups (p<0.005), and disposition status: intervention (26/29; 89.6%) vs. comparison (29/44; 65.9%) groups (p<0.02). Significant decreases in documentation of time of arrival: intervention (12/29; 41.3%) vs. comparison (31/44; 70.4%), and radiographs taken: intervention (11/29; 37.9%) vs. comparison (37/44; 84.1%). No improvements in the documentation of injury descriptions or history. |
Benger 2001 | Educational program
Chart checklist (sticker)
|
Standard practice (ND) | Physician documentation:
|
Improved frequency (97% of flagged charts) and adequacy of physician documentation after intervention: Documentation of time of injury (36% increase), consistency of history and compatibility of injury (53% and 55% increase, respectively), and suspicion of non-accidental event (59% increase). No improvements in physician documentation of child protection register status, tetanus status, or consultation with colleagues. |
Benger 2002 | Reminder flowchart (sticker)
|
Standard practice (ND) | Physician documentation:
|
Improvement in the documentation of consideration of non-accidental injury: intervention (711/1000) vs. comparison (16/1000) groups (p<.0001) and across other documentation standards (p<.0001) with the exception of consultation with colleagues including child protective services. |
ND=not described
Intervention Effects on Clinical Knowledge and Practice
Educational programs with14,29 and without26 reminder systems for patient charts demonstrated a mixed impact (Table 2). In their evaluation of the effectiveness of two self-instructional programs, Showers and Laird reported a significant increase in mean scores of physician knowledge of both physical and sexual abuse (p<0.0001).26 Benger and McCabe reported significant improvements to physician documentation through the introduction of an educational program and chart reminder for pediatric burn and scald patients.29 The intervention resulted in a 59% increase in the consideration of non-accidental injury, and also improved physician documentation of time of injury (36% increase in documentation), as well as consistency of history and compatibility of injury (53% and 55% increase in documentation, respectively). A recently published RCT16 by Guenther et al. contradicts both the Showers23 and Benger26 study findings. This multi-site trial found that multiple educational interventions along with a reminder chart did not significantly improve ED documentation practices of cases of suspected physical abuse.14
Studies evaluating the impact of reminder systems on physician documentation28 and referral to social services27 also yielded mixed results (Table 2). Benger and Pearce found that, compared to standard practice, flowcharts placed on patient charts consistently increased physician documentation on all expected assessment facets,28 while Clark’s use of a checklist improved physician reporting of non-accidental burns to social services.27
As shown in Table 2, only one study, of modest quality, examined the impact of the introduction of specialized, in-house services and training on physician documentation.30 Significant improvements were noted in documentation of time of arrival to the ED, the involvement of child protective services and disposition status. Improvements were not observed in the documentation of history and physical examinations.30
Intervention Adherence
One study reported the response rate to their mail-out educational intervention, and three studies evaluated adherence to their study’s ED-based intervention. Showers and Laird reported a 22% and 30% response rate for return of test booklets on physical and sexual abuse, respectively.26 Adherence to ED-based interventions was similar across the three reporting studies: 60% inclusion of a documentation reminder in eligible charts,29 72% inclusion of a documentation reminder in eligible charts,28 and 78% inclusion of a chart checklist in eligible charts.27
Discussion
This systematic review evaluated the effectiveness of interventions aimed at improving medical processes, such as documentation or clinical assessments, in the care of pediatric ED patients where abuse was suspected. While moderate quality studies suggested education and reminder systems increased various aspects of clinical knowledge and physician documentation,26–30 these findings were not supported by a higher quality randomized trial which reported limited to no effect on clinical practice trends.14 The lack of theoretical base for conceptualizing the change in health care provider behaviour and the impact of the ED environment on clinical practice makes it difficult to determine what influenced the medical process changes in the studies. Noted variability in documentation (termed ‘sporadic’) in the Guenther trial14 highlights the possibility of unaccounted for factors that influence clinical practices.
There are no gold standards for developing and evaluating educational, behavioral or organizational interventions designed to improve health care professional practices. Modest and mixed effects of these interventions are noted in comprehensive reviews31–37 and objectives remain for ED researchers to better understand factors which facilitate or impede physician behavior change, and the ideal form interventions and health care systems need to take to effectively address these factors and influence clinical practices.38–41 While the scope of this discussion is beyond the purpose of this paper, systematic reviews have demonstrated that a range of professional interventions such as audit and feedback,37 continuing medical education (CME),42–45 printed educational materials (including clinical practice guidelines and peer reviewed publications),33 and educational outreach31 have varied effects in different clinical practice settings and emphasizes the need for theoretically-driven and -evaluated interventions. This tenet also holds true for improving medical processes for suspected child abuse in the ED. Socolar et al., for example, used an audit and feedback strategy with physicians in the Child Medical Evaluation Program to target physician documentation and knowledge of child sexual abuse.46 While discrete changes were noted in physician history taking, tailored feedback with directed educational resources did not improve documentation or knowledge in this large RCT. Results indicated that CME for child sexual abuse, use of structured record for documentation, and physician gender (female) were significantly associated with better history documentation. Factors such as physician attitudes and beliefs were not measured,46 and the use of a theoretical framework to link intervention strategies with evaluation outcomes would have strengthened interpretation of study results.
In future studies of ED medical processes for suspected child abuse, we propose exploring a comprehensive set of effect mediators and moderators across practice behaviors and to measure barriers and facilitators to ED practice change. As a first step, study designs must acknowledge the complexity of health care provider focused interventions and should include the following: (1) increased sample sizes to detect the small to modest effects health care provider interventions can have, (2) independent comparison groups (trial designs versus observational designs) and (3) measurement of the extent to which interventions were implemented and adhered to in the ED. The nature of behaviors targeted for improvement also requires consideration. An asset of the studies in this review, irrespective of their quality, was the inclusion of evidence-based criteria from which to evaluate documentation practices. However, these behaviors are complex and likely require a number of cognitive and behavioral steps before a change in documentation behavior is realized (such as a cascade of decision-making). Future studies must be theoretically-driven to rigorously conceptualize these steps.
To optimize practice change, future interventions aimed at improving medical processes need to account for the complexity of the ED clinical practice setting and how this can affect care and documentation practices. Effect mediators and moderators of various practice behaviors need to be identified and explored as they can account for how different interventions impact ED care quality and delivery. Factors known to facilitate or impede the assessment and management of child abuse also need to be measured (e.g., concerns with personal abilities, time demands, perceived obstacles to system responses, training gaps, human resources). Factors inherent in the ED practice setting also need to be accounted for including the high patient volume, high levels of diagnostic uncertainty, limited clinician performance feedback, the multitude of interruptions and distractions for clinicians, and the complexity of care—all of which contribute to a clinical practice environment that is prone to clinical error and high stress.47 Accounting for the impact of these factors when measuring practice change will assist in the detection of true intervention effects.
Accounting for the multiple roles involved in delivering care may help to better delineate processes required to improve care and patient outcomes. The evaluation of professional interventions targeting other emergency health care providers such as nurses and social workers would be of value as would the evaluation of organizational strategies aimed at optimizing the role of multidisciplinary teams, and in particular, the role of physicians alongside child protection services and the police. Such studies would help answer questions of how best to carry out comprehensive child protection in the ED.
Limitations
This review is limited by the small number of studies available meeting our review objective. Other limitations in this review stem primarily from the studies themselves. Confidence in the observational studies’ findings is tempered by the studies’ modest methodological quality as well as inconsistent results among the included studies. Heterogeneity in the interventions, outcomes, and unit of analysis limited our ability to make between study comparisons. The studies also did not assess clinical outcomes in patients or families (e.g., emotional distress) associated with efforts such as charting/documentation.
These limitations are compounded by the lack of theoretical base for conceptualizing behavior change and the influence of clinical environment on clinical practice across all studies. To date, one of the major limitations of provider-focused intervention studies has been the lack of underlying theory to support choice of intervention.32 Research in this area has been “an expensive version of trial and error”.48 The limitations of atheoretical interventions have been duly noted by Grimshaw and colleagues,49–50 which have resulted in a number of well-executed, theoretically-driven studies.51–56 Social cognitive theories, such as the theory of planned behavior, for example, have aided interventions to account for the cognitive mechanisms that underline behavior change in provider-oriented interventions. Attention to the ED provider-specific barriers and facilitators while considering theoretical perspectives to develop and evaluate future provider-focused interventions may result in more effective (and tailored) interventions in emergency medicine41 and may improve the modest adherence noted in several studies.26–29
Conclusions
The small number of studies identified in this review highlights the need for future studies aimed at improving child abuse care in the ED setting. While moderate quality observational studies suggested education and reminder systems increased clinical knowledge and documentation, these findings were not supported by a single randomized trial. More theory-based studies with a rigorous design and well defined clinical scope are needed to better evaluate the impact of professional and organizational interventions on clinical practice and patient and family outcomes.
Acknowledgments
The authors would like to acknowledge the important contributions from Ms. Lisa Tjosvold (Alberta Research Centre for Child Health Evidence, University of Alberta) for conducting the initial literature search; and Mses. Justina Tuli and Carla Farnesi (Department of Pediatrics, University of Alberta) for assisting with initial screening and data extraction, respectively. Funding for this project was partially provided by a Knowledge Synthesis grant awarded to the principal author from the Canadian Institutes of Health Research (CIHR). Dr. Newton and Ms. Curran are salary supported by the Canadian Child Health Clinician Scientist Program, in partnership with SickKids Foundation, Child & Family Research Institute (British Columbia), Women & Children’s Health Research Institute (Alberta), Manitoba Institute of Child Health.
References
- 1.U.S. Department of Health and Human Services, Administration on Children, Youth and Families. Child Maltreatment 2006. Washington, DC: U.S. Government Printing Office; 2008. [Google Scholar]
- 2.Trocmé N, Fallon B, MacLaurin B, Daciuk J, Felstiner C, Black T, Tonmyr L, et al. Canadian Incidence Study of Reported Child Abuse and Neglect – 2003: Major Findings. Ottawa, ON: Minister of Public Works and Government Services Canada; 2005. [Google Scholar]
- 3.Jack S, Munn C, Cheng C, MacMillan H for the National Clearinghouse on Family Violence. Child Maltreatment in Canada: Overview Paper. Ottawa, ON: Public Health Agency of Canada; 2006. [Google Scholar]
- 4.Trocmé N, MacMillan H, Fallon B, DeMarco R. Nature and severity of physical harm caused by child abuse and neglect: Results from the Canadian Incidence Study. CMAJ. 2003;169(9):911–15. [PMC free article] [PubMed] [Google Scholar]
- 5.MacMillan HL, Jamieson E, Walsh CA. Repeated contact with child protection services among those reporting child physical and sexual abuse: Results from a community survey. Child Abuse & Neglect. 2003;27(1):1397–1408. doi: 10.1016/j.chiabu.2003.06.003. [DOI] [PubMed] [Google Scholar]
- 6.Paradise JE, Bass J, Forman SD, Berkowitz J, Greenberg DB, Mehta K. Minimum criteria for reporting child abuse from health care settings. Del Med J. 1997;69:357–63. [PubMed] [Google Scholar]
- 7.King WK, Kiesel EL, Simon HK. Child abuse fatalities: Are we missing opportunities for intervention? Pediatr Emerg Care. 2006;22:211–4. doi: 10.1097/01.pec.0000208180.94166.dd. [DOI] [PubMed] [Google Scholar]
- 8.Jenny C, Hymel KP, Ritzen SE, Hay TC. Analysis of missed cases of abusive head trauma. JAMA. 1999;281:621–6. doi: 10.1001/jama.281.7.621. [DOI] [PubMed] [Google Scholar]
- 9.Baren JM, Mace SE, Hendry PL. Children’s mental health emergencies – Part 3. Special situations: Child maltreatment, violence, and response to disasters. Pediatr Emerg Care. 2008;24:569–577. doi: 10.1097/PEC.0b013e318180fef2. [DOI] [PubMed] [Google Scholar]
- 10.Jain AM. Emergency department evaluation of child abuse. Emerg Med Clin North Am. 1999;17(3):575–93. doi: 10.1016/s0733-8627(05)70083-3. [DOI] [PubMed] [Google Scholar]
- 11.Hyden PW, Gallagher TA. Child abuse intervention in the emergency room. Pediatr Clin North Am. 1992;39(5):1053–81. doi: 10.1016/s0031-3955(16)38407-3. [DOI] [PubMed] [Google Scholar]
- 12.Berkowitz CD. Child abuse recognition and reporting: Supports and resources for changing the paradigm. Pediatrics. 2008. Available from: www.pediatrics.org/cgi/doi/10.1542/peds.2008-0715. [DOI] [PubMed]
- 13.Sidebotham P, Biu T, Goldsworthy Child protection procedures in emergency departments. Emerg Med J. 2007;24:831–5. doi: 10.1136/emj.2007.051011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Guenther E, Olsen C, Keenan H, Newberry C, Dean JM, Olson LM. Randomized prospective study to evaluate child abuse documentation in the emergency department. Acad Emerg Med. 2009;16:1–9. doi: 10.1111/j.1553-2712.2008.00346.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Boyce MC, Melhorn KJ, Vargo G. Pediatric trauma documentation: Adequacy for assessment of child abuse. Arch Pediatr Adolesc Med. 1996;150:730–2. doi: 10.1001/archpedi.1996.02170320076013. [DOI] [PubMed] [Google Scholar]
- 16.Flaherty EG, Sege R. Barriers to physician identification and reporting of child abuse. Pediatr Ann. 2005;34:349–56. doi: 10.3928/0090-4481-20050501-08. [DOI] [PubMed] [Google Scholar]
- 17.Jones R, Flaherty EG, Binns HJ, Price LL, Slora E, Abney D, Harris DL, et al. Clinicians’ description of factors influencing their report of suspected child abuse: Report of the Child Abuse Reporting Experience Study Research Group. Pediatrics. 2008;122:259–66. doi: 10.1542/peds.2007-2312. [DOI] [PubMed] [Google Scholar]
- 18.Markenson D, Tunik M, Cooper A, Olson L, Cook L, Matza-Haughton H, Treiber M, et al. A national assessment of knowledge, attitudes, and confidence of prehospital providers in the assessment and management of child maltreatment. Pediatrics. 2007;119(1):e103–8. doi: 10.1542/peds.2005-2121. [DOI] [PubMed] [Google Scholar]
- 19.Socolar RR, Reives P. Factors that facilitate or impede physicians who perform evaluations for child maltreatment. Child Maltreat. 2002;7:377–81. doi: 10.1177/107755902237268. [DOI] [PubMed] [Google Scholar]
- 20.Wright RJ, Wright RO, Farnan L, Isaac NE. Response to child abuse in the pediatric emergency department: Need for continued education. Pediatr Emerg Care. 1999;15:376–82. doi: 10.1097/00006565-199912000-00002. [DOI] [PubMed] [Google Scholar]
- 21.Deeks JJ, Dinnes J, D’Amico R, Sowden AJ, Sakarovitch C, Song F, Petticrew M, et al. Evaluating non-randomised intervention studies. Health Technol Assess. 2003;7(27):iii–x. 1–173. doi: 10.3310/hta7270. [DOI] [PubMed] [Google Scholar]
- 22.Jadad AR, Moore RA, Carrol D, Jenkinson C, Reynolds DJ, Gavaghan DJ, McQuay HJ. Assessing the quality of reports of randomized clinical trials: Is blinding necessary? Control Clin Trials. 1996;17:1–12. doi: 10.1016/0197-2456(95)00134-4. [DOI] [PubMed] [Google Scholar]
- 23.Shulz KF, Chalmers I, Hayes RJ, Altman DG. Empirical evidence of bias. Dimensions of methodological quality associated with estimates of treatment effects in controlled trials. JAMA. 1995;273:408–12. doi: 10.1001/jama.273.5.408. [DOI] [PubMed] [Google Scholar]
- 24.Downs SH, Black N. The feasibility of creating a checklist for the assessment of the methodological quality of both randomised and non-randomised studies of health care interventions. J Epidemiol Community Health. 1998;52:377–84. doi: 10.1136/jech.52.6.377. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Altman DG. Practical statistics for medical research. London, UK: Chapman and Hall; 1991. [Google Scholar]
- 26.Showers J, Laird M. Improving knowledge of emergency physicians about child physical and sexual abuse. Pediatric Emergency Care. 1991;7:275–7. doi: 10.1097/00006565-199110000-00003. [DOI] [PubMed] [Google Scholar]
- 27.Clark KD, Tepper D, Jenny C. Effect of a screening profile on the diagnosis of nonaccidental burns in children. Pediatric Emergency Care. 1997;13:259–61. doi: 10.1097/00006565-199708000-00005. [DOI] [PubMed] [Google Scholar]
- 28.Benger JR, Pearce AV. Simple intervention to improve detection of child abuse in emergency departments. BMJ. 2002;324:780–782. doi: 10.1136/bmj.324.7340.780. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Benger RJ, McCabe SE. Burns and scalds in pre-school children attending accident and emergency: accident or abuse? Emerg Med J. 2001;18:172–174. doi: 10.1136/emj.18.3.172. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Limbos MAP, Berkowitz CD. Documentation of child physical abuse: How far have we come? Pediatrics. 1998;102:53–8. doi: 10.1542/peds.102.1.53. [DOI] [PubMed] [Google Scholar]
- 31.O’Brien MA, Rogers S, Jamtvedt G, Oxman AD, Odgaard-Jensen J, Kristoffersen DT, Forsetlund L, et al. Educational outreach visits: Effects on professional practice and health care outcomes. Cochrane Database of Systematic Reviews. 2007;(4) doi: 10.1002/14651858.CD000409.pub2. Art. No.: CD000409. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Grimshaw J, McAuley LM, Bero LA, Grilli R, Oxman AD, Ramsay C, Vale L, et al. Systematic reviews of the effectiveness of quality improvement strategies and programmes. Quality and Safety in Health Care. 2003;12(4):298–303. doi: 10.1136/qhc.12.4.298. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L, Whitty P, et al. Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technology Assessment. 2004;8(6):iii–iv. 1–72. doi: 10.3310/hta8060. [DOI] [PubMed] [Google Scholar]
- 34.Farmer AP, Légaré F, Turcot L, Grimshaw J, Harvey E, McGowan JL, Wolf F. Printed educational materials: Effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2008;(3) doi: 10.1002/14651858.CD004398.pub2. Art. No.: CD004398. [DOI] [PubMed] [Google Scholar]
- 35.Gilbody S, Whitty P, Grimshaw J, Thomas R. Educational and organizational interventions to improve the management of depression in primary care: A systematic review. JAMA. 2003;289(23):3145–51. doi: 10.1001/jama.289.23.3145. [DOI] [PubMed] [Google Scholar]
- 36.Shaw B, Cheater F, Baker R, Gillies C, Hearnshaw H, Flottorp S, Robertson N. Tailored interventions to overcome identified barriers to change: Effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2005;(3) doi: 10.1002/14651858.CD005470. Art. No.: CD005470. [DOI] [PubMed] [Google Scholar]
- 37.Jamtvedt G, Young JM, Kristoffersen DT, O’Brien MA, Oxman AD. Does telling people what they have been doing change what they do? A systematic review of the effects of audit and feedback. Qual Saf Health Care. 2006;15:433–6. doi: 10.1136/qshc.2006.018549. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Hedges JR. The knowledge translation paradigm: Historical, philosophical, and practice perspectives. Acad Emerg Med. 2007;14(11):924–7. doi: 10.1197/j.aem.2007.06.016. [DOI] [PubMed] [Google Scholar]
- 39.Lang ES, Wyer PC, Eskin B, Tselios C, Afilalo M, Adams JG. The development of the Academic Emergency Medicine Consensus Conference Project on Knowledge Translation. Acad Emerg Med. 2007;14(11):919–23. doi: 10.1197/j.aem.2007.07.002. [DOI] [PubMed] [Google Scholar]
- 40.Wyer PC. Responsiveness to change: A quality indicator for assessment of knowledge translation systems. Acad Emerg Med. 2007;14(11):928–31. doi: 10.1197/j.aem.2007.06.013. [DOI] [PubMed] [Google Scholar]
- 41.Brehaut J, Hamm R, Majumdar S, Papa F, Lott A, Lang E. Cognitive and social issues in emergency medicine knowledge translation: A research agenda. Acad Emerg Med. 2007;97:984–90. doi: 10.1197/j.aem.2007.06.025. [DOI] [PubMed] [Google Scholar]
- 42.Forsetlund L, Bjørndal A, Rashidian A, Jamtvedt G, O’Brien MA, Wolf F, Davis D, et al. Continuing education meetings and workshops: Effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2009;(2) doi: 10.1002/14651858.CD003030.pub2. Art. No.: CD003030. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Mazmanian PE, David DA, Galbraith R. Continuing medical education effect on clinical outcomes. Chest. 2009;135:49–55S. doi: 10.1378/chest.08-2518. [DOI] [PubMed] [Google Scholar]
- 44.Davis D, Galbraith R. Continuing medical education effect on practice performance. Chest. 2009;135:42–48S. doi: 10.1378/chest.08-2517. [DOI] [PubMed] [Google Scholar]
- 45.O’Neil KM, Addrizzo-Harris DJ. Continuing medical education effect on physician knowledge application and psychomotor skills. Chest. 2009;135:37–41S. doi: 10.1378/chest.08-2516. [DOI] [PubMed] [Google Scholar]
- 46.Socolar RR, Raines B, Chen-Mok M, Runyan DK, Green C, Paterno S. Intervention to improve physician documentation and knowledge of child sexual abuse: A randomized, controlled trial. Pediatrics. 1998;101:817–24. doi: 10.1542/peds.101.5.817. [DOI] [PubMed] [Google Scholar]
- 47.Burstin H. Crossing the quality chasm in emergency medicine. Acad Emerg Med. 2002;9:1074–7. doi: 10.1111/j.1553-2712.2002.tb01560.x. [DOI] [PubMed] [Google Scholar]
- 48.Eccles M, Grimshaw J, Walker A, Johnston M, Pitts N. Changing the behavior of healthcare professionals: The use of theory in promoting uptake of research findings. J Clin Epidem. 2005;58:107–12. doi: 10.1016/j.jclinepi.2004.09.002. [DOI] [PubMed] [Google Scholar]
- 49.Ceccato NE, Ferris LE, Manuel D, Grimshaw JM. Adopting health behavior change theory throughout the clinical practice guideline process. J Contin Educ Health Prof. 2007;27(4):201–7. doi: 10.1002/chp.138. [DOI] [PubMed] [Google Scholar]
- 50.Godin G, Bélanger-Gravel A, Eccles M, Grimshaw J. Healthcare professionals’ intentions and behaviors: A systematic review of studies based on social cognitive theories. Implement Sci. 2008;3:36. doi: 10.1186/1748-5908-3-36. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Grimshaw JM, Zwarenstein M, Tetroe JM, Godin G, Graham ID, Lemyre L, Eccles MP, et al. Looking inside the black box: a theory-based process evaluation alongside a randomised controlled trial of printed educational materials (the Ontario printed educational message, OPEM) to improve referral and prescribing practices in primary care in Ontario, Canada. Implement Sci. 2007;2:38. doi: 10.1186/1748-5908-2-38. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Foy R, Francis JJ, Johnston M, Eccles M, Lecouturier J, Bamford C, Grimshaw J. The development of a theory-based intervention to promote appropriate disclosure of a diagnosis of dementia. BMC Health Serv Res. 2007;7:207. doi: 10.1186/1472-6963-7-207. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Francis JJ, Stockton C, Eccles MP, Johnston M, Cuthbertson BH, Grimshaw JM, Hyde C, et al. Evidence-based selection of theories for designing behavior change interventions: Using methods based on theoretical construct domains to understand clinicians’ blood transfusion behavior. Br J Health Psychol. 2009 Jan 20; doi: 10.1348/135910708X397025. [Epub ahead of print] [DOI] [PubMed] [Google Scholar]
- 54.Francis JJ, Eccles MP, Johnston M, Whitty P, Grimshaw JM, Kaner EF, Smith L, Walker A. Explaining the effects of an intervention designed to promote evidence-based diabetes care: a theory-based process evaluation of a pragmatic cluster randomised controlled trial. Implement Sci. 2008;3:50. doi: 10.1186/1748-5908-3-50. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Hrisos S, Eccles M, Johnston M, Francis J, Kaner EF, Steen N, Grimshaw J. An intervention modelling experiment to change GPs’ intentions to implement evidence-based practice: using theory-based interventions to promote GP management of upper respiratory tract infection without prescribing antibiotics #2. BMC Health Serv Res. 2008;8:10. doi: 10.1186/1472-6963-8-10. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Walker A, Watson M, Grimshaw J, Bond C. Applying the theory of planned behavior to pharmacists’ beliefs and intentions about the treatment of vaginal candidiasis with non-prescription medicines. Fam Pract. 2004;21:670–6. doi: 10.1093/fampra/cmh615. [DOI] [PubMed] [Google Scholar]