Abstract
Background
Training in communication skills for health professionals is important, but there are substantial barriers to individual in-person training for practicing clinicians. We evaluated the feasibility and desirability of on-line training and sought suggestions for future courses.
Methods
Based on successful in-person curricula for communication skills and our previous on-line curricula, we created an on-line course consisting of 28 modules (4.75 hours CME credit) about communication skills during pediatric visits that included a mental health concern; each module included a brief case, a multiple choice question, an explanation, and a 1–2 minute video demonstrating key skills. Specific communication skills included: greeting, setting an agenda, discussing diagnosis and treatment, and managing negative interactions. The course was announced by emails in spring, 2007; the course was available on-line for 60 days; we aimed to enroll 50 clinicians. Outcomes were analyzed for those who evaluated the course within 75 days of its initial availability.
Results
Overall, 61 clinicians registered, of whom most were nurses (N = 24), physicians (N = 22), or psychologists or social workers (N = 12). Of the 36 (59%) clinicians who evaluated the course, over 85% agreed that all course objectives had been met; over 90% reported greater confidence in greetings and agenda-setting; and over 80% reported greater confidence in discussing diagnosis and treatment and managing negative interactions. Nearly all, 97% would recommend the course to other clinicians and trainees. Suggestions for improvement included a library of additional video vignettes and written materials to accompany the on-line training.
Conclusion
On-line training in communication skills for pediatric mental health visits is feasible, desirable and associated with increased confidence in key skills. Positive feedback from clinicians suggests that a comparison of on-line versus in-person training is warranted.
Background
Up to 20% of children and adolescents in the United States are thought to have an emotional or behavioral disorder, and twice as many children have functional problems related to behavior or feelings, even though they don't meet criteria for a particular diagnosis [1-5]. Half of all primary care office visits involve behavioral, psychosocial or educational concerns [6,7]. Mental disorders are largely chronic conditions, and most begin in childhood or adolescence.
A main strategy for improving children's mental health care has been to position services where children spend their time. This includes increasing the mental health service capacity of primary medical care providers [8-10]. Reflecting the importance of this primary care strategy, the American Academy of Pediatrics, the American Academy of Family Practice, and the National Association of Pediatric Nurse Practitioners haveeach launched educational programs about mental health care. These organizations recognize that primary care clinicians are well positioned to detect emerging mental health issues[11,12].
Although pediatricians are identifying more children with behavioral and mental health problems than they did in the past [13], the vast majority of children with these problems remain undiagnosed and untreated [14,15]; for example, primary care clinicians identify only about a quarter of children and adolescents with mental problems [16,17]. Clinicians' lack of training remains a significant barrier in identifying problems and providing mental health services to pediatric and adolescent patients with psychosocial problems [18-20]. In one study, more than half of parents with emotional, behavioral, or developmental concerns about their children did not discuss them with their child's doctor [17]. Even when cases are detected, problems may be under-treated and receive minimal follow-up [21]. Furthermore, even among physicians who prescribe antidepressant medications, most provide limited information to patients about their medications, resulting in unfilled or non-renewed prescriptions [22].
Clinicians providing mental health care to children and adolescents need communication skills to elicit mental health concerns from those who may be reluctant to disclose them and who may not see that clinician as a source of help. Research has identified common communication patterns that affect clinician-patient discussion of psychosocial problems [20,23,24]. For example the quality of care for depressed patients improves when physicians explore and validate patient concerns [25]. Clinicians need skills to explore the family's perceptions about their problems and their readiness to seek help. If clinicians find the child and/or family unmotivated, embarrassed, resistant, hopeless, angry, conflicted, or otherwise unready to address the issue, they need skills to address these barriers.
Training primary care clinicians to use communications skills applicable to the disclosure and management of emotional problems shows promise as one way of increasing the mental health service capacity of primary care [26-29]. Optimal communication skills enhance patients' trust, satisfaction and adherence with treatment recommendations [30-36]. Communication skills reflecting respect and empathy can be taught, learned and practiced by health professionals [28,34,37-39].
Training in advanced communication skills (readiness to change, conflict management, and dealing with emotionally challenging patients) is generally a high intensity endeavor; typically, it includes a low student-teacher ratio, often using video tape to observe desired behaviors and role plays to practice them [40-45]. While in-person training by a child psychiatrist appears to be effective in enhancing clinician's skills in these areas, it is costly and limited in terms of the number of clinicians who can be trained. Not all clinicians have ready access to in-person training sessions, and skilled trainers may not be available, particularly in rural areas [46,47].
One successful approach to educating diverse, widely dispersed busy clinicians is the use of internet-based curricula [48-50]. As access to high speed internet connections improves, it becomes feasible to imbed brief video vignettes or demonstrations into web-based courses, enhancing education related to skills as well as knowledge [51]. These tools have been used successfully for internet-based or telemedicine courses on surgical procedures [51,52], but they have not been applied to curricula addressing communication skills during mental health-related visits for primary care clinicians.
The aim of this study was to assess the feasibility and desirability of delivering an on-line course on communication skills for pediatric mental health visits using an internet-based platform incorporating brief video demonstrations of desired skills. We defined feasibility as the ability to recruit diverse health professionals to the on-line course with few technical barriers reported by enrollees; we defined desirability as positive feedback about the course from enrollees. We were also interested in obtaining enrollee suggestions to enhance future courses. These data are essential before embarking on costly studies comparing the effectiveness of standard in-person training to on-line training to enhance communication skills for clinicians engaged in mental health care of children.
Methods
This was an evaluation of an educational program provided over the internet during the spring of 2007.
Subjects and Recruitment
Subjects were eligible to enroll if they were a licensed health care provider. We aimed to enroll a convenience sample of 50 clinicians with some expertise in pediatric mental health. Recruitment was done via email from the authors to five groups of pediatric primary care clinicians and pediatric mental health professionals (physicians, nurses, psychologists and social workers): the Multidisciplinary Mental Health/School Health Committee of the North Carolina Pediatric Society (N = 57), the Community Care of North Carolina Behavioral Health Integration Pilot sites (N = 64), nurses in the Child and Family Service Teams in Forsyth County, NC (N = 7), the American Academy of Pediatrics Mental Health Task Force (N = 220), and School Health Alliance for Forsyth County staff (N = 10). Two emails (sent April 12 and May 1) were sent to each of these groups; these emails may have been forwarded. Emails were also sent to the two pediatric chief residents at Wake Forest University School of Medicine (WFUSM). The emails invited participants to help "evaluate" and "beta test" the curriculum. Although the program was offered through the Northwestern North Carolina Area Health Education Center's web site (NWAHEC), it was not actively marketed by NWAHEC. Furthermore, although continuing education credit was offered through the WFUSM Office of Continuing Medical Education (CME), the course was not advertised through the CME or alumni offices because the primary purpose was to collect feedback about the program.
Course content
The course content was based on an in-person training funded by the National Institutes of Mental Health (RO1 MH62469). The in-person training used a case-based interactive, one-to-one teaching approach including written materials; video taped illustrative vignettes; role playing and feedback on one-to-one feedback on trainees' videotapes with standardized patients (See Appendix for example of one section of one module). The in-person training required approximately 4 hours of learner time, including 3 one hour individual or small group sessions with a child psychiatrist and the standardized patient.
The curriculum included material relevant to eliciting parent and child mental health concerns, developing an agenda for the visit, prioritizing concerns, partnering with families to develop an acceptable treatment plan, and increasing expectations that treatment would be helpful. The course materials were consistent with principles of patient-centered care and relied on motivational interviewing tools such as identifying barriers to change and rolling with resistance. Materials were arranged by learning objectives; a content outline was developed based on these objectives. Both the objectives and content outline were reviewed for accuracy and completeness and modified as needed. Based on the outline, we divided the objectives and content into eight (8) "sections" comprising the overall course. Each section built on prior sections. The sections were further divided one or more modules to make each learning section easier to complete on-line (Table 1).
Table 1.
Section | Number of Modules | CME credit in hours | Number video demonstrations | Number of Enrollees who completed each Section for CE/CME Credit |
Goals for Pediatric MH Visit | 4 | 0.5 | 3 | 35 |
Epidemiology and Description of Pediatric MH Problems | 4 | 0.5 | 0 | 26 |
Barriers to MH Care for Youth | 1 | 0.25 | 0 | 25 |
Greetings | 4 | 0.5 | 4 | 23 |
Agenda-Setting | 5 | 0.5 | 5 | 19 |
Discussing Diagnosis | 1 | 0.25 | 2 | 18 |
Developing Treatment Plans/Giving Advice | 1 | 0.25 | 2 | 18 |
Managing Negative Interactions | 8 | 2.0 | 12 | 15 |
TOTAL | 28 | 4.75 | 28 | 36 completed formal course evaluations |
Course organization
The organization and format of the curriculum were based on earlier studies on internet-based education funded by NIH NLM (R01 LM007709) [48,50]. Each module had a learning objective; a brief outpatient clinical scenario featuring a parent and child with a mental health concern; a teaching question; the "preferred" answer with a 1–3 page explanation; if appropriate, one or more 1 to 2 minute video(s) illustrating the desired communication behavior (28 videos altogether); and, if appropriate, resources and tools to assist patients with behavior change. Most of the videos had been used in the in-person training and featured one of the co-authors; additional videos were made specifically for this course to cover gaps. In the on-line module, an image of one screen of the video was located at the bottom of the explanation; learners simply clicked on the image to link to the video file.
After the content was thoroughly reviewed by the co-authors and modified as needed, a post-test was created for each section. Programming to put the materials on-line was done by NW AHEC staff, reviewed and modified as needed. Free Continuing Medical Education (CME) credit was provided for each section for participants who scored 70% or higher on the section post-test.
Course evaluation and feedback
At the close of the course (two weeks after enrolling the target of 50 clinicians), we asked participants by email to complete the on-line course evaluation, even if they had not completed all of the course sections or received any CME credit. Two reminder emails were sent. Complete web-based evaluations received within 10 weeks of placing the course on-line were included in this analysis. Brief email communications about the course (e.g. "Great, I really enjoyed it!") sent in response to the email requests to complete the on-line evaluation were not included in the formal analysis.
All data were entered on-line and analyzed anonymously using simple descriptive statistics.
The Wake Forest University Health Sciences Institutional Review Board approved this project as educational research.
Results
Although the recruitment goal was 50 participants, 64 health professionals enrolled by 5/16/07. Of these, 95% were from North Carolina; others were from nearby states and one was from Germany. Most (81%) were women. Data on age and race were not collected. Nearly all were the targeted professional groups: 24 nurses (including nurse practitioners and clinical nurse specialists), 22 physicians, and 12 social workers or psychologists; the other participants were mental health counselors or administrators.
Enrollees tended to study the course sections in the order presented (Table 1). By May 30, 2007 when the course was closed, over half of the participants (N = 35) had completed the CME questions for the first section. Fewer completed CME questions for each of the subsequent sections: Epidemiology of Pediatric Mental Health (MS) Problems (26), Barriers to MH Care for Youth (25), Greetings (23), Agenda-Setting (19), Discussing Diagnosis (18), Developing Treatment Plans/Giving Advice (18), and Managing Negative Interactions (15). No enrollees reported dropping the course for technical reasons. Several reported that they felt able to provide meaningful feedback based on reviewing just a few modules. Completion rates for the CME questions for all eight sections were highest for psychologists and social workers (5/12 who enrolled), next highest for nurses (7/24), lower for physicians (3/22) and lowest (0) for the others. Data on gender, age and other demographic characteristics of completers versus non-completers of the CME questions are not available.
As expected from the recruitment strategy, enrollees were experienced in providing care to pediatric patients with mental health concerns Among the 36 (59%) participants who provided formal course feedback, 32 (89%) reported having seen a pediatric outpatient in the previous month; 76% of these 32 reported discussing a mental health concern in more than 10% of their clinic visits (23%) reported discussing a mental health concern with more than 90% of patients).
Overall feedback about the course was very positive. Nearly all (97%) of those who gave feedback (and all four of those who did not respond to the formal review but did send emails later) said they would recommend the course to others. Most agreed that the course had met its objectives (Table 2). Specifically, 96% agreed or strongly agreed that the course helped them better identify and clarify mental health needs and use a collaborative style of communication; and 94% agreed or strongly agreed that the course helped them better manage negative interactions during pediatric mental health visits, such as a rambling, angry, demoralized or conflicted family or patient. The percentage of respondents who agreed that they were more confident in specific skills after the course than before taking it ranged from 80% (for discussing a diagnosis) to 90% (for greeting and setting an agenda); 83% reported they were more confident managing negative interactions and 86% said they were more confident discussing treatment.
Table 2.
Course Objectives | Percent strongly agreeing or agreeing objective met (N = 36) |
Support family confidence and hope | 97% |
Identify and clarify mental health needs during visit | 96% |
Use collaborative, style of communication | 96% |
Facilitate and build agreement on Diagnosis, Evaluation and Treatment | 94% |
Manage negative interactions (visits with demoralized, angry, embarrassed, rambling, disagreeable pt or family) | 94% |
Reduce family/child conflict | 93% |
Enhance confidence in caring for children with MH problem | 93% |
Enhance confidence in diagnostic info/advice accepted | 85% |
Feedback about the structure and format of the course was also positive, with 94% agreeing that the course used effective teaching methods. Most respondents (83%) felt the number of sections (8) was "about right," with the remaining respondents split between those who wanted more and those who wanted fewer. The amount of time allocated for CME (4.75 hours total) reflected the amount of time most participants spent on the course; 55% of completers spent 3–4 hours, and 14% spent 5 or more hours. Most liked the course organization, noting that the "Modules flowed well and (were) built on previous content – clear and easy to follow"; participants also liked the opportunity to "do it at my own pace."
We were particularly interested in feedback about the video demonstrations. Most (72%) respondents felt the course would not be as good without the videos. Most (64%) also felt the number of videos (28) was "about right," with most of the remainder (28%) indicating that they would have preferred fewer videos, noting that there was some redundancy, particularly in the latter sessions. This finding was supported in the number of video clips actually viewed: 90% or more of the videos were watched by only 40% of those who completed the CME questions for all sections. A few participants requested more videos, suggesting a repository of additional examples of challenging situations showing diverse (age/gender) clinicians and patients as an option for learners who desired more demonstrations. The vast majority of participants accessed the content including the videos without difficulty, though some complained that without a high speed internet connection, they did not like waiting for the videos to load.
In response to the questions of what they gained and how they intended to change their practice based on the course, participants provided qualitative feedback for most, but not all sections. None commented on what they'd learned or planned to change as a result of the sections on epidemiology or barriers to care. However, they reported greater confidence over all in addressing mental health issues: "less afraid to approach mental health issues" and "willing to address mental health issues more readily, collaborate better with family." Also, participants felt more confident about basic communication skills during visits: "Setting the tone in a mental health visit more appropriately," "how I introduce myself", "the way I go about setting an agenda," "more collaborative interactions," and "I will be more comfortable working with patients/families to set an agenda even if it means asking them to return to address topics we couldn't adequately cover in a single visit". They also reported gaining skills in reflective listening: "Restating what patient or parent have given as reason for appointment and asking them questions to expand that" and patient/family centered, collaborative care: "Build consensus toward plan of care" and "Involve family more in developing treatment plan."
The largest section of the course, illustrating the most demanding skills, was on managing negative interactions. This section also engendered several comments about what participants had learned and what they planned to do. For example, "I plan to utilize some of the worksheets and other web sites in having a plan when I deal with these issues (managing negative interactions)"; I plan to "use info about managing negative interactions, use pros and cons and other work sheets." Some specifically learned from the specific approach skills related to changing behavior; for example, one respondent reported plans to use "more reframing and helping to set measurable goals".
Participants also provided comments on what they liked most and what changes they would suggest to the course. Most liked the case scenarios, the concise practical explanations and the videos; one participant specifically commented that these situations are "just like my practice." Of those who completed the CME questions for all eight sections of the course, the favorite section was "Managing Negative Interactions." When asked what changes they would make to the curriculum, most respondents said "none" or left the question blank. Several requested written materials, a summary, or a workbook to accompany the on-line materials to use as a reference. Another wanted more video vignettes with variations in a repository. Several wanted the opportunity to review or update the materials regularly so as to better incorporate some of the behavioral changes. A few suggested minor wording changes to case questions or CME test questions. One participant wanted to do more work with children with mental health problems and requested additional on-line training in how to provide psychotherapy.
Discussion
These data demonstrate that it is feasible and desirable to provide an on-line course including brief video demonstrations of communication skills during pediatric visits that include mental health concerns. Response rates to on-line requests are typically approximately 1%; for the 300+ emails we sent, over 60 persons enrolled. Although the enrollment period was brief, enrollment exceeded the recruitment goal by 28%, and the course drew diverse clinicians (physicians, nurses, psychologists, social workers and others). The only technical problems related to the speed of downloading video vignettes for those that did not have high speed internet connections; none dropped out due to technical problems. The on-line course also appeared to be desirable. Feedback was positive, and the vast majority, even those who did not complete the CME questions for all the sections of the course, would recommend it to others.
Compared with in-person training, computer-based and internet-based training has shown comparable benefits for learners' knowledge; furthermore, over time, on-line training may become even more feasible and desirable. For example, in a randomized, controlled comparison, Davis, et al, found similar improvements in knowledge and attitude about evidence-based medicine for an in-person and computer-based course for postgraduate medical trainees [53]; computer-based learning has also proven effective for patient education, enhancing families' safety behaviors and adolescent physical activity, for example [54-56]. Using video clips, on-line training can improve learners' confidence and skills as well as knowledge [57]. As the next generation, which has grown up with the internet and internet-based learning (including undergraduate on-line courses offered through Blackboard®, and other providers), joins the health care professions, it is likely that on-line training will become even more desirable [58]. As internet connection and processing speeds continue to improve and as access increases, on-line training becomes even more feasible.
The course feedback provides valuable guidance for future on-line courses. For example, for courses geared toward clinicians who routinely provide mental health care, the sections on epidemiology of mental health problems and barriers to care could be omitted. On the other hand, if offered as a requirement to students or trainees who are less familiar with the clinical challenges and the need for services, these sections might well be included. For all learners, the course might be divided into one hour segments to allow learners to focus on the skills of most interest to them (e.g., developing an agenda versus discussing diagnosis and treatment versus managing negative interactions), to promote engagement and to encourage completion. Each smaller class might include reminders and deadlines to encourage completion. Furthermore, to sustain interest and engagement and reduce the burden on participants with slower internet connections, the number of video clips could be reduced, with others available through an on-line course resource area. The separate resource area could provide multiple video vignettes of the same basic skills demonstrated by different types of clinicians (age, race, gender, profession) as well as additional tools to facilitate communication and behavior change. Future courses should also provide written materials such as workbooks and study tools to accompany the on-line materials.
As a pilot project, this study had several limitations. First, the sample, although larger than anticipated, was still relatively small and self-selected. The short time frame may have excluded some potential enrollees. The self-selected sample makes it difficult to generalize conclusions to clinicians who are less interested in mental health issues. Future studies will need to enroll a larger and more diverse sample. Future courses will also need to create additional videos showing more diverse clinicians demonstrating the desired communication skills. Cost data were not collected; studies comparing the feasibility and costs of on-line versus in-person training will need to include such data. Furthermore, the follow-up period was quite brief and limited to self-report; physicians have a limited ability to self assess accurately [59]. Although self-reported confidence is associated with better identification of mental health problems [2], future studies should include observations of actual clinical behavior. Drop off in completing the CME questions was moderately high; because we did not specifically query non-completers, we are unsure of their reasons for not completing all of the CME questions and course evaluation questions. One possible reason is that the course was marketed as a beta-test soliciting feedback rather than as a formal curriculum. This conclusion is supported by the fact that 36 enrollees provided formal web-based feedback while only 15 completed the CME questions for all 8 sections; furthermore, several additional enrollees provided unstructured email feedback not included in the formal analysis here, suggesting that even more enrollees reviewed the material, but chose not to complete the CME questions or the formal on-line evaluation. The lower evaluation rate by physicians and nurses compared with psychologists and social workers further limits generalizability and suggests the need for more focused evaluation in different professional groups. It is possible that completion rates are hampered by factors in the course itself, its format, its length or its content or some factor in the participants or the short time period allowed for completion. Finally, this course concentrated on communication skills for mental health visits; future research might test feasibility and desirability of such courses for other challenging clinical communication settings such as patients with obesity, sexually transmitted diseases, domestic violence or child abuse.
Conclusion
Despite these limitations, these data provide a small but valuable first step for educators interested in improving clinicians' communication skills during pediatric visits that include a mental health concern. Although extensive in-person training is the standard, an on-line course on this topic is feasible and desirable. Additional research is needed to evaluate more objective outcomes (actual skills practiced, patient satisfaction, and clinical outcomes), to compare the costs and effectiveness of in-person versus on-line training, and to explore the feasibility of this format for other challenging communication settings in clinical practice.
Competing interests
The author(s) declare that they have no competing interests.
Authors' contributions
KK conceived of the on-line training, wrote all the modules, analyzed the data and drafted the manuscript.
JF conceived of the project, reviewed all modules, recruited participants and participated in revising the manuscript.
LW developed the in-person training on which the on-line curriculum is based, reviewed and revised the on-line content, and participated in drafting and revising the manuscript.
SS helped create video vignettes for the course, disseminated information about it to members of the NC Pediatric Society and participated in revising the manuscript.
All the authors have read and approved the final version of this manuscript.
Appendix – Example of a section within a module
Objective
By the end of the section on "Greetings", participants will be able confidently to greet patients and their family members/guardians appropriately. Specifically, an appropriate greeting includes:
• Tone of voice: warm and respectful
• Names: greet each person in the room by name
• Words: "I want to hear from all of you; who wants to go first?"
• Non-verbal behavior: handshake or gentle touch for each person, eye contact, posture facing speaker
Teaching Question for objective 4
Case: You are seeing a 16 year old girl, Nancy Verhoeff, who is brought to clinic by her mother, Ms. Brenda Verhoeff, for evaluation of chronic fatigue.
Question: While warmly and respectfully greeting Nancy and Ms. Verhoeff by name and asking which of them wants to go first in sharing their concerns, the best non-verbal behavior is to:
a. Efficiently review Nancy's chart while asking about the duration and severity of symptoms as well as precipitating and relieving factors.
b. Turn toward and keep looking at Nancy while you're talking so that Ms. Verhoeff gets the idea that Nancy is the primary concern and Nancy should do the talking now that she's 16 years old.
c. Shake hands with Ms. Verhoeff, but avoid touching Nancy until you start the physical examination to avoid touching that might be misinterpreted as sexual.
d. Shake hands with both Nancy and Ms. Verhoeff as you greet them. Turn toward whoever is speaking or the person to whom you are speaking; maintain eye contact with whomever is speaking or the person to whom you are speaking.
Preferred answer
Answer: d is the best answer. Shake hands with both Nancy and Ms. Verhoef as you greet them. Turn toward whoever is speaking or the person to whom you are speaking; maintain eye contact with whomever is speaking or the person to whom you are speaking.
Explanation:
People who are stressed are extremely attentive to subtleties in body language. Non-verbal behavior is an important way to convey respect and caring.
Clinicians should shake hands with adults and older children and lightly touch younger children on the arm or shoulder. In some cultures, it is considered inappropriate to touch a person on the head, so it is prudent to avoid touching children or infants on the head until you are familiar with the family and their customs and beliefs.
Clinicians should avoid staring at their clipboard (as in answer "a"), computer screen, the medical record, the clock on the wall or the floor while interacting with patients.
Instead, maintain eye contact with the speaker or the person to whom you are speaking. Again, there are cultural differences and distinctions must be made between respectful eye contact and staring.
Generally, if a clinician has a respectful and caring intention, his or her body language will reflect that intention. Similarly, if a clinician is distracted, thinking about a previous patient or a list of things to do, the lack of attention will be conveyed by body language.
Clinicians should ensure that their non-verbal behavior, like their words and tone of voice, reflect a respectful, patient-centered, calm, professional attitude of wanting to serve the best health interests of the patient.
Click < link not included in manuscript > to watch a video of a clinician using respectful non-verbal behavior.
Observe the clinician's behavior.
Reflect on what you observe. What do you think is done well or could be improved?
Click < link not included in manuscript > to find out what others say:
Please practice shaking hands or gently touching each person in the room in a culturally sensitive way. And practice maintaining eye contact.
Reflect, how long do you usually maintain eye contact before starting to look at elsewhere (e.g., notes, the clock, physical characteristics of the patient).
Consider practicing with a colleague or willing patient while being videotaped.
Pre-publication history
The pre-publication history for this paper can be accessed here:
Acknowledgments
Acknowledgements
Dr. Kemper was supported in part by the Duke Endowment, the NIH NCCAM K24AT002207 and by the Caryl Guth Fund for Holistic and Integrative Medicine at Wake Forest University School of Medicine. Dr. Foy was supported by the Duke Endowment. Dr. Wissow was supported by NIMH grant RO1 MH62469. We are grateful to Jessica Gobble and Chris Jones at NC Northwest AHEC for programming the web site and survey. We are grateful to Dr. Michael Lischke, director of NW AHEC and WFUSM CME for allowing NW AHEC to host the curriculum and for facilitating CME credit for participants.
Contributor Information
Kathi J Kemper, Email: kkemper@wfubmc.edu.
Jane M Foy, Email: foy.jane@gmail.com.
Larry Wissow, Email: lwissow@jhsph.edu.
Steve Shore, Email: ssncps@attglobal.net.
References
- Angold A, Costello EJ, Farmer EM, Burns BJ, Erkanli A. Impaired but undiagnosed. J Am Acad Child Adolesc Psychiatry. 1999;38:129–137. doi: 10.1097/00004583-199902000-00011. [DOI] [PubMed] [Google Scholar]
- Brown JD, Riley AW, Wissow LS. Identification of youth psychosocial problems during pediatric primary care visits. Adm Policy Ment Health. 2007;34:269–281. doi: 10.1007/s10488-006-0106-7. [DOI] [PubMed] [Google Scholar]
- Cassidy LJ, Jellinek MS. Approaches to recognition and management of childhood psychiatric disorders in pediatric primary care. Pediatr Clin North Am. 1998;45:1037–1052. doi: 10.1016/S0031-3955(05)70061-4. [DOI] [PubMed] [Google Scholar]
- Costello EJ. Child psychiatric disorders and their correlates: a primary care pediatric sample. J Am Acad Child Adolesc Psychiatry. 1989;28:851–855. doi: 10.1097/00004583-198911000-00007. [DOI] [PubMed] [Google Scholar]
- Williams J, Burwell S, Foy CG, Foy JM. Addressing behavioral health issues during well child visits by pediatric residents. Clin Pediatr (Phila) 2006;45:734–740. doi: 10.1177/0009922806292790. [DOI] [PubMed] [Google Scholar]
- Merritt KA, Thompson RJ, Jr., Keith BR, Johndrow DA, Murphy LB. Screening for behavioral and emotional problems in primary care pediatrics. J Dev Behav Pediatr. 1993;14:340–343. doi: 10.1097/00004703-199310000-00009. [DOI] [PubMed] [Google Scholar]
- Williams J, Klinepeter K, Palmes G, Pulley A, Foy JM. Diagnosis and treatment of behavioral health disorders in pediatric practice. Pediatrics. 2004;114:601–606. doi: 10.1542/peds.2004-0090. [DOI] [PubMed] [Google Scholar]
- Kelleher KJ, Campo JV, Gardner WP. Management of pediatric mental disorders in primary care: where are we now and where are we going? Curr Opin Pediatr. 2006;18:649–653. doi: 10.1097/MOP.0b013e3280106a76. [DOI] [PubMed] [Google Scholar]
- Wang PB., P; Olfson, M; Pincus, HA; Wells, KB; Kessler, RC Failure and delay in initial treatment contact after first onset of mental disorders in the National Comorbidity Survey replication. Arch Gen Psychiatry. 2006;62:603–613. doi: 10.1001/archpsyc.62.6.603. [DOI] [PubMed] [Google Scholar]
- WHO . Atlas: Child and Adolescent Mental Health Resources. Geneva , World Health Organization; 2005. [Google Scholar]
- Bernal P. Hidden morbidity in pediatric primary care. Pediatr Ann. 2003;32:413–8; quiz 421-2. doi: 10.3928/0090-4481-20030601-10. [DOI] [PubMed] [Google Scholar]
- Costello EJ, Shugart MA. Above and below the threshold: severity of psychiatric symptoms and functional impairment in a pediatric sample. Pediatrics. 1992;90:359–368. [PubMed] [Google Scholar]
- Kelleher KJ, McInerny TK, Gardner WP, Childs GE, Wasserman RC. Increasing identification of psychosocial problems: 1979-1996. Pediatrics. 2000;105:1313–1321. doi: 10.1542/peds.105.6.1313. [DOI] [PubMed] [Google Scholar]
- Briggs-Gowan MJ, Horwitz SM, Schwab-Stone ME, Leventhal JM, Leaf PJ. Mental health in pediatric settings: distribution of disorders and factors related to service use. J Am Acad Child Adolesc Psychiatry. 2000;39:841–849. doi: 10.1097/00004583-200007000-00012. [DOI] [PubMed] [Google Scholar]
- Leaf PJ, Alegria M, Cohen P, Goodman SH, Horwitz SM, Hoven CW, Narrow WE, Vaden-Kiernan M, Regier DA. Mental health service use in the community and schools: results from the four-community MECA Study. Methods for the Epidemiology of Child and Adolescent Mental Disorders Study. J Am Acad Child Adolesc Psychiatry. 1996;35:889–897. doi: 10.1097/00004583-199607000-00014. [DOI] [PubMed] [Google Scholar]
- Kramer T, Garralda ME. Psychiatric disorders in adolescents in primary care. Br J Psychiatry. 1998;173:508–513. doi: 10.1192/bjp.173.6.508. [DOI] [PubMed] [Google Scholar]
- Horwitz SM, Leaf PJ, Leventhal JM. Identification of psychosocial problems in pediatric primary care: do family attitudes make a difference? Arch Pediatr Adolesc Med. 1998;152:367–371. doi: 10.1001/archpedi.152.4.367. [DOI] [PubMed] [Google Scholar]
- Horwitz SM, Kelleher KJ, Stein RE, Storfer-Isser A, Youngstrom EA, Park ER, Heneghan AM, Jensen PS, O'Connor KG, Hoagwood KE. Barriers to the identification and management of psychosocial issues in children and maternal depression. Pediatrics. 2007;119:e208–18. doi: 10.1542/peds.2005-1997. [DOI] [PubMed] [Google Scholar]
- Leaf PJ, Owens PL, Leventhal JM, Forsyth BW, Vaden-Kiernan M, Epstein LD, Riley AW, Horwitz SM. Pediatricians' training and identification and management of psychosocial problems. Clin Pediatr (Phila) 2004;43:355–365. doi: 10.1177/000992280404300407. [DOI] [PubMed] [Google Scholar]
- Wissow LS, Larson S, Anderson J, Hadjiisky E. Pediatric residents' responses that discourage discussion of psychosocial problems in primary care. Pediatrics. 2005;115:1569–1578. doi: 10.1542/peds.2004-1535. [DOI] [PubMed] [Google Scholar]
- Gardner W, Kelleher KJ, Pajer K, Campo JV. Follow-up care of children identified with ADHD by primary care clinicians: A prospective cohort study. J Pediatr. 2004;145:767–771. doi: 10.1016/j.jpeds.2004.08.028. [DOI] [PubMed] [Google Scholar]
- Young HN, Bell RA, Epstein RM, Feldman MD, Kravitz RL. Types of information physicians provide when prescribing antidepressants. J Gen Intern Med. 2006;21:1172–1177. doi: 10.1111/j.1525-1497.2006.00589.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wissow LS, Roter DL, Wilson ME. Pediatrician interview style and mothers' disclosure of psychosocial issues. Pediatrics. 1994;93:289–295. [PubMed] [Google Scholar]
- Makoul G, Curry RH. The value of assessing and addressing communication skills. Jama. 2007;298:1057–1059. doi: 10.1001/jama.298.9.1057. [DOI] [PubMed] [Google Scholar]
- Epstein RM, Shields CG, Franks P, Meldrum SC, Feldman M, Kravitz RL. Exploring and validating patient concerns: relation to prescribing for depression. Ann Fam Med. 2007;5:21–28. doi: 10.1370/afm.621. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Roter DL, Hall JA, Kern DE, Barker LR, Cole KA, Roca RP. Improving physicians' interviewing skills and reducing patients' emotional distress. A randomized clinical trial. Arch Intern Med. 1995;155:1877–1884. doi: 10.1001/archinte.155.17.1877. [DOI] [PubMed] [Google Scholar]
- Tevyaw TO, Monti PM. Motivational enhancement and other brief interventions for adolescent substance abuse: foundations, applications and evaluations. Addiction. 2004;99 Suppl 2:63–75. doi: 10.1111/j.1360-0443.2004.00855.x. [DOI] [PubMed] [Google Scholar]
- Roter DL, Larson S, Shinitzky H, Chernoff R, Serwint JR, Adamo G, Wissow L. Use of an innovative video feedback technique to enhance communication skills training. Med Educ. 2004;38:145–157. doi: 10.1111/j.1365-2923.2004.01754.x. [DOI] [PubMed] [Google Scholar]
- Wissow LS, Gadomski A, Roter D, Larson S, Horn I, Bartlett E, Brown E, Zachary C, Luo X, Wang MC. A cluster-randomized trial of mental health communication skills for pediatric generalists. Pediatrics. 2007. [DOI] [PubMed]
- Fiscella K, Meldrum S, Franks P, Shields CG, Duberstein P, McDaniel SH, Epstein RM. Patient trust: is it related to patient-centered behavior of primary care physicians? Med Care. 2004;42:1049–1055. doi: 10.1097/00005650-200411000-00003. [DOI] [PubMed] [Google Scholar]
- Franks P, Fiscella K, Shields CG, Meldrum SC, Duberstein P, Jerant AF, Tancredi DJ, Epstein RM. Are patients' ratings of their physicians related to health outcomes? Ann Fam Med. 2005;3:229–234. doi: 10.1370/afm.267. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Korsch BM, Gozzi EK, Francis V. Gaps in doctor-patient communication. 1. Doctor-patient interaction and patient satisfaction. Pediatrics. 1968;42:855–871. [PubMed] [Google Scholar]
- Levinson W, Roter DL, Mullooly JP, Dull VT, Frankel RM. Physician-patient communication. The relationship with malpractice claims among primary care physicians and surgeons. Jama. 1997;277:553–559. doi: 10.1001/jama.277.7.553. [DOI] [PubMed] [Google Scholar]
- Howells RJ, Davies HA, Silverman JD. Teaching and learning consultation skills for paediatric practice. Arch Dis Child. 2006;91:367–370. doi: 10.1136/adc.2005.073775. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shaw JR. Four core communication skills of highly effective practitioners. Vet Clin North Am Small Anim Pract. 2006;36:385–96, vii. doi: 10.1016/j.cvsm.2005.10.009. [DOI] [PubMed] [Google Scholar]
- Wissow LS. Communication and malpractice claims--where are we now? Patient Educ Couns. 2004;52:3–5. doi: 10.1016/j.pec.2003.11.004. [DOI] [PubMed] [Google Scholar]
- Alexander SC, Keitz SA, Sloane R, Tulsky JA. A controlled trial of a short course to improve residents' communication with patients at the end of life. Acad Med. 2006;81:1008–1012. doi: 10.1097/01.ACM.0000242580.83851.ad. [DOI] [PubMed] [Google Scholar]
- Egnew TR, Mauksch LB, Greer T, Farber SJ. Integrating communication training into a required family medicine clerkship. Acad Med. 2004;79:737–743. doi: 10.1097/00001888-200408000-00004. [DOI] [PubMed] [Google Scholar]
- Hart CN, Drotar D, Gori A, Lewin L. Enhancing parent-provider communication in ambulatory pediatric practice. Patient Educ Couns. 2006;63:38–46. doi: 10.1016/j.pec.2005.08.007. [DOI] [PubMed] [Google Scholar]
- Ang M. Advanced communication skills: conflict management and persuasion. Acad Med. 2002;77:1166. doi: 10.1097/00001888-200211000-00034. [DOI] [PubMed] [Google Scholar]
- Bragard I, Razavi D, Marchal S, Merckaert I, Delvaux N, Libert Y, Reynaert C, Boniver J, Klastersky J, Scalliet P, Etienne AM. Teaching communication and stress management skills to junior physicians dealing with cancer patients: a Belgian Interuniversity Curriculum. Support Care Cancer. 2006;14:454–461. doi: 10.1007/s00520-005-0008-3. [DOI] [PubMed] [Google Scholar]
- Towle A, Hoffman J. An advanced communication skills course for fourth-year, post-clerkship students. Acad Med. 2002;77:1165–1166. doi: 10.1097/00001888-200211000-00033. [DOI] [PubMed] [Google Scholar]
- Wagner PJ, Lentz L, Heslop SD. Teaching communication skills: a skills-based approach. Acad Med. 2002;77:1164. doi: 10.1097/00001888-200211000-00031. [DOI] [PubMed] [Google Scholar]
- Merckaert I, Libert Y, Delvaux N, Marchal S, Boniver J, Etienne AM, Klastersky J, Reynaert C, Scalliet P, Slachmuylder JL, Razavi D. Factors influencing physicians' detection of cancer patients' and relatives' distress: can a communication skills training program improve physicians' detection? Psychooncology. 2007. [DOI] [PubMed]
- Butow P, Cockburn J, Girgis A, Bowman D, Schofield P, D'Este C, Stojanovski E, Tattersall MH. Increasing oncologists' skills in eliciting and responding to emotional cues: evaluation of a communication skills training program. Psychooncology. 2007. [DOI] [PubMed]
- Badger L, Robinson H, Farley T. Management of mental disorders in rural primary care: a proposal for integrated psychosocial services. J Fam Pract. 1999;48:813–818. [PubMed] [Google Scholar]
- Glazebrook RM, Harrison SL. Obstacles and solutions to maintenance of advanced procedural skills for rural and remote medical practitioners in Australia. Rural Remote Health. 2006;6:502. [PubMed] [Google Scholar]
- Beal T, Kemper KJ, Gardiner P, Woods C. Long-term impact of four different strategies for delivering an on-line curriculum about herbs and other dietary supplements. BMC Med Educ. 2006;6:39. doi: 10.1186/1472-6920-6-39. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kemper KJ, Amata-Kynvi A, Sanghavi D, Whelan JS, Dvorkin L, Woolf A, Samuels RC, Hibberd P. Randomized trial of an internet curriculum on herbs and other dietary supplements for health care professionals. Acad Med. 2002;77:882–889. doi: 10.1097/00001888-200209000-00014. [DOI] [PubMed] [Google Scholar]
- Kemper KJ, Gardiner P, Gobble J, Mitra A, Woods C. Randomized Controlled Trial Comparing Four Strategies for Delivering e-Curriculum to Health Care Professionals [ISRCTN88148532] BMC Med Educ. 2006;6:2. doi: 10.1186/1472-6920-6-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hahm JS, Lee HL, Kim SI, Shimizu S, Choi HS, Ko Y, Lee KG, Kim TE, Yun JW, Park YJ, Naoki N, Koji O. A remote educational system in medicine using digital video. Hepatogastroenterology. 2007;54:373–376. [PubMed] [Google Scholar]
- Mutter D, Rubino F, Temporal MS, Marescaux J. Surgical education and Internet-based simulation: The World Virtual University. Minim Invasive Ther Allied Technol. 2005;14:267–274. doi: 10.1080/13645700500243927. [DOI] [PubMed] [Google Scholar]
- Davis J, Chryssafidou E, Zamora J, Davies D, Khan K, Coomarasamy A. Computer-based teaching is as good as face to face lecture-based teaching of evidence based medicine: a randomised controlled trial. BMC Med Educ. 2007;7:23. doi: 10.1186/1472-6920-7-23. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gielen AC, McKenzie LB, McDonald EM, Shields WC, Wang MC, Cheng YJ, Weaver NL, Walker AR. Using a computer kiosk to promote child safety: results of a randomized, controlled trial in an urban pediatric emergency department. Pediatrics. 2007;120:330–339. doi: 10.1542/peds.2006-2703. [DOI] [PubMed] [Google Scholar]
- Vandelanotte C, Spathonis KM, Eakin EG, Owen N. Website-delivered physical activity interventions a review of the literature. Am J Prev Med. 2007;33:54–64. doi: 10.1016/j.amepre.2007.02.041. [DOI] [PubMed] [Google Scholar]
- Haerens L, Deforche B, Vandelanotte C, Maes L, De Bourdeaudhuij I. Acceptability, feasibility and effectiveness of a computer-tailored physical activity intervention in adolescents. Patient Educ Couns. 2007;66:303–310. doi: 10.1016/j.pec.2007.01.003. [DOI] [PubMed] [Google Scholar]
- Harris JM, Jr., Kutob RM, Surprenant ZJ, Maiuro RD, Delate TA. Can Internet-based education improve physician confidence in dealing with domestic violence? Fam Med. 2002;34:287–292. [PubMed] [Google Scholar]
- Sandars J, Morrison C. What is the Net Generation? The challenge for future medical education. Med Teach. 2007;29:85–88. doi: 10.1080/01421590601176380. [DOI] [PubMed] [Google Scholar]
- Davis DA, Mazmanian PE, Fordis M, Van Harrison R, Thorpe KE, Perrier L. Accuracy of physician self-assessment compared with observed measures of competence: a systematic review. Jama. 2006;296:1094–1102. doi: 10.1001/jama.296.9.1094. [DOI] [PubMed] [Google Scholar]