Abstract
Background
Young people (aged 16-24 years) with long-term health conditions can disengage from health services, resulting in poor health outcomes, but clinicians in the UK National Health Service (NHS) are using digital communication to try to improve engagement. Evidence of effectiveness of this digital communication is equivocal. There are gaps in evidence as to how it might work, its cost, and ethical and safety issues.
Objective
Our objective was to understand how the use of digital communication between young people with long-term conditions and their NHS specialist clinicians changes engagement of the young people with their health care; and to identify costs and necessary safeguards.
Methods
We conducted mixed-methods case studies of 20 NHS specialist clinical teams from across England and Wales and their practice providing care for 13 different long-term physical or mental health conditions. We observed 79 clinical team members and interviewed 165 young people aged 16-24 years with a long-term health condition recruited via case study clinical teams, 173 clinical team members, and 16 information governance specialists from study NHS Trusts. We conducted a thematic analysis of how digital communication works, and analyzed ethics, safety and governance, and annual direct costs.
Results
Young people and their clinical teams variously used mobile phone calls, text messages, email, and voice over Internet protocol. Length of clinician use of digital communication varied from 1 to 13 years in 17 case studies, and was being considered in 3. Digital communication enables timely access for young people to the right clinician at the time when it can make a difference to how they manage their health condition. This is valued as an addition to traditional clinic appointments and can engage those otherwise disengaged, particularly at times of change for young people. It can enhance patient autonomy, empowerment and activation. It challenges the nature and boundaries of therapeutic relationships but can improve trust. The clinical teams studied had not themselves formally evaluated the impact of their intervention. Staff time is the main cost driver, but offsetting savings are likely elsewhere in the health service. Risks include increased dependence on clinicians, inadvertent disclosure of confidential information, and communication failures, which are mostly mitigated by young people and clinicians using common-sense approaches.
Conclusions
As NHS policy prompts more widespread use of digital communication to improve the health care experience, our findings suggest that benefit is most likely, and harms are mitigated, when digital communication is used with patients who already have a relationship of trust with the clinical team, and where there is identifiable need for patients to have flexible access, such as when transitioning between services, treatments, or lived context. Clinical teams need a proactive approach to ethics, governance, and patient safety.
Keywords: digital communication, long-term conditions, young people, digital health care, patient communication, NHS, National Health Service
Introduction
Young people living with long-term conditions are vulnerable to disengagement from health care, which endangers their current and future health [1-5]. Health service factors affecting young peoples’ engagement with health care include poor patient-clinician communication, inflexible access to people and information, lack of person-centered health care, and the need for continuity and relationship development [2,6-9].
In the United Kingdom, 90% of young people aged 16-24 years own a smartphone [10]. Studies have reported requests from young people to be able to communicate via email, text message, and social media with their health care team [6,11]. There are reports of specialist clinical teams using digital channels for monitoring and information sharing [12,13]. In the United Kingdom, government policy and investment is driving the digitization of the National Health Service (NHS) [14,15]. With the rollout of NHSmail 2 [16], NHS clinicians now have access to secure email and other digital channels for communicating with patients on clinical matters.
Evidence for effectiveness on health outcome of the use of digital channels with patients on clinical matters is not strong. Prior to starting our project, we found 16 systematic reviews [17-32] and 1 clinical review [33] published from 2010 to 2012 on the effectiveness of digital communication between clinicians and patients with long-term conditions, where the long-term condition was relevant to young people (only 2 reviews focused on young people [25,32]). Evidence of an impact on clinical outcomes was equivocal, although no trials reported poorer outcomes in the intervention arm. The reporting of interventions was generally poor. The systematic reviews identified the following gaps in evidence: how digital communication might work [19,21,27,30,33,34], in particular examining the function of the communication rather than the communication channel [33]; what was important to patients and clinicians [19,20,22,23,25-27,32,33,35]; cost and resource use [17,19,21,23,25,27-29]; risks including privacy and data security [19,22,23,27,33]; the need to focus on widely used digital communication rather than being future focused [29]; and research to inform policy, practice, and implementation or rollout [21,22,28].
Given the poor quality of the evidence, and the gaps in the evidence about how digital communication might work, its value to patients and clinicians, and its cost and risks, we had the following aims. First, we wanted to identify how the use of digital channels for communication between young people and their clinicians was addressing the health service factors influencing young people’s engagement with health care, and the perceived impact and value of the digital communication. Second, we aimed to identify cost, ethical, and patient safety issues that need to be considered in the NHS policy-driven rollout of digital communication. To meet both these aims, we studied NHS clinicians and young people with long-term conditions requiring specialist care, who were already using, or considering using, digital channels for communication about clinical issues, where the communication was two-way (synchronous or asynchronous), and where both the clinician and the young person could be mobile.
Methods
This was an observational mixed-methods study of cases [36] undertaken in the UK NHS, where services are free at the point of delivery.
Case Study Sampling
We used multiple strategies to identify clinical teams. First, between December 2013 and February 2014, using Google (Google Inc, Mountain View, CA, USA), we searched the Internet for reports of the use of digital communication with patients in the NHS using the keywords “e-health,” “telehealth,” “telemedicine,” “digital communication,” “young people,” and “young persons.” We scrutinized the first 35 pages of each search for relevant reports. Further information was then sourced from individual NHS Trust websites, documents, and reports and by contacting key individuals. Second, we listed the project on the UK National Institute for Health Research (NIHR) portfolio inviting participation. Third, we contacted clinicians we knew personally or had encountered at applied health conferences and asked them to distribute information about the project to their networks. Fourth, clinical teams expressing interest in the study were asked to pass on the study information to potentially interested colleagues.
Study inclusion criteria were that (1) the clinical team was providing specialist care for young people (age 16-24 years) with long-term conditions (eg, sickle cell, liver disease, cystic fibrosis, cancer, or mental health issues), (2) the team had interest in the use of two-way digital communications with the young people, and (3) the long-term condition had considerable cost implications for the NHS.
We sampled 20 teams purposively for diversity of clinical condition, use of digital communication with patients, size, and geographic location. Studying 20 teams ensured both diversity and anonymity of study teams. Anonymity was important as; at the time of undertaking the study, some study teams may have been in breach of information governance policies.
We obtained ethical approval (14/WM/0066) from National Research Ethics Service Committee West Midlands - The Black Country.
Data Collection
We collected data between November 2014 and March 2016. Prior to commencing fieldwork with each clinical team, we requested to see any in-house evaluations of their digital communication with patients that they had done. During recruitment of clinical teams, some teams mentioned that they were using digital channels without formal approval from their Trust. We therefore sought to interview the Trust information governance specialist before collecting data from any clinical teams.
To understand how digital clinical communication was used, including its perceived impact, and to identify issues related to ethics and patient safety, we observed and interviewed clinical team members at all study sites. We collected data within a 2-week data collection period during the team’s day-to-day work, recruiting as many team members as were prepared to participate. To explore the cost of using digital communication with patients, we collected data on equipment and clinician time spent on the use of digital communication with patients and its cost. To gather these data, we developed a questionnaire based on early interview data and used this as part of clinical team interviews.
We also recruited for interview young people aged 16-24 years under the care of the clinical team and due to be seen by the team during the 2-week data collection period. The young people were sent study information prior to their scheduled encounter. The clinical team or the study researcher approached each young person at the scheduled encounter—usually before the appointment time—to take consent and confirm interview arrangements. Those not attending were further contacted to request participation. At the interview, we asked the young people about their use of digital communication with the clinical team, its impact on their day-to-day life and ability to manage their health condition, and ethical and safety issues. To explore the value young people placed on digital access to their clinical team, we asked them what they would be willing to pay for the service. Young people were each offered a £20 store voucher as a thank-you token. Interviews used any communication channel preferred by the participant, such as phone, in person, or email. We recruited for interview until we were confident we were not gaining any new data from the young people on their experience and views of the use of digital communication with clinicians at their clinic.
Data Management and Analysis
Observation notes were taken, and then typed up and expanded immediately after observation. Interviews were audio-recorded or notes taken, typed up, and expanded. We made reflective notes after each observation or interview. Recordings were transcribed and checked for accuracy. All identifiers were removed, and data were identified with a site and participant number. Independent coding was undertaken on 20% of all coding, and discrepancies were discussed. Quality checks were undertaken on data entry of survey data.
We coded all qualitative data for the major prespecified analysis themes related to our aims: (1) how digital communication with patients is used and its perceived impact, (2) the value of the communication to young people, (3) its ethical impact, and (4) patient safety and governance issues and their mitigation. Within these coded data, we undertook (1) further analysis identifying the mechanisms by which the digital communication had an immediate impact, and its context [37], (2) thematic analysis [38], (3) thematic analysis informed by theory [39], and (4) thematic analysis with an established safety framework [40].
Using staff questionnaire data, we calculated, for each respondent, the annual direct costs associated with digital communication with patients. We used NHS Agenda for Change pay scales 2014-2015 [41] for salaries and University of Warwick information technology service price lists for employer-provided equipment, annualized assuming a 3-year life span and a discount rate of 3.5% [42]. We estimated total costs at each site where over 50% of clinical team members responded to the survey. Where data permitted, we estimated cost per patient based on the size of each clinic’s patient list.
Patient, Public, and Stakeholder Involvement
We explored early research ideas with an experienced Patient, Public, and Stakeholder Involvement group with which we had worked for over 10 years (Warwick Diabetes Research and Education User Group). Subsequently, to gain input from young people, 20 students (15-17 years of age) from 5 local schools collected opinions from their peers and reported this as a film [43]. Patient, Public, and Stakeholder Involvement coapplicant and coauthor JF drew on this to advise the project team about collecting data from the young people living with long-term conditions. He subsequently chaired the project management group. This group included 4 young adults and a parent of a young person living with a long-term condition, and representation from NHS Digital (UK Department of Health, Leeds, UK). They advised on recruitment, data collection procedures, analysis, and impact strategies.
Each clinical team is receiving a copy of the project report. Study results in the form of Quick Reference Guides [44] are being disseminated to patient support and advocacy groups, professional organizations, and all NHS Trusts, Health Boards, and Clinical Commissioning Groups.
Results
Study Sites and Participants
We identified 104 clinical teams (via Internet search, 15; NIHR portfolio, 7; networks and contacts, 58; contacts of already interested clinical teams, 24), of which 47 were eligible and interested in participating (see Figure 1). We initiated site setup at 25 sites and studied 20, covering 13 clinical specialties (see Table 1). Clinic populations included children and adolescent services, transition services, young adult services, and adult services. There were 9 clinical teams in the South and East of England, 7 in the Midlands, 3 in the North of England, and 1 in Wales. At recruitment, clinical teams variously reported using with their young people the following communication channels: mobile phone calls, text messages, email, voice over Internet protocol, and personal health records. A total of 3 clinical teams used no digital communication with their young people.
Table 1.
Site identifier | Clinic populationa | Patient age range (years) |
Digital communication channels used in clinic |
No. of young people interviewed |
No. of staff interviewed |
No. of information governance specialists interviewed |
No. of staff shadowed |
Diabetes 1 | Transition | 12-19 | Mobile phone, text message, email | 12 | 8 | 0 | 5 |
Mental Health 1 (Early Intervention) | Age independent | >16 | Mobile phone, text message, email | 1 | 8 | 1 | 2 |
Cystic Fibrosis 1 | Adult | >16 | 2 | 5 | 1 | 1 | |
Dermatology | Adult | >18 | 7 | 4 | 0 | 2 | |
Mental Health 2 (CAMHSb) | Child and adolescent | <18 | None | 4 | 11 | 1c | 4 |
Mental Health 3 (Outreach team) | Child and adolescent | <18 | Mobile phone, text message, VoIPd | 5 | 11 | 1 | 3 |
Arthritis | Transition | 16-25 | None | 16 | 8 | 1 | 1 |
Cystic Fibrosis 2 | Adult | >16 | Mobile phone, text message, VoIP | 13 | 11 | 0 | 3 |
School nurse service | Young people | 14-19 | Text message, VoIP (pilot) | 0 | 7 | 1 | 4 |
Kidney | Young adult | 16-22 | 7 | 7 | 0 | 3 | |
Liver | Transition | 12-25 | Text message, email | 15 | 12 | 2 | 7 |
Sickle Cell | Transition | 12-24 | Mobile phone, text message | 10 | 13 | 2 | 9 |
Mental Health 4 (Early Intervention in Psychosis Team) | Youth | 14-35 | Mobile phone, text message, email | 4 | 9 | 2 | 8 |
Cancer 1 | Teenage and young adult | 15-24 | Mobile phone, text message, email | 12 | 7 | 0 | 3 |
Diabetes 2 | Transition | 16-25 | Mobile phone, VoIP | 11 | 6 | 2 | 2 |
Inflammatory Bowel Disease 1 | Adult | >16 | Web portal, email | 1 | 6 | 1 | 3 |
Inflammatory Bowel Disease 2 | Adolescent | 13-23 | 13 | 7 | 0 | 4 | |
HIVe | Adult | >18 | None | 9 | 12 | 0 | 4 |
Sexual Health | Adult and young people | >16 | Testing kits ordered online | 12 | 10 | 0 | 3 |
Cancer 2 | Teenage and young adult | 15-24 | Mobile phone, text message, email | 11 | 11 | 2 | 8 |
aAs described by clinic staff.
bCAMHS: Child and Adolescent Mental Health Services.
cInformation governance specialist was the same person as for Mental Health 1.
dVoIP: voice over Internet protocol.
eHIV: human immunodeficiency virus.
We recruited for interview 165 young people. Interviews were undertaken by phone (n=82), face-to-face (n=41), email (n=35), Facebook (n=4), Skype (n=2), and text message (n=1). Speech-based interviews lasted 20-60 minutes, with the majority lasting approximately 30 minutes. Text message-based interviews took up to 2 weeks.
We recruited 16 information governance specialists and 173 clinical team members for interview. The clinicians included consultants, registrars, community nurses, advanced nurse practitioners, psychologists, dietitians, physiotherapists, occupational therapists, and pharmacists (7 interviews were with clinic administrators closely involved with patient care). Interviews were undertaken face-to-face (n=158) or by phone (n=31) and lasted up to 2 hours, with the majority lasting approximately 45 minutes. We shadowed 79 clinical team members, usually for 1-2 hours, longer if appropriate (eg, when observing home visits with a clinician). Of the 173 clinical team members, 115 completed staff health economic questionnaires across 18 sites.
Timely Digital Contact Between Young People and Their Clinical Team
Young people and clinicians mostly used digital channels to be in contact at times when the contact could make a difference to how the young people managed their condition. This timely access was not scheduled, although clinicians often planned their contacts.
The channels of communication used for this timely access varied across clinical teams (see Table 1) and according to the reason for making contact. Mobile phones were used for urgent issues and when discussion was needed to resolve the clinical problem. Text messaging was used for keeping in touch, raising less-urgent concerns such as new symptoms or changing trends in home monitoring (eg, blood sugars), personal reminders about upcoming appointments, and reminders about therapy. Additional clinical team members used text messaging to make direct contact with young people where parents were involved in a young person’s treatment, as this allowed issues to be raised that would not be raised in front of parents. Email was useful for sending complex information and summaries of discussion at a consultation, as the young people were then able to read and reread the information, and for sending test results where the results were routine or as expected and the individual was well known to the service. The young people emailed questions such as how to use a skin cream or fix equipment, concerns such as suitability of vaccinations for travel, photographs of their condition, such as a rash, and requests for supplies.
Although the clinical teams we studied were motivated to use timely digital communication with their young people to improve their health outcome, none of the clinical teams had evaluated the impact of its use on health outcome. However, our data revealed many mechanisms by which timely digital access improved health care and so had the potential to improve health outcome. Young people and clinicians reported that timely digital communication enhanced engagement, reduced patient anxiety, and improved trust between the young people and their clinicians. Young people felt they received personalized care and valued the continuity of care they received by being able to contact the clinicians who knew them when they needed to. The timely access prompted activation and better self-management by the young people:
I sort of just avoided doing anything really and just thought it might sort itself. But...I do need to accept the help that’s out there for me...it’s a lot better just being able to speak over email and then when you do need a test done you’re only going into your doctors every four or five months, if that.
Young person 06, Diabetes 2
I can email them anytime, I can get a response anytime and sort it out myself.
Young person 07, Inflammatory Bowel Disease 2
Young people who were already engaged with their clinical team sometimes used email or text messaging to communicate about sensitive issues that they found difficult to raise face-to-face, knowing that the email or text message would prompt the clinician to raise the issue when they saw them. Some disengaged young people reengaged with their clinical team via email or text message when the young person had not responded to phone calls or regular mail.
Young people and clinicians reported examples of where timely digital communication had been used to diagnose minor issues, sometimes avoiding unnecessary clinic visits, or to treat symptoms before they became serious, thus avoiding the need for emergency care.
Timely digital access was considered, by both young people and their clinicians, to be a valuable addition to traditional clinic appointments, not a replacement. Face-to-face communication was considered important for establishing relationships and for conveying bad or potentially upsetting news. The use of digital channels for routine issues and exchange of information between appointments left more time in clinic appointments for complex issues, and so increased the value of the face-to-face consultations for both the young people and clinicians.
Digital communication was convenient for the clinicians and young people, as it avoided disruption to their other activities and sometimes avoided unnecessary consultations. The use of asynchronous communication such as email and text messaging allowed them to think about their questions or responses. Clinicians liked the opportunity to consult clinical records before responding, although where a clinician knew the patient well they did not always do this.
Value to the Young People and Cost to the NHS of Timely Digital Access
A total of 110 of the 165 young people answered the exploratory question on their willingness to pay for digital communication with their clinical team. The median willingness to pay was £5 per month (interquartile range £0-£16, maximum £120). A total of 27 young people reported being willing to pay £30 or more per month, 35 were willing to pay between £0 and £30, 30 would not be willing to pay extra, and 18 were unable or unwilling to answer this question. The reasons young people gave for wanting the service mostly related to resolving problems quickly, such as an issue with self-injection; enabling easier contact with a named clinician for continuity of care; and saving time travelling to a clinic to report progress and to hear or provide results.
Young people from one mental health site objected to the question on the basis that the service should be free, or because of a perception that payment would be discriminatory if applied only in their service. Those not willing to pay were not currently using digital channels for communicating with their clinical team, even where they were available, and thought that conventional channels could be used just as well.
Our exploratory data indicated that the mean time spent by staff per day using digital channels to communicate with young people was 76 minutes (median 45 minutes, interquartile range 0-120 minutes). The mean and median times were not typical levels of activity (see Figure 2): 33 of 115 staff (28.7%) reported using digital communication with patients “rarely” or “never,” and 25 staff (21.7%) reported using it for over 2 hours per day. Use varied by grade and profession. Medical consultants reported substantially lower use (mean time 28 minutes per day) than nurses (120 minutes per day) and physiotherapists (120 minutes per day), but consultants’ use was similar to that of dietitians (14 minutes per day) and psychologists (34 minutes per day). The major cost for providing digital communication between clinic appointments was staff time (see Table 2). Staff time was typically 90%-95% of total cost. For sites where the clinic was able to provide the size of their patient list so that cost per patient could be calculated, the reported figure was between £0 and £20 per month, with the exception of the 2 cystic fibrosis sites, where costs per patient were much higher (£73-£130).
Table 2.
Site | No. of health economic questionnaires completed | Cost per month (£) | |||
|
|
Clinical team cost | Equipment cost | Total cost | Average cost per patient |
Cancer 1 | 5 | 2920 | 97 | 3017 | N/Aa |
Mental Health 3 (Outreach team) | 8 | 9230 | 330 | 9560 | N/A |
Arthritis | 8 | 0 | 0 | 0 | 0 |
Kidney | 6 | 135 | 26 | 161 | 16 |
Diabetes 1 | 6 | 2648 | 85 | 2733 | 4 |
Cystic Fibrosis 1 | 11 | 5323 | 383 | 5706 | 73 |
Sexual Health | 10 | 3673 | 120 | 3793 | N/A |
HIVb | 9 | 1055 | 51 | 1106 | N/A |
Cancer 2 | 11 | 6090 | 267 | 6357 | N/A |
Inflammatory Bowel Disease 1 | 7 | 3604 | 26 | 3630 | 3 |
Mental Health 2 (CAMHSc) | 6 | 212 | 18 | 230 | 2 |
Liver | 7 | 3806 | 71 | 3877 | N/A |
Inflammatory Bowel Disease 2 | 4 | 2672 | 63 | 2735 | N/A |
Cystic Fibrosis 2 | 3 | 1490 | 69 | 1559 | 130 |
Dermatologyd | 2 | – | – | – | – |
Mental Health 4 (Early Intervention in Psychosis Team)d | 4 | – | – | – | – |
Sickle Celld | 6 | – | – | – | – |
Diabetes 2d | 2 | – | – | – | – |
aN/A: not available.
bHIV: human immunodeficiency virus.
cCAMHS: Child and Adolescent Mental Health Services.
dInsufficient data to calculate clinic costs.
Most staff reported that their workload was manageable. When asked what they would do without digital communication, they said they would spend time trying to contact young people by phone or arranging appointments for them. However, staff did not report that digital communication reduced their workload overall, and several reported an increase.
From the qualitative data we identified mechanisms by which NHS costs may be reduced through the use of digital communication with patients. These were a follows:
Reducing costly complications of illness through early treatment
Reducing the number of appointments young people had to attend
Reducing “did not attend” rates
Responding to queries, for example, for young people with sickle cell, to avoid a visit to an emergency department
Improving response to therapy through provision of advice and support, so reducing future health care cost.
Managing Access Through Digital Channels
Although the ease of access that digital channels allowed was appreciated by both young people and clinicians, both were aware of the need to manage expectations. These were still being worked out by some clinical teams and their young people. Clarity about response times, working hours, and the channels of communication suitable for different purposes was considered important. Young people and clinicians wanted this information to be easily available through email and text messages, bounce-back messages, and voicemail and to be reinforced during consultations and communications. Clinical teams reported response times between a few minutes to a few days, depending on the health condition and channel of communication. Poor network coverage in some rural areas and the cost to young people of digital communication were identified as limiting digital access for some young people.
Ethical Impact of the Use of Timely Digital Communication
Digital communication has the potential to both enhance and undermine patient autonomy. Clinicians explained that it increased patient autonomy [45] by giving the young people more control in both the management of their condition and the way in which they communicated with their clinical team. But they also noted that it may discourage some young people from taking responsibility for their own health by providing easy access to a decision maker. Young people placed more emphasis on the personalization of their care with digital communication than on increased empowerment. The ability to have more frequent contact with a specific clinician meant the clinician was more likely to know that particular young person, their circumstances, and what is important to them, so enabling the clinician to deliver person-centered care [46]:
Your relationship with the nurse is a lot easier...because they know you and they know your condition...[rather]than just another nurse that you come to see. They understand how yours is different to everybody else’s.
Young person 04, Diabetes 1
Communicating digitally reduced the power imbalance in the patient-clinician relationship, with clinicians fitting into the young person’s world rather than the young person being expected to fit into the clinical world. However, there were consequences for clinician autonomy. Clinicians expressed concerns about blurring of the patient-clinician boundary:
[The patient]started sending me huge numbers of emails and chasing me a lot...I had to then think about what’s a reasonable time frame for getting back to[the patient].
Consultant 04, Mental Health 3
Another concern was losing control over clinician information; one clinician reported how their patient had put the clinician’s text messages out on social media.
The concept of a duty of care to an individual patient is enshrined in professional codes and common law [42,47]. The development of a more personalized relationship through digital communication created uncertainty for both patient and clinician about their understanding of the duty of care and its limits. Clinicians described their concerns about the patient’s use of text messaging or email for communication about serious health concerns outside of the clinic’s normal working hours. They were unsure where the boundary was to the duty of care:
I was worried she [the patient] was going to do something dangerous like commit suicide or something, because she has mental health issues. And then felt awful the fact that I’d given her my email as a point of contact and then she’d reached out but it was two o’clock in the morning and of course I hadn’t picked it up.
Clinical team member 01, Liver Disease
However, across all sites, few participants were able to recall an instance where a patient had left an urgent communication that was not picked up in a timely manner.
There is an implied promise at the heart of the patient-clinician relationship that information disclosed to the clinician by the patient, or gained in the process of that patient’s care, will not be disclosed to others without the patient’s consent. Young people varied in their level of understanding of, and concern about, confidentiality and privacy. Clinicians were usually cautious about sending confidential data digitally, and many distinguished between a clinician sending information to the young person (risk of breach of confidentiality) and the young person sending data to the clinician (young person’s choice and their responsibility).
Patient Safety
In addition to the inadvertent disclosure of sensitive information discussed above, our data revealed three other major categories of hazards from the use of timely digital communication between young people and their clinical team: communication failures; failure to record the content of the communication; and failure to consult the patient’s notes prior to engaging in communication. Table 3 summarizes the causes, consequences, and current form of mitigation of these hazards. These hazards are common to all forms of clinical communication, but the ease and speed of use of digital channels magnifies the risks.
Table 3.
Hazard | Consequences | Causes | Current form of mitigation |
Inadvertent disclosure of sensitive information | Negative effects on patient wellbeing; jeopardizing trust between clinician and patient | Hacking, interception of communication, loss or theft of hardware, poor usability of encrypted mail service, shared email accounts and computers, sending communication to wrong recipient, excessive distribution of communication | Limiting the use of digital communication; technical solutions; double-checking contact details; ensuring explicit or implicit patient consent |
Communication failures | Failure or delay in providing relevant clinical information and advice; patients discouraged from seeking relevant advice; delays in escalation to emergency care; unnecessary escalation to emergency care; patient uncertain or anxious; clinician stressed or anxious | Not answering communication from unknown numbers, not being able to establish the patient’s identity, delay in picking up or responding to messages, inability to access the Internet on mobile phones due to lack of signal or credit, poor usability of devices, difficulty expressing clearly information requests in text messages, patients downplaying seriousness of their condition in text messages, difficulty of checking correct understanding of communication content using asynchronous channels | Limiting the use of digital communication; clinician training in use of asynchronous digital channels with patients; planning for sufficient time to write and read digital communication carefully; using alternative means of emergency advice seeking; following up using a different communication channel |
Failure to record content of digital communication | Other clinicians unaware of prior communication; unnecessary duplication of questions and advice given to patients; gaps in clinical record; lack of clarity for patients and clinicians about what was communicated | Digital communication not logged automatically; content of text and email messages not easily transferred to clinical notes; time consuming to record all digital communication; limited storage on communication device; lack of common understanding of how to document content of digital communication in clinical record | Treating every communication as equivalent to a face-to-face consultation; limiting the use of digital communication to forms readily integrated with patient’s clinical record; restricting the use of digital communication |
Failure to consult patient’s notes prior to engaging in digital communication | Reliance on an incomplete understanding of patient’s clinical history; duplicate or contradictory advice giving | Perceived familiarity with the patient because of frequent contact; acute problem requiring urgent response; nonclinical nature of many of the digital communications between young person and clinician | Familiarity with the patient; double-checking notes after the communication has taken place |
Information governance specialists expressed a willingness to support their clinical teams in using digital communication to improve health care. They are also required to monitor adherence to NHS Trust policy. Of the 16 information governance specialists interviewed, 13 reported the existence of policies in their organizations that specifically covered text messaging, emailing, and the use of handheld mobile devices. They recognized that policies need to evolve as digital communications evolve, with a majority of those interviewed currently developing policies. A few Trusts did not permit digital communication with patients, and some information governance specialists in these Trusts were aware that it was nonetheless taking place. During their interviews, information governance specialists discussed the hazards of digital communication with patients in general terms and recognized the need for training clinical teams in its use. None of the clinical teams we studied reported that they had undertaken a formal patient ethical or safety appraisal of their service. As Table 3 describes, young people and clinicians were often left to mitigate the risks by relying on common-sense strategies (eg, escalation by other means for emergencies) and by restricting the use of digital communication (eg, restricting it to nonurgent matters). A trusting relationship between the young people and their clinical team was important for mitigating both patient safety and ethical risks.
Discussion
Principal Findings
The provision of timely digital communication between young people with long-term conditions and their clinicians is addressing the health system factors that in the past have led to these young people disengaging from health services. Digital channels enable contact between young people and their clinical teams when this contact can make a difference to how the patient manages their condition. This digital service improves the patient’s experience of and engagement with care and prompts greater levels of self-management. Offering both digital and face-to-face contact is important to young people and clinicians. It also has the potential to reduce health care inequalities by engaging young people who are otherwise hard to reach. Young people value the enhanced access. Providing this access increases staff workload. The cost of providing this access is mostly attributable to staff costs. This cost is not immediately apparent to patients in the NHS, where services are free at the point of delivery. There is potential for offsetting savings from reduced adverse events and enhanced long-term outcomes, but these will not generally accrue to the service facing increased initial costs. As NHS policy prompts further rollout of digital access between patients and clinicians, there are ethical, governance, and patient safety issues to be considered by the patients, clinical teams, and their service organizations. These issues are currently mitigated by patients and clinicians working together in relationships of trust.
Strengths and Limitations
Our study findings are likely to apply to adult populations, as they do not relate specifically to the age or clinical condition of the young people, particularly as smartphone ownership among older people is rapidly increasing [10], giving them easier access to text messaging and email. We included a relatively large number of case study sites for mixed-methods data collection covering a wide range of clinical conditions. Clinical teams were using widely used digital channels. The study captured the perspectives of many young people living with long-term conditions and those of a wide range of clinical team members. The generalizability of our study findings is limited by the study design, as with any empirical study of practice-initiated behavior. We may have detected only what is most obvious and may have missed more subtle issues. Our participants may have reported particularly positive or, perhaps to a lesser extent, negative experiences. We were unable to recruit young people who were not engaging with their health care provider. Interviews did not elicit explicit ethical reflection. Clinicians found it difficult to estimate their workload during the interviews, and we did not attempt to collect data about digital communication activity via their digital communication system. Some clinics were unable to provide the size of their patient list. We did not attempt to collect cost data for patients as we had no comparator group. We were able to estimate the direct costs associated with the delivery of providing digital communication with patients, but we did not have comparator data to estimate the costs incrementally. While we identified qualitatively how this communication could lead to NHS savings, we did not have accurate-enough incremental outcome data to quantify the savings or cost-effectiveness. The study was undertaken in the NHS, where costs of care are not made clear to individual patients.
Comparison With Prior Work
The clinical teams we studied did not need convincing of the benefits of implementing timely digital clinical communication [48]. There is evidence that motivation and enthusiasm make a difference when implementing digital clinical interventions [49]. However, despite the importance of evaluating their digital access service for justifying its further development [50], none of the clinical teams had done so. Systematic reviews of intervention studies, usually focused on specific disease areas and published since we were preparing for this study, have mostly found some benefit from the use of digital channels for communication between patient and clinical teams, but some found no benefit. One review of text messaging for diabetes found no clear impact on glycemic control and self-management [51], whereas other reviews have found that telehealth improves glycemic control [52,53]. Systematic reviews on mental health found mostly positive findings [54,55]. A systematic review of telehealth to support family caregivers of people with chronic disease concluded that telehealth can positively affect care [56].
Conclusions
Our study findings suggest how the introduction of timely access for patients to their clinical team using digital channels could be safely and ethically achieved, to improve the experience of health care and enhance self-management. First, implement the service initially with patients where there is an existing relationship of trust between patient and clinical team. Examples include patients with long-term conditions and women in the antenatal period. Second, focus on delivery to the population of patients where the service is responding to an identified need—for example, patients in transition between services (such as the young people we studied); patients in transition between treatments (eg, a person with diabetes starting insulin), or before or after treatment (eg, liver transplant); and patients in transition in their life (eg, starting university)—and monitor impact on staff workload. Third, prior to introducing the timely digital access, clinical teams need to work out how they will proactively manage safety [57] (eg, inadvertent information disclosure) and ethical issues (eg, role boundaries), and use their information governance specialists as a resource (eg, provision of training). Improvements in the technological infrastructure (eg, NHSmail 2 [16]) have solved, or will solve, some safety and ethical concerns, but others need to be addressed within the clinical team, often with simple measures such as a timetable of clinical team members’ availability within email signatures (see LYNC study Quick Reference Guides designed to support clinical team discussions on these issues) [44].
Introducing timely access for patients to their clinical team using digital channels will require trained leadership [15] and patient involvement [50].
An experimental research design is needed to evaluate the impact of timely digital access to clinical teams on health outcome and health care provision. The research will need to take account of the nature of the existing relationship between patient and clinician.
Acknowledgments
This project was funded by the NIHR, Health Services and Delivery Research Programme (project number 12/209/51).
Department of Health disclaimer: the views and opinions expressed herein are those of the authors and do not necessarily reflect those of the Health Services and Delivery Research Programme, NIHR, NHS, or the Department of Health.
Abbreviations
- NHS
National Health Service
- NIHR
National Institute for Health Research
Footnotes
Authors' Contributions: FG and JS led the study from design through to writing up study reports. FG drafted this paper. JC, JF, JM, AMS, and MS contributed to study design, and supervised data collection and analysis. CB, MD, KH, CH, and PKK undertook data collection and analysis. AI and SWK contributed to data analysis. All authors contributed to writing the paper.
LYNC study authorship group: Xavier Armoiry, Helen Atherton, Abigail Buckle, Rachel Court, Patrick Elder, Eleni Karasouli, Mike May, Paul A Sutcliffe, Isabelle Svahnstrom, Frances Taggart, Ayesha Uddin, and Alice Verran, Warwick Medical School, University of Warwick; Thandiwe Rebecca Dliwayo, Vera Forjaz, and Richard Goodwin, Florence Nightingale Faculty of Nursing and Midwifery, King’s College London; Harjit Matharu and Sailesh Sankaranarayanan, University Hospitals Coventry and Warwickshire NHS Trust; Luhanga Musumadi, Guy’s and St Thomas’ NHS Foundation Trust; Moli Paul, Coventry and Warwickshire Partnership Trust; and Gyanu Raut, King’s College Hospital NHS Foundation Trust, UK
Conflicts of Interest: FG and AMS received grants from the UK National Institute of Health Research during the conduct of the study. JF received personal fees from NHS England, outside the submitted work.
References
- 1.Watson AR. Non-compliance and transfer from paediatric to adult transplant unit. Pediatr Nephrol. 2000 Jun;14(6):469–72. doi: 10.1007/s004670050794. [DOI] [PubMed] [Google Scholar]
- 2.Heery E, Sheehan AM, While AE, Coyne I. Experiences and outcomes of transition from pediatric to adult health care services for young people with congenital heart disease: a systematic review. Congenit Heart Dis. 2015;10(5):413–27. doi: 10.1111/chd.12251. [DOI] [PubMed] [Google Scholar]
- 3.Witherspoon D, Drotar D. Correlates of adherence to prophylactic penicillin therapy in children with sickle cell disease. Child Health Care. 2006 Dec;35(4):281–96. doi: 10.1207/s15326888chc3504_1. [DOI] [Google Scholar]
- 4.Singh SP. Transition of care from child to adult mental health services: the great divide. Curr Opin Psychiatry. 2009 Jul;22(4):386–90. doi: 10.1097/YCO.0b013e32832c9221. [DOI] [PubMed] [Google Scholar]
- 5.National Paediatric Diabetes Audit Project Board, Royal College of Paediatrics and Child Health . Natioanl paediatric diabetes audit report 2010-11. London, UK: Royal College of Paediatrics and Child Health; 2012. Sep, [2017-03-24]. http://www.rcpch.ac.uk/system/files/protected/page/NPDA%20Annual%20Report_25%2009%2012%20for%20web_0.pdf . [Google Scholar]
- 6.Dovey-Pearce G, Hurrell R, May C, Walker C, Doherty Y. Young adults' (16-25 years) suggestions for providing developmentally appropriate diabetes services: a qualitative study. Health Soc Care Community. 2005 Sep;13(5):409–19. doi: 10.1111/j.1365-2524.2005.00577.x.HSC577 [DOI] [PubMed] [Google Scholar]
- 7.Kennedy A, Sloman F, Douglass JA, Sawyer SM. Young people with chronic illness: the approach to transition. Intern Med J. 2007 Aug;37(8):555–60. doi: 10.1111/j.1445-5994.2007.01440.x.IMJ1440 [DOI] [PubMed] [Google Scholar]
- 8.Kreyenbuhl J, Nossel IR, Dixon LB. Disengagement from mental health treatment among individuals with schizophrenia and strategies for facilitating connections to care: a review of the literature. Schizophr Bull. 2009 Jul;35(4):696–703. doi: 10.1093/schbul/sbp046. http://schizophreniabulletin.oxfordjournals.org/cgi/pmidlookup?view=long&pmid=19491314 .sbp046 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Bell LE, Sawyer SM. Transition of care to adult services for pediatric solid-organ transplant recipients. Pediatr Clin North Am. 2010 Apr;57(2):593–610. doi: 10.1016/j.pcl.2010.01.007.S0031-3955(10)00008-8 [DOI] [PubMed] [Google Scholar]
- 10.Ofcom . Communications market report 2016. London, UK: Ofcom; 2016. Aug 4, [2017-03-24]. https://www.ofcom.org.uk/__data/assets/pdf_file/0024/26826/cmr_uk_2016.pdf . [Google Scholar]
- 11.Van Walleghem N, Macdonald CA, Dean HJ. Evaluation of a systems navigator model for transition from pediatric to adult care for young adults with type 1 diabetes. Diabetes Care. 2008 Aug;31(8):1529–30. doi: 10.2337/dc07-2247. http://europepmc.org/abstract/MED/18458141 .dc07-2247 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Simon J, Budge K, Foster J, Bell S, Christensen J, Price J, Goodwin G, Geddes J. Impact of True Colours mood monitoring on mental health service utilisation. 9th International Conference on Bipolar Disorder; June 9-11, 2011; Pittsburgh, PA. 2011. [Google Scholar]
- 13.Bartlett C, Simpson K, Turner AN. Patient access to complex chronic disease records on the Internet. BMC Med Inform Decis Mak. 2012 Aug 06;12:87. doi: 10.1186/1472-6947-12-87. https://bmcmedinformdecismak.biomedcentral.com/articles/10.1186/1472-6947-12-87 .1472-6947-12-87 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.National Information Board . National Information Board's workstream roadmaps. Leeds, UK: National Information Board; 2015. Oct 01, [2017-03-24]. https://www.gov.uk/government/publications/national-information-boards-workstream-roadmaps . [Google Scholar]
- 15.Wachter R. Making IT work: harnessing the power of health information technology to improve care in England. London, UK: Department of Health; 2016. Sep 07, [2017-03-15]. https://www.gov.uk/government/publications/using-information-technology-to-improve-the-nhs/making-it-work-harnessing-the-power-of-health-information-technology-to-improve-care-in-england . [Google Scholar]
- 16.NHS Digital NHSmail. 2016. [2016-12-13]. https://digital.nhs.uk/nhsmail .
- 17.Ye J, Rust G, Fry-Johnson Y, Strothers H. E-mail in patient-provider communication: a systematic review. Patient Educ Couns. 2010 Aug;80(2):266–73. doi: 10.1016/j.pec.2009.09.038. http://europepmc.org/abstract/MED/19914022 .S0738-3991(09)00454-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Blackburn S, Brownsell S, Hawley MS. A systematic review of digital interactive television systems and their applications in the health and social care fields. J Telemed Telecare. 2011;17(4):168–76. doi: 10.1258/jtt.2010.100610.jtt.2010.100610 [DOI] [PubMed] [Google Scholar]
- 19.de Jongh T, Gurol-Urganci I, Vodopivec-Jamsek V, Car J, Atun R. Mobile phone messaging for facilitating self-management of long-term illnesses. Cochrane Database Syst Rev. 2012;12:CD007459. doi: 10.1002/14651858.CD007459.pub2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Holtz B, Lauckner C. Diabetes management via mobile phones: a systematic review. Telemed J E Health. 2012 Apr;18(3):175–84. doi: 10.1089/tmj.2011.0119. [DOI] [PubMed] [Google Scholar]
- 21.Johansen MA, Henriksen E, Horsch A, Schuster T, Berntsen GK. Electronic symptom reporting between patient and provider for improved health care service quality: a systematic review of randomized controlled trials. part 1: state of the art. J Med Internet Res. 2012 Oct 03;14(5):e118. doi: 10.2196/jmir.2214. http://www.jmir.org/2012/5/e118/ v14i5e118 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Meyer B, Atherton H, Sawmynaden P, Car J. Email for communicating results of diagnostic medical investigations to patients. Cochrane Database Syst Rev. 2012 Aug 15;(8):CD007980. doi: 10.1002/14651858.CD007980.pub2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Atherton H, Sawmynaden P, Sheikh A, Majeed A, Car J. Email for clinical communication between patients/caregivers and healthcare professionals. Cochrane Database Syst Rev. 2012;11:CD007978. doi: 10.1002/14651858.CD007978.pub2. [DOI] [PubMed] [Google Scholar]
- 24.Osborn CY, Mayberry LS, Mulvaney SA, Hess R. Patient web portals to improve diabetes outcomes: a systematic review. Curr Diab Rep. 2010 Dec;10(6):422–35. doi: 10.1007/s11892-010-0151-1. http://europepmc.org/abstract/MED/20890688 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Sutcliffe P, Martin S, Sturt J, Powell J, Griffiths F, Adams A, Dale J. Systematic review of communication technologies to promote access and engagement of young people with diabetes into healthcare. BMC Endocr Disord. 2011;11:1. doi: 10.1186/1472-6823-11-1. http://bmcendocrdisord.biomedcentral.com/articles/10.1186/1472-6823-11-1 .1472-6823-11-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Verhoeven F, Tanja-Dijkstra K, Nijland N, Eysenbach G, van Gemert-Pijnen GL. Asynchronous and synchronous teleconsultation for diabetes care: a systematic literature review. J Diabetes Sci Technol. 2010 May;4(3):666–84. doi: 10.1177/193229681000400323. http://europepmc.org/abstract/MED/20513335 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Gurol-Urganci I, de Jongh T, Vodopivec-Jamsek V, Car J, Atun R. Mobile phone messaging for communicating results of medical investigations. Cochrane Database Syst Rev. 2012;6:CD007456. doi: 10.1002/14651858.CD007456.pub2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Van Gaalen JL, Hashimoto S, Sont JK. Telemanagement in asthma: an innovative and effective approach. Curr Opin Allergy Clin Immunol. 2012 Jun;12(3):235–40. doi: 10.1097/ACI.0b013e3283533700. [DOI] [PubMed] [Google Scholar]
- 29.Välimäki M, Hätönen H, Lahti M, Kuosmanen L, Adams CE. Information and communication technology in patient education and support for people with schizophrenia. Cochrane Database Syst Rev. 2012 Oct;10:CD007198. doi: 10.1002/14651858.CD007198.pub2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Gentles SJ, Lokker C, McKibbon KA. Health information technology to facilitate communication involving health care providers, caregivers, and pediatric patients: a scoping review. J Med Internet Res. 2010;12(2):e22. doi: 10.2196/jmir.1390. http://www.jmir.org/2010/2/e22/ v12i2e22 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Bender JL, Radhakrishnan A, Diorio C, Englesakis M, Jadad AR. Can pain be managed through the Internet? A systematic review of randomized controlled trials. Pain. 2011 Aug;152(8):1740–50. doi: 10.1016/j.pain.2011.02.012.S0304-3959(11)00118-7 [DOI] [PubMed] [Google Scholar]
- 32.Martin S, Sutcliffe P, Griffiths F, Sturt J, Powell J, Adams A, Dale J. Effectiveness and impact of networked communication interventions in young people with mental health conditions: a systematic review. Patient Educ Couns. 2011 Nov;85(2):e108–19. doi: 10.1016/j.pec.2010.11.014.S0738-3991(10)00699-3 [DOI] [PubMed] [Google Scholar]
- 33.McLean S, Protti D, Sheikh A. Telehealthcare for long term conditions. BMJ. 2011;342:d120. doi: 10.1136/bmj.d120. [DOI] [PubMed] [Google Scholar]
- 34.Johansen MA, Berntsen GK, Schuster T, Henriksen E, Horsch A. Electronic symptom reporting between patient and provider for improved health care service quality: a systematic review of randomized controlled trials. part 2: methodological quality and effects. J Med Internet Res. 2012 Oct 03;14(5):e126. doi: 10.2196/jmir.2216. http://www.jmir.org/2012/5/e126/ v14i5e126 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Gagnon M, Légaré F, Labrecque M, Frémont P, Pluye P, Gagnon J, Car J, Pagliari C, Desmartis M, Turcot L, Gravel K. Interventions for promoting information and communication technologies adoption in healthcare professionals. Cochrane Database Syst Rev. 2009 Jan 21;(1):CD006093. doi: 10.1002/14651858.CD006093.pub2. http://europepmc.org/abstract/MED/19160265 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Yin R. Case Study Research: Design and Methods. Thousand Oaks, CA: Sage Publications; 2013. [Google Scholar]
- 37.Pawson R, Tilley N. Realistic Evaluation. London, UK: Sage; 1997. [Google Scholar]
- 38.Boyatzis R. Transforming Qualitative Information: Thematic Analysis and Code Development. Thousand Oaks, CA: Sage Publications; 1998. [Google Scholar]
- 39.Ives J, Draper H. Appropriate methodologies for empirical bioethics: it's all relative. Bioethics. 2009 May;23(4):249–58. doi: 10.1111/j.1467-8519.2009.01715.x.BIOT1715 [DOI] [PubMed] [Google Scholar]
- 40.International Electrotechnical Commission . IEC 60812: Analysis Techniques for System Reliability-Procedure for Failure Mode and Effects Analysis (FMEA) Geneva, Switzerland: International Electrotechnical Commission; 2006. pp. 1–93. [Google Scholar]
- 41.Royal College of Nursing . Agenda for Change pay scales for 2014-2015. London, UK: Royal College of Nursing; 2014. [2017-03-24]. https://www2.rcn.org.uk/__data/assets/pdf_file/0007/572812/nurse-pay-scales-nhs-agenda-for-change-england-2014-2015.pdf . [Google Scholar]
- 42.National Institute for Health and Care Excellence Guide to the methods of technology appraisal 2013. 2013. Apr 4, [2017-03-15]. https://www.nice.org.uk/process/pmg9/resources/guide-to-the-methods-of-technology-appraisal-2013-pdf-2007975843781 . [PubMed]
- 43.LYNCS Project LYNCS Young Researchers Symposium: the films. 2011. Jul 7, [2017-03-15]. https://www.youtube.com/watch?v=ennqoM2BoFU .
- 44.Warwick Medical School, University of Warwick LYNC study quick reference guides. 2016. Oct 5, [2017-03-24]. http://www2.warwick.ac.uk/fac/med/research/hscience/sssh/research/lyncs/outputs .
- 45.Slowther A. The concept of autonomy and its interpretation in health care. Clin Ethics. 2007;2(4):173–5. [Google Scholar]
- 46.Lee Y, Lin JL. Do patient autonomy preferences matter? Linking patient-centered care to patient-physician relationships and health outcomes. Soc Sci Med. 2010 Nov;71(10):1811–8. doi: 10.1016/j.socscimed.2010.08.008.S0277-9536(10)00632-5 [DOI] [PubMed] [Google Scholar]
- 47.General Medical Council Duties of a doctor: the duties of a doctor registered with the General Medical Council. 2017. [2017-03-15]. http://www.gmc-uk.org/guidance/good_medical_practice/duties_of_a_doctor.asp .
- 48.Gagnon M, Ngangue P, Payne-Gagnon J, Desmartis M. m-Health adoption by healthcare professionals: a systematic review. J Am Med Inform Assoc. 2016 Jan;23(1):212–20. doi: 10.1093/jamia/ocv052.ocv052 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.O'Cathain A, Drabble SJ, Foster A, Horspool K, Edwards L, Thomas C, Salisbury C. Being human: a qualitative interview study exploring why a telehealth intervention for management of chronic conditions had a modest effect. J Med Internet Res. 2016 Jun 30;18(6):e163. doi: 10.2196/jmir.5879. http://www.jmir.org/2016/6/e163/ v18i6e163 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Greenhalgh T, Procter R, Wherton J, Sugarhood P, Hinder S, Rouncefield M. What is quality in assisted living technology? The ARCHIE framework for effective telehealth and telecare services. BMC Med. 2015;13:91. doi: 10.1186/s12916-015-0279-6. http://www.biomedcentral.com/1741-7015/13/91 .10.1186/s12916-015-0279-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Herbert L, Owen V, Pascarella L, Streisand R. Text message interventions for children and adolescents with type 1 diabetes: a systematic review. Diabetes Technol Ther. 2013 May;15(5):362–70. doi: 10.1089/dia.2012.0291. [DOI] [PubMed] [Google Scholar]
- 52.Pal K, Eastwood SV, Michie S, Farmer AJ, Barnard ML, Peacock R, Wood B, Inniss JD, Murray E. Computer-based diabetes self-management interventions for adults with type 2 diabetes mellitus. Cochrane Database Syst Rev. 2013;3:CD008776. doi: 10.1002/14651858.CD008776.pub2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Guljas R, Ahmed A, Chang K, Whitlock A. Impact of telemedicine in managing type 1 diabetes among school-age children and adolescents: an integrative review. J Pediatr Nurs. 2014;29(3):198–204. doi: 10.1016/j.pedn.2013.10.013.S0882-5963(13)00308-4 [DOI] [PubMed] [Google Scholar]
- 54.Ye X, Bapuji SB, Winters SE, Struthers A, Raynard M, Metge C, Kreindler SA, Charette CJ, Lemaire JA, Synyshyn M, Sutherland K. Effectiveness of internet-based interventions for children, youth, and young adults with anxiety and/or depression: a systematic review and meta-analysis. BMC Health Serv Res. 2014 Jul 18;14:313. doi: 10.1186/1472-6963-14-313. https://bmchealthservres.biomedcentral.com/articles/10.1186/1472-6963-14-313 .1472-6963-14-313 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Aardoom JJ, Dingemans AE, Spinhoven P, Van Furth EF. Treating eating disorders over the internet: a systematic review and future research directions. Int J Eat Disord. 2013 Sep;46(6):539–52. doi: 10.1002/eat.22135. [DOI] [PubMed] [Google Scholar]
- 56.Chi N, Demiris G. A systematic review of telehealth tools and interventions to support family caregivers. J Telemed Telecare. 2015 Jan;21(1):37–44. doi: 10.1177/1357633X14562734. http://europepmc.org/abstract/MED/25475220 .1357633X14562734 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Sujan M, Spurgeon P, Cooke M, Weale A, Debenham P, Cross S. The development of safety cases for healthcare services: practical experiences, opportunities and challenges. Reliability Eng Syst Safety. 2015;140:200–7. [Google Scholar]