Skip to main content
International Journal of Environmental Research and Public Health logoLink to International Journal of Environmental Research and Public Health
. 2023 Feb 19;20(4):3694. doi: 10.3390/ijerph20043694

Ethical, Legal, Organisational and Social Issues of Teleneurology: A Scoping Review

Alezandra Torres-Castaño 1,2,3,4,*, Analía Abt-Sacks 1,2,3,4, Ana Toledo-Chávarri 1,2,3,4, José Carlos Suarez-Herrera 2,5, Janet Delgado-Rodríguez 1,4,6, Beatriz León-Salas 1,2,3,4, Yadira González-Hernández 1,2,3,4, Montserrat Carmona-Rodríguez 3,4,7, Pedro Serrano-Aguilar 1,8
Editors: Carlo Giacomo Leo, Pierpaolo Mincarone
PMCID: PMC9962592  PMID: 36834388

Abstract

Background: Neurological disorders are the leading cause of disability and the second leading cause of death worldwide. Teleneurology (TN) allows neurology to be applied when the doctor and patient are not present in the same place, and sometimes not at the same time. In February 2021, the Spanish Ministry of Health requested a health technology assessment report on the implementation of TN as a complement to face-to-face neurological care. Methods: A scoping review was conducted to answer the question on the ethical, legal, social, organisational, patient (ELSI) and environmental impact of TN. The assessment of these aspects was carried out by adapting the EUnetHTA Core Model 3.0 framework, the criteria established by the Spanish Network of Health Technology Assessment Agencies and the analysis criteria of the European Validate (VALues In Doing Assessments of healthcare TEchnologies) project. Key stakeholders were invited to discuss their concerns about TN in an online meeting. Subsequently, the following electronic databases were consulted from 2016 to 10 June 2021: MEDLINE and EMBASE. Results: 79 studies met the inclusion criteria. This scoping review includes 37 studies related to acceptability and equity, 15 studies developed during COVID and 1 study on environmental aspects. Overall, the reported results reaffirm the necessary complementarity of TN with the usual face-to-face care. Conclusions: This need for complementarity relates to factors such as acceptability, feasibility, risk of dehumanisation and aspects related to privacy and the confidentiality of sensitive data.

Keywords: teleneurology, health technology assessment, ethical, legal, organizational, social, equity, accessibility

1. Introduction

Neurological diseases include all disorders affecting the nervous system in general, or some of its components, such as the brain, cerebellum, brainstem, spinal cord or nerves. Overall, these disorders are the leading cause of disability and the second leading cause of death worldwide. In the past 30 years, the absolute numbers of deaths and people with disabilities owing to neurological diseases have risen substantially, particularly in low-income and middle-income countries, and further increases are expected globally as a result of population growth and ageing [1].

The increase in the population demand for care, together with territorial inequalities in patient access to health services, and the difficulties of economic sustainability for health systems in most countries, has led to telemedicine being an alternative to these three divergent challenges [2]. Unfortunately, for almost two decades, limitations in available scientific evidence delayed the widespread adoption of the different modalities of telemedicine in its different applications. Time has elapsed, accompanied by improvements in the designs of evaluative studies on telemedicine, and, more recently, the need for tools to meet the population’s health needs during the COVID-19 pandemic, which favour the implementation and diffusion of telemedicine in all health fields [3].

The practice of telemedicine (TM) has changed the way healthcare is delivered, towards a model that can be considered a “disruptive innovation” [4]. Teleneurology (TN) is a procedure that allows neurology to be performed when the doctor and patient are not present in the same place, and sometimes not at the same time [5].

The successful long-term use and outcomes of technology-based interventions (TBI) can be improved by identifying the factors that influence their adoption and developing strategies to address specific barriers and build on identified facilitators [6]. The remote provision of health services, such as TN, in particular, presents challenges at different levels, such as the political, organisational, technical, ethical-legal and clinical [4,7,8].

The use of TM in the case of neurological diseases must be sensitive to characteristics that determine the conditions of healthcare, such as the urgency of care for some of these diseases. While, once diagnosed, most neurological patients can be cared for on an outpatient basis, those requiring immediate diagnostic tests and treatment must be managed in a hospital setting [9]. The greatest evidence for the use of TN has been in neurocritical care and emergency stroke, where rapid assessment by a neurologist or other cerebrovascular pathology specialist is required, especially in remote underserved communities, such as rural areas, where direct access to neurology services are lacking [10,11,12,13,14].

While the adoption of healthcare interventions is mostly guided by evidence on its effectiveness, safety and cost-effectiveness, the impact of the ethical, legal and social issues (also known as ELSI) [15] and organizational, environmental aspects and patients’ perspectives that may derive from the use of TN is scarcely known, despite their relevance in successful implementation. The evaluation of all these dimensions should consider the type of neurological disease, the care trajectory (prevention, clinical management, clinical home follow-up, etc.) and its complementary use to usual face-to-face care. To review the evidence on effectiveness, cost-effectiveness and impacts on the ethical, legal, organisational and social dimensions of the complementary use of teleneurology, the Spanish Ministry of Health in February 2021 commissioned The Spanish Network of Agencies for Health Technology Assessment (RedETS) with the elaboration of a health technology assessment report. The objective of this scoping review was to identify the impact of the ELSI dimensions and other dimensions, such as the organisational and environmental, to analyse in depth the challenges of the implementation of teleneurology as a complement to face-to-face neurology care. This scoping review is part of the health technology assessment report mentioned before.

To meet this objective, a methods section is included to explain the approach we followed, based on a consultation carried out in a virtual meeting with experts in the field of teleneurology. This meeting allowed us to identify key issues in the use of teleneurology, which was complemented by the development of a systematic search. Subsequently, the main themes that emerged according to the Core Model 3.0 of EUnetHTA are presented. In the discussion, the implications of these results are analysed, as well as the main strengths and limitations, and the implications for future practice. Finally, the most relevant ideas that emerged from the development of this scoping review are presented in the Conclusions section.

2. Methods

A scoping review (SR) was performed according to the recommended five-step framework for scoping reviews [16,17,18,19]. A detailed protocol for the review was developed by the research team and further approved by the Spanish Ministry of Health (available from the corresponding author on request). The assessment of ethical, legal, organisational and social aspects was carried out by adapting the framework of the Core Model 3.0 of EUnetHTA, the criteria established by the Spanish Network of Agencies for Health Technology Assessment for the National Health Service, and the analysis criteria of the European VALIDATE Project (VALues In Doing Assessments of healthcare TEchnologies) [20,21,22]. None of these frameworks addresses patient safety specifically in teleneurology, but rather in general health technology terms. The environmental aspects were assessed considering the analysis of the carbon footprint caused by the technology during its complete life cycle. The whole life cycle (WLC) includes five stages: (1) material acquisition and pre-processing; (2) production; (3) distribution and storage; (4) use and (5) end of [7,8].

2.1. Information Sources and Search Strategy

Within the VALIDATE approach, the initial key question was whether the Health Technology Assessment (HTA) addresses all relevant concerns that different stakeholders may have concerning teleneurology as a complement to face-to-face neurology care. Thus, to ensure that the perspective of all the stakeholders was included, we invited them to discuss their concerns about teleneurology in an online meeting to identify the main problems and benefits of TN from their perspectives. This group of stakeholders belonged to the working group and were collaborators in the HTA report described above. They were chosen for their experience and relevant publications in the field of TN. For the online meeting, they did not sign a specific consent form, as they had previously completed these documents as authors of the report.

This meeting was held on 6 June 2021. The participants were representatives of patient associations, representatives of scientific societies, healthcare professionals and industry representatives with expertise in neurological diseases and/or TM. The list of participants can be found in Supplementary File S1. The consultation was guided by the following authors ATC; ATCh; JDR; BLS and PSP. A semi-structured script available in Supplementary File S2 was used for this purpose.

Patient representatives were the first to respond to each of the questions, healthcare professionals and representatives of scientific societies gave their perspective next, while industry representatives were the last ones. This pre-established order of interventions was set up to prevent patient interventions from being constrained by differences in knowledge and ease of communication on the part of professional and industry representatives. A summary of the topics discussed was sent after the meeting and reviewed by all participants. The themes raised at this meeting were translated into research questions which are shown in column 1 of Table 1. Those themes that could not be addressed in this review because insufficient evidence was found were taken as research needs. These themes are shown in column 2 of Table 1.

Table 1.

Themes emerging from the virtual stakeholder meeting.

Questions Addressed within This Review Research Needs
How can/should universal accessibility of teleneurology be ensured?
Voluntariness at the European level, testing of connectivity and compatibility of devices.

What access barriers exist for access to teleneurology? How can these access barriers be reduced? What technologies and ways of implementing these technologies or interventions facilitate access?
Could teleconsultation be positive for patients with behavioural or cognitive problems?

Does it reduce the time between visits for patients?

Is it more efficient for professionals?
How effective are the different organisational models for contact points?
How should patient perspectives and preferences be considered? Do some patients feel insecure about teleneurology or perceive it as an inferior model of care to traditional models, such as face-to-face care?
How can the quality of teleconsultation be ensured? Should quality criteria be changed or adapted to teleneurology?
  • -

    How can/should a teleservice be organized taking into account consultation and recording times adapted to each type of contact?

  • -

    Can increased multidisciplinary coordination be managed efficiently and cost-effectively?

Can the time management of healthcare professionals be improved by promoting work-life balance?
How should privacy and confidentiality be ensured in the different types of teleconsultation and in the storage of additional data?
  • -

    How can it be determined that teleneurology is used appropriately as a complement to face-to-face consultations? Which types of healthcare events require face-to-face attendance and which ones do not?

  • -

    Could a checklist in the report help in deciding when it is appropriate to implement/pilot complementary teleneurology?

How can continuity of care be ensured in the face of possible connection or device failures by healthcare providers and patients?

Subsequently, a systematic search of articles was conducted in the electronic databases MEDLINE (OVID interface) and EMBASE (Elsevier interface) from 2016 to June 10, 2021. The search strategy was initially developed in MEDLINE, using a combination of controlled vocabulary and free text terms and was then adapted for EMBASE. The full search strategy is available in Supplementary File S3.

Search terms included the following: teleneurology, mhealth, teleconsultation, TM complementary service, ethics, organisational, legal, social, environmental impacts and carbon footprint. Searches were limited to the English and Spanish languages.

2.2. Selection Criteria

Studies were eligible for inclusion if they fulfilled the following criteria:

  1. Design: Qualitative, mixed studies, observational studies, systematic and narrative reviews covering ethical, legal, organisational, social and environmental aspects.

  2. Language: Articles published in English and Spanish.

  3. Population: People with any neurological disease (adults and children).

  4. Intervention: Teleneurology as a complementary service to face-to-face neurological care.

  5. Comparison: Regular face-to-face neurology care.

  6. Outcomes: The outcomes selected were all those that answered the research questions that emerged from the stakeholder group meeting.

2.3. Study Selection

Retrieved references were first screened independently and in duplicate based on their titles and abstracts by four reviewers. The full text of the potentially eligible references was then screened again, independently and in duplicate, to confirm eligibility. Doubts and disagreements between the reviewers were resolved by discussion in pairs, and where no consensus was reached, a third reviewer was consulted.

2.4. Data Collection Process

Data extraction from included studies was carried out by three reviewers. The data collection included the identification of the article (authors, publication date, country, etc.), methodology (design, intervention characteristics, participant’s characteristics, etc.) and study results.

2.5. Quality Assessment

To ascertain the quality of the studies, the methodological limitations section within each of the included studies was consulted. No specific scale was used to assess the quality of the studies.

2.6. Synthesis of Results

The data analysis was performed using a thematic analysis, identifying the most relevant categories that were extracted from the included studies followed by a narrative synthesis. Finally, the findings were checked against the EUnetHTA Core Model 3.0. Evaluative framework to validate their relevance.

3. Results

From a total of 2230 initially identified references (1605 after eliminating the duplicates), 212 were selected after the first screening round by title and abstract. After the second screening round, based on full-text revision, 79 studies met the criteria. Thirty-seven studies were related to acceptability and equity, 15 studies related to the reorganisation of neurology services as a consequence of the COVID pandemic, one study addressed environmental aspects related to technology and 26 studies were related to feasibility. Figure 1 shows the PRISMA flowchart of the study-selection process.

Figure 1.

Figure 1

PRISMA flowchart of the study selection process.

This scoping review will only include 53 studies: the 37 studies related to acceptability and equity, the 15 studies developed during COVID, and the study on environmental aspects.

The research question addressed was: What ethical, legal, organisational and social aspects related to the use of TN as a complementary service to face-to-face neurological care are relevant for its implementation in the health system?

3.1. Characteristics of Included Studies

Studies from the following countries were included: the United Kingdom, Netherlands, Norway, Australia, Sweden, Mexico, Canada, the United States of America, Uganda, Belgium, Spain and Germany. The included study designs were: 19 qualitative studies [6,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42], 9 mixed-methods studies [24,43,44,45,46,47,48,49,50], 6 implementation reports [23,51,52,53,54,55] 6 descriptive studies [56,57,58,59,60,61], 1 cohort [62], 1 cross-sectional [63], 1 prospective cohort [64], 1 retrospective cohort [65] and 1 observational cohort (case/control) [66].

The population of these studies included patients with different neurological disorders and health care professionals: (a) stroke 20 studies [6,23,24,26,27,28,30,31,32,35,39,40,42,47,56,58,62,67,68,69], at different disease stages (acute o rehabilitation) and technological modalities (synchronous and asynchronous consultations), (b) Parkinson’s disease, 9 studies (1 about a body sensor to assess motor symptoms, 1 about smartphone use for follow-up, 1 about virtual visit, 1 about eHealth functionalities for co-care, and 1 about implementation issues) [33,34,41,45,54,57,66,70,71], (c) epilepsy, 6 studies (1 related to digital and wearable technology, 1 about mHealth and 1 through video conferencing for children in rural areas) [36,44,50,60,61,72], (d) multiple sclerosis, 2 studies (1 related to m-health in people with relapsing remitting sclerosis and progressive multiple sclerosis, and 1 on telecommunication technologies and rehabilitation services [37,46,63]; 1 dementia [64] and 2 other studies with other pathologies (patients with multiple sclerosis, depression and epilepsy, remote sensing technology for symptom severity) [38,43]. The other 11 studies analysed neurological disorders in general (1 remote follow-up, 1 adoption of virtual reality in patients with motor impairment for chronic conditions, 1 examine implementation issues, 1 virtual rehabilitation and 1 acceptability and long-term adherence) [25,29,32,48,51,53,55,59,65,73,74].

Finally, one study focused on greenhouse gas reduction using neuro-emergency telemedicine consultations [52]. Besides patients, caregivers and professionals in primary and specialized care, as well as resident physicians, were also part of the selected study population.

The main outcomes reported were about barriers and facilitators of TN use, perceptions and expectations about the use of TN, perceived benefits of its use, competence development needs, resistance from professionals, legal and organisational aspects, and ethical and environmental dimensions. Supplementary File S4 shows the characteristics of the included studies.

3.2. Quality Assessment

The main methodological limitations observed in the included studies were the small sample size and the inadequate examination of the social determinants of health (gender, age, ethnicity, co-morbidity, disability, digital literacy, family/social support, geographic residence and socioeconomic status) [23,25,26,27,28,34,43,45,46,47,61,62,69]. Moreover, insufficient information is provided to assess methodological limitations [6,51,63]. Other studies were carried out in hypothetical settings [36,37,56]. Furthermore, the studies analysing TN in various health conditions do not allow us to delve into specific aspects of care for each condition, limiting the transferability of their results [25,32,38,51,58,73,74].

3.3. Synthesis of Results

A narrative synthesis of the main results was conducted and organised according to the research questions identified by the stakeholders. The research questions were addressed according to the EUnetHTA Core Model 3.0 framework, the criteria established by the Spanish Network of Health Technology Assessment Agencies for the National Health Service, and the themes that emerged from the included studies. Main findings were finally formulated under the following issues: (1) Acceptability, (2) Usability, (3) Ethical aspects and risk of dehumanisation, (4) Equity (universal accessibility to the technology), (5) Organisational aspects related to implementation, quality and environmental implications.

3.3.1. Acceptability

Acceptability was evaluated from the point of view of patients, caregivers, community leaders and health professionals involved at different health-care levels: primary and specialized care, and emergencies [27,42,58]; including different modalities of TN, either by videoconference or through remote measurement technologies [43], such as tracking devices or mobile applications for stroke, multiple sclerosis, Parkinson’s disease, epilepsy and depression, and for different moments in the care trajectory. Patients and caregivers considered TN as an acceptable complementary option to face-to-face neurology consultation [6,34,45]. The benefits resulting from the use of TN, such as cost savings in travel or waiting time in health services and the avoidance of work absenteeism and reducing caregiver burden and fatigue, are aspects that can improve its acceptability. Ease of access to otherwise inaccessible specialists is another reason for patient acceptability [56]. Monitoring through body sensors was acceptable to patients in the short term, although, in the long term, they reported discomfort in aspects related to usability and doubts about the quality of the data captured [45].

However, studies with healthcare professionals and patients with Parkinson’s disease and stroke indicate that the quality of personal interactions is a key aspect that may condition the acceptability of TN [27,30,34]. Patients also expressed concern that TN should ensure interpersonal engagement, understood as attentive or active listening, as well as the ability to establish a bond of trust [30,34]. In the rehabilitation phase, patients find complementary TN consultations acceptable when there is prior training, when some social interaction is provided, when caregivers are available, and when consultations take place in the home setting [26].

From the professional perspective, the use of tele neurorehabilitation technologies is complex, considering the context-specific benefits and challenges. Some facilitator factors include the possibility of providing accurate and objective feedback and monitoring performance, as well as its potential to encourage patients to continue physical activity outside therapy hours [25]. Practitioners noted, as a requirement for acceptability, that mobile applications be previously validated by experts [46].

3.3.2. Usability

Healthcare professionals stated that the different TN interventions could be combined in a central dashboard in which all facilities are directly available through a digital environment, allowing their synchronisation with the programs used for the patients’ electronic medical records [47]. In terms of user experience, health professionals prefer pictograms, symbols and graphics, and a smooth, flicker-free interface. The design configuration should be adjustable and ensure that it can be heard well, i.e., with the ability to hear the written text and to emit sounds as alerts or feedback. Simplicity, as measured by the limited number of web pages that are opened as a result of using a service, as well as by the information provided on a single screen, should be ensured [38]. In addition, the TN tool for rehabilitation should have a support service, a menu with frequently asked questions, videos with instructions for use, a help desk or direct assistance at home or the workplace, and the monitoring of physical activity and health status, as well as the possibility of having personalised goals, socialisation and gamification options [38,46,56,63]. To enhance the video consultation experience for both patients and professionals, proposed solutions included virtual waiting rooms and multi-user interfaces to facilitate multidisciplinary care [47].

3.3.3. Ethical Aspects and Risk of Dehumanisation

As in the face-to-face modality of care, all ethical standards and integrity of medical practice must be maintained in TN to ensure that patients receive the best possible healthcare. All remote consultations should be treated with a confidential guarantee [72], including the storage of data using mobile and wearable technology to monitor health outcomes, subject to signed consent [71]. Patients and caregivers must receive adequate information to ensure that the identity and credentials of remote professionals are explicit to them [30,67,72].

Healthcare professionals have stated that TN should provide the standards they need to be comfortable. While space, adequate technology implementation and organisational support are all necessary for the successful use of TN, they are not enough for its ethical delivery.

Other studies warn about ethical, legal and technological implications of the use of mobile send-tracking apps for persons affected with Parkinson’s disease or stroke [67,71] because is necessary to maintain an adequate balance between the proper monitoring of patients for strictly therapeutic purposes and excessive surveillance of the person, which may violate their privacy. It is important to provide enough information to allow patients to choose whether they want to measure aspects of their health and well-being and avoid collecting data without an explicit purpose, to reduce the emotional burden that it can mean for them [71]. Careful co-design and feedback with users must be respected throughout the process, to ensure that the technology is adapted to the user’s needs and preferences, as well as reporting all interactions with non-human tools and resources (e.g., chatbot) and even ensuring the signing of consent-to-participate forms [71].

The paradigm shift in routine medical care, related to the ability of professionals to convey compassion, should also be incorporated into TM interventions, especially because the forms of expression of empathy in virtual meetings differ from those in person. This communication dimension is reported in studies about paediatric neuropsychology services during the COVID-19 pandemic [49] and clinical encounters for acute stroke. The feeling of deterioration or rupture of the traditional health professional–patient relationship constitutes a major concern for patients and companions/caregivers and the health professionals themselves, due to the risk of dehumanisation that ICT-mediated therapeutic relationships entail, both in ictus healthcare [30,58,62,72] as well as autism, with paediatric and adult populations [30,46,58,72,75]. In Parkinson’s disease, the quality of interpersonal engagement is identified as one major theme for patients’ perceptions of virtual visits [34]. Among health professionals, there is a risk of dehumanisation related to examining patients without physical contact [34].

3.3.4. Equity

TN promises to increase access to specialised care, contributing to reducing healthcare inequities associated with accessibility in remote or rural areas, and patient movement difficulties. Indeed, this avoid a loss of productivity for the accompanying caregiver too [49,55,55]. Besides the potential to improve equity in access to evaluation, diagnosis, and follow-up, TN reduces barriers such as travel costs and community stigma [72]. Moreover, the complementary use of videoconferencing could have relatively fewer restrictions than in-person visits, which are often scheduled months in advance, and could therefore reduce wait times.

Several studies show also the interest of patients in telerehabilitation, because, in addition to reducing the burden of access to health care, it reduces periodic transportation, besides being more comfortable at home [26,34,42,72]. However, obstacles to universal accessibility to TN have been identified, the main ones being the digital divide, and the diverse functional capacity of users, especially the elderly or those with some disabilities such as multiple sclerosis [63] that are not contemplated in the design and implementation of these technologies. People with different moderate and severe physical or cognitive disabilities who, in principle, could benefit more from telerehabilitation programs, have, on average, more difficulties in accessing and using technologies [63]. For patients with chronic progressive neurological conditions and loss of muscle function for whom face-to-face consultations become increasingly challenging, video visits have been found to improve the patient experience, although several challenges remain [59]. The most vulnerable people with the greatest needs are often the most difficult to serve virtually, not only because of their diagnosis (patients with sensory or cognitive deficits) but also because of the need to have the support of a companion/caregiver and their socioeconomic status and consequent difficulties in access to internet services [27,48,57]. The main barriers to accessing the telematic sessions were socioeconomic and linguistic disadvantages—difficulties in communicating in the language of the professionals or poor language skills—together with family health problems [49]. Due to these barriers, health professionals consider that the complementary use of TN should only be offered to people who are willing to be treated under this modality and have the required skills [58].

In European countries such as Belgium or France, where TM reimbursement has been regulated, teleconsultations are voluntary and require patient consent [76]. To ensure effective accessibility and an adequate quality of TN, the necessary technical support to patients should be guaranteed at home [77,78], access to teleconsultations provided from duly equipped local health centres [79] or the connectivity checked before conducting video consultations [27].

Multi-stakeholder efforts are required to develop interoperable platforms capable of providing equity in access to care, easily, without detriment to safety, in addition to providing a person-centred approach to care [73].

3.3.5. Organisational Aspects

Quality of Neurology Teleconsultations

Some studies propose a generic approach to quality in the complementary use of TN interventions [65], from the monitoring of general quality criteria in the provision of health services [80], to the provision of TN in particular, from which two fundamental concepts are proposed: service quality, related to the ability of internet services to meet the technical requirements in terms of the connectivity indicated for users, and experience quality, related to the general acceptability of a service or application and linked to the extent to which the service in question meets the needs of users. In the latter, aspects of service quality, such as response time, reliability, security and service costs, are taken into account [44].

In the pursuit of quality care in the specific field of TN, the American Academy of Neurology (AAN) has developed a specific guideline to guide medical students, residents and practitioners in the safe practice of TN [81]. In addition, the AAN has formulated a series of practical recommendations in the Telehealth Position Statement [82] that include improving access and insurance coverage, ensuring fair reimbursement, reducing regulatory and legislative barriers, and expanding the evidence for TM by promoting research on its proper role and value in neurological care and on the costs associated with the provision of these TN services.

Another example is the Movement Disorder Society Task Force on Technology [70], which comprises members from clinical, academic and scientific institutions from several countries, those who have proposed a roadmap for the implementation of patient-centred digital outcome measures using mobile health technologies for Parkinson’s disease care. This collaborative effort will foster the development of integrated systems that can achieve more sophisticated characterisation of patient function, better tailoring of symptomatic therapy, increased patient engagement and self-assessment, and improved overall healthcare outcomes, as digital outcomes correlate with patient-centred global scales for appropriate domains [70].

In an analysis of 2589 telehealth consultations in neurologically affected children, performed during the COVID-19 pandemic, Rametta et al. [65] rated the vast majority of TN consultations as successful, with only a small proportion of consultations requiring short-term in-person follow-up. These results suggest that TN is feasible and effective for a large proportion of paediatric neurologic care.

3.3.6. Environmental Aspects

A single study has been identified that evaluates environmental aspects related to TN service provision [52] evaluating the greenhouse gas (GHG) emissions related to air travel that is avoided when patients receive neuro-emergency telemedicine care. Whetten [52] compared the emissions related to the transfer of the patient in air ambulances from a rural hospital to a referral site (the rural hospital’s designated level-one trauma centre), compared to the GHG emissions associated with TN consultations. For the total visits, the calculation of the total travel distance avoided resulted in 618.77 metric tons of CO2 emissions avoided or 0.306 metric tons of CO2 per patient. The GHG emissions associated with the use of the TN equipment measured in electricity demand were calculated at 176 W for the use of a monitor and a standard personal computer, with a total time of 1241 h, which would generate 32 kg of CO2 emissions (considering the TM equipment and the patient’s equipment) for the total number of consultations evaluated.

The study concludes that the use of TN results in a minor effect compared to GHG emissions produced by patient transfers, and suggests that the methodology used in this study can be applied to other areas of TN that are intended to be implemented taking into account a carbon footprint reduction policy. However, the design of this study does not allow for a comparison of the health results obtained through the two healthcare alternatives.

3.4. Implementation Issues

Regarding the implementation of TN services, two key aspects emerged from the studies: consultation and information recording times, and interdisciplinary coordination.

At the organizational level, some studies point out, as one of the key aspects within the organization, the availability of a professional technical team capable of solving logistical, technical, legal and financial problems derived from the complementary use of TN consultations, as well as coordinating the training activities received by all clinical and administrative staff [53,55]. These support teams could provide communication between clinical team members reinforced by weekly update meetings on legal aspects, software licensing and best practices [53].

Workflow adjustments and technical support to integrate the platform with the electronic health record and to formalize financial reimbursements must also be assumed. Cloud storage has enabled sufficient expansion among many providers and thousands of simultaneous TN queries [53]. Other studies emphasize the importance of the availability and proper maintenance of device provisioning and connectivity [83].

Besides professional commitment [55], the training of the whole team, including videos, clinical practice guidelines and live sessions by specialists, has been highlighted [34]. It is considered that the use of TN should be part of the academic curriculum and training followed by resident physicians. As discussed above, the AAN Telemedicine Working Group formed a sub-working group to develop a framework for a formal TN curriculum in residency programmes, which it is hoped can also be introduced to medical students [81].

At the patient and caregiver level, in the video consultation cases during the COVID-19 pandemic in the elderly population for Parkinson’s disease and movement disorders, there were some problems with teleservices, related to the lack of digital and health literacy and the regulation of the participation of other family members in the TN consultation [54].

To ensure the successful implementation of complementary TN consultations, a preparatory process with patients beforehand has been recommended [54]. Instructions should be provided on basic aspects of the process, such as downloading the necessary applications and software for telematic consultation, as well as the location and use of alternative devices required for thorough clinical assessment [53]. Some patients may require support from caregivers or family members to access video consultations and telephone support for connection [64]. However, when technology places a significant burden on patients, interventions may have poor adherence—for example, if they require a regular input of symptoms or medication data [84].

4. Discussion

The objective of this review was to assess the ethical, legal, organisational, social and environmental aspects involved in the complementary use of TN as an adjunct to face-to-face neurology consultations. These aspects refer to an evaluation that goes beyond the core dimensions of conventional HTA (effectiveness and safety), taking into account individual, ethical and cultural aspects. The analysis of these dimensions is particularly relevant, due to two different arguments. The first one is the need to promote person-centred healthcare strategies focused on people’s needs and preferences. The second has been conditioned by the recent difficulties of the health systems, caused by the COVID-19 pandemic, in meeting the population’s health needs. In both cases, the use of technologies to promote remote health care reveals different organisational, legal, and ethical dilemmas that must be considered [4].

To incorporate research questions into this study that were relevant to all stakeholders, we introduced the VALIDATE [20,21,22] framework early in the review process. In the health research field, the criteria of patients or stakeholders, in general, might differ from those of researchers and healthcare professionals and can add value. Patients may have important insights that clinicians and researchers may miss, information about things that can cause problems for them or the types of technology and outcomes that patients value or are concerned about [85]. The participation of patients in the reorganisation of care processes and research can increase the perceived relevance and acceptability of the findings, which can lead to the research results being more fully applied. It has long been pointed out that there are several reasons for conducting participatory research [86]: acceptance is likely to improve, it generates important information, patients’ participation helps identify a whole list of perspectives and issues related to technology and participatory research leads to a better understanding of what technology does, while otherwise evaluation could be limited to measuring what a researcher, using a particular perspective, expects a technology to do.

Despite the diversity of methodological TN approaches reported, the different neurological conditions addressed, the type of technology used at the phase of care at which the service took place and the outcomes reported, the studies included in this review point to a few relevant themes. Firstly, issues related to equity of access, since it is a basic prerequisite of the TM. The digital divide and the limited health and digital literacy at the community level are both important barriers. TN, like TM in general, can pose challenges to accessing health care if it is offered as a non-voluntary proposal and without an alternative. In addition, older and disabled people may find it difficult to establish this relationship at a distance due to their lesser day-to-day relationship and cultural proximity to digital formats [59]. All these issues have been relevant to the consulted stakeholders, and the literature reviewed supports the need to guarantee these prerequisites to implement TN. The effectiveness of the organisational models at different points of contact along the care trajectory of neurological patients was another relevant concern for the panel members consulted. The results of this review do not, however, provide clear evidence about the effectiveness of these organizational models. In countries such as Belgium and France, TM reimbursement is regulated [76]; however, we have not found clearly defined specific legislation regulating the implementation of TN in the Spanish context, so there is some legal uncertainty [87,88,89]. The regulation of virtual medical activity must move forward to overcome the legal gap in which teleneurology care currently finds itself. While TN services can overcome geographical barriers and travel costs, the absence of specific legislation on TM and TN has been found to leave unresolved the problem of universal access to this service [90], as well as the inherent challenges of data protection and professional responsibilities [30,34,46,58,67,72], all of which creates a degree of uncertainty for healthcare professionals [89,91]. However, despite this absence of a specific legal framework for TN, important steps have been taken in the implementation of TN.

According to the Implementation Guide for Telemedicine Services published by the World Health Organisation (WHO) in 2022 [92], TM creates some special situations with unique considerations necessary to protect patient privacy and safety. All these considerations are perfectly applicable to the field of TN, as a particular type of TM. Legal regulations are currently a challenge and a key factor for the successful implementation and development of TM. These legal instruments provide a framework of security for the healthcare professional during the exercise of their clinical activities.

As TM system functionalities are established and refined, the WHO recommends the implementation of regulatory and protective arrangements for healthcare workers, patients and their health information, to mitigate risks and maximise end-user confidence in the system. In general, these regulatory aspects include the protection, privacy and accessibility of personal data, as well as the credibility of healthcare professionals providing TM services.

Special attention has been given to aspects related to the protection of the therapeutic relationship, both for the professional and for the patient, so that it can be developed respecting the ethical principles that govern its treatment [20,21,22,30,34,46,58,72]. The questions proposed by the working group also pointed out the concern for the legal aspects related to the implementation of TN in Spain. The review as carried out has identified this problem beyond the Spanish context, since a concern for the lack of regulation in different scenarios has been highlighted. Patients are increasingly willing to adopt TN systems to improve home care and daily self-management. An essential step towards wider adoption of these systems is to increase regulatory compliance, better define stakeholder responsibilities [88,93] and improve the necessary complementarity of TN with routine face-to-face care [94,95]. Evidence from studies shows that access to TN services can be limited by aspects related to a healthcare organisation, such as the poor reorganisation of roles and workflows and a lack of training for healthcare and administrative staff and patients. During the VALIDate process, it was noted as a concern that health professionals may need specialised training, ongoing support, and practical experience in performing teleneurology and that it may require a model of care delivered by health professionals with experience in this field.

The studies included in this review show that the provision of TM services generates a series of contradictions and tensions [4]. While it is true that there is evidence supporting the acceptability of TN for a proportion of patients and professionals and its feasibility at the time of implementation, other studies identify challenges or dilemmas that condition its acceptability and feasibility. Acceptability may be threatened by various aspects such as (1) the configuration and coverage of internet services, which result in connection failures, frequent interruptions, poor sound or image quality; (2) a lack of understanding of the functioning and benefits of the use of monitoring devices; (3) a perception of the loss of continuity of care and a relational distance and trust with the healthcare professional [27]. Specific training programmes for patients and professionals and the design of a comprehensive plan that fosters the commitment of both parties and establishes clear guidelines for the functioning of TN at home could contribute to the solution of these challenges that compromise the acceptability of the service [27].

In relation to healthcare professionals, the analysis has identified the risk of dehumanisation in the clinical relationship as an element that may influence the acceptability and even the feasibility of TN [71,72], as some consultations require direct contact for an adequate examination—hence the convenience of TN as a complementary service to regular face-to-face care is emphasised. This finding is consistent with some of the concerns expressed by the experts in the virtual meeting and was therefore included as a question to be addressed in this scoping review. TM is a welcome but disruptive innovation because it has the potential cost of altering the dynamics of physician–patient interaction, i.e., the tactile and other non-verbal cues that occur during human interaction in face-to-face settings. How physicians express empathy during TM encounters is an important but unexplored question, despite the abundant literature establishing the clinical efficacy of TN in acute stroke care, and its importance in maintaining patient trust [62]. Stakeholders also referred to socioeconomic and cultural barriers to access.

The findings show that at the practitioner level, the aspects that may affect acceptability are the technical quality of the service and organisational support. This has to do with having an interdisciplinary team to coordinate logistical, technical, legal and financial aspects derived from the use of TN, the training of clinical and administrative staff, and adequately equipping and maintaining the organisation’s devices and connectivity. Another key element reported by the studies analysed is the adaptation of existing clinical protocols [72,83], which allows professionals to develop technological and communication skills, as well as to fulfil basic practical aspects to be followed in TN consultations [53]. Similarly, the results show that to guarantee the successful implementation of the TN service, it is essential to follow a protocolised process of preparation with patients and companions/caregivers to guide patients before, during and after the virtual clinical encounter [48,53,55,57].

Concerning the implementation of TN, we found that the formats in which TN is carried out (synchronous or asynchronous, with professional or caregiver accompaniment) and the type of technology used must be related to the clinical objectives set, requiring users (both clinicians and patients) to have skills linked to ICTs and the organisation of the digital environment in which health interactions take place.

During the COVID-19 pandemic, numerous measures have been taken at the organisational level to ensure the quality of care and patient safety. Among the measures taken to reduce the risk of infection, visits to health centres have been reduced and virtual consultations have been increased [53,55,64,87]. However, the COVID-19 pandemic is unmasking an emerging form of technology-related social inequality: policy and community interventions are needed to support the most socially vulnerable populations and prevent social inequalities in health. In this sense, the panel of experts consulted stated that there could be a gap between the potential of TN in terms of the promise of access and efficiency and the reality of its implementation, during the COVID-19 pandemic and in the current period of cuts in health spending, in which the cost-effectiveness of the savings has not been taken into account.

Once the pandemic is over, the question will be whether TN should be limited to periods of a health crisis or whether it can become a new way of practising medicine. TN lacks specific standards and presents loopholes that leave physicians with a considerable degree of uncertainty [87].

Finally, the study of Whetten [52] represents a methodological contribution to the estimation of greenhouse gas (GHG) emissions that can be avoided due to TN services, taking into account that the health care sector is one of the sectors that contribute more to global warming. However, it should be considered as a limitation of the study that it does not present an evaluation of the GHG emissions generated by the implementation of the TN from a whole life-cycle approach to technology. Although the investigation is still limited, this study can serve as a reference to promote future research that seeks to evaluate the carbon footprint of the complementary service through TN, thus contributing to the mitigation of climate change and its consequences.

Planetary health and sustainability have been considered fundamental principles within the ethics of care to provide ethical and quality medical care within the framework of the Planning and Evaluation of Remote Consultation Services (PERCS) [4]. Despite the relevance and increasing attention given to the environmental impact of health technologies, this aspect is nonetheless complementary, concerning the main outcome measures of comparative effectiveness, safety and cost-effectiveness.

It should be noted that potential obstacles that contribute to limiting the development of a TM service, such as lack of legal clarity and the specific fragmentation of a given legal framework, can only be addressed through a coordinated approach between the different organisations that manage health resources [96].

This scoping review is framed in an HTA report, which has limited the deepening of some of the topics proposed by the stakeholders. Aspects that could not be addressed are identified as research needs, which will be the subject of future work, as reflected in Table 1.

Strengths and Limitations

The main strength of this review has been the contribution made by stakeholders in the initial phase of defining the research question in a virtual consensus meeting, developed as part of the process proposed by the VALIDATE project analysis framework [20,21,22]. This has allowed our results to gain relevance, as they reflect the different perspectives and values of the group of stakeholders consulted. This strength is, however, context-dependent to the Spanish setting because all the participants in the consultation were selected in this country.

Another potential strength of this article lies in the combined application of our theoretical framework. Indeed, the combined assessment of ethical, legal, organisational and social aspects through the EUnetHTA Core Model 3.0, the criteria established by the Spanish Network of Health Technology Assessment Agencies of the National Health System and the analysis of environmental dimension and the criteria of the European VALIDATE project offers new perspectives for the analysis of the context in scoping reviews and other types of reviews.

Regarding limitations, although a greater balance between the neurological disorders in the included studies would have been desirable, the available evidence reflects a greater interest in research on acute phases of some specific diseases, such as stroke, with a greater number of studies included in this review.

Future work that could also be considered include an interpretive phenomenological approach to provide a deeper understanding of the experiences of patients and professionals, as there is considerable variation in individual perceptions of TN and how the program was integrated (or not). Participatory research in different conditions and clinical settings would contribute to a better understanding of the implications of TN implementation.

According to the report published by WHO in 2020 on the implementation of telemedicine services at the time of COVID-19, the following guiding principles should be considered for the successful implementation of telemedicine services [97]: patient-centred care, a multi-sectoral and multi-disciplinary approach, strong digital governance, equity and inclusion, usability and communication and contextualisation and localisation.

In addition, Kho et al. [98], suggest the need for a process-based approach that comprehensively deploys a combination of strategic and operational practices when managing change efforts. Rather than focusing on barriers and facilitators of change, they encourage future telemedicine research to examine the change processes and practices used to achieve successful implementation, particularly those practices that address cultural and people issues, as many barriers to adoption focus on attitudes and behaviours towards change.

5. Conclusions

Overall, the reported results reaffirm the necessary complementarity of TN with regular face-to-face care. This need for complementarity has to do with factors such as acceptability, feasibility, risk of dehumanisation and aspects related to the privacy and confidentiality of sensitive data. Likewise, the findings on implementation show that it is crucial to have an interdisciplinary team capable of coordinating logistical, technical, legal and financial aspects derived from the use of TN, as well as the training of clinical and administrative staff, professionals and patients. Balancing the interests and needs of professionals, and guaranteeing the connectivity and quality of all technological resources is also relevant.

TN should be performed in a framework of person-centred care, where co-design and humanised treatment can be guaranteed. It is a therapeutic relationship mediated by technology, where the same ethical, deontological and legal principles that guide face-to-face care must be followed even more carefully.

Acknowledgments

We would especially like to thank all the experts who participated in the virtual meeting described above for helping us to better understand the implications of TN and to formulate relevant research questions. This list of experts can be found in Supplementary File S1. We would like also to thank Carlos Gonzalez Rodriguez and Leticia Rodriguez Rodriguez for their support as documentalists.

Supplementary Materials

The following are available online at https://www.mdpi.com/article/10.3390/ijerph20043694/s1.

Author Contributions

Conceptualization, Supervision, Writing—Original draft preparation, Reviewing and Editing, A.T.-C. (Alezandra Torres-Castaño) and A.A.-S.; Conceptualization, Writing—Original draft preparation, A.A.-S.; Conceptualization, Writing—Reviewing and Editing, A.T.-C. (Ana Toledo-Chávarri); Writing—Reviewing and Editing, J.C.S.-H.; Writing—Reviewing and Editing, J.D.-R.; Reviewing and Editing, B.L.-S.; Original draft preparation, Y.G.-H.; Reviewing and Editing, M.C.-R. and Reviewing and Editing, P.S.-A. All authors have read and agreed to the published version of the manuscript.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The data presented in this study are available in supplementary material.

Conflicts of Interest

The authors declare no conflict of interest.

Funding Statement

This work was financed by the Spanish Ministry of Health, in the framework of activities developed by the Spanish Network of Agencies for Health Technology Assessment for the National Health Service.

Footnotes

Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

References

  • 1.Feigin V.L., Vos T., Nichols E., Owolabi M.O., Carroll W.M., Dichgans M., Deuschl G., Parmar P., Brainin M., Murray C. The global burden of neurological disorders: Translating evidence into policy. Lancet Neurol. 2020;19:255–265. doi: 10.1016/S1474-4422(19)30411-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Board of Directors of the American Medical Informatics Association A Proposal to Improve Quality, Increase Efficiency, and Expand Access in the U.S. Health Care System. J. Am. Med. Inform. Assoc. 1997;4:340–341. doi: 10.1136/jamia.1997.0040340. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Parnell K., Kuhlenschmidt K., Madni D., Chernyakhovsky C., Donovan I., Garofalo K., Hambrick S., Scott D., Oltmann S., Luk S. Using telemedicine on an acute care surgery service: Improving clinic efficiency and access to care. Surg. Endosc. 2021;35:5760–5765. doi: 10.1007/s00464-020-08055-9. [DOI] [PubMed] [Google Scholar]
  • 4.Greenhalgh T., Rosen R., Shaw S.E., Byng R., Faulkner S., Finlay T., Grundyn E., Husain L., Hughes G., Leone C., et al. Planning and Evaluating Remote Consultation Services: A New Conceptual Framework Incorporating Complexity and Practical Ethics. [(accessed on 22 November 2022)];Front. Digit. Health. 2021 3 doi: 10.3389/fdgth.2021.726095. Available online: https://www.frontiersin.org/articles/10.3389/fdgth.2021.726095. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Patterson V. Teleneurology. J. Telemed. Telecare. 2005;11:55–59. doi: 10.1258/1357633053499840. [DOI] [PubMed] [Google Scholar]
  • 6.Bagot K.L., Bladin C.F., Vu M., Kim J., Hand P.J., Campbell B., Walker A., Donnan G.A., Dewey H.M., Cadilhac D.A., et al. Exploring the benefits of a stroke telemedicine programme: An organisational and societal perspective. J. Telemed. Telecare. 2016;22:489–494. doi: 10.1177/1357633X16673695. [DOI] [PubMed] [Google Scholar]
  • 7.Polisena J., Angelis G.D., Kaunelis D., Shaheen M., Gutierrez-Ibarluzea I. Environmental Impact Assessment of a Health Technology: A Scoping Review. Int. J. Technol. Assess. Health Care. 2018;34:317–326. doi: 10.1017/S0266462318000351. [DOI] [PubMed] [Google Scholar]
  • 8.Marsh K., Ganz M.L., Hsu J., Strandberg-Larsen M., Gonzalez R.P., Lund N. Expanding Health Technology Assessments to Include Effects on the Environment. Value Health. 2016;19:249–254. doi: 10.1016/j.jval.2015.11.008. [DOI] [PubMed] [Google Scholar]
  • 9.Ellis M.J., Boles S., Derksen V., Dawyduk B., Amadu A., Stelmack K., Kowalchuk M., Russell K. Evaluation of a pilot paediatric concussion telemedicine programme for northern communities in Manitoba. Int. J. Circumpolar Health. 2019;78:1573163. doi: 10.1080/22423982.2019.1573163. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Capampangan D.J., Wellik K.E., Bobrow B.J., Aguilar M.I., Ingall T.J., Kiernan T.E., Wingerchuk D.M., Demaerschalk B.M. Telemedicine Versus Telephone for Remote Emergency Stroke Consultations: A Critically Appraised Topic. Neurologist. 2009;15:163–166. doi: 10.1097/NRL.0b013e3181a4b79c. [DOI] [PubMed] [Google Scholar]
  • 11.Shafqat S., Kvedar J.C., Guanci M.M., Chang Y., Schwamm L.H. Role for Telemedicine in Acute Stroke: Feasibility and Reliability of Remote Administration of the NIH Stroke Scale. Stroke. 1999;30:2141–2145. doi: 10.1161/01.STR.30.10.2141. [DOI] [PubMed] [Google Scholar]
  • 12.Schwamm L.H. Virtual TeleStroke Support for the Emergency Department Evaluation of Acute Stroke. Acad. Emerg. Med. 2004;11:1193–1197. doi: 10.1197/j.aem.2004.08.014. [DOI] [PubMed] [Google Scholar]
  • 13.Miley M.L., Demaerschalk B.M., Olmstead N.L., Kiernan T.E.J., Corday D.A., Chikani V., Bobrow B.J. The State of Emergency Stroke Resources and Care in Rural Arizona: A Platform for Telemedicine. Telemed. e-Health. 2009;15:691–699. doi: 10.1089/tmj.2009.0018. [DOI] [PubMed] [Google Scholar]
  • 14.Bellomo R.G., Paolucci T., Saggino A., Pezzi L., Bramanti A., Cimino V., Tommasi M., Saggini R. The WeReha Project for an Innovative Home-Based Exercise Training in Chronic Stroke Patients: A Clinical Study. J. Cent. Nerv. Syst. Dis. 2020;12:117957352097986. doi: 10.1177/1179573520979866. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Refolo P., Sacchini D., Brereton L., Gerhardus A., Hofmann B., Lysdahl K.B., Mozygemba K., Oortwijn W., Tummers M., van der Wilt G.J., et al. Why is it so difficult to integrate ethics in Health Technology Assessment (HTA)? The epistemological viewpoint. Eur. Rev. Med. Pharmacol. Sci. 2016;20:4202–4208. [PubMed] [Google Scholar]
  • 16.Arksey H., O’Malley L. Scoping studies: Towards a methodological framework. Int. J. Soc. Res. Methodol. 2005;8:19–32. doi: 10.1080/1364557032000119616. [DOI] [Google Scholar]
  • 17.Munn Z., Peters M.D.J., Stern C., Tufanaru C., McArthur A., Aromataris E. Systematic review or scoping review? Guidance for authors when choosing between a systematic or scoping review approach. BMC Med. Res. Methodol. 2018;18:143. doi: 10.1186/s12874-018-0611-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Pham M.T., Rajić A., Greig J.D., Sargeant J.M., Papadopoulos A., McEwen S.A. A scoping review of scoping reviews: Advancing the approach and enhancing the consistency. Res. Synth. Methods. 2014;5:371–385. doi: 10.1002/jrsm.1123. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Tricco A.C., Lillie E., Zarin W., O’Brien K., Colquhoun H., Kastner M., Levac D., Ng C., Pearson-Sharpe J., Wilson K., et al. A scoping review on the conduct and reporting of scoping reviews. BMC Med. Res. Methodol. 2016;16:15. doi: 10.1186/s12874-016-0116-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.van der Wilt G.J., Bloemen B., Grin J., Gutierrez-Ibarluzea I., Sampietro-Colom L., Refolo P., Sacchini D., Hofmann B., Sandman L., Oortwijn W. Integrating Empirical Analysis and Normative Inquiry in Health Technology Assessment: The Values in Doing Assessments of Health Technologies Approach. Int. J. Technol. Assess. Health Care. 2022;38:e52. doi: 10.1017/S0266462321001768. [DOI] [PubMed] [Google Scholar]
  • 21.Grin J., Bloemen B., Gutierrez-Ibarluzea I., Hofmann B., Oortwijn W., Refolo P. Learning and practicing more value-reflective, problem-setting health technology assessment: Experiences and lessons from the VALIDATE project. Int. J. Technol. Assess. Health Care. 2022;38:e63. doi: 10.1017/S0266462322000204. [DOI] [PubMed] [Google Scholar]
  • 22.van der Wilt G.J., Oortwijn W., VALIDATE-HTA Consortium Health technology assessment: A matter of facts and values. Int. J. Technol. Assess. Health Care. 2022;38:e53. doi: 10.1017/S0266462322000101. [DOI] [PubMed] [Google Scholar]
  • 23.Bagot K.L., Cadilhac D.A., Bladin C.F., Watkins C.L., Vu M., Donnan G.A., Dewey H., Emsley H.C.A., Davies D.P., Day E., et al. Integrating acute stroke telemedicine consultations into specialists’ usual practice: A qualitative analysis comparing the experience of Australia and the United Kingdom. BMC Health Serv. Res. 2017;17:751. doi: 10.1186/s12913-017-2694-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Bagot K., Moloczij N., Arthurson L., Hair C., Hancock S., Bladin C.F., Cadilhac D.A. Nurses’ Role in Implementing and Sustaining Acute Telemedicine: A Mixed-Methods, Pre-Post Design Using an Extended Technology Acceptance Model. J. Nurs. Scholarsh. 2020;52:34–46. doi: 10.1111/jnu.12509. [DOI] [PubMed] [Google Scholar]
  • 25.Bower K.J., Verdonck M., Hamilton A., Williams G., Tan D., Clark R.A. What Factors Influence Clinicians’ Use of Technology in Neurorehabilitation? A Multisite Qualitative Study. Phys. Ther. 2021;101:pzab031. doi: 10.1093/ptj/pzab031. [DOI] [PubMed] [Google Scholar]
  • 26.Caughlin S., Mehta S., Corriveau H., Eng J.J., Eskes G., Kairy D., Meltzer J., Sakakibara B.M., Teasell R. Implementing Telerehabilitation After Stroke: Lessons Learned from Canadian Trials. Telemed. e-Health. 2020;26:710–719. doi: 10.1089/tmj.2019.0097. [DOI] [PubMed] [Google Scholar]
  • 27.Chan S., O’Riordan A., Appireddy R. Exploring the Determinants and Experiences of Senior Stroke Patients with Virtual Care. Can. J. Neurol. Sci. 2021;48:87–93. doi: 10.1017/cjn.2020.162. [DOI] [PubMed] [Google Scholar]
  • 28.Chen Y., Chen Y., Zheng K., Dodakian L., See J., Zhou R., Chiu N., Augsburger R., McKenzie A., Cramer S.C. A qualitative study on user acceptance of a home-based stroke telerehabilitation system. Top. Stroke Rehabil. 2020;27:81–92. doi: 10.1080/10749357.2019.1683792. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Courtney E., Blackburn D., Reuber M. Neurologists’ perceptions of utilising tele-neurology to practice remotely during the COVID-19 pandemic. Patient. Educ. Couns. 2021;104:452–459. doi: 10.1016/j.pec.2020.12.027. [DOI] [PubMed] [Google Scholar]
  • 30.Gibson J., Lightbody E., McLoughlin A., McAdam J., Gibson A., Day E., Fitzgerald J., May C., Price C., Emsley H., et al. ‘It was like he was in the room with us’: Patients’ and carers’ perspectives of telemedicine in acute stroke. Health Expect. 2016;19:98–111. doi: 10.1111/hex.12333. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Kjelle E., Myklebust A.M. Elemedicine remote controlled stroke evaluation and treatment, the experience of radiographers, paramedics and junior doctors in a novel rural stroke management team. BMC Health Serv. Res. 2021;21:554. doi: 10.1186/s12913-021-06591-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Lawson D.W., Stolwyk R.J., Ponsford J.L., Baker K.S., Tran J., Wong D. Acceptability of telehealth in post-stroke memory rehabilitation: A qualitative analysis. Neuropsychol. Rehabil. 2020;32:1–21. doi: 10.1080/09602011.2020.1792318. [DOI] [PubMed] [Google Scholar]
  • 33.Macchi Z.A., Ayele R., Dini M., Lamira J., Katz M., Pantilat S.Z., Jones J., Kluger B.M. Lessons from the COVID-19 pandemic for improving outpatient neuropalliative care: A qualitative study of patient and caregiver perspectives. Palliat. Med. 2021;35:1258–1266. doi: 10.1177/02692163211017383. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Mammen J.R., Elson M.J., Java J.J., Beck C.A., Beran D.B., Biglan K.M., Boyd C.M., Schmidt P.N., Simone R., Willis A.W., et al. Patient and Physician Perceptions of Virtual Visits for Parkinson’s Disease: A Qualitative Study. Telemed. e-Health. 2018;24:255–267. doi: 10.1089/tmj.2017.0119. [DOI] [PubMed] [Google Scholar]
  • 35.Shea C.M., Turner K., Alishahi Tabriz A., North S. Implementation Strategies for Telestroke: A Qualitative Study of Telestroke Networks in North Carolina. Telemed. e-Health. 2019;25:708–716. doi: 10.1089/tmj.2018.0131. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Simblett S.K., Bruno E., Siddi S., Matcham F., Giuliano L., López J.H., Biondi A., Curtis H., Ferrão J., Polhemus A., et al. Patient perspectives on the acceptability of mHealth technology for remote measurement and management of epilepsy: A qualitative analysis. Epilepsy Behav. 2019;97:123–129. doi: 10.1016/j.yebeh.2019.05.035. [DOI] [PubMed] [Google Scholar]
  • 37.Simblett S.K., Evans J., Greer B., Curtis H., Matcham F., Radaelli M., Mulero P., Arévalo M.J., Polhemus A., Ferrao J., et al. Engaging across dimensions of diversity: A cross-national perspective on mHealth tools for managing relapsing remitting and progressive multiple sclerosis. Mult. Scler. Relat. Disord. 2019;32:123–132. doi: 10.1016/j.msard.2019.04.020. [DOI] [PubMed] [Google Scholar]
  • 38.Simblett S., Matcham F., Curtis H., Greer B., Polhemus A., Novák J., Ferrao J., Gamble P., Hotopf M., Narayan V., et al. Remote Assessment of Disease and Relapse – Central Nervous System (RADAR-CNS) Consortium Patients’ Measurement Priorities for Remote Measurement Technologies to Aid Chronic Health Conditions: Qualitative Analysis. JMIR mHealth uHealth. 2020;8:e15086. doi: 10.2196/15086. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Teriö M., Eriksson G., Kamwesiga J.T., Guidetti S. What’s in it for me? A process evaluation of the implementation of a mobile phone-supported intervention after stroke in Uganda. BMC Public Health. 2019;19:562. doi: 10.1186/s12889-019-6849-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Uscher-Pines L., Sousa J., Zachrison K., Guzik A., Schwamm L., Mehrotra A. What Drives Greater Assimilation of Telestroke in Emergency Departments? J. Stroke Cerebrovasc. Dis. 2020;29:105310. doi: 10.1016/j.jstrokecerebrovasdis.2020.105310. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Wannheden C., Revenäs Å. How People with Parkinson’s Disease and Health Care Professionals Wish to Partner in Care Using eHealth: Co-Design Study. J. Med. Internet Res. 2020;22:e19195. doi: 10.2196/19195. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Wentink M., van Bodegom-Vos L., Brouns B., Arwert H., Houdijk S., Kewalbansing P., Boyce L., Vliet Vlieland T., de Kloet A., Meesters J. How to improve eRehabilitation programs in stroke care? A focus group study to identify requirements of end-users. BMC Med. Inform. Decis. Mak. 2019;19:145. doi: 10.1186/s12911-019-0871-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Andrews J.A., Craven M.P., Jamnadas-Khoda J., Lang A.R., Morriss R., Hollis C., RADAR-CNS Consortium Health Care Professionals’ Views on Using Remote Measurement Technology in Managing Central Nervous System Disorders: Qualitative Interview Study. J. Med. Internet Res. 2020;22:e17414. doi: 10.2196/17414. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Banks J., Corrigan D., Grogan R., El-Naggar H., White M., Doran E., Synnott C., Fitzsimons M., Delanty N., Doherty C.P. LoVE in a time of CoVID: Clinician and patient experience using telemedicine for chronic epilepsy management. Epilepsy Behav. 2021;115:107675. doi: 10.1016/j.yebeh.2020.107675. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Fisher J.M., Hammerla N.Y., Rochester L., Andras P., Walker R.W. Body-Worn Sensors in Parkinson’s Disease: Evaluating Their Acceptability to Patients. Telemed. e-Health. 2016;22:63–69. doi: 10.1089/tmj.2015.0026. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Giunti G., Kool J., Rivera Romero O., Dorronzoro Zubiete E. Exploring the Specific Needs of Persons with Multiple Sclerosis for mHealth Solutions for Physical Activity: Mixed-Methods Study. JMIR mHealth uHealth. 2018;6:e37. doi: 10.2196/mhealth.8996. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Morse H., Biggart L., Pomeroy V., Rossit S. Exploring perspectives from stroke survivors, carers and clinicians on virtual reality as a precursor to using telerehabilitation for spatial neglect post-stroke. Neuropsychol. Rehabil. 2020;32:707–731. doi: 10.1080/09602011.2020.1819827. [DOI] [PubMed] [Google Scholar]
  • 48.Saliba-Gustafsson E.A., Miller-Kuhlmann R., Kling S.M.R., Garvert D.W., Brown-Johnson C.G., Lestoquoy A.S., Verano M.R., Yang L., Falco-Walter J., Shaw J.G., et al. Rapid Implementation of Video Visits in Neurology During COVID-19: Mixed Methods Evaluation. J. Med. Internet Res. 2020;22:e24328. doi: 10.2196/24328. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Taddei M., Bulgheroni S. Facing the real time challenges of the COVID-19 emergency for child neuropsychology service in Milan. Res. Dev. Disabil. 2020;107:103786. doi: 10.1016/j.ridd.2020.103786. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.von Wrede R., Moskau-Hartmann S., Baumgartner T., Helmstaedter C. Counseling of people with epilepsy via telemedicine: Experiences at a German tertiary epilepsy center during the COVID-19 pandemic. Epilepsy Behav. 2020;112:107298. doi: 10.1016/j.yebeh.2020.107298. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.O’Neil O., Fernandez M.M., Herzog J., Beorchia M., Gower V., Gramatica F., Starrost K., Kiwull L. Virtual Reality for Neurorehabilitation: Insights From 3 European Clinics. PM R. 2018;10((Suppl. 2)):S198–S206. doi: 10.1016/j.pmrj.2018.08.375. [DOI] [PubMed] [Google Scholar]
  • 52.Whetten J., Montoya J., Yonas H. ACCESS to Better Health and Clear Skies: Telemedicine and Greenhouse Gas Reduction. Telemed. J. E Health. 2019;25:960–965. doi: 10.1089/tmj.2018.0172. [DOI] [PubMed] [Google Scholar]
  • 53.Spindler M., Jacobs D., Yuan K., Tropea T., Teng C.W., Perrone C., Do D., Wechsler L. A Department Approach to Teleneurology. Telemed. e-Health. 2021;27:1078–1084. doi: 10.1089/tmj.2020.0323. [DOI] [PubMed] [Google Scholar]
  • 54.Kumar A. Experience of video consultation during the COVID-19 pandemic in elderly population for Parkinson’s disease and movement disorders. Postgrad. Med. J. 2021;97:117–118. doi: 10.1136/postgradmedj-2020-138846. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Yang L., Brown-Johnson C.G., Miller-Kuhlmann R., Kling S.M.R., Saliba-Gustafsson E.A., Shaw J.G., Gold C.A., Winget M. Accelerated launch of video visits in ambulatory neurology during COVID-19: Key lessons from the Stanford experience. Neurology. 2020;95:305–311. doi: 10.1212/WNL.0000000000010015. [DOI] [PubMed] [Google Scholar]
  • 56.Vloothuis J., de Bruin J., Mulder M., Nijland R., Kwakkel G., van Wegen E.E.H. Description of the CARE4STROKE programme: A caregiver-mediated exercises intervention with e-health support for stroke patients. Physiother. Res. Int. 2018;23:e1719. doi: 10.1002/pri.1719. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57.Sennott B., Woo K., Hess S., Mitchem D., Klostermann E.C., Myrick E., Anderson S., Savica R., Fleisher J.E. Novel Outreach Program and Practical Strategies for Patients with Parkinsonism in the COVID-19 Pandemic1. JPD. 2020;10:1383–1388. doi: 10.3233/JPD-202156. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.Nemeth L.S., Jenkins C., Jauch E.C., Conway S., Pearlman A., Spruill I.J., Brown L.J., Linnen J., Linnen F., Andrews J.O. A Community-Engaged Assessment of Barriers and Facilitators to Rapid Stroke Treatment: Barriers and Facilitators of Early Stroke Treatment. Res. Nurs. Health. 2016;39:438–448. doi: 10.1002/nur.21749. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59.McKenna M.C., Al-Hinai M., Bradley D., Doran E., Hunt I., Hutchinson S., Langan Y., O’Rourke D., Qasem R., Redmond J., et al. Patients’ Experiences of Remote Neurology Consultations during the COVID-19 Pandemic. Eur. Neurol. 2020;83:622–625. doi: 10.1159/000511900. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 60.Casares M., Wombles C., Skinner H.J., Westerveld M., Gireesh E.D. Telehealth perceptions in patients with epilepsy and providers during the COVID-19 pandemic. Epilepsy Behav. 2020;112:107394. doi: 10.1016/j.yebeh.2020.107394. [DOI] [PubMed] [Google Scholar]
  • 61.Bruno E., Simblett S., Lang A., Biondi A., Odoi C., Schulze-Bonhage A., Wykes T., Richardson M.P., RADAR-CNS Consortium Wearable technology in epilepsy: The views of patients, caregivers, and healthcare professionals. Epilepsy Behav. 2018;85:141–149. doi: 10.1016/j.yebeh.2018.05.044. [DOI] [PubMed] [Google Scholar]
  • 62.Cheshire W.P., Barrett K.M., Eidelman B.H., Mauricio E.A., Huang J.F., Freeman W.D., Robinson M.T., Salomon G.R., Ball C.T., Gamble D.M., et al. Patient perception of physician empathy in stroke telemedicine. J. Telemed. Telecare. 2021;27:572–581. doi: 10.1177/1357633X19899237. [DOI] [PubMed] [Google Scholar]
  • 63.Remy C., Valet M., Stoquart G., El Sankari S., Van Pesch V., De Haan A., Lejeune T. Telecommunication and Rehabilitation for Patients with Multiple Sclerosis: Access and Willingness to Use. A Cross-Sectional Study. [(accessed on 22 November 2022)];Eur. J. Phys. Rehabil. Med. 2020 56 doi: 10.23736/S1973-9087.20.06061-X. Available online: https://www.minervamedica.it/index2.php?show=R33Y2020N04A0403. [DOI] [PubMed] [Google Scholar]
  • 64.Arighi A., Fumagalli G.G., Carandini T., Pietroboni A.M., De Riz M.A., Galimberti D., Galimberti D., Scarpini E. Facing the digital divide into a dementia clinic during COVID-19 pandemic: Caregiver age matters. Neurol. Sci. 2021;42:1247–1251. doi: 10.1007/s10072-020-05009-w. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 65.Rametta S.C., Fridinger S.E., Gonzalez A.K., Xian J., Galer P.D., Kaufman M., Prelack M.S., Sharif U., Fitzgerald M.P., Melamed S.E., et al. Analyzing 2,589 child neurology telehealth encounters necessitated by the COVID-19 pandemic. Neurology. 2020;95:e1257–e1266. doi: 10.1212/WNL.0000000000010010. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 66.Cilia R., Mancini F., Bloem B.R., Eleopra R. Telemedicine for parkinsonism: A two-step model based on the COVID-19 experience in Milan, Italy. Parkinsonism Relat. Disord. 2020;75:130–132. doi: 10.1016/j.parkreldis.2020.05.038. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 67.Calleja-Castillo J.M., Gonzalez-Calderon G. WhatsApp in Stroke Systems: Current Use and Regulatory Concerns. Front. Neurol. 2018;9:388. doi: 10.3389/fneur.2018.00388. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 68.Bagot K.L., Moloczij N., Barclay-Moss K., Vu M., Bladin C.F., Cadilhac D.A. Sustainable implementation of innovative, technology-based health care practices: A qualitative case study from stroke telemedicine. Telemed. Telecare. 2020;26:79–91. doi: 10.1177/1357633X18792380. [DOI] [PubMed] [Google Scholar]
  • 69.Bagot K.L., Cadilhac D.A., Kim J., Vu M., Savage M., Bolitho L., Howlett G., Rabl J., Dewey H.M., Hand P.J., et al. Transitioning from a single-site pilot project to a state-wide regional telehealth service: The experience from the Victorian Stroke Telemedicine programme. J. Telemed. Telecare. 2017;23:850–855. doi: 10.1177/1357633X17734004. [DOI] [PubMed] [Google Scholar]
  • 70.Espay A.J., Hausdorff J.M., Sánchez-Ferro Á., Klucken J., Merola A., Bonato P., Paul S.S., Horak F.B., Vizcarra J.A., Mestre T.A., et al. A roadmap for implementation of patient-centered digital outcome measures in Parkinson’s disease obtained using mobile health technologies. Mov. Disord. 2019;34:657–663. doi: 10.1002/mds.27671. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 71.Liddle J., Burdon M., Ireland D., Carter A., Knuepffer C., Milevskiy N., McBride S., Chenery H., Hall W. Balancing Self-Tracking and Surveillance: Legal, Ethical and Technological Issues in Using Smartphones to Monitor Communication in People with Health Conditions. J. Law. Med. 2016;24:387–397. [PubMed] [Google Scholar]
  • 72.Velasquez S.E., Chaves-Carballo E., Nelson E.L. Pediatric Teleneurology: A Model of Epilepsy Care for Rural Populations. Pediatr. Neurol. 2016;64:32–37. doi: 10.1016/j.pediatrneurol.2016.08.001. [DOI] [PubMed] [Google Scholar]
  • 73.Chirra M., Marsili L., Wattley L., Sokol L.L., Keeling E., Maule S., Sobrero G., Artusi C.A., Romagnolo A., Zibetti M., et al. Telemedicine in Neurological Disorders: Opportunities and Challenges. Telemed. e-Health. 2019;25:541–550. doi: 10.1089/tmj.2018.0101. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 74.Patel U.K., Malik P., DeMasi M., Lunagariya A., Jani V.B. Multidisciplinary Approach and Outcomes of Tele-Neurology: A Review. [(accessed on 16 April 2022)];Cureus. 2019 11 doi: 10.7759/cureus.4410. Available online: https://www.cureus.com/articles/18445-multidisciplinary-approach-and-outcomes-of-tele-neurology-a-review. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 75.Matthews N.L., Skepnek E., Mammen M.A., James J.S., Malligo A., Lyon A., Mitchell M., Kiefer S.L., Smith C.J. Feasibility and acceptability of a telehealth model for autism diagnostic evaluations in children, adolescents, and adults. Autism Res. 2021;14:2564–2579. doi: 10.1002/aur.2591. [DOI] [PubMed] [Google Scholar]
  • 76.Mistiaen P., Devriese S., Pouppez C., Roberfroid D., Savoye I. Video Consultations in the Care for Patients with a Chronic Somatic Disease. [(accessed on 15 November 2022)];KCE. Available online: https://kce.fgov.be/en/publications/all-reports/video-consultations-in-the-care-for-patients-with-a-chronic-somatic-disease.
  • 77.Kratz A.L., Atalla M., Whibley D., Myles A., Thurston T., Fritz N.E. Calling Out MS Fatigue: Feasibility and Preliminary Effects of a Pilot Randomized Telephone-Delivered Exercise Intervention for Multiple Sclerosis Fatigue. J. Neurol. Phys. Ther. 2020;44:23–31. doi: 10.1097/NPT.0000000000000296. [DOI] [PubMed] [Google Scholar]
  • 78.Øra H.P., Kirmess M., Brady M.C., Sørli H., Becker F. Technical Features, Feasibility, and Acceptability of Augmented Telerehabilitation in Post-stroke Aphasia—Experiences From a Randomized Controlled Trial. Front. Neurol. 2020;11:671. doi: 10.3389/fneur.2020.00671. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 79.Schneider R.B., Biglan K.M. The promise of telemedicine for chronic neurological disorders: The example of Parkinson’s disease. Lancet Neurol. 2017;16:541–551. doi: 10.1016/S1474-4422(17)30167-9. [DOI] [PubMed] [Google Scholar]
  • 80.Institute of Medicine (US) Committee on Quality of Health Care in America . Crossing the Quality Chasm: A New Health System for the 21st Century. National Academies Press; Washington, DC, USA: 2001. [(accessed on 22 November 2022)]. Available online: http://www.ncbi.nlm.nih.gov/books/NBK222274/ [PubMed] [Google Scholar]
  • 81.Govindarajan R., Anderson E.R., Hesselbrock R.R., Madhavan R., Moo L.R., Mowzoon N., Otis J., Rubin M.N., Soni M., Tsao J.W., et al. Developing an outline for teleneurology curriculum: AAN Telemedicine Work Group recommendations. Neurology. 2017;89:951–959. doi: 10.1212/WNL.0000000000004285. [DOI] [PubMed] [Google Scholar]
  • 82.Hatcher-Martin J.M., Busis N.A., Cohen B.H., Wolf R.A., Jones E.C., Anderson E.R., Fritz J.V., Shook S.J., Bove R.M. American Academy of Neurology Telehealth Position Statement. Neurology. 2021;97:334–339. doi: 10.1212/WNL.0000000000012185. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 83.Cucca A., Sharma K., Agarwal S., Feigin A.S., Biagioni M.C. Tele-monitored tDCS rehabilitation: Feasibility, challenges and future perspectives in Parkinson’s disease. J. NeuroEng. Rehabil. 2019;16:20. doi: 10.1186/s12984-019-0481-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 84.Elm J.J., Daeschler M., Bataille L., Schneider R., Amara A., Espay A.J., Afek M., Admati C., Teklehaimanot A., Simuni T. Feasibility and utility of a clinician dashboard from wearable and mobile application Parkinson’s disease data. NPJ Digit. Med. 2019;2:95. doi: 10.1038/s41746-019-0169-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 85.Delgado J. La importancia de los valores en la investigación en salud. El caso de la evaluación de tecnologías sanitarias. In: de la Vieja M.T.L., editor. Bioética Traslacional. Plaza y Valdés; Madrid, Spain: 2022. pp. 149–164. [Google Scholar]
  • 86.Reuzel R.P.B., Van der Wilt G.J. The Societal Context of Health Technology Assessment. TA-Datenbank-Nachrichten. 2011;4:107–108. doi: 10.14512/tatup.10.4.107. [DOI] [Google Scholar]
  • 87.Gil Membrado C., Barrios V., Cosín-Sales J., Gámez J.M. Telemedicine, ethics, and law in times of COVID-19. A look towards the future. Rev. Clínica Española (Engl. Ed.) 2021;221:408–410. doi: 10.1016/j.rce.2021.03.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 88.Parimbelli E., Bottalico B., Losiouk E., Tomasi M., Santosuosso A., Lanzola G., Quaglini S., Bellazzi R. Trusting telemedicine: A discussion on risks, safety, legal implications and liability of involved stakeholders. Int. J. Med. Inform. 2018;112:90–98. doi: 10.1016/j.ijmedinf.2018.01.012. [DOI] [PubMed] [Google Scholar]
  • 89.Raposo V.L. Telemedicine: The legal framework (or the lack of it) in Europe. GMS Health Technol. Assess. 2016;12:Doc03. doi: 10.3205/hta000126. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 90.Appireddy R., Khan S., Leaver C., Martin C., Jin A., Durafourt B.A., Archer S.L. Home Virtual Visits for Outpatient Follow-Up Stroke Care: Cross-Sectional Study. J. Med. Internet Res. 2019;21:e13734. doi: 10.2196/13734. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 91.Otto L., Harst L. Investigating barriers for the implementation of telemedicine initiatives: A systematic review of reviews; Proceedings of the Twenty-Fifth Americas Conference on Information Systems; Cancun, Mexico. 15–17 August 2019. [Google Scholar]
  • 92.World Health Organization . Consolidated Telemedicine. Implementation Guide. WHO Regional Office for Europe; København, Danmark: 2022. [(accessed on 21 May 2022)]. p. 68. Available online: https://www.who.int/publications/i/item/9789240059184. [Google Scholar]
  • 93.Salvador Vergès À., Cusí Sánchez M.V., Bossio Grigera P., Fàbrega Agulló C., da Costa F.G., Serra Trullas A., García Abejas A. Determinants in Stakeholder Opinions About Telemedicine in Palliative Care: A Scoping Review. [(accessed on 15 April 2022)];Telemed. e-Health. 2021 doi: 10.1089/tmj.2021.0441. Available online: https://www.liebertpub.com/doi/abs/10.1089/tmj.2021.0441. [DOI] [PubMed] [Google Scholar]
  • 94.Varghese S., Scott R.E. Categorizing the Telehealth Policy Response of Countries and Their Implications for Complementarity of Telehealth Policy. Telemed. J. E Health. 2004;10:61–69. doi: 10.1089/153056204773644599. [DOI] [PubMed] [Google Scholar]
  • 95.Durrani H., Khoja S. A systematic review of the use of telehealth in Asian countries. J. Telemed. Telecare. 2009;15:175–181. doi: 10.1258/jtt.2009.080605. [DOI] [PubMed] [Google Scholar]
  • 96.Pan American Health Organization . Framework for the Implementation of a Telemedicine Service. PAHO; Washington, DC, USA: 2016. [(accessed on 10 November 2022)]. p. 76. Cat 4. Health Systems. Available online: https://iris.paho.org/handle/10665.2/28414. [Google Scholar]
  • 97.World Health Organization . Implementing Telemedicine Services during COVID-19: Guiding Principles and Considerations for a Stepwise Approach. WHO Regional Office for the Western Pacific; Manila, Philippines: 2020. [(accessed on 23 October 2022)]. p. 18. WPR/DSE/2020/032. Available online: https://apps.who.int/iris/handle/10665/336862. [Google Scholar]
  • 98.Kho J., Gillespie N., Martin-Khan M. A systematic scoping review of change management practices used for telemedicine service implementations. BMC Health Serv. Res. 2020;20:815. doi: 10.1186/s12913-020-05657-w. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Data Availability Statement

The data presented in this study are available in supplementary material.


Articles from International Journal of Environmental Research and Public Health are provided here courtesy of Multidisciplinary Digital Publishing Institute (MDPI)

RESOURCES