Abstract
Objective
This systematic review aims to describe the involvement of persons with epilepsy (PWE), healthcare professionals (HP) and caregivers (CG) in the design and development of medical devices is epilepsy.
Methods
A systematic review was conducted, adhering to the Preferred Reporting Items for Systematic Reviews and Meta‐Analyses (PRISMA) guidelines. Eligibility criteria included peer‐reviewed research focusing on medical devices for epilepsy management, involving users (PWE, CG, and HP) during the MDD process. Searches were performed on PubMed, Web of Science, and Scopus, and a total of 55 relevant articles were identified and reviewed.
Results
From 1999 to 2023, there was a gradual increase in the number of publications related to user involvement in epilepsy medical device development (MDD), highlighting the growing interest in this field. The medical devices involved in these studies encompassed a range of seizure detection tools, healthcare information systems, vagus nerve stimulation (VNS) and electroencephalogram (EEG) technologies reflecting the emphasis on seizure detection, prediction, and prevention. PWE and CG were the primary users involved, underscoring the importance of their perspectives. Surveys, usability testing, interviews, and focus groups were the methods used for capturing user perspectives. User involvement occurs in four out of the five stages of MDD, with production being the exception.
Significance
User involvement in the MDD process for epilepsy management is an emerging area of interest holding a significant promise for improving device quality and patient outcomes. This review highlights the need for broader and more effective user involvement, as it currently lags in the development of commercially available medical devices for epilepsy management. Future research should explore the benefits and barriers of user involvement to enhance medical device technologies for epilepsy.
Plain Language Summary
This review covers studies that have involved users in the development process of medical devices for epilepsy. The studies reported here have focused on getting input from people with epilepsy, their caregivers, and healthcare providers. These devices include tools for detecting seizures, stimulating nerves, and tracking brain activity. Most user feedback was gathered through surveys, usability tests, interviews, and focus groups. Users were involved in nearly every stage of device development except production. The review highlights that involving users can improve device quality and patient outcomes, but more effective involvement is needed in commercial device development. Future research should focus on the benefits and challenges of user involvement.
Keywords: epilepsy, medical device design, medical devices, user involvement
Key Points.
PWE are the users more involved in the MDD process.
Surveys and usability testing are the methods more frequently adopted for user involvement in the MDD process in epilepsy.
Literature discloses the involvement of users in the MDD process of 13 commercially available medical devices for epilepsy management.
1. INTRODUCTION
Epilepsy impacts approximately 70 million individuals and 30% of them do not respond to current treatments to control their seizures. 1 Accurately anticipating the onset of seizures and managing them can assist PWE in avoiding self‐injury and potentially enhance their overall well‐being. Seizure detection and, more recently, seizure forecasting are critical areas of clinical advancement in epilepsy. The progress in these areas has been driven by developments in medical devices, which have the potential to optimize seizure control and prevent seizure‐related morbidity and mortality in individuals with epilepsy. 2
Medical devices used in epilepsy range from implantable devices such as vagus nerve stimulators, responsive neurostimulation and deep brain stimulation to non‐implantable devices such as electroencephalography (EEG)‐based systems and non‐EEG‐based seizure detection wearable devices. 1 Regardless of the type of medical device, the ultimate goal is to develop devices that meet the needs of end‐users (PWE, CGs and HP), improve disease outcomes, and enhance the overall quality of life of individuals with epilepsy.
Medical device manufacturers create life‐changing innovations through the collaborative expertise of various disciplines, including engineering, manufacturing, clinical, regulatory, marketing, sales, and business specialists. Although cutting‐edge technology advancement in medical device design is absolutely vital, it is the overall experience (cognitive and emotional) that impacts the daily life of the patient and CG. 3 In recent years, there has been a growing recognition of the importance of user involvement in MDD in general, 4 and specifically for epilepsy. 5 In epilepsy, user involvement refers to the active participation of PWE, CGs, HP and other stakeholders in the design and development of medical devices. Understanding and incorporating users' needs, preferences, and feedback into the MDD process can help to ensure that the device is effective, safe, and well‐received by the intended users. User involvement can take various forms, including needs assessment, usability testing, co‐creation and co‐design. 6 User‐centered design is a critical factor in the design and development of medical devices. Specifically, considering user needs during the early stages of device conceptualization and throughout the subsequent development process can yield substantial benefits. This approach can improve patient safety, increase compliance with treatment regimens, and enhance health outcomes. 7 Additionally, user‐centered design promotes higher levels of user satisfaction, and it can lead to a reduction in device development time by identifying and addressing usability issues prior to launch. This, in turn, can help to avoid costly design changes and product recalls, which can have significant financial and reputational implications for device manufacturers. 8 Therefore, successful medical device innovation requires investigation of end‐user and broader stakeholder contexts and incorporation of those context‐specific needs into design processes. 9
Despite the initial promise that user involvement in medical device design and development for epilepsy holds, there is widespread skepticism regarding its effectiveness within the scientific, medical, and general communities, leaving important choices and questions open for debate, namely: (i) who should be involved, (ii) at which stages should they be involved, (iii) which participatory methods are most suitable and (iv) what topics are to be discussed with end users during development. Therefore, we conducted a systematic review to explore the practice of user involvement in the design and development of medical devices for epilepsy, aiming to provide valuable insights into the role of user involvement in this context and inform future research and practice in this area. Descriptive statistics and qualitative thematic analysis were used for analyzing the data, which were divided into different themes, that is, types of medical devices developed and assessed; types of medical device users involved; extent of user involvement by different stages of the MDD cycle; and methods used for capturing users' perspectives.
2. METHODS
The present systematic literature review was performed to identify and extract all currently available literature related to user involvement in medical devices or technology utilized in the monitoring, treatment and/or management of epilepsy.
2.1. Protocol and registration
This systematic review was reported according to the Preferred Reporting Items for Systematic Reviews and Meta‐Analyses (PRISMA) guidelines, 10 and was prospectively registered on the International Prospective Register of Systematic Reviews (PROSPERO) (CRD42023490599).
2.2. Eligibility criteria
Publications inclusion and eligibility for short‐listing criteria encompassed (a) peer‐reviewed original research, (b) targeted only at medical devices according to WHO's definition 11 with application for epilepsy management and (c) indicating user (PWE, CG and HP) involvement during these products' development lifecycle.
Original publications were excluded if presenting any of the following characteristics: the wrong population (i.e., non‐human population); the wrong intervention (i.e., medical devices used for other purposes rather than epilepsy management); the wrong outcome (i.e., there were no epilepsy or seizure diagnosis, management, or treatment outcomes); publication not available in the English language; publications not in full publication. All studies published up to 30 November 2023 were included with no other time limitations.
2.3. Search strategy
Search strings related to medical devices, users' (PWE, CG and HP) involvement and epilepsy were developed. Thus, the search term (“epilepsy”) was searched in combination with the following search strings: (“device users” OR “end‐users” OR “medical devices” OR “medical device users” OR “needs assessment” OR “new medical technology” OR “user centered product” OR “user criteria” OR “user input” OR “user interests” OR “user involvement” OR “user needs” OR “user needs assessment” OR “user needs research” OR “user participation” OR “user perceptions” OR “user perspective” OR “user requirements” OR “user requirements elicitation” OR “user studies” or “user survey” OR “user‐based” OR “wearable device” OR “device” and “acceptability” OR (“device” AND “usability”) OR (“device” AND “satisfaction”) OR (“device” AND “patient views”)). The Boolean operator AND was used to link the search term with the respective search strings on all databases.
Three databases were used from database inception on 30 November 2023: PubMed, Web of Science and Scopus. All searches were performed based on the title, abstract and keyword in all databases. Articles were first screened through their titles and abstracts before proceeding with the full‐text screening of relevant articles. The search criteria and keywords were arrived at through consensus with all researchers. Hand searching, personal collections (unpublished studies, conference abstracts, gray literature, or other resources that researchers have accumulated through personal networks or professional contacts) and exploding references (reviewing the reference lists of relevant articles to identify additional studies that may not have been captured through our primary search strategy) were also used to augment the results.
2.4. Selection process
Database search results were imported into EndNote (EndNote x9; Clarivate, Philadelphia, PA, USA), and duplicates were removed. Results were then exported to an Excel spreadsheet for title, abstract, and full‐text screening. Study selection, data extraction and assessment of study quality followed the Standards for Reporting Qualitative Research. 12 No assumptions were made during the selection to reduce the risk of bias. Each paper was screened and discussed by two independent reviewers (JF, RP). Disagreements were resolved by a third independent researcher (CC).
2.5. Data collection and analysis
Data were extracted using a data‐extraction form (Appendix A) developed for the review. 13 Data extracted included: (1) author details, (2) year of publication, (3) country of study, (4) type of medical device, (5) method/tool/approach, (6) users and (7) product development stages. Since there is no standard framework to describe the MDD stages, 14 for data extraction purposes, the medical device lifecycle was divided into five stages: 1‐Concept, 2‐Design, 3‐Testing and Trials, 4‐Production, and 5‐Deployment. The classification of medical device lifecycle stages was carried out based on the product lifecycle reported in the literature (Table 1 adapted from Shah, Robinson 15 ).
TABLE 1.
Product Lifecycle Stages (Adapted from Shah, Robinson 15 ).
| Medical device lifecycle stage | Details |
|---|---|
| Concept | Starts with idea generation and includes technical, financial, and commercial assessment |
| Design | Involves product development process from (re)design to prototype development |
| Testing and trials | Starts with prototype testing in‐house and includes trials in the real field |
| Production | Includes production on large scale supported by business and commercial rationale |
| Deployment | Includes product marketing, launch, and use in the real field |
3. RESULTS
The study workflow and paper selection process is illustrated in Figure 1. Following the inclusion criteria review, 55 publications 16 , 17 , 18 , 19 , 20 , 21 , 22 , 23 , 24 , 25 , 26 , 27 , 28 , 29 , 30 , 31 , 32 , 33 , 34 , 35 , 36 , 37 , 38 , 39 , 40 , 41 , 42 , 43 , 44 , 45 , 46 , 47 , 48 , 49 , 50 , 51 , 52 , 53 , 54 , 55 , 56 , 57 , 58 , 59 , 60 , 61 , 62 , 63 , 64 , 65 , 66 , 67 , 68 , 69 , 70 were included, and 109 were excluded (see Figure 1 for PRISMA flow chart).
FIGURE 1.

PRISMA Flowchart adopted for the present systematic review.
Seventeen of the 55 included publications were from the United States, 7 from the United Kingdom, 6 from Canada, 5 from Denmark, 4 from The Netherlands, 3 from Germany and 3 from South Korea and 1 from Sweden, 1 from Mexico, 1 from France, 1 from Italy and 1 from Belgium. Five studies were of multiple origin (Table S1).
Across the years, we find that user involvement in MDD is becoming more frequent. Figure 2 shows the number of papers published per year and the total accumulated number of publications over time since the inaugural paper by Hufford, R.L., P.M. 16
FIGURE 2.

Number of publications per year (blue bars) and cumulative number (orange line) of publications from 1999 to 2023, as of *November 30, 2023. (N = 55).
3.1. Types of medical devices assessed by user involvement
In our comprehensive review, we have identified a broad spectrum of medical devices (as illustrated in Figure 3) that have been conceived and rigorously assessed by involving end‐users. The majority of the devices were seizure detection devices (44%) and healthcare/clinical information systems (40%) such as Software as Medical Device, web‐based tools, electronic health records, and videoconferencing systems. Vagus Nerve Stimulator systems represented 9% of the studies found, followed by EEG (5%) and 1 study on an automated injection system (2%).
FIGURE 3.

Types of medical devices developed and assessed by user involvement (N = 55).
3.2. Types of medical devices users involved in MDD and assessment
A wide range of users were involved in the MDD process, including clinicians, PWE, carers, family members and persons with different disabilities and impairments (Figure 4). PWE were the users more frequently involved (40%, N = 3), followed by the PWE alongside CG (27%, N = 15) and HP (11%, N = 6). CG and HP alone were the users less frequently involved.
FIGURE 4.

Included publications by types of users (N = 55), CG, caregivers; HP, health professionals; PWE, patients with epilepsy.
3.3. Extent of user involvement by stage of the medical device lifecycle
The findings of the selected studies, especially the stages of the development of new medical devices, and methods used for capturing user perspectives by stages of the medical device lifecycle, are summarized in Figure 5 and Table S1. In 93% (N = 51) of the studies, users were involved in one stage of the medical device lifecycle especially in the deployment stage, and in the remaining studies users were involved in 2 (5%, N = 3) or 3 (2%, N = 1) stages of the lifecycle. Single‐stage involvement was predominant in the deployment phase during which the product is already in the market, as reported in 45% (N = 25) of the studies, followed by concept stages in 25% (N = 14), when all uncertainties such as the clinical need definition, customer requirements and needs, finances, reimbursement strategy, team selection, or legal aspects must be considered. Two‐stage combinations were between design and testing and trials in 5% (N = 3). Three‐stage combinations for user involvement were between concept, design, and testing and trials stages in 2% (N = 1), which is shown in Figure 5.
FIGURE 5.

Included publications by products lifecycle stages (N = 55).
All other studies are less comprehensive as their models only encompass one stage.
3.4. Methods used for capturing users' perspectives
Our review shows that several methods were designed to involve users, often requiring the combination of both qualitative methods to evaluate parameters from a numerical point of view and quantitative methods to indicate the user's choices, thoughts, and feelings. Involving users and capturing their perspectives in the medical device technology lifecycle concerned mostly surveys in 49% (N = 43), usability testing in 20% (N = 18), interviews in 19% (N = 17), and focus groups in 11% (N = 10) of the studies (Figure 6). These methods are mapped against the medical device lifecycle stages where they were used (Table 2). Some of the studies used more than one method of inquiry.
FIGURE 6.

Methods used for capturing user perspectives (N = 55).
TABLE 2.
Methods used for capturing user perspectives by stages of the medical device lifecycle (N = 55).
| Concept stage | Design stage | Test and trials stages | Deployment stage |
|---|---|---|---|
|
Survey (11) Focus groups (2) Interview (3) Usability testing (1) |
Focus groups (4) Interviews (3) Survey (4) Usability testing (4) |
Usability testing (6) Survey (8) Focus groups (3) |
Interviews (10) Survey (16) Usability testing (6) Focus groups (3) |
Abbreviation: N, total publications included.
Surveys and focus groups were used in all four medical device lifecycle stages where the users were involved. Typically, surveyed individuals were asked to respond to the questions in a yes/no manner, on a Likert‐type scale (e.g., very often to not at all often), or with open‐ended responses. The choice of responses was dictated by the investigator and the medical device (if one was used). The selection of the type of response desired was often made based on the difficulty of the question asked and the depth of knowledge and level of precision the investigator would like to have about a particular factor. 71
Usability tests and interviews were most commonly used for involving users and capturing their perspectives across three stages of the medical device lifecycle. During usability tests, various data collection methods were used to collect both qualitative and quantitative data. Results such as time to complete tasks, or errors made during tasks, were easy to understand and compare. In its simplest form, a usability test just involved users performing a number of typical tasks and then reporting their experiences of using the device, that is, what, in their opinion, worked well and what was problematic in the device placement. 42 When testing an existing or prototype device to identify areas for improvement for example, qualitative data were more useful. 46 In some of the reviewed studies, the developers observed users performing scenario‐based usability tests to identify shortcomings or areas for improvement 48 and/or asked the user to report their experiences in follow‐up interviews 55 or through user‐centered methods such as empathy interviews, empathy mapping, and persona development as they complete the task. 63 Sometimes quantitative data were collected during usability tests, such as the time taken to complete a task using the device or the number of errors made while performing the task. 41 Interviews were mainly semi‐structured and face‐to‐face. The factors on which information was routinely collected in these studies include socio‐demographic characteristics, lifestyle practices, medical history, and use of medical devices.
Finally, our systematic review revealed that almost half of the papers we retrieved incorporated 2 or more methods to evaluate user perspectives throughout the MDD process. For example, a scoping method such as exploratory interviews 64 or a focus group 50 were used to specify the needs and requirements of the users with an evaluative method such as a usability test 64 or survey 50 then used respectively at a later stage to determine whether these have been met.
4. DISCUSSION
Successful medical device innovation requires research beyond technology‐centered or technocentric design approaches to embrace user‐centered methods. 9 Using formal methods to involve users in the MDD process should increase the probability that devices meet proper clinical goals, comply with technical standards, are cost‐effective and meet ethical norms. 72
4.1. Types of devices
In this review, a substantial proportion of the devices pertained to seizure detection, and healthcare and clinical information systems. This distribution aligns with previous studies 73 , 74 that highlight the predominant focus on seizure forecasting and detection in epilepsy research, underscoring the profound impact of seizures' unpredictability in this condition. Notably, only 5 VNS and 3 EEG‐based systems were found in our literature search. Moreover, among the 23 commercially available seizure detection devices and tools in the US and Europe, reported by Shum, Friedman, 75 only Nightwatch, Epicare, Epilog, Sensor Dots and GeneActiv were identified to have involved users in the MDD process predominantly in the deployment phase. 26 , 36 , 38 , 49 This indicates a notable discrepancy in the extent of user involvement in the development of commercially available devices for epilepsy management. As highlighted by Hagedorn, Krishnamurty, Grosse, 76 the disclosure of user involvement might be limited due to safety, privacy, and other ethical concerns that are unique to medical environments and contexts. Nevertheless, these results highlight a potential area for further research and improvement.
4.2. Types of users
The development of better products requires an in‐depth understanding of all types of users, their activities, and their needs. 77 In epilepsy, prior research has demonstrated that distinctions among users, including PWE, CG or HP can influence the delineation of user‐specific requirements. 27 Consequently, similar factors were appropriately considered in this study. Our review reveals that various types of medical devices are developed and assessed by PWE, CG and HP. These different groups of healthcare technology users' characteristics, skills and working environment may be different, which is worth considering when developing health care technologies from the users' perspective. It must be mentioned, however, that in assessing user needs, there is a substantial bias towards considering the needs of HP in contrast to PWE and CG. It is vital, therefore, that a range of users are consulted to get as wide an array of input as possible. 78 Our review showed that PWE and CG are the users more involved in the MDD process. These users are likely to be a non‐medical, heterogeneous group, including family members. As a result, their background, age, level of training, physical and mental fitness, and language knowledge vary considerably. Furthermore, the context of use is hard to predict and likely to be less controlled, when compared with a healthcare setting where standardized procedures and protocols are usually in effect. Therefore, understanding their individual needs is imperative for a successful device development process, and product quality and safety, 13 , 15 which might be the reason why these are more involved.
4.3. Methods of involvement
In the process of designing and developing medical devices, biomedical innovators have at their disposal a range of formal methods to incorporate user requirements. Our review shows that four methods were used to involve users in the MDD process, despite several other available approaches could have been considered such as heuristic evaluation, journey mapping, 79 and cognitive walkthrough. 80 The majority of the studies used surveys, probably due to their effectiveness in gathering user feedback, namely through scalability, cost‐effectiveness, standardization of data, anonymity, and quick data collection. 81 With increasing attention being paid to patient‐reported outcomes by funding agencies, measures of patient‐centered factors, such as quality of life, depression, anxiety, cognitive, and functional status, are increasingly included in these surveys. Usability evaluation was the second most used method, reported in 20% of the reviewed studies, probably due to the current focus on improving usability and reducing human error within the medical device industry, and their need for regulatory agencies' certification. 82
Depending on the purpose and context of the medical device, understanding user needs and eliciting their perspectives for developing medical devices could entail a combination of different methods. 13 Our systematic review revealed that nearly half of the papers we retrieved incorporated two or more methods to evaluate user perspectives throughout the MDD process. The identified use of multiple qualitative and quantitative methods in combination with specific design methods is in line with the most recent literature which highlights the importance of multi‐method human‐centered design approaches for the development of health innovations comprising several design cycles. 83
4.4. Stages of MDD
Human‐centered design should be central to all MDD to ensure that user needs are met. It is recommended that user‐centered design should begin early, and continue throughout device development. 84 Although we have found that users were involved in four out of the five stages of the MDD process—concept, design, testing and trials, and deployment stages—none of the medical devices identified was assessed in all of these four stages. Moreover, the predominance of studies found in the deployment phase suggests that devices may lack sufficient user input during their development, since the form and function has already been determined, and the ability to innovate based on user needs is limited due to a number of fixed parameters. 3 Consequently, the medical devices found in this review may only partially meet user requirements or fail to meet user requirements which could result in suboptimal user experiences, higher modification costs, and missed opportunities for innovation.
4.5. Regulatory view
Despite the fact that regulatory authorities such as Food and Drug Administration (FDA) and European Medicines Agencies (EMA) and international standards organizations have increasingly emphasized the importance of the using formal methods for users' involvement in the MDD as a critical factor in ensuring the effectiveness, safety, and usability of medical devices, 85 , 86 the involvement of users in the MDD process in epilepsy remains marginal. Our systematic review revealed that users were only involved in the MDD process of 13 commercially available medical devices for epilepsy management with most of the involvement being performed at the end of the MDD process in the deployment phase. These results are in line with other therapeutic areas, as medical device manufacturers often do not consider the benefit of using formal human factors engineering methods within the MDD process. 7 This gap suggests that the appropriate employment of formal methods by manufacturers is unlikely to occur to significant levels without deliberate efforts to encourage and support manufacturers in doing so. Alternatively, the implementation of such methods could assume a mandatory character, being dictated to manufacturers by standards and purchasing agencies.
5. LIMITATIONS
This systematic review adopted the MDD cycle comprising 5 phases accordingly with Shah, Robinson. 15 However, there is a lack of standardization of the MDD life cycle phases. WHO has yet to publish the medical device innovation part of the WHO medical device technical series, where it is expected to contribute to the standardization of the stages of the MDD process. Moreover, one limitation of this systematic review lies in the potential exclusion of medical devices developed by HP, whose contributions, though integral to the development phase, may not be explicitly reported in dedicated studies. Moreover, our review is contingent on published studies, and thus, it might not capture unpublished research, proprietary assessments by companies, or start‐up initiatives aimed at gathering end‐users' feedback. This limitation highlights the potential underrepresentation of critical insights and developments in the field. The underreporting of user involvement in the MDD process, especially in epilepsy management, results in a missed opportunity for the broader medical community. Theoretically, once IP rights are secured, companies could safely disclose their methods of user involvement without jeopardizing their competitive position. However, the prevalent medical device industry practice of non‐disclosure prevents the sharing of potentially beneficial experiences. Such transparency could foster an environment of collaborative improvement, motivating others to adopt user‐centric approaches in device development. The lack of published information on user involvement methods in peer‐reviewed journals hinders the opportunity for cross‐learning and iterative enhancements in medical device design. This gap in knowledge dissemination ultimately impacts the quality and efficacy of devices developed for epilepsy care, as well as other medical fields. Additionally, our review found only 55 papers on user involvement or acceptability, likely because these metrics are often embedded within the paper rather than highlighted in the abstract or title. This may have inadvertently excluded relevant studies, suggesting there could be more instances of user involvement not captured in our review.
6. CONCLUSION AND FUTURE DIRECTIONS
This systematic review elucidates the potential advantages and constraints of user involvement in MDD for epilepsy management. The analysis of 55 scientific sources reveals key findings: PWE are the most involved users, emphasizing the critical role of end‐user feedback. Surveys and usability testing are common methods for gathering user input due to their scalability and cost‐effectiveness. The selection of formal methods varies by device type, indicating a need for diverse qualitative and quantitative approaches. Despite user involvement in four out of five MDD stages—concept, design, testing, and deployment—there is insufficient engagement across all stages, potentially affecting device efficacy and usability. Existing regulatory guidelines stress the importance of user involvement, but more detailed guidelines are necessary for widespread adoption.
Future research should develop comprehensive guidelines that detail best practices for user involvement, ensuring early and continuous engagement. It should also broaden the scope to include caregivers and healthcare professionals, recognizing their distinct needs. Innovative methods like heuristic evaluation and journey mapping should be explored to enhance user feedback. Addressing underreporting and non‐disclosure of user involvement methods is crucial, advocating for greater transparency and sharing of best practices. Additionally, research should investigate the impact of user involvement on clinical outcomes, safety, and satisfaction, providing robust evidence for user‐centered design. This comprehensive approach aims to improve patient outcomes, foster innovation, and enhance efficiency in medical device development for epilepsy care.
AUTHOR CONTRIBUTIONS
J.F., R.P., C.C., J.C. and L.L. were responsible for conceptualization, study design, and search strategy for this Review. J.F. and R.P. carried out the systematic review. C.C. adjudicated disagreements. J.F. carried out the statistical analyses. J.F. and R.R. drafted the manuscript. All authors critically revised the manuscript, approved its submitted version, and accept responsibility for its content. The article is the original work of the authors and has not been previously published, nor is it currently under consideration by any other journal.
CONFLICT OF INTEREST STATEMENT
The authors declare no competing interests. We confirm that we have read the Journal’s position on issues involved in ethical publication and affirm that this report is consistent with those guidelines.
Supporting information
Table S1.
ACKNOWLEDGMENTS
This systematic review was funded by the European Union. Views and opinions expressed are however those of the author(s) only and do not necessarily reflect those of the European Union or European Innovation Council and SMEs Executive Agency (EISMEA). Neither the European Union nor the granting authority can be held responsible for them. The work of J.C. is partially financed by National Funds through the Portuguese funding agency, FCT—Fundação para a Ciência e a Tecnologia, within project LA/P/0063/2020. DOI 10.54499/LA/P/0063/2020 | https://doi.org/10.54499/LA/P/0063/2020. C.C. is supported by a Scientific Employment Stimulus contract (2020.00067.CEECIND) from Fundação para a Ciência e a Tecnologia.
APPENDIX A. Data extraction form
A.1.
| Author details | Study design | Country of the study | Year of publication | Objectives | Stages/phases of the development of medical device | Medical device |
|---|---|---|---|---|---|---|
Ferreira J, Peixoto R, Lopes L, Beniczky S, Ryvlin P, Conde C, et al. User involvement in the design and development of medical devices in epilepsy: A systematic review. Epilepsia Open. 2024;9:2087–2100. 10.1002/epi4.13038
Contributor Information
João Ferreira, Email: joao.ferreira@biostrike.pt.
Carlos Conde, Email: cconde@ibmc.up.pt.
João Claro, Email: jclaro@fe.up.pt.
REFERENCES
- 1. Ong JS, Wong SN, Arulsamy A, Watterson JL, Shaikh MF. Medical technology: a systematic review on medical devices utilized for epilepsy prediction and management. Curr Neuropharmacol. 2022;20:950–964. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2. Hubbard I, Beniczky S, Ryvlin P. The challenging path to developing a Mobile health device for epilepsy: the current landscape and where we go from here. Front Neurol. 2021;12:740743. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3. Dunn JL, Ko KHK, Lahoud D, Nusem E, Straker K, Wrigley C. Exploring the role of design in the context of medical device innovation. In: Almendra RA, editor. Proceedings of the academy for design innovation management conference 2019. United Kingdom: Academy for Design Innovation Management; 2019. p. 1–19. [Google Scholar]
- 4. FDA . Applying Human Factors and Usability Engineering to Medical Devices. 2016.
- 5. Bruno E, Viana PF, Sperling MR, Richardson MP. Seizure detection at home: do devices on the market match the needs of people living with epilepsy and their caregivers? Epilepsia. 2020;61(Suppl 1):S11–S24. [DOI] [PubMed] [Google Scholar]
- 6. Vaisson G, Provencher T, Dugas M, Trottier ME, Chipenda Dansokho S, Colquhoun H, et al. User involvement in the design and development of patient decision aids and other personal health tools: a systematic review. Med Decis Making. 2021;41:261–274. [DOI] [PubMed] [Google Scholar]
- 7. Money AG, Barnett J, Kuljis J, Craven MP, Martin JL, Young T. The role of the user within the medical device design and development process: medical device manufacturers' perspectives. BMC Med Inform Decis Mak. 2011;11:15. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8. Arthur G, Money JB, Kuljis J, Craven MP, Martin JL, Young T. The role of the user within the medical device design and development process: medical device manufacturers' perspectives. BMC Med Inform Decis Mak. 2011;11:12. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9. Rodriguez NM, Burleson G, Linnes JC, Sienko KH. Thinking beyond the device: an overview of human‐ and equity‐centered approaches for health technology design. Annu Rev Biomed Eng. 2023;8(25):257–280. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10. Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021;29(372):n71. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11. WHO . Global Model Regulatory Framework for Medical Devices including in vitro diagnostic medical devices. 2017.
- 12. O'Brien BC, Harris IB, Beckman TJ, Reed DA, Cook DA. Standards for reporting qualitative research: a synthesis of recommendations. Acad Med. 2014;89:1245–1251. [DOI] [PubMed] [Google Scholar]
- 13. Shah SG, Robinson I, AlShawi S. Developing medical device technologies from users' perspectives: a theoretical framework for involving users in the development process. Int J Technol Assess Health Care. 2009;25:514–521. [DOI] [PubMed] [Google Scholar]
- 14. Maresova P, Klimova B, Honegr J, Kuca K, Ibrahim WNH, Selamat A. Medical device development process, and associated risks and legislative aspects‐systematic review. Front Public Health. 2020;8:308. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15. Shah SG, Robinson I. User involvement in healthcare technology development and assessment: structured literature review. Int J Health Care Qual Assur Inc Leadersh Health Serv. 2006;19:500–515. [DOI] [PubMed] [Google Scholar]
- 16. Hufford BJ, Glueckauf RL, Webb PM. Home‐based, interactive videoconferencing for adolescents with epilepsy and their families. Rehabil Psychol. 1999;44:176–193. [Google Scholar]
- 17. Zamponi N, Rychlicki F, Corpaci L, Cesaroni E, Trignani R. Vagus nerve stimulation (VNS) is effective in treating catastrophic 1 epilepsy in very young children. Neurosurg Rev. 2008;31:291–297. [DOI] [PubMed] [Google Scholar]
- 18. DiIorio C, Escoffery C, McCarty F, Yeager KA, Henry TR, Koganti A, et al. Evaluation of WebEase: an epilepsy self‐management web site. Health Educ Res. 2009;24:185–197. [DOI] [PubMed] [Google Scholar]
- 19. Schulze‐Bonhage A, Sales F, Wagner K, Teotonio R, Carius A, Schelle A, et al. Views of patients with epilepsy on seizure prediction devices. Epilepsy Behav. 2010;18:388–396. [DOI] [PubMed] [Google Scholar]
- 20. Koo YS, Yang KS, Seok HY, Lee SK, Lee IK, Cho YW, et al. Characteristics of patients with epilepsy who use a website providing healthcare information about epilepsy in South Korea. Epilepsy Behav. 2012;25:156–161. [DOI] [PubMed] [Google Scholar]
- 21. Vonhofen G, Evangelista T, Lordeon P. Nursing benefits of using an automated injection system for ictal brain single photon emission computed tomography. J Neurosci Nurs. 2012;44:91–95; quiz 96‐97. [DOI] [PubMed] [Google Scholar]
- 22. Thygesen KS, Sabers A. Promising effect of vagal stimulation in Danish patients with epilepsy. Dan Med J. 2013;60:A4597. [PubMed] [Google Scholar]
- 23. Brunnhuber F, Amin D, Nguyen Y, Goyal S, Richardson MP. Development, evaluation and implementation of video‐EEG telemetry at home. Seizure. 2014;23:338–343. [DOI] [PubMed] [Google Scholar]
- 24. Askamp J, van Putten MJ. Mobile EEG in epilepsy. Int J Psychophysiol. 2014;91:30–35. [DOI] [PubMed] [Google Scholar]
- 25. Hoppe C, Feldmann M, Blachut B, Surges R, Elger CE, Helmstaedter C. Novel techniques for automated seizure registration: Patients' wants and needs. Epilepsy Behav. 2015;52:1–7. [DOI] [PubMed] [Google Scholar]
- 26. van Andel J, Leijten F, van Delden H, van Thiel G. What makes a good home‐based nocturnal seizure detector?A value sensitive design. PLoS One. 2015;10:e0121446. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27. Van de Vel A, Smets K, Wouters K, Ceulemans B. Automated non‐EEG based seizure detection: do users have a say? Epilepsy Behav. 2016;62:121–128. [DOI] [PubMed] [Google Scholar]
- 28. Newman C, Shankar R, Hanna J, McLean B, Osland A, Milligan C, et al. Developing an evidence‐based epilepsy risk assessment eHealth solution: from concept to market. JMIR Res Protoc. 2016;7(5):e82. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29. Patel AD, Moss R, Rust SW, Patterson J, Strouse R, Gedela S, et al. Patient‐centered design criteria for wearable seizure detection devices. Epilepsy Behav. 2016;64:116–121. [DOI] [PubMed] [Google Scholar]
- 30. Sauro KM, Holroyd‐Leduc J, Wiebe S, Quan H, Cooke L, Cross JH, et al. Knowledge translation of an online tool to determine candidacy for epilepsy surgery evaluation. Neurol Clin Pract. 2016;6:304–314. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31. Tovar Quiroga DF, Britton JW, Wirrell EC. Patient and caregiver view on seizure detection devices: a survey study. Seizure. 2016;41:179–181. [DOI] [PubMed] [Google Scholar]
- 32. Modi AC, Schmidt M, Smith AW, Turnier L, Glaser N, Wade SL. Development of a web‐based executive functioning intervention for adolescents with epilepsy: the epilepsy journey. Epilepsy Behav. 2017;72:114–121. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33. Ali R, Elsayed M, Kaur M, Air E, Mahmood N, Constantinou J, et al. Use of social media to assess the effectiveness of vagal nerve stimulation in Dravet syndrome: a caregiver's perspective. J Neurol Sci. 2017;15(375):146–149. [DOI] [PubMed] [Google Scholar]
- 34. Halford JJ, Sperling MR, Nair DR, Dlugos DJ, Tatum WO, Harvey J, et al. Detection of generalized tonic‐clonic seizures using surface electromyographic monitoring. Epilepsia. 2017;58:1861–1869. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35. Ozanne A, Johansson D, Hallgren Graneheim U, Malmgren K, Bergquist F, Alt MM. Wearables in epilepsy and Parkinson's disease‐a focus group study. Acta Neurol Scand. 2018;137:188–194. [DOI] [PubMed] [Google Scholar]
- 36. Arends J, Thijs RD, Gutter T, Ungureanu C, Cluitmans P, Van Dijk J, et al. Multimodal nocturnal seizure detection in a residential care setting: a long‐term prospective trial. Neurology. 2018;20(91):e2010–e2019. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37. Afra P, Bruggers CS, Sweney M, Fagatele L, Alavi F, Greenwald M, et al. Mobile software as a medical device (SaMD) for the treatment of epilepsy: development of digital therapeutics comprising behavioral and music‐based interventions for neurological disorders. Front Hum Neurosci. 2018;12:171. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38. Meritam P, Ryvlin P, Beniczky S. User‐based evaluation of applicability and usability of a wearable accelerometer device for detecting bilateral tonic‐clonic seizures: a field study. Epilepsia. 2018;59(Suppl 1):48–52. [DOI] [PubMed] [Google Scholar]
- 39. Janse SA, Dumanis SB, Huwig T, Hyman S, Fureman BE, Bridges JFP. Patient and caregiver preferences for the potential benefits and risks of a seizure forecasting device: a best‐worst scaling. Epilepsy Behav. 2019;96:183–191. [DOI] [PubMed] [Google Scholar]
- 40. Chiang S, Moss R, Patel AD, Rao VR. Seizure detection devices and health‐related quality of life: a patient‐ and caregiver‐centered evaluation. Epilepsy Behav. 2020;105:106963. [DOI] [PubMed] [Google Scholar]
- 41. Bruno E, Biondi A, Thorpe S, Richardson MP, Consortium R‐C . Patients self‐mastery of wearable devices for seizure detection: A direct user‐experience. Seizure. 2020;81:236–240. [DOI] [PubMed] [Google Scholar]
- 42. Bruno E, Biondi A, Bottcher S, Lees S, Schulze‐Bonhage A, Richardson MP, et al. Day and night comfort and stability on the body of four wearable devices for seizure detection: a direct user‐experience. Epilepsy Behav. 2020;112:107478. [DOI] [PubMed] [Google Scholar]
- 43. Khan A, Peechatka A, Dias NR, Lima V, Seddo M, Inja A, et al. Patient perspective in the development of electronic patient‐reported outcomes (epros) in seizure disorders: a patient‐centric approach. Patient Prefer Adherence. 2020;14:13–21. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44. Beck M, Simony C, Zibrandtsen I, Kjaer TW. Readiness among people with epilepsy to carry body‐worn monitor devices in everyday life: a qualitative study. Epilepsy Behav. 2020;112:107390. [DOI] [PubMed] [Google Scholar]
- 45. Thompson ME, Goodwin R, Ojeda A, Morris L, Fairman AD. User preferences for the Design of a Mobile Health System to support transition‐age youth with epilepsy. J Pediatr Health Care. 2020;34:e28–e36. [DOI] [PubMed] [Google Scholar]
- 46. Simblett S, Matcham F, Curtis H, Greer B, Polhemus A, Novak J, et al. Patients' measurement priorities for remote measurement technologies to aid chronic health conditions: qualitative analysis. JMIR Mhealth Uhealth. 2020;10(8):e15086. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47. Simblett SK, Biondi A, Bruno E, Ballard D, Stoneman A, Lees S, et al. Patients' experience of wearing multimodal sensor devices intended to detect epileptic seizures: a qualitative analysis. Epilepsy Behav. 2020;102:106717. [DOI] [PubMed] [Google Scholar]
- 48. Yoo S, Lim K, Baek H, Jang SK, Hwang GY, Kim H, et al. Developing a mobile epilepsy management application integrated with an electronic health record for effective seizure management. Int J Med Inform. 2020;134:104051. [DOI] [PubMed] [Google Scholar]
- 49. Nasseri M, Nurse E, Glasstetter M, Bottcher S, Gregg NM, Laks Nandakumar A, et al. Signal quality and patient experience with wearable devices for epilepsy management. Epilepsia. 2020;61(Suppl 1):S25–S35. [DOI] [PubMed] [Google Scholar]
- 50. Buchhalter JR, Scantlebury MH, D'Alfonso S, Pablo Appendino J, Bello Espinosa L, Brooks BL, et al. Creation and implementation of an electronic health record note for quality improvement in pediatric epilepsy: practical considerations and lessons learned. Epilepsia Open. 2021;6:345–358. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51. Grzeskowiak CL, Dumanis SB. Seizure forecasting: patient and caregiver perspectives. Front Neurol. 2021;12:717428. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52. Cote J, Beaudet L, Auger P, Rouleau G, Chicoine G, Leger V, et al. Evaluation of a web‐based virtual nursing intervention to support self‐management among adults with epilepsy: a mixed‐methods study. Epilepsy Behav. 2021;114:107581. [DOI] [PubMed] [Google Scholar]
- 53. Bruno E, Biondi A, Richardson MP, Consortium O . Digital semiology and time‐evolution pattern of bio‐signals in focal onset motor seizures. Seizure. 2021;87:114–120. [DOI] [PubMed] [Google Scholar]
- 54. Herrera‐Fortin T, Bou Assi E, Gagnon MP, Nguyen DK. Seizure detection devices: a survey of needs and preferences of patients and caregivers. Epilepsy Behav. 2021;114:107607. [DOI] [PubMed] [Google Scholar]
- 55. Olsen LS, Nielsen JM, Simony C, Kjaer TW, Beck M. Wearables in real life: a qualitative study of experiences of people with epilepsy who use home seizure monitoring devices. Epilepsy Behav. 2021;125:108398. [DOI] [PubMed] [Google Scholar]
- 56. Willems LM, Baier H, Bien CG, Bosebeck F, Dumpelmann M, Hamer HM, et al. Satisfaction with and reliability of in‐hospital video‐EEG monitoring systems in epilepsy diagnosis ‐ a German multicenter experience. Clin Neurophysiol. 2021;132:2317–2322. [DOI] [PubMed] [Google Scholar]
- 57. Monfort E, Poulet C, Nahas C, Bakridan S, Clair L, Latour P. Clustering patients and caregivers for technology design: a step prior to the design of an innovative technological device for the detection of epileptic seizures. Epilepsy Behav. 2021;122:108233. [DOI] [PubMed] [Google Scholar]
- 58. Chiang S, Moss R, Black AP, Jackson M, Moss C, Bidwell J, et al. Evaluation and recommendations for effective data visualization for seizure forecasting algorithms. JAMIA Open. 2021;4:ooab009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59. Sabers A, Aumuller‐Wagner S, Christensen LR, Henning O, Kostov K, Lossius M, et al. Feasibility of transcutaneous auricular vagus nerve stimulation in treatment of drug resistant epilepsy: a multicenter prospective study. Epilepsy Res. 2021;177:106776. [DOI] [PubMed] [Google Scholar]
- 60. Siegel BI, Johnson M, Dawson TE, Kurzen E, Holt PJ, Wolf DS, et al. Reducing prescribing errors in hospitalized children on the ketogenic diet. Pediatr Neurol. 2021;115:42–47. [DOI] [PubMed] [Google Scholar]
- 61. von Wrede R, Rings T, Schach S, Helmstaedter C, Lehnertz K. Transcutaneous auricular vagus nerve stimulation induces stabilizing modifications in large‐scale functional brain networks: towards understanding the effects of taVNS in subjects with epilepsy. Sci Rep. 2021;12(11):7906. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62. Hadady L, Klivényi P, Fabó D, Beniczky S. Real‐world user experience with seizure detection wearable devices in the home environment. Epilepsia. 2023;64:S72–S77. [DOI] [PubMed] [Google Scholar]
- 63. Schmidt M, Glaser N, Riedy T, Rietta C, Huszti H, Wagner J, et al. Learning experience design of an mHealth intervention for parents of children with epilepsy. Int J Med Inform. 2022;160:104671. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 64. Lazaro MJ, Alvaran A, Yun MH, Kim S. Mobile health application for seizure management: a human‐systems integration approach. Hum Factors. 2022;25:187208221074427. [DOI] [PubMed] [Google Scholar]
- 65. Macea J, Bhagubai M, Broux V, De Vos M, Van Paesschen W. In‐hospital and home‐based long‐term monitoring of focal epilepsy with a wearable electroencephalographic device: diagnostic yield and user experience. Epilepsia. 2023;64:937–950. [DOI] [PubMed] [Google Scholar]
- 66. van Leeuwen MMA, Droger MM, Thijs RD, Kuijper B. Nocturnal seizure detection: what are the needs and expectations of adults with epilepsy receiving secondary care? Epilepsy Behav. 2023;147:109398. [DOI] [PubMed] [Google Scholar]
- 67. Guerrero‐Aranda A, Friman‐Guillen H, González‐Garrido AA. Acceptability by end‐users of a standardized structured format for reporting EEG. Clin EEG Neurosci. 2023;54:483–488. [DOI] [PubMed] [Google Scholar]
- 68. Lewis‐Fung S, Tchao D, Gray HG, Nguyen E, Pardini S, Harris LR, et al. Designing virtual reality exposure scenarios to treat anxiety in people with epilepsy: phase 2 of the AnxEpiVR clinical trial. 2023. Original Research.
- 69. Tchao D, Lewis‐Fung S, Gray H, Pardini S, Harris LR, Appel L. Describing epilepsy‐related anxiety to inform the design of a virtual reality exposure therapy: results from phase 1 of the AnxEpiVR clinical trial. Epilepsy Behav Rep. 2023;21:100588. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 70. Lennard S, Newman R, McLean B, Jory C, Cox D, Young C, et al. Improving nocturnal event monitoring in people with intellectual disability in community using an artificial intelligence camera. Epilepsy Behav Rep. 2023;22:100603. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 71. Saczynski JS, McManus DD, Goldberg RJ. Commonly used data‐collection approaches in clinical research. Am J Med. 2013;126:946–950. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 72. Woudstra K, Tummers M, Rovers MM, Reuzel R. Innovators' views on involving users and patients in surgical device development: a qualitative interview study. BMJ Open 2021;11:e050801. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 73. Dumanis SB, French JA, Bernard C, Worrell GA, Fureman BE. Seizure forecasting from idea to reality. Outcomes of the my seizure gauge epilepsy innovation institute workshop. eNeuro. 2017;4:ENEURO.0349‐17.2017. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 74. Kuhlmann L, Lehnertz K, Richardson MP, Schelter B, Zaveri HP. Seizure prediction ‐ ready for a new era. Nat Rev Neurol. 2018;14:618–630. [DOI] [PubMed] [Google Scholar]
- 75. Shum J, Friedman D. Commercially available seizure detection devices: a systematic review. J Neurol Sci. 2021;15(428):117611. [DOI] [PubMed] [Google Scholar]
- 76. Hagedorn TJ, Krishnamurty S, Grosse IR. An information model to support user‐centered design of medical devices. J Biomed Inform. 2016;62:181–194. [DOI] [PubMed] [Google Scholar]
- 77. Staccini P, Joubert M, Quaranta JF, Fieschi D, Fieschi M. Modelling health care processes for eliciting user requirements: a way to link a quality paradigm and clinical information system design. Int J Med Inform. 2001;64:129–142. [DOI] [PubMed] [Google Scholar]
- 78. Smith V, Warty R, Nair A, Krishnan S, Sursas JA, da Silva CF, et al. Defining the clinician's role in early health technology assessment during medical device innovation—a systematic review. BMC Health Serv Res. 2019;219:514. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 79. Ly S, Runacres F, Poon P. Journey mapping as a novel approach to healthcare: a qualitative mixed methods study in palliative care. BMC Health Serv Res. 2021;21:915. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 80. Farzandipour M, Nabovati E, Sadeqi JM. Comparison of usability evaluation methods for a health information system: heuristic evaluation versus cognitive walkthrough method. BMC Med Inform Decis Mak. 2022;22:157. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 81. Dillman DA, Smyth JD, Christian LM. Internet, phone, mail, and mixed mode surveys: the tailored design method. 4th ed. Hoboken, NJ, US: John Wiley & Sons Inc; 2014. [Google Scholar]
- 82. Bitkina OV, Kim HK, Park J. Usability and user experience of medical devices: an overview of the current state, analysis methodologies, and future challenges. Int J Ind Ergon. 2020;76:102932. [Google Scholar]
- 83. Gottgens I, Oertelt‐Prigione S. The application of human‐centered design approaches in Health Research and innovation: a narrative review of current practices. JMIR Mhealth Uhealth. 2021;6(9):e28102. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 84. Martin JL, Clark DJ, Morgan SP, Crowe JA, Murphy E. A user‐centred approach to requirements elicitation in medical device development: a case study from an industry perspective. Appl Ergon. 2012;43:184–190. [DOI] [PubMed] [Google Scholar]
- 85. U.S. Department of Health and Human Services FDA . Center for Devices and Radiological Health, Office of Device Evaluation. Applying human factors and usability engineering to medical devices. Guid Ind Food Drug Adm Staff. 2016. [Google Scholar]
- 86. Regulation (EU) 2017/745 of the European Parliament and of the Council of 5 April 2017 on medical devices aDE, Regulation (EC) No 178/2002 and Regulation (EC) No1223/2009 and repealing Council Directives 90/385/EEC and 93/42/EEC. 2017 O.J. (L 117) 1.
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Table S1.
