Abstract
The control and manipulation of various types of end effectors such as powered exoskeletons, prostheses, and ‘neural’ cursors by brain-machine interface (BMI) systems has been the target of many research projects. A seamless “plug and play” interface between any BMI and end effector is desired, wherein similar user's intent cause similar end effectors to behave identically. This report is based on the outcomes of an IEEE Standards Association Industry Connections working group on End Effectors for Brain-Machine Interfacing that convened to identify and address gaps in the existing standards for BMI-based solutions with a focus on the end-effector component. A roadmap towards standardization of end effectors for BMI systems is discussed by identifying current device standards that are applicable for end effectors. While current standards address basic electrical and mechanical safety, and to some extent, performance requirements, several gaps exist pertaining to unified terminologies, data communication protocols, patient safety and risk mitigation.
Keywords: Brain-machine interface, exoskeletons, prosthetics, robotics, standards
I. Introduction
Brain-Machine or brain-computer interfaces (BMI/BCI) are systems that allow users to control devices or end effectors through their thoughts. End effectors such as exoskeletons and prostheses are often used for restoring, replacing or improving lost functionality caused by physical or neurological injury [1]. There is also a growing interest in using BMIs to control end effectors related to commercial and academic research projects [2]. Given the growing breadth of BMIs and end effectors, it is desired to have a set of standards that recommend how these systems should be linked with each other. Such a standard would greatly facilitate development by reducing the workload needed to make the systems compatible with each other. Also, as these systems become widely deployed for different medical conditions, standardization of these devices will become essential from a regulatory standpoint in order to demonstrate safety and efficacy.
Creating a device standard invokes a variety of considerations. For example, current BMI research related to restoring limb movements lay emphasis on the prediction of joint kinematics [3]–[7]. Many end effectors, such as powered prostheses and orthoses, operate with higher level commands (e.g., take a step forward), which may move multiple joints in a sequence. BMIs could also be used to control nonanthropomorphic end effectors such as a computer cursor's position, or a wheelchair's movement. Thus, the range of commands that can be sent to such a spectrum of external devices or end effectors by a BMI is likely to be large, so it could be argued that such a standard for end effectors should be limited in scope to promote innovation.
To address the lack of specific standards on neurotechnologies for BMI systems, in February 2020, the IEEE Standards Association Industry Connections released a roadmap focusing on standards for “Neurotechnologies for Brain-Machine Interfacing” [8]. The roadmap provided an overview of existing and ongoing standardization efforts with regards to different components of a closed-loop BMI system that ranged from sensor technology, end effectors, data storage and sharing, user needs, performance assessment and benchmarking. This paper is based on the end effectors’ section of the Standards Roadmap. We expand on the state-of-the art end effectors review presented in the Standards Roadmap [8] by adding the most recent studies. To make the review more relevant, we decided to limit the review to only those studies that demonstrate real-time control of end effectors using various neural interfaces. Next, we present relevant existing standards as well as the gaps therein. Finally, we conclude by summarizing some of the ongoing efforts and future directions towards standardization of neurally controlled end effectors.
This work does not comment on how a BMI system interfaces with its user or patient. The suggestions made here should apply to systems that use any kind of neural recordings, which can be noninvasive (e.g., scalp electroencephalography (EEG), etc.) or invasive (e.g., electrocorticography (ECoG), microelectrodes, etc.). Our discussion also applies to systems that use peripheral modalities such as limb motion kinematics, electromyography (EMG), or peripheral nerve recordings. Our suggestions should apply regardless of how neural features are mapped to the end-effector commands and what BMI algorithms are used. For example, if a robotic hand were controlled by a BMI that used either motor imagery, SSVEPs or other types of intent detection; all would yield standardized commands to either open or close the hand.
II. Overview of State-of-the-art End Effectors
In the context of BMIs, end effectors can generally be considered as virtual and/or physical devices or objects (“things”) embedded with sensors, software and other technologies that would allow them to connect and exchange data with BMI systems. End effectors encompass a broad range of devices and functions, including physical or virtual devices/systems that assume both anthropomorphic and non-anthropomorphic forms. Current end effectors that are typically interfaced by BMI systems can be broadly divided into seven main categories, as described below. Here, we briefly review the state-of-the-art within each subcategory of end effectors.
A. Upper and Lower Limb Powered Exoskeletons
Several upper limb powered exoskeletons have been developed primarily for rehabilitation of any combination of the shoulder, elbow, wrist or finger joints after spinal cord injury (SCI) and stroke. Two comprehensive reviews of these systems were recently published in 2017 [9], [10], with Stewart's review focusing specifically on hybrid exoskeletons, i.e., those which are used in conjunction with Functional Electrical Stimulation (FES) to facilitate muscle contraction [10]. Also, Gull et al. summarizes various design considerations for upper limb exoskeleton devices [11]. These exoskeletons utilize a variety of control strategies (e.g., assistance, correction and resistance based) [12] and can also serve as an end effector for BMIs, by taking advantage of neural signals as inputs such as EMG [4] and EEG [13], [14].
Lower limb powered robotic devices have emerged as assistive and rehabilitative tools, which enable individuals to walk and exercise in previously unavailable ways [15]. The devices fall under two categories: wearable joint actuators [16] or devices fixed to a platform (e.g., treadmill-based or paddle-based devices) [17]. Powered orthoses induce motion to one or more paralyzed lower limb joints using external power, usually via electric, pneumatic or hydraulic actuators [18], and have emerged as aids for over-ground, bipedal ambulation. The US Food and Drug Administration (FDA) has recognized exoskeletons as Class II medical devices with special controls [19]. Several studies have reviewed existing lower limb exoskeletons in a clinical context, evaluating the outcomes, effectiveness, possible benefits [20]–[23] and potential risks and adverse events [24]. Recent efforts to review and benchmark performance indicators found that the majority of studies are limited to straight walking performance review and lack the evaluation of tasks related to daily living [25], [26].
B. Upper and Lower Limb Prostheses
For upper and lower limb amputees, motorized prosthetic devices can be interfaced with neurotechnology to help restore lost motor function. We refer the reader to the following reviews on upper limb [27], [28] and lower limb [29] prostheses available to amputees. Typically, most of these powered prostheses are controlled with surface electromyography, which detects motor intent through electric fields generated by engaged muscles [30]–[35]. There are ongoing developments to enhance myoelectric control through surgical interventions such as targeted muscle reinnervation [36], [37] and electrode implantation [38], [39]. Very few studies have demonstrated real time control of a potential upper limb prosthesis with BMIs, such as the control of hand shape with scalp EEG with amputees [40], and the online control of the grasping and opening of a robotic hand with MEG from paralyzed patients [41].
A major challenge associated with prostheses is the interface between the prosthesis and the residual limb. Traditional sockets present challenges for some individuals and can lead to discomfort and chronic skin problems, resulting in decreased mobility and lower quality of life [42]. Recent efforts have shown promise in overcoming these limitations through osseointegration, where the residual bone is surgically modified to serve as a mechanical anchor and data communication port to the prosthetic device.
C. Robotic Manipulators
Robotic arms or manipulators can also be used to assist severely paralyzed individuals. These devices are not necessarily worn by the individual, and typically do not mimic the form of the natural human arm. They are usually designed to have multiple joints in the arm and manipulate objects through a claw-like gripper. While robotic arms are available for other contexts such as factory manufacturing, there is little discussion on how much clinical utility they may have for paralyzed patients. Despite this, robotic arms have been explored with BMIs, where individuals with tetraplegia were able to control them with implanted microelectrodes [44]–[47], ECoG [48], and scalp EEG [49].
D. Functional Electrical Stimulation
Functional or Neuromuscular Electrical Stimulation (FES/NMES) is the application of brief electrical pulses using transcutaneous, percutaneous or implanted electrodes, in order to artificially contract the targeted muscles. FES systems have been widely used as a rehabilitative therapy and as an assistive device to restore lost motor function [50]. Typically, to control a FES device, the controller needs to specify stimulation parameters such as frequency, pulse-width, voltage/current output, and the specific channels to activate in order to evoke specific limb movements. Several studies have demonstrated BMI controlled FES systems for rehabilitation of stroke and SCI patients [51]–[55]. More recently, BMI controlled spinal cord stimulation that allows brain signals to bypass and electrically stimulate below the injury site have also been developed [56].
E. Powered Wheelchairs
BMI-controlled powered wheelchairs provide augmentation and/or restoration of mobility. These devices have been used for research purposes, but currently there are no available BMI-controlled powered wheelchairs in the US market. Fernandez- Rodríguez et al. provides a review of the studies related to BMIs and wheelchairs [57].
F. Virtual/Augmented Reality
Virtual Reality (VR) is a simulated environment that provides an immersive and interactive experience for the user. While VR immerses the user in a simulated environment, the Augmented Reality (AR) systems superimpose virtual elements in the real world thereby augmenting the view of the user in real-time. Virtual objects can vary from anthropomorphic objects, such as human avatars or limbs [58]–[60], to non-anthropomorphic objects and graphical user interfaces [61]–[65]. For a review of application of VR system in neuroscience research and therapeutics, readers are directed to Bohil et al. [66].
G. Smart Physical Devices or Objects (“things”)
Recent efforts to connect BMI to objects through the Internet provide clear evidence for the coupling of these technologies into a ‘BMI-of-things’ (BMIoT) for consumer-based [67], [68] and healthcare applications [69], [70]. Data transfer protocols associated with BMI coupled with IoT include: Websockets [71], SYNAISTHISI [72], MQTT [73], HTTPS [70], and added security through blockchain [74].
Mobile neurotechnologies have been identified as a key sensing technology for the dynamic field of personalized healthcare systems, with unresolved standardized IoT architectures for neurotechnologies posing a significant challenge [75]. It is likely that other types of virtual and/or physical devices or objects (“things”) embedded with sensors, software and other technologies will be designed to allow them to connect and exchange data with BMI systems. This BMIoT could be valuable not only for individuals with disabilities, but also for able-bodied individuals to control home and office appliances, automobiles, workplace devices, and toys.
III. Existing Standards for End Effectors
Table I presents a list of existing standards that are applicable to end effectors. This list was compiled by reviewing the state-of-the-art end effectors that are currently approved by the FDA and identifying the standards with which these devices were required to be compliant. In addition, standards currently under development or applicable to specific type of end effectors such as VR/AR and Osseointegrated implants, are all listed. Table I is not an exhaustive list but is meant as a reference for future manufacturers of end effectors that want to seek FDA approval or clearance, as well as to identify gaps that are relevant in the context of a neurally controlled end effector.
TABLE I. (Continued) Current Standards Related to End-Effector Devices.
| Standard | Description | ||||
|---|---|---|---|---|---|
| Electrical Specifications | IEC 60601-1:2005+AMD1:2012, ANSI/AAMI ES60601-1:2005/(R)2012, IEC 80601-2-78:2019 | General safety | |||
| IEC 60601-2-10:2012+AMD1:2016 | Stimulator safety | ||||
| IEC 60601-2-40:2016 | EMG safety | ||||
| IEC 60601-1-2:2014, ETSI EN 301 489-1, ETSI EN 301 489-3 , BS EN 50561-1:2013 | Electromagnetic | ||||
| IEC 62304:2006+AMD1:2015 | Software | ||||
| IEC 60601-1-10:2007+AMD1:2013 | Closed-loop control | ||||
| ANSI/AAMI HA60601-1-11:2015 | Devices for home healthcare | ||||
| ANSI/IEC 60529-2004 | Electrical enclosure | ||||
| UL 1642 5th Ed. | Lithium Batteries | ||||
|
ISO/WD 7176-14, ISO 7176-4:2008 |
Wheelchair power/controls | ||||
| IEEE 1856 | Prognostics & Health Management of Electronic Systems | ||||
| Mechanical |
ISO 10328:2016, ISO 15032:2000, ISO 22675:2016, ISO/TR 22676:2006, ISO/TS 16955:2016, ISO 22523:2006 , |
Requirements and testing | |||
| ISO 7176-6:2001, ISO 7176-2:2017 | Wheelchair speed and dynamics | ||||
| General | ISO 14971:2007 | Risk management | |||
| ISO 13485:2016, ISO 9001:2015 | Quality management of medical devices | ||||
| ISO 15223-1:2016 | Labeling | ||||
| ISO 10993-1:2009 , ISO 10993-10:2010 , ISO 10993-5:2009 | Biocompatibility | ||||
| AAMI ANSI HE75:2009/(R)2013 | Human factors engineering | ||||
| AAMI TIR49:2013 | Instructional materials | ||||
| AAMI ANSI IEC 62366-1:2015 | Application and usability | ||||
| ISO 14001:2015 | Environmental management | ||||
| WHO standards for prosthetics and orthotics. Geneva: World Health Organization; 2017. License: CC BY-NC-SA 3.0 IGO. | Global standards for prosthetics and orthotics | ||||
| Definition & Terminology |
ISO 8548-1:1989
,
ISO 8548-2:1993
,
ISO 8548-3:1993 , ISO 8548-4:1998 , ISO 8548-5:2003 , |
Limb deficiencies | |||
|
ISO 8549-1:1989
,
ISO 8549-2:1989
,
ISO 8549-3: 1989 , ISO 8549-4:2014 |
Prosthetics & orthotics vocabulary | ||||
|
ISO 8551:2003
,
ISO 21065:2017
,
ISO 29781:2008 , ISO 29782:2008 |
Functional deficiencies & rehabilitation | ||||
| ISO 29783-1:2008 , ISO 29783-2:2015 , ISO 29783-3:2016 | Human gait | ||||
|
ISO 13404:2007, ISO 13405-1:2015, ISO 13405-2:2015, ISO 21064:2017, ISO 21063:2017 |
Prosthetics & Orthotics components | ||||
|
IEEE 1872-2015
,
IEEE P1872.1
,
IEEE 7007 , IEEE 7008 |
Robotics | ||||
| IoT | IEEE 1451-99 | Harmonization and Security | |||
| IEEE 2413 | Architectural Framework | ||||
| Standard | Description | ||||
| IEEE 2510 | Sensor performance & Quality | ||||
| Virtual Reality & Augmented Reality | IEEE 2048.1 | Definitions | |||
| IEEE 2048.2 , 2048.3 , 2048.7 , 2048.8 | Visual | ||||
| IEEE 2048.9 , 2048.10 | Audio | ||||
| IEEE 2014.6 | Interface | ||||
| IEEE 3333.1.1-2015 | User Experience | ||||
| IEEE 2048.4 | Person Identify | ||||
| IEEE 2048.5 | Safety | ||||
| IEEE 2048.12 | Content ratings | ||||
| Implants (e.g., Osseointegrated Devices) | Materials | ISO 5832-3:2016 | Wrought titanium 6-aluminium 4-vanadium alloy | ||
| ASTM F136-13 | Wrought titanium-6 aluminum-4 vanadium ELI (extra low interstitial) | ||||
| ASTM F67-13 | Unalloyed titanium | ||||
| ASTM F899-12b | Wrought Stainless Steels | ||||
| Mechanical | ASTM F88/F88M-09 | Seal strength | |||
| ISO 10993-18:2005 | Chemical Characterization | ||||
| ISO 11607-2:2006 | Forming, Sealing & Assembly processes | ||||
| ASTM F1929-12 | Detecting seal leaks | ||||
| General | ISO 14971:2007 | Risk Management | |||
| ISO 15223-1:2016 | Labeling | ||||
| ISO 14644-1:2015 | Controlled Environments | ||||
| IEC 62366-1:2015 | Usability | ||||
| BS EN 1041 | Device Information | ||||
TABLE I. Current Standards Related to End-Effector Devices.
| Standard | Description | ||||
|---|---|---|---|---|---|
| Electrical Specifications | IEC 60601-1:2005+AMD1:2012, ANSI/AAMI ES60601-1:2005/(R)2012, IEC 80601-2-78:2019 | General safety | |||
| IEC 60601-2-10:2012+AMD1:2016 | Stimulator safety | ||||
| IEC 60601-2-40:2016 | EMG safety | ||||
| IEC 60601-1-2:2014, ETSI EN 301 489-1, ETSI EN 301 489-3, BS EN 50561-1:2013 | Electromagnetic | ||||
| IEC 62304:2006+AMD1:2015 | Software | ||||
| IEC 60601-1-10:2007+AMD1:2013 | Closed-loop control | ||||
| ANSI/AAMI HA60601-1-11:2015 | Devices for home healthcare | ||||
| ANSI/IEC 60529-2004 | Electrical enclosure | ||||
| UL 1642 5th Ed. | Lithium Batteries | ||||
|
ISO/WD 7176-14, ISO 7176-4:2008 |
Wheelchair power/controls | ||||
| IEEE 1856 | Prognostics & Health Management of Electronic Systems | ||||
| Mechanical |
ISO 10328:2016, ISO 15032:2000, ISO 22675:2016, ISO/TR 22676:2006, ISO/TS 16955:2016, ISO 22523:2006 , |
Requirements and testing | |||
| ISO 7176-6:2001, ISO 7176-2:2017 | Wheelchair speed and dynamics | ||||
| General | ISO 14971:2007 | Risk management | |||
| ISO 13485:2016, ISO 9001:2015 | Quality management of medical devices | ||||
| ISO 15223-1:2016 | Labeling | ||||
| ISO 10993-1:2009 , ISO 10993-10:2010 , ISO 10993-5:2009 | Biocompatibility | ||||
| AAMI ANSI HE75:2009/(R)2013 | Human factors engineering | ||||
| AAMI TIR49:2013 | Instructional materials | ||||
| AAMI ANSI IEC 62366-1:2015 | Application and usability | ||||
| ISO 14001:2015 | Environmental management | ||||
| WHO standards for prosthetics and orthotics. Geneva: World Health Organization; 2017. License: CC BY-NC-SA 3.0 IGO. | Global standards for prosthetics and orthotics | ||||
| Definition & Terminology |
ISO 8548-1:1989
,
ISO 8548-2:1993
,
ISO 8548-3:1993 , ISO 8548-4:1998 , ISO 8548-5:2003 , |
Limb deficiencies | |||
|
ISO 8549-1:1989
,
ISO 8549-2:1989
,
ISO 8549-3: 1989 , ISO 8549-4:2014 |
Prosthetics & orthotics vocabulary | ||||
|
ISO 8551:2003
,
ISO 21065:2017
,
ISO 29781:2008 , ISO 29782:2008 |
Functional deficiencies & rehabilitation | ||||
| ISO 29783-1:2008 , ISO 29783-2:2015 , ISO 29783-3:2016 | Human gait | ||||
|
ISO 13404:2007, ISO 13405-1:2015, ISO 13405-2:2015, ISO 21064:2017, ISO 21063:2017 |
Prosthetics & Orthotics components | ||||
|
IEEE 1872-2015
,
IEEE P1872.1
,
IEEE 7007 , IEEE 7008 |
Robotics | ||||
| IoT | IEEE 1451-99 | Harmonization and Security | |||
| IEEE 2413 | Architectural Framework | ||||
| Standard | Description | ||||
| IEEE 2510 | Sensor performance & Quality | ||||
| Virtual Reality & Augmented Reality | IEEE 2048.1 | Definitions | |||
| IEEE 2048.2 , 2048.3 , 2048.7 , 2048.8 | Visual | ||||
| IEEE 2048.9 , 2048.10 | Audio | ||||
| IEEE 2014.6 | Interface | ||||
| IEEE 3333.1.1-2015 | User Experience | ||||
| IEEE 2048.4 | Person Identify | ||||
| IEEE 2048.5 | Safety | ||||
| IEEE 2048.12 | Content ratings | ||||
| Implants (e.g., Osseointegrated Devices) | Materials | ISO 5832-3:2016 | Wrought titanium 6-aluminium 4-vanadium alloy | ||
| ASTM F136-13 | Wrought titanium-6 aluminum-4 vanadium ELI (extra low interstitial) | ||||
| ASTM F67-13 | Unalloyed titanium | ||||
| ASTM F899-12b | Wrought Stainless Steels | ||||
| Mechanical | ASTM F88/F88M-09 | Seal strength | |||
| ISO 10993-18:2005 | Chemical Characterization | ||||
| ISO 11607-2:2006 | Forming, Sealing & Assembly processes | ||||
| ASTM F1929-12 | Detecting seal leaks | ||||
| General | ISO 14971:2007 | Risk Management | |||
| ISO 15223-1:2016 | Labeling | ||||
| ISO 14644-1:2015 | Controlled Environments | ||||
| IEC 62366-1:2015 | Usability | ||||
| BS EN 1041 | Device Information | ||||
IV. Gaps in Existing Standards
A. BMI Relevant Terminologies
Despite the existence of standard terminology for certain end effectors (e.g., prosthetics and orthotics in Table I), there is lack of clarity on terminologies related to the BMI control of these devices [8]. Below we discuss these confounding terms and propose definitions from a BMI's perspective.
1). Active Versus Passive Systems
Traditionally, end-effector systems wherein the patient voluntarily drives the movement of the system and receives minimal assistance in performing the movement are referred to as active-assistance systems [76]. Systems that do not rely on the patient's voluntary input, or only passively assists them through the movement, are referred to as passive systems. Recently, the IEC 80601-2-78:2019 standard defined ‘active controlled’ systems as those in which control can solely be with the robot or shared with the patient or operator. This definition confounds with the definition of traditionally passive systems.
Therefore, for BMI-controlled end effectors, we propose that active systems imply those systems in which commands decoded by the BMI will be used to manipulate the end effectors, generally through electromechanical actuation (e.g., robotics, BMIoT), digital manipulation of the virtual environment (VR/AR), or electrical stimulation (e.g., FES).
2). Continuous Versus Discrete Commands
A BMI system can send out two types of commands which we designate as continuous or discrete. Continuous commands are associated with states that continuously evolve with time and could apply to commanding an end effector's joint angle, position, velocity, force, etc. Discrete commands are associated with a finite number of states in an end effector. Examples include walking or stopping with a leg prosthesis, opening or closing a robotic hand, turning left or right in a wheelchair, etc. This convention can help guide how commands are generated from a BMI system and passed to the end effector. Continuous commands can be generated, for example, from regression-based models and output a range of values with defined intervals and boundaries. Discrete commands can be generated from classification algorithms and outputs a set of integers that are mapped to distinct states in the end effector.
3). Initial or Zero State
The initial state of the end effector at its initial resting state must be specified within the standard. While the exact definition of the starting state is dependent on the specific end-effector configuration, it is important that end effector's state definition includes the initial state (e.g., end effector position, on/off, etc.) that follows a universal coordinate reference frame so that the correct transformation can occur between the BMI's output and end effector's next state.
B. Nomenclature of Motor Functions
End effectors can assume numerous physical configurations, depending on the design and desired use of the device. In the case of anthropomorphic devices, the end effector attempts to replicate, restore, or augment a type of human motor function. Thus, a taxonomy of functions should be developed to provide a standardized language when considering the prescribed use of the device. For example, grasp patterns are a set of unique hand postures that allow a robotic hand to manipulate different objects [77]. This can be adapted from medical and anatomy literature but should carefully consider the definitions in the context of a robotic system.
C. Omissions of Motor Functions or Degrees-Of-Freedom
For specialization applications (e.g., industrial work), or to reduce complexity and costs, anthropomorphic end effectors are often designed to have fewer degrees of freedom than human limbs. For example, hand-based prostheses are “underactuated” where the natural finger joints are mimicked as a bent solid material, or mechanically coupled to a singular motor so that they do not move independently [78]. These strategies should be defined explicitly to facilitate control and comparisons in device capabilities.
D. Standardized Communication Protocols
The interconnection between a BMI's sensing and processing modules and the end effector requires the development of standards for data communication. Ideally, this communication standard may allow ‘plug-and-play’ settings where a BMI system can interchange functionally similar endeffectors and expect the same behavior (without need for redesign). To meet these requirements, the IEEE/ISO standard 11073 (Point-of-care medical device communication) could be adapted.
E. Potential Risks in Powered Exoskeletons
Exoskeletons have inherent risks that are not fully investigated or mitigated as discussed in [23], [79]: First, shared control is typically used in exoskeletons, where user intent commands the end effector, while internal control algorithms act to implement control of the device [80]. There is a need to standardize how to prioritize commands from the user and the device to ensure safety during hazardous scenarios (e.g., falls, slips, etc.). Second, among the adverse events reported during use of an exoskeleton, skin and soft tissue breakdown is the most frequently occurring type [24]. While clinicians refer to a number of management techniques for musculoskeletal injuries [81]–[83], specific guidelines for preventing such injuries during use of an exoskeleton do not exist. Third, falls pose a significant risk to elderly individuals, especially when they are strapped in an exoskeleton. Studies often conclude that the risk of falls is low during use of a particular device simply because no falls were observed during experiments or they were caught by the harness/staff in [23], [24]. Clearly, this poses risks to the user.
F. Sensory Feedback
End effectors are currently being improved with sensory feedback, which involves the integration of environmental sensors that can be used to present sensory information back to the user. This is mostly pertinent to hand based robotic devices, where proper grasp function calls for the user to have a sense of finger forces and object textures [84]. Tactile feedback includes various modalities such as vibration motors [85] or electrical stimulation [86], [87]. There is also ongoing development in stimulating peripheral nerves [39] and the brain to simulate sensory percepts [88], [89]. We omit an in-depth review of all sensory modalities in this work, but we emphasize that a standardized protocol between a BMI and an end effector should have bi-directional communication to accommodate motor commands and sensory information.
V. Ongoing Efforts & Industry Insights
In addition to the standards activities of the IEEE Standards Association, several initiatives are currently underway in order to develop standards within the neurotechnology space. The Center for Devices and Radiological Health (CDRH) of the Food and Drug Administration (FDA) recognizes that patient preference information can inform the design of a medical device, including end effectors. Moreover, patient preference can be an input in the design of medical devices and clinical trials, and form part of the regulatory process for medical device evaluation [90]. To address the importance of patient preference information, the FDA has published draft guidance [91].
The IEEE Robotics & Automation Society is developing a standard for wearable robotics, with the focus being on devices for non-medical applications, such as military, construction, and industry [92].
An EU-funded project called EUROBENCH was launched in January 2018 with the aim of developing a benchmarking framework for robotics. It mainly focuses on bipedal machines (i.e., exoskeletons, prosthetics, and humanoids) [93]. Also, another EU-funded initiative: “Inbots Inclusive Robots for a better society” is focused on building a multidisciplinary community that work on aspects of responsible research and innovation paradigms for interactive robotics [94].
Industry Perspective: It can be argued that standardization can promote interoperability, compatibility, reliability, safety, and effective operations in a global scale. As a case study of the importance of standardization, the IEEE SA Industry Connections working group discussed the issue of standardization with Blair Lock (CEO of Coapt LLC), a developer of a myoelectric pattern recognition system that is potentially compatible with every prosthetic hand, wrist, and elbow, currently on the market. Excerpts from this discussion are presented in the Supplementary Materials.
The ongoing development of standards for wearable robotics (IEEE RAS), Internet of Things (IoT), and Neurotechnologies for BMI (IEEE Standards Association) are very encouraging. Future standardization efforts must prioritize unification of terminologies across multiple fields and end effectors, as well as harmonization and safety of end effectors, performance and quality. Importantly, specific requirements for measuring performance of systems that rely on shared control between the user and the device, must be addressed in future standards.
Supplemental Materials
Acknowledgment
The authors acknowledge the assistance of Tom Thompson and Carole Carey during the preparation of this manuscript.
Funding Statement
This work was supported in part by the IUCRC BRAIN funded by the U.S. National Science Foundation under Grant #1650536, the IEEE Standards Association Industry Connections, the IEEE Engineering in Medicine and Biology Society, and the IEEE Brain Initiative.
Contributor Information
Andrew Y. Paek, Email: aypaek@uh.edu.
Justin A. Brantley, Email: justin.a.brantley@gmail.com.
Akshay Sujatha Ravindran, Email: asujatharavindran@uh.edu.
Kevin Nathan, Email: kcnathan@uh.edu.
Yongtian He, Email: chrissshe@gmail.com.
David Eguren, Email: davidreguren@gmail.com.
Jesus G. Cruz-Garza, Email: jgcruzgarza@gmail.com.
Sho Nakagome, Email: beartran3@gmail.com.
Dilranjan S. Wickramasuriya, Email: dswickramasuriya@uh.edu.
Jiajun Chang, Email: jchang15@uh.edu.
Md Rashed-Al-Mahfuz, Email: ram@ru.ac.bd.
Md. Rafiul Amin, Email: mamin@uh.edu.
Nikunj A. Bhagat, Email: nabhagat@uh.edu.
Jose L. Contreras-Vidal, Email: jlcontreras-vidal@uh.edu.
References
- [1].Bowsher K. et al. , “Brain–computer interface devices for patients with paralysis and amputation: A meeting report,” J. Neural Eng., vol. 13, no. 2, Apr. 2016, Art. no. 023001. [DOI] [PubMed] [Google Scholar]
- [2].Paek A., Brantley J., Evans B., and Contreras-Vidal J. L., “Concerns in the blurred divisions between medical and consumer neurotechnology,” IEEE Syst. J., 2020, to be published, doi: 10.1109/JSYST.2020.3032609. [DOI] [PMC free article] [PubMed]
- [3].Contreras-Vidal J. L. et al. , “Neural decoding of robot-assisted gait during rehabilitation after stroke,” Amer J. Phys. Med. Rehabil., vol. 97, no. 8, pp. 541–550, Aug. 2018. [DOI] [PubMed] [Google Scholar]
- [4].Flint R. D., Rosenow J. M., Tate M. C., and Slutzky M. W., “Continuous decoding of human grasp kinematics using epidural and subdural signals,” J. Neural Eng., vol. 14, no. 1, Nov. 2016, Art. no. 016005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [5].Abiri R., Borhani S., Sellers E. W., Jiang Y., and Zhao X., “A comprehensive review of EEG-based brain-computer interface paradigms,” J. Neural Eng., vol. 16, no. 1, Jan. 2019, Art. no. 011001. [DOI] [PubMed] [Google Scholar]
- [6].Vouga T. et al. , “EXiO–A brain-controlled lower limb exoskeleton for rhesus macaques,” IEEE Trans. Neural Syst. Rehabil. Eng., vol. 25, no. 2, pp. 131–141, Jan. 2017. [DOI] [PubMed] [Google Scholar]
- [7].Fitzsimmons N. A., Lebedev M. A., Peikon I. D., and Nicolelis M. A. L., “Extracting kinematic parameters for monkey bipedal walking from cortical neuronal ensemble activity,” Front. Integr. Neurosci., vol. 3, no. 3, Mar. 2009, to be published, doi: 10.3389/neuro.07.003.2009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [8].IEEE Standards Association, “Standards Roadmap:Neurotechnologies for brain-machine interfacing,” 2020. [Online]. Available: https://standards.ieee.org/content/dam/ieee-standards/standards/web/documents/presentations/ieee-neurotech-for-bmi-standards-roadmap.pdf
- [9].Islam M. R., Spiewak C., Rahman M., and Fareh R., “A brief review on robotic exoskeletons for upper extremity rehabilitation to find the gap between research porotype and commercial type,” Adv. Robot Autom., vol. 6, no. 3, pp. 1–12. 2017. [Google Scholar]
- [10].Stewart A. M., Pretty C. G., Adams M., and Chen X., “Review of upper limb hybrid exoskeletons,” IFAC-PapersOnLine, vol. 50, no. 1, pp. 15169–15178, 2017. [Google Scholar]
- [11].Gull M. A., Bai S., and Bak T., “A review on design of upper limb exoskeletons,” Robotics, vol. 9, no. 1, pp. 1–35, Mar. 2020, doi: 10.3390/robotics9010016. [DOI] [Google Scholar]
- [12].Proietti T., Crocher V., Roby-Brami A., and Jarrasse N., “Upper-limb robotic exoskeletons for neurorehabilitation: A review on control strategies,” IEEE Rev. Biomed. Eng.,vol. 8, no. 9, pp. 4–14, Apr. 2016. [DOI] [PubMed] [Google Scholar]
- [13].Al-Quraishi M. S., Elamvazuthi I., Daud S. A., Parasuraman S., and Borboni A., “EEG-based control for upper and lower limb exoskeletons and prostheses: A systematic review,” Sensors (Basel), vol. 18, no. 10, Oct. 2018, Art. no. 3342. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [14].Bhagat N. A. et al. , “Neural activity modulations and motor recovery following brain-exoskeleton interface mediated stroke rehabilitation,” NeuroImage: Clin, vol. 28, Jan. 2020, Art. no. 102502. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [15].Grasmücke D. et al. , “Against the odds: What to expect in rehabilitation of chronic spinal cord injury with a neurologically controlled hybrid assistive limb exoskeleton. A subgroup analysis of 55 patients according to age and lesion level,” Neurosurg. Focus, vol. 42, no. 5, 2017, Art. no. E15. [DOI] [PubMed] [Google Scholar]
- [16].Pons J. L., Wearable Robots: Biomechatronic Exoskeletons. Hoboken, NJ, USA: Wiley, 2008. [Google Scholar]
- [17].García-Cossio E. et al. , “Decoding sensorimotor rhythms during robotic-assisted treadmill walking for brain computer interface (BCI) applications,” PLoS One, vol. 10, no. 12, pp. 1–21, 2015. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [18].Arazpour M., Hutchins S. W., and Bani M. A., “The efficacy of powered orthoses on walking in persons with paraplegia,” Prosthet. Orthot. Int., vol. 39, no. 2, pp. 90–99, 2015. [DOI] [PubMed] [Google Scholar]
- [19].“U.S. Food and Drug Administration, Powered lower extremity exoskeleton, 21 C.F.R. §890.3480,” 2020. [Online]. Available: https://www.accessdata.fda.gov/scripts/cdrh/cfdocs/cfcfr/CFRSearch.cfm?fr=890.3480
- [20].Contreras-Vidal J. L. et al. , “Powered exoskeletons for bipedal locomotion after spinal cord injury,” J. Neural Eng., vol. 13, no. 3, 2016, Art. no. 031001. [DOI] [PubMed] [Google Scholar]
- [21].Dijkers M. P., Akers K. G., Galen S. S., Patzer D. E., and Vu P. T., “Letter to the Ed. regarding ‘Clinical effectiveness and safety of powered exoskeleton-assisted walking in patients with spinal cord injury: Systematic review with meta-analysis’,” Med. Devices (Auckland, NZ), vol. 9, 2016, Art. no. 419. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [22].Lajeunesse V., Vincent C., Routhier F., Careau E., and Michaud F., “Exoskeletons’ design and usefulness evidence according to a systematic review of lower limb exoskeletons used for functional mobility by people with spinal cord injury,” Disabil. Rehabil. Assist. Technol., vol. 11, no. 7, pp. 535–547, 2016. [DOI] [PubMed] [Google Scholar]
- [23].Louie D. R. and Eng J. J., “Powered robotic exoskeletons in post-stroke rehabilitation of gait: A scoping review,” J. Neuroeng. Rehabil., vol. 13, no. 1, 2016, Art. no. 53. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [24].He Y., Eguren D., Luu T. P., and Contreras-Vidal J. L., “Risk management and regulations for lower limb medical exoskeletons: A review,” Med. devices (Auckland, NZ), vol. 10, 2017, Art. no. 89. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [25].Pinto-Fernandez D. et al. , “Performance evaluation of lower limb exoskeletons: A systematic review,” IEEE Trans. Neural Syst. Rehabil. Eng., vol. 28, no. 7, pp. 1573–1583, 2020. [DOI] [PubMed] [Google Scholar]
- [26].Asselin P. K., Avedissian M., Knezevic S., Kornfeld S., and Spungen A. M., “Training persons with spinal cord injury to ambulate using a powered exoskeleton,” J. Vis. Exp., no. 112, 2016, Art. no. e54071, doi: 10.3791/54071. [DOI] [PMC free article] [PubMed]
- [27].Belter J. T., Segil J. L., Dollar A. M., and Weir R. F., “Mechanical design and performance specifications of anthropomorphic prosthetic hands: A review,” J. Rehabil. Res. Dev., vol. 50, 2013, Art. no. 599. [DOI] [PubMed] [Google Scholar]
- [28].Trent L. et al. , “A narrative review: Current upper limb prosthetic options and design,” Disabil. Rehabil. Assist. Technol., vol. 15, no. 6, pp. 604–613, 2020. [DOI] [PubMed] [Google Scholar]
- [29].Windrich M., Grimmer M., Christ O., Rinderknecht S., and Beckerle P., “Active lower limb prosthetics: A systematic review of design issues and solutions,” Biomed. Eng. Online, vol. 15, no. 3, 2016, Art. no. 140. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [30].Das N., Nagpal N., and Bankura S. S., “A review on the advancements in the field of upper limb prosthesis,” J. Med. Eng. Technol., vol. 42, no. 7, pp. 532–545, 2018. [DOI] [PubMed] [Google Scholar]
- [31].Atzori M. and Müller H., “Control capabilities of myoelectric robotic prostheses by hand amputees: A scientific research and market overview,” Front. Syst. Neurosci., vol. 9, 2015, Art. no. 162. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [32].Resnik L., Acluche F., Borgia M., Latlief G., and Phillips S., “EMG pattern recognition control of the DEKA arm: Impact on user ratings of satisfaction and usability,” IEEE J. Transl. Eng. Health Med., vol. 24, no. 7, pp. 1–3, Dec. 2018. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [33].Hargrove L. J. et al. , “Intuitive control of a powered prosthetic leg during ambulation: A randomized clinical trial,” JAMA, vol. 313, no. 22, pp. 2244–2252, 2015. [DOI] [PubMed] [Google Scholar]
- [34].Huang H., Zhang F., Hargrove L. J., Dou Z., Rogers D. R., and Englehart K. B., “Continuous locomotion-mode identification for prosthetic legs based on neuromuscular-mechanical fusion,” IEEE Trans. Biomed Eng., vol. 58, no. 10, pp. 2867–2875, Oct. 2011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [35].Spanias J. A., Simon A. M., Finucane S. B., Perreault E. J., and Hargrove L. J., “Online adaptive neural control of a robotic lower limb prosthesis,” J. Neural Eng., vol. 15, no. 1, Jan. 2018, Art. no. 016015. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [36].Cheesborough J. E., Smith L. H., Kuiken T. A., and Dumanian G. A., “Targeted muscle reinnervation and advanced prosthetic arms,” Semin. Plast. Surg., vol. 29, no. 1, pp. 62–72, Feb. 2015. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [37].Vu P. P. et al. , “A regenerative peripheral nerve interface allows real-time control of an artificial hand in upper limb amputees,” Sci. Transl. Med., vol. 12, no. 533, pp. 1–11, Mar. 2020. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [38].Ortiz-Catalan M., Brånemark R., Håkansson B., and Delbeke J., “On the viability of implantable electrodes for the natural control of artificial limbs: Review and discussion,” Biomed. Eng. Online, vol. 11, no. 33, pp. 1–24, 2012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [39].Wendelken S. et al. , “Restoration of motor control and proprioceptive and cutaneous sensation in humans with prior upper-limb amputation via multiple utah slanted electrode arrays (USEAs) implanted in residual peripheral arm nerves,” J. Neuroeng. Rehabil, vol. 14, no. 1, pp. 1–17, Dec. 2017. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [40].Agashe H. A., Paek A. Y., and Contreras-Vidal J. L., “Multisession, noninvasive closed-loop neuroprosthetic control of grasping by upper limb amputees,” Prog. Brain Res., vol. 228, pp. 107–128, 2016. [DOI] [PubMed] [Google Scholar]
- [41].Fukuma R. et al. , “Real-time control of a neuroprosthetic hand by magnetoencephalographic signals from paralysed patients,” Sci. Rep., vol. 6, 2016, Art. no. 21781. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [42].de Meent H., Hopman M. T., and Frölke J. P., “Walking ability and quality of life in subjects with transfemoral amputation: A comparison of osseointegration with socket prostheses,” Arch. Phys. Med. Rehabil., vol. 94, no. 11, pp. 2174–2178, 2013. [DOI] [PubMed] [Google Scholar]
- [43].Ortiz-Catalan M., Hakansson B., Branemark R., Håkansson B., and Brånemark R., “An osseointegrated human-machine gateway for long-term sensory feedback and motor control of artificial limbs,” Sci. Transl. Med., vol. 6, no. 257, Oct. 2014, Art. no. 257re6. [DOI] [PubMed] [Google Scholar]
- [44].Collinger J. L. et al. , “High-performance neuroprosthetic control by an individual with tetraplegia,” Lancet, vol. 381, no. 9866, pp. 557–564, 2013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [45].Wodlinger B., Downey J. E., Tyler-Kabara E. C., Schwartz A. B., Boninger M. L., and Collinger J. L., “Ten-dimensional anthropomorphic arm control in a human brain−machine interface: Difficulties, solutions, and limitations,” J. Neural Eng., vol. 12, no. 1, Feb. 2015, Art. no. 016011. [DOI] [PubMed] [Google Scholar]
- [46].Hochberg L. R. et al. , “Reach and grasp by people with tetraplegia using a neurally controlled robotic arm,” Nature, vol. 485, no. 7398, pp. 372–375, May 2012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [47].Downey J. E. et al. , “Blending of brain-machine interface and vision-guided autonomous robotics improves neuroprosthetic arm performance during grasping,” J. Neuroeng. Rehabil., vol. 13, no. 1, pp. 1–12, 2016. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [48].Yanagisawa T. et al. , “Electrocorticographic control of a prosthetic arm in paralyzed patients,” Ann. Neurol., vol. 71, no. 3, pp. 353–361, 2012. [DOI] [PubMed] [Google Scholar]
- [49].Kim Y. J. et al. , “Vision-aided brain-machine interface training system for robotic arm control and clinical application on two patients with cervical spinal cord injury,” Biomed. Eng. Online, vol. 18, no. 1, pp. 1–21, 2019. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [50].Rushton D. N., “Functional electrical stimulation and rehabilitation—An hypothesis,” Med. Eng. Phys., vol. 25, no. 1, pp. 75–78, Nov. 2003. [DOI] [PubMed] [Google Scholar]
- [51].Ajiboye A. B. et al. , “Restoration of reaching and grasping movements through brain-controlled muscle stimulation in a person with tetraplegia: A proof-of-concept demonstration,” Lancet, vol. 389, no. 10081, pp. 1821–1830, 2017. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [52].Bouton C. E. et al. , “Restoring cortical control of functional movement in a human with quadriplegia,” Nature, vol. 000, no. 7602, pp. 1–13, 2016. [DOI] [PubMed] [Google Scholar]
- [53].Daly J. J., Cheng R., Rogers J., Litinas K., Hrovat K., and Dohring M., “Feasibility of a new application of noninvasive brain computer interface (BCI): A case study of training for recovery of volitional motor control after stroke,” J. Neurol. Phys. Ther., vol. 33, no. 4, pp. 203–211, 2009. [DOI] [PubMed] [Google Scholar]
- [54].Do A. H., Wang P. T., King C. E., Abiri A., and Nenadic Z., “Brain-computer interface controlled functional electrical stimulation system for ankle movement,” J. Neuroeng. Rehabil., vol. 8, no. 1, 2011, Art. no. 49. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [55].Selfslagh A. et al. , “Non-invasive, Brain-controlled functional electrical stimulation for locomotion rehabilitation in individuals with paraplegia,” Sci. Rep., vol. 9, no. 1, pp. 1–7, May 2019. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [56].Alam M., Rodrigues W., Pham B. N., and Thakor N. V., “Brain-machine interface facilitated neurorehabilitation via spinal stimulation after spinal cord injury: Recent progress and future perspectives,” Brain Res., vol. 1646, pp. 25–33, Sep. 2016. [DOI] [PubMed] [Google Scholar]
- [57].Fernández-Rodríguez, Velasco-Álvarez F., and Ron-Angevin R., “Review of real brain-controlled wheelchairs,” J. Neural Eng., vol. 13, no. 6, Oct. 2016, Art. no. 061001. [DOI] [PubMed] [Google Scholar]
- [58].Correa-Agudelo E., Hernandez A. M., Ferrin C., and Gomez J. D., “ViLimbs: Improving phantom limb treatment through multisensory feedback,” in Proc. 33rd Annu. ACM Conf. Extended Abstr. Hum. Factors Comput. Syst., pp. 1313–1318, 2015. [Google Scholar]
- [59].Luu T. P., He Y., Brown S., Nakagame S., and Contreras-Vidal J. L., “Gait adaptation to visual kinematic perturbations using a real-time closed-loop brain-computer interface to a virtual reality avatar,” J. Neural Eng., vol. 13, no. 3, 2016, Art. no. 36006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [60].Wairagkar M., Zoulias I., Oguntosin V., Hayashi Y., and Nasuto S., “Movement intention based brain computer interface for virtual reality and soft robotics rehabilitation using novel autocorrelation analysis of EEG,” in Proc. Biomed. Robot. Biomechatronics (BioRob), 6th IEEE Int. Conf., vol. 2016, Art. no. 685. [Google Scholar]
- [61].Blum T., Stauder R., Euler E., and Navab N., “Superman-like X-ray vision: Towards brain-computer interfaces for medical augmented reality,” in Proc. IEEE Int. Symp. Mixed Augmented Reality (ISMAR), 2012, pp. 271–272. [Google Scholar]
- [62].Käthner I., Kübler A., and Halder S., “Rapid P300 brain-computer interface communication with a head-mounted display,” Front. Neurosci., vol. 9, 2015, Art. no. 207. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [63].Kerous B. and Liarokapis F., “BrainChat-A collaborative augmented reality brain interface for message communication,” in Proc. IEEE Int. Symp. Mixed Augmented Reality (ISMAR-Adjunct), 2017, pp. 279–283. [Google Scholar]
- [64].Lécuyer A., Lotte F., Reilly R. B., Leeb R., Hirose M., and Slater M., “Brain-computer interfaces, virtual reality, and videogames,” Comput. (Long. Beach. Calif)., vol. 41, no. 10. pp. 66–72, 2008. [Google Scholar]
- [65].O'Doherty J. E. et al. , “Active tactile exploration using a brain-machine-brain interface,” Nature, vol. 479, no. 7372, pp. 228–231, Nov. 2011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [66].Bohil C. J., Alicea B., and Biocca F. A., “Virtual reality in neuroscience research and therapy,” Nat. Rev. Neurosci., vol. 12, no. 12, pp. 752–762, Dec. 2011. [DOI] [PubMed] [Google Scholar]
- [67].Dong N., Li Y., Gao Z., Ip W. H., and Yung K. L., “A WPCA-based method for detecting fatigue driving from EEG-based internet of vehicles system,” IEEE Access, vol. 12, no. 12, pp. 752–762, Dec. 2019. [Google Scholar]
- [68].Coogan C. G. and He B., “Brain-computer interface control in a virtual reality environment and applications for the internet of things,” IEEE Access, vol. 26, no. 6, pp. 10840–10849, Feb. 2018. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [69].Chatterjee R., Maitra T., Hafizul Islam S. K., Hassan M. M., Alamri A., and Fortino G., “A novel machine learning based feature selection for motor imagery EEG signal classification in internet of medical things environment,” Futur. Gener. Comput. Syst., vol. 1, no. 98, pp. 419–434, Sep. 2019. [Google Scholar]
- [70].Hosseini M. P., Pompili D., Elisevich K., and Soltanian-Zadeh H., “Optimized deep learning for EEG big data and seizure prediction BCI via internet of things,” IEEE Trans. Big Data, vol. 3, no. 4, pp. 392–404, Nov. 2017. [Google Scholar]
- [71].Konstantinidis E. I., Sidiropoulos E. A., Conci N., De Natale F., Bamparopoulos G., and Bamidis P. D., “Introducing neuroberry, a platform for pervasive EEG signaling in the IoT domain,” 2015, to be published, doi: 10.4108/eai.14-10-2015.2261698. [DOI]
- [72].Mathe E. and Spyrou E., “Connecting a consumer brain-computer interface to an internet-of-things ecosystem,” in Proc. 9th ACM Int. Conf. PErvasive Technol. Related to Assistive Environments, vol. 29, Jun. 2016, pp. 1–2. [Google Scholar]
- [73].Zao J. K. et al. , “Augmented brain computer interaction based on fog computing and linked data,” in Proc. Int. Conf. Intell. Environments, Jun. 2014, pp. 374–377. [Google Scholar]
- [74].Singh R., Ahmed T., Singh A. K., Chanak P., and Singh S. K., “SeizSClas: An efficient and secure internet of things based EEG classifier,” IEEE Internet Things J., 2020, to be published, doi: 10.1109/jiot.2020.3030821. [DOI]
- [75].Qi J., Yang P., Min G., Amft O., Dong F., and Xu L., “Advanced internet of things for personalised healthcare systems: A survey,” Pervasive Mobile Comput., vol. 1, no. 41, pp. 132–149, Oct. 2017. [Google Scholar]
- [76].O'Malley M. K., Ro T., and Levin H. S., “Assessing and inducing neuroplasticity with transcranial magnetic stimulation and robotics for motor function,” Arch. Phys. Med. Rehabil., vol. 87, no. 12, pp. S59–S66, Dec. 2006. [DOI] [PubMed] [Google Scholar]
- [77].Feix T., Romero J., Schmiedmayer H. B., Dollar A. M., and Kragic D., “The GRASP taxonomy of human grasp types,” IEEE Trans. Hum.-Mach. Syst., vol. 46, no. 1, pp. 66–77, Sep. 2016. [Google Scholar]
- [78].Belter J. T., Segil J. L., Dollar A. M., and Weir R. F., “Mechanical design and performance specifications of anthropomorphic prosthetic hands: A review,” J. Rehabil. Res. Dev., vol. 50, no. 5, May 2013, Art. no. 599. [DOI] [PubMed] [Google Scholar]
- [79].Crea S. et al. , “Feasibility and safety of shared EEG/EOG and vision-guided autonomous whole-arm exoskeleton control to perform activities of daily living,” Sci. Rep., vol. 8, no. 1, pp. 1–9, Jul. 2018. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [80].Losey D. P., McDonald C. G., Battaglia E., and O'Malley M. K., “A review of intent detection, arbitration, and communication aspects of shared control for physical human–robot interaction,” Appl. Mechanics Rev., vol. 70, no. 1, Jan. 2018, Art. no. 010804, doi: 10.1115/1.4039145. [DOI] [Google Scholar]
- [81].Burnham J. P., Kirby J. P., and Kollef M. H., “Diagnosis and management of skin and soft tissue infections in the intensive care unit: A review,” Intensive Care Med., vol. 42, no. 12, pp. 1899–1911, 2016. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [82].Esposito S. et al. , “Diagnosis and management of skin and soft-tissue infections (SSTI): A literature review and consensus statement on behalf of the italian society of infectious diseases and international society of chemotherapy,” J. Chemother., vol. 23, no. 5, pp. 251–262, 2011. [DOI] [PubMed] [Google Scholar]
- [83].Esposito S. et al. , “Diagnosis and management of skin and soft-tissue infections (SSTI). A literature review and consensus statement: An update,” J. Chemother., vol. 29, no. 4, pp. 197–214, 2017. [DOI] [PubMed] [Google Scholar]
- [84].Bensmaia S. J., Tyler D. J., and Micera S., “Restoration of sensory information via bionic hands,” Nat. Biomed. Eng., pp. 1–3, Nov. 2020. [Online]. Available: https://doi.org/10.1038/s41551-020-00630-8 [DOI] [PMC free article] [PubMed]
- [85].Ganzer P. D. et al. , “Restoring the sense of touch using a sensorimotor demultiplexing neural interface,” Cell, vol. 181, no. 4, pp. 763–773, May 2020. [DOI] [PubMed] [Google Scholar]
- [86].Antfolk C., D'alonzo M., Rosén B., Lundborg G., Sebelius F., and Cipriani C., “Sensory feedback in upper limb prosthetics,” Expert Rev. Med. Devices, vol. 10, no. 1, pp. 45–54, Jan. 2013. [DOI] [PubMed] [Google Scholar]
- [87].Chandrasekaran S. et al. , “Sensory restoration by epidural stimulation of the lateral spinal cord in upper-limb amputees,” Elife, vol. 21, no. 9, Jul. 2020, Art. no. e54349. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [88].Lee B. et al. , “Engineering artificial somatosensation through cortical stimulation in humans,” Front. Syst. Neurosci., vol. 12, 2018, doi: 10.3389/fnsys.2018.00024. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [89].Sensinger J. W. and Dosen S., “A review of sensory feedback in upper-limb prostheses from the perspective of human motor control,” Front. Neurosci., vol. 12, Jan. 2018, Art. no. 24. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [90].“Patient preference information (PPI) in medical device decision-making,” Accessed: Nov. 11, 2020. [Online]. Available: https://www.fda.gov/about-fda/cdrh-patient-engagement/patient-preference-information-ppi-medical-device-decision-making
- [91].“Patient preference information - FDA Guidance document,” Accessed: Nov. 11, 2020. [Online]. Available: https://www.fda.gov/regulatory-information/search-fda-guidance-documents/patient-preference-information-voluntary-submission-review-premarket-approval-applications
- [92].“Wearable robotics standard,” Accessed: Nov. 11, 2020. [Online]. Available: https://www.ieee-ras.org/about-ras/latest-news/206-industry-government/standard/762-wearable-robotics-standard
- [93].“EUROBENCH,” Accessed: Nov. 11, 2020. [Online]. Available: https://eurobench2020.eu/
- [94].“Inbots,” Accessed: Nov. 11, 2020, [Online]. Available: https://inbots.eu/
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
