Abstract
Objective
Electrical stimulation of visual cortex via a neuroprosthesis induces the perception of dots of light (‘phosphenes’), potentially allowing recognition of simple shapes even after decades of blindness. However, restoration of functional vision requires large numbers of electrodes, and chronic, clinical implantation of intracortical electrodes in the visual cortex has only been achieved using devices of up to 96 channels. We evaluated the efficacy and stability of a 1024-channel neuroprosthesis system in non-human primates (NHPs) over more than 3 years to assess its suitability for long-term vision restoration.
Approach
We implanted 16 microelectrode arrays (Utah arrays) consisting of 8 × 8 electrodes with iridium oxide tips in the primary visual cortex (V1) and visual area 4 (V4) of two sighted macaques. We monitored the animals’ health and measured electrode impedances and neuronal signal quality by calculating signal-to-noise ratios of visually driven neuronal activity, peak-to-peak voltages of the waveforms of action potentials, and the number of channels with high-amplitude signals. We delivered cortical microstimulation and determined the minimum current that could be perceived, monitoring the number of channels that successfully yielded phosphenes. We also examined the influence of the implant on a visual task after 2–3 years of implantation and determined the integrity of the brain tissue with a histological analysis 3–3.5 years post-implantation.
Main results
The monkeys remained healthy throughout the implantation period and the device retained its mechanical integrity and electrical conductivity. However, we observed decreasing signal quality with time, declining numbers of phosphene-evoking electrodes, decreases in electrode impedances, and impaired performance on a visual task at visual field locations corresponding to implanted cortical regions. Current thresholds increased with time in one of the two animals. The histological analysis revealed encapsulation of arrays and cortical degeneration. Scanning electron microscopy on one array revealed degradation of IrOx coating and higher impedances for electrodes with broken tips.
Significance
Long-term implantation of a high-channel-count device in NHP visual cortex was accompanied by deformation of cortical tissue and decreased stimulation efficacy and signal quality over time. We conclude that improvements in device biocompatibility and/or refinement of implantation techniques are needed before future clinical use is feasible.
Keywords: non-human primate, V1, V4, blindness, neuroprosthesis, microstimulation, Utah arrays
1. Introduction
Approximately 40 million people worldwide are blind, leading to difficulties in navigation, reading, and face and emotion recognition, which impair social interaction, reduced workforce participation and significant economic losses [1]. When blindness stems from damage that occurs early along the visual processing pathway but spares part of the retina, therapies that target the retina or the eyeball offer hope for this group of people [2]. However, for those individuals who sustain extensive and irreversible damage to the eye or the optic nerve, vision restoration would require interfacing with the central nervous system [3]. Pioneering work in the 1960s by Button and Putnam, and Brindley et al showed that electrical stimulation of the occipital lobe produces visual experiences in blind subjects [4, 5].
It is now well established in both humans [4–19] and animals [20–33] that electrical stimulation of the visual cortex evokes the percept of a dot of light, known as a ‘phosphene’. The location of a phosphene in the visual field is consistent across sessions and depends on the site of stimulation relative to the retinotopic maps in the visual cortex [17, 21, 23, 24, 33–35]. Recently, stimulation of the visual cortex via a 96-channel Utah array allowed a blind volunteer to perceive simple shapes [19] within a small region of the visual field (less than 4 degrees of visual angle (dva)).
However, studies on simulated phosphene vision [36–43] indicate that restoration of functional vision in blind individuals is likely to require at least hundreds to thousands of electrodes, distributed over a large portion of the visual field. This range might be an underestimate given that several of these studies [37–40] assumed that it would be possible to accurately control the perceived luminance of phosphenes in real time, but this has not been realized to date. Furthermore, the visual cortices are highly folded with a complex three-dimensional structure, with only a small part of each visual area at the surface of the brain and accessible to penetrating electrodes, whereas the rest of the cortex is buried within sulci. If a future neuroprosthestic device interfaces with only a small portion of the visual field representation in each visual area, phosphene generation would be limited to small patches of the visual field. Lastly, implant longevity remains a challenge- ideally, a device should remain functional for decades, if not a lifetime. To date, however, clinical studies using microelectrodes have achieved implantation for 4–6 months, followed by device explantation upon conclusion of the study [15,19].
To test the efficacy of generating phosphenes across a larger region of the visual field and obtaining recognizable shapes, we developed a chronically implantable 1024-channel neuroprosthesis system for recording from and stimulation of the visual cortex in monkeys at high spatial and temporal resolution [33]. The device was used to deliver microstimulation via multiple electrodes simultaneously and thereby generate recognizable shapes such as letters, composed of phosphenes. The implant consisted of 16 Utah electrode arrays (Blackrock Neurotech), attached via 7 cm-long wire bundles to a customized, in-house-designed, 3D-printed pedestal (figure 1(a)). Each array contained an 8-by-8 grid of 64 iridium-oxide electrodes, yielding a total of 1024 electrodes per subject. Fourteen arrays were implanted in V1 and two arrays in V4 (figures 1(b) and (c)).
Figure 1. 1024-channel neuroprosthesis.
(a), Photograph of the implant, consisting of a 1024-channel cranial pedestal connected to 16 Utah arrays. (b), Locations of arrays in areas V1 and V4 of the visual cortex in the left hemisphere of monkey L. (c), Photograph of implanted arrays and wire bundles, taken during surgery in monkey L. Arrays are labelled in black. A: anterior; P: posterior; L: left; R: right.
We used this 1024-channel system for chronic recording and/or stimulation of the cortex, providing a large-scale brain interface that could have a range of future clinical applications, including visual, motor and somatosensory prostheses. Due to the large number of arrays, which were densely tiled across the visual cortex, we considered the possibility that the implant might cause more tissue damage than a single array. Hence, we evaluated the chronic stability and efficacy of the 1024-channel device in two sighted rhesus macaque monkeys over a period of 3–3.5 years. We assessed the longevity of the implant and the health of the animals, and examined the number of channels on which phosphene percepts could be elicited, at different time points after implantation. We also determined the minimum stimulation currents required for phosphene perception. Furthermore, we measured the animals’ performance on a visual task several years after implantation, to examine possible adverse effects on cortical integrity and visual perception. To examine the quality of the implant and recorded signals across time, we measured electrode impedance, the signal-to-noise ratio (SNR) of visually driven neuronal activity, peak-to-peak voltages of the recorded action potentials, and the number of channels with high-amplitude action potentials. After sacrificing the animals, we carried out histological examinations of the implanted region of cortex, evaluating the mechanical and electrical integrity of the explanted prosthesis, and examining possible prosthesis failure modes.
By assessing the long-term stability and functionality of our implant, we explored the potential of using a 1024-microelectrode device for electrical stimulation of the visual cortex, identifying possible biological and technological challenges for multi-year use in patients.
2. Methods
2.1. Health and behaviour of animals
All experimental surgical procedures complied with the NIH Guide for Care and Use of Laboratory Animals (National Institutes of Health, Bethesda, Maryland), and were approved by the Institutional Animal Care and Use Committee of the Royal Netherlands Academy of Arts and Sciences. We tested the device in two macaque monkeys, L and A. Each animal received two cranial implants (a head post and a pedestal connected to electrode arrays) during separate surgical procedures under general anaesthesia. At the time of head post implantation, the monkeys were 4 and 5 years old, weighing 6.5 and 7.2 kg, respectively. Upon implantation of electrodes in the visual cortex, they were both 7 years old, weighing 11.0 and 12.6 kg, respectively.
The behaviour and general appearance of the monkeys were monitored daily by lab technicians, animal caretakers and research scientists, and if issues arose, they were addressed. We recorded the weight of the animals in a digital logbook on each training day, and veterinarians carried out regular checks on the animals and a thorough annual examination that included a clinical evaluation and several blood tests. The results did not reveal abnormalities.
2.2. Surgery for implanting electrode arrays
A 1024-channel device comprising 16 Utah arrays (Blackrock Neurotech) was implanted in the visual cortex of two monkeys, as described previously [33, 44, 45]. Electrode shanks were 1.5 mm in length, with 400 μm inter-shank spacing. Pre-implantation electrode impedances (measured by Blackrock Neurotech prior to lead attachment) ranged from 6 to 12 kΩ. The reference wires protruded from the wire bundles of odd-numbered arrays and each reference wire served as the reference for two arrays, yielding eight reference wires in total. The wire bundles were attached to a customized 3D-printed titanium cranial implant that was anatomically tailored to the individual monkey, ensuring a good fit with the skull [33, 46].
During the surgery, the skin was opened, a craniotomy was made over the visual cortex, and the dura was reflected. We used an inserter wand (Blackrock Neurotech) to insert each array into the cortex, and used a micropipette to apply small amounts (microliters) of Histoacryl tissue glue to the sides of the array to secure it to the cortex, and to secure the wire bundle to the bone. The arrays and wire bundles were connected to each other due to the glue, forming a large implant that spanned approximately 3 cm of cortex. The dura and craniotomy were closed and excess lengths of wire bundles above the skull were covered with dental cement. The surgery lasted 8–10 h, of which 3–4 h were spent inserting the arrays. The animals received close monitoring for signs of pain or discomfort during the recovery period immediately following surgical implantation of arrays. We administered antibiotics and painkillers in accordance with animal welfare protocols.
2.3. Health of cranial implant
We inspected the skin surrounding the implant regularly and cleaned it using Prontosan® Wound Irrigation Solution (Braun). In both monkeys, initial regrowth of the skin over the dental cement was followed by gradual retraction of the skin, exposing the dental cement. A gel formulation (Prontosan® Wound Gel, Braun) was topically applied to the wound margin every other day, and surrounding hair was trimmed. If there were signs of local infection of the wound margin, we took bacterial swabs. In monkey L, antibiotic treatment was carried out for one week at 27 months after array implantation, with daily 1-ml intramuscular injections of Duphatroxim.
2.4. Software for stimulus presentation and control
We carried out stimulus presentation and control using a combination of custom-written Matlab scripts, and Tracker [47], Psychophysics Toolbox [48–50] and Cogent 2000 (RRID:SCR_015672) software packages.
2.5. Current thresholds
A visual cortical prosthesis works by delivering electrical currents to the brain tissue to generate phosphene perception. We monitored the number of electrodes that yielded phosphenes, and the current amplitude required for phosphene generation on each electrode. To measure phosphene thresholds, we trained the monkeys on a detection task. Prior to the implantation of electrode arrays, the monkeys performed a saccade task in which they reported the location of a visually presented dot on the screen (figure 2(a)), with an equal proportion of ‘visual trials’ and ‘catch trials’. During visual trials, the animal maintained fixation on a red dot at the centre of the screen, for a period ranging from 300 to 700 ms relative to fixation onset (randomly chosen from a uniform distribution). At the end of this interval, a circular visual target appeared in the bottom-right quadrant of the screen, for a duration ranging from 120 to 150 ms (randomly chosen from a uniform distribution), and a diameter ranging from 0.2 to 0.6 dva. The animal had to make a saccade to the visual target within 250 ms to receive a reward. During catch trials, no visual target was presented, and the animal was rewarded for maintaining fixation throughout the trial. On both visual and catch trials, reward delivery occurred at 1200 ms after fixation onset.
Figure 2. Current thresholding task for phosphene perception.
(a), Illustration of the task used to determine the current thresholds. The monkey maintained fixation on a red dot at the centre of the screen. After an interval that ranged from 300 to 700 ms in duration, microstimulation at various current amplitudes was delivered to V1 via a single electrode, and the monkey made a saccade to the phosphene within 250 ms of stimulation onset to obtain a reward. During catch trials, no stimulation was delivered, and the animal was rewarded for maintaining fixation. (b), Left: mean current threshold across channels over time, relative to implantation date. Grey shaded areas show SD. Right: number of channels yielding phosphene perception at this date or later (green); cumulative number of ineffective channels (red). Current thresholds increased significantly with time in monkey L (t(26) = −5.1295, p < .001). (c), Current thresholds for a subset of electrodes shown at their corresponding location of implantation in the cortex, during an early (left) and late (right) epoch, which have been indicated by grey bars and arrows in panel (b). Green indicates phosphene perception; red indicates no perception. White indicates channels for which current thresholding was not attempted during the respective period. Note that the array positions on the cortex were less orderly than illustrated here (see figure 1(c)).
After implantation of the arrays, we replaced presentation of the visual stimulus with delivery of microstimulation on a single electrode. Biphasic cathodic-first monopolar microstimulation was delivered via a train of 50 pulses at 300 Hz, with a pulse width of 170 μs per phase and an inter-phase interval of 60 μs. The animal had to make a saccade to a target window (of 17 dva in diameter that spanned the bottom-right quadrant of the screen) within 250 ms to receive a reward. During catch trials, no microstimulation was delivered, and the animal had to maintain fixation throughout the trial. On both microstimulation and catch trials, reward delivery occurred at 1200 ms after fixation onset. Performance during microstimulation trials was calculated as the number of hits divided by the sum of hits and misses, while performance during catch trials was calculated as the number of correct rejections divided by the sum of false alarms and correct rejections.
The current amplitudes used for microstimulation were drawn from a fixed range of values on a logarithmic scale, from 1 to 210 μA. This logarithmic distribution ensured that accurate current threshold values could be obtained for all channels, including those with very low current thresholds, where even small changes in current amplitude (on the order of a few μA) influenced perception, as predicted by Weber’s law [51].
A staircase procedure was used to determine the current threshold for each electrode (described in detail in [33]). Briefly, the monkey performed the saccade-to-phosphene task, in which microstimulation was delivered on 50% of trials. The staircase procedure was terminated after 10–20 microstimulation trials were obtained. We plotted the proportion of hits and misses against current amplitude, and fit the data with a Weibull function, yielding a psychometric function for phosphene perception as function of current amplitude. The current threshold for a given channel was defined as the current amplitude that yielded an equal proportion of hits and misses. The threshold value was stored and used to set the initial current amplitude value during subsequent current thresholding sessions for that channel.
To identify changes in current thresholds with time, we identified sessions at early and late time points, during which current thresholding was carried out for many electrodes. We selected channels for which a current threshold was obtained during both early and late periods (pooled across sessions for each period) and performed a paired-sample t-test using the earliest and last current thresholds obtained for these channels. Note that surgical implantation of the arrays was followed by a recovery period of one month, after which the monkeys were engaged in other (unrelated) tasks that did not involve stimulation. Hence, current thresholding began at around 3 and 2 months after the surgery in monkeys L and monkey A, respectively. Across channels, current thresholding was carried out on a mean of 10.5 ± 6.8 (SD) and 4.5 ± 6.0 sessions for monkeys L and A, respectively.
2.6. Visual detection task
We trained the monkeys to perform a stimulus detection task (figure 3(a)), to assess vision at various locations throughout the visual field. They initiated fixation at a central spot, and after 200 ms a light grey (30.3 cd m−2) circle stimulus was presented on a grey background with a luminance of 16.8 cd m−2. The monkeys made a saccade to a target window of 2 dva in diameter centred on the stimulus within 200 ms of stimulus onset, to receive a liquid reward. In the initial stages of training, the stimulus was large and appeared at the centre of the screen, overlapped by the fixation spot. Once task performance was high, the stimulus was moved away from the centre of the screen and its diameter was reduced. In the final version of the task, the stimulus had a diameter of 0.2 dva and was presented at different locations in the lower visual field, following a grid layout (38 by 23 locations on the x- and y-axis, respectively, with 0.3 dva spacing between adjacent grid points). Task performance was calculated across a mean of 14 trials per condition (μN = 14.3, SD = 2.7 in both monkeys, across 12 and 19 sessions in monkeys L and A respectively), yielding a map of detection performance in the lower visual field.
Figure 3. Performance on the visual detection task.
(a), Illustration of the task. The monkey initiated the trial by fixating on a red dot at the centre of the screen. After 200 ms, a small grey circle stimulus was presented and the monkey was rewarded for making a saccade to the stimulus within 200 ms of its onset. (b) and (c), Performance on the visual detection task, showing accuracy (b) and reaction time (c) at each stimulus location. The black line demarcates the region of the visual field corresponding to the retinotopy of the implanted cortex. Significant decreases in accuracy (monkey L: t(217) = 23.17, p < .001; monkey A: t(134) = 14.20, p < .001) and increases in reaction time (monkey L: t(217) = −20.07, p < .001; monkey A: t(134) = −10.61, p < .001) were observed.
The arrays were implanted in the left hemisphere and the V1 receptive fields were located in the lower right hemifield, spanning the central 8 and 5 degrees of the visual field in monkeys L and A, respectively. Hence, we hypothesized that tissue damage would cause visual deficits in the lower right hemifield. To determine the region of the visual field corresponding to implanted cortical regions, we determined receptive field (RF) locations for each channel using an RF mapping task [45], and identified the boundary of the ‘conglomerate RFs’ for each monkey. First, we selected channels with SNR of >2, excluding channels with outlying RF centres and sizes (>3 SDs from the mean). We drew a line bounding the RF centres of these channels, yielding the boundary of the ‘conglomerate RFs’. For each stimulus location in the visual acuity task, we determined whether the stimulus lay within or outside this boundary. Mean task accuracy and reaction time were calculated across trials for each stimulus location and compared between within-conglomerate-RF and outside-conglomerate-RF conditions.
2.7. Visually evoked activity and signal-to-noise ratios (SNRs)
We assessed the quality of neuronal signals on each channel using visually evoked responses to a full-screen checkerboard stimulus that was displayed for 400 ms, while the monkey maintained fixation on a dot at the centre of the screen (figure 4(a)). The checkerboard squares were 1 dva in diameter, and the luminance of the black and white squares was 0 and 92.1 cd m−2, respectively. Prior to stimulus onset, the screen was grey (with a luminance of 14.8 cd m−2).
Figure 4. Checkerboard stimulus used to assess signal quality.
(a), Illustration of the task. The monkey initiated a trial by fixating on a red dot at the centre of the screen. After 400 ms, a full-screen checkerboard stimulus was presented for 400 ms, and the monkey was rewarded for maintaining fixation. (B)–(D), Data from an example channel (channel 40 on array 11, marked by red circles in figures 5(a) and (c)) during early and late sessions (91 and 279 d post-implantation, respectively). (b), Raw data (band-pass filtered from 500 to 9000 Hz) on 5 example trials, showing visually evoked responses. Grey: stimulus presentation from 0 to 400 ms. (c), Mean visually evoked response across trials, used to calculate the SNR for each session (corresponding to data marked by red circles in figures 5(a) and (c)). Grey: stimulus presentation from 0 to 400 ms. (d), Snippets used to calculate peak-to-peak voltage of action potentials, and mean waveform and SD (black dotted line and grey shaded areas) across all snippets from the session.
The task was carried out across 21 and 8 recording sessions, distributed over a 3.5 year and 3 year period in monkeys L and A, respectively. The raw neuronal signal (sampling frequency of 30 kHz) on each of the 1024 channels was processed to obtain envelope multiunit activity (MUAe [52], down-sampled to 1 kHz). The SNR on each channel was calculated as follows: the spontaneous activity level was calculated as the mean activity in the 300 ms time window prior to stimulus onset, while the noise level was calculated as the standard deviation of the activity in the same window across trials. Next, the MUAe data was smoothed with a moving average of 20 bins (corresponding to 20 ms), and we identified the peak response elicited by the stimulus. The mean spontaneous activity level was subtracted from this peak activity level, yielding the response level relative to baseline, and the result was divided by the standard deviation of the baseline activity, yielding the SNR (see equation (1)):
| (1) |
Supplementary figure 1 shows the mean responses elicited by the checkerboard stimuli across all 1024 channels, for example early (left) and late (right) sessions (days 75 and 727 for monkey L; days 33 and 384 for monkey A). For each channel, the range on the Y-axis is set to be equal between early and late sessions. Across channels, the mean and SD of the range on the y-axis are 5.83 ± 5.79, in arbitrary units (a.u.). figure 4 shows raw data (figure 4(b)) and MUAe (figure 4(c)) from an example channel (channel 40 on array 11) during early and late sessions (91 and 279 d post-implantation, respectively). We examined the SNR values across all channels and sessions (supplementary figure 2(a)), as well as the physical locations of the channels and arrays on the cortex.
To compare SNR values between the period immediately following array implantation to those obtained at a later point in time, we combined data across the first two sessions (categorized as ‘early sessions’) and across the last two sessions (‘late sessions’) and compared SNR values for all 1024 channels. A one-way analysis of variance (ANOVA) was carried out, with time as a factor (‘early’ or ‘late’). Violin plots were generated to visualize changes in SNR with time, using open-source Matlab scripts [53]. To examine changes in the number of channels with good signal quality, we calculated the number of channels with SNR >1 for each session and carried out a linear regression.
2.8. Signal amplitude and peak-to-peak voltage
The dataset obtained for the calculation of SNR was also used to calculate peak-to-peak voltage during visual stimulus presentation and to identify channels with high-amplitude signals, providing two additional measures of signal quality [54]. We used automated techniques [54, 55] instead of manual spike sorting to avoid bias when assessing the quality of spike recordings [56].
The methods and values used are identical to those described by Hughes et al [54]. For each trial and electrode, we calculated the root-mean-square level of baseline activity. If the voltage signal during stimulus presentation crossed a negative threshold of −4.5 times the root-mean-square level, the time of threshold crossing was noted and a 1.6-ms snippet of signal was stored (starting ten samples before threshold crossing). Snippets from an example channel (channel 40 on array 11) during early and late sessions (91 and 279 d post-implantation, respectively) are shown in figure 4(d).
For each electrode, we identified the largest 2% of snippets across trials, and calculated the average waveform across these snippets. We then measured the peak-to-peak voltage of the average waveform. Electrodes with a trial-wise snippet occurrence rate of >1.67 Hz and a peak-to-peak voltage of >30 μV in the average waveform were used for further analysis. If the peak-to-peak voltage on a given electrode was >100 μV, it was deemed to yield high-amplitude spikes. Violin plots were generated to visualize changes in peak-to-peak voltage with time, using open-source Matlab scripts [53]. We calculated the mean peak-to-peak voltage across channels for each session, and carried out a linear regression against the number of days post-implantation. If the slope of the regression line was significantly different from 0, this indicated a change in mean peak-to-peak voltage over time. We examined the peak-to-peak voltages across all channels and sessions (supplementary figure 2(b)), and the locations of the channels and arrays on the cortex.
2.9. Impedance values
We measured electrode impedance at 1 kHz at multiple time points during the implantation period, across 19 and 9 sessions in monkeys L and A, respectively, using the Impedance Tester function in the Central Software Suite (Blackrock Neurotech). Following perfusion of the animals and explantation of the arrays, we measured electrode impedance at 1 kHz using a nanoZ (White Matter LLC, Seattle, US). We examined impedances across all channels and sessions (supplementary figure 2(c)), and the locations of the channels and arrays on the cortex.
2.10. MRI template registration for histological analysis
In preparation for the histological analysis, a 3D rendering of the magnetic resonance imaging (MRI) template of the rhesus macaque brain, compiled across 31 macaques (NIMH Macaque Template, version 2; NMTv2) was non-linearly co-registered to the anatomical T1-weighted scan of the brain of monkey L, obtained before implantation of electrode arrays. First, a T1-weighted MRI (3D-FFE; GR-MP, TE = 7 ms, TR = 15 ms, flip angle = 8°, 0.5 × 0.5 × 0.5 mm isotropic voxels) was acquired on a 3 T Philips Ingenia MR scanner using a 32-channel head coil while the animal was anesthetized with an intramuscular injection of Medetomidine (0.08 ml kg−1) together with Ketamine (0.07 ml kg− 1). Digital Imaging and Communications in Medicine (DICOM) images were converted to nifti files using dcm2niix [57] and the individual anatomical scan was nonlin-early registered to the NMTv2 template using AFNI’s @animal_warper function [58]. This yielded an anatomical model of the intact brain (pre-implantation), providing a basis of comparison with the implanted, post-mortem brain.
2.11. Perfusion and tissue processing
Euthanasia was carried out at 3 and 3.5 years of implantation in monkeys L and A, respectively. We perfused monkey A transcardially with a 4% solution of phosphate-buffered paraformaldehyde. Due to an error during the perfusion procedure, the brain of monkey L was incompletely fixed, hence we fixed it by immersion.
We detached the meninges from the skull and observed a mass of newly formed tissue that encapsulated the implants. We observed that on some arrays, several electrode tips remained visible and protruded from the encapsulating tissue. We identified the channels that remained exposed and the arrays to which they belonged. The encapsulation tissue was carefully dissected away, allowing retrieval and storage of arrays, wire bundles, and reference wires. In monkey L, to avoid damaging the brain tissue, we cut the wire bundles connecting the arrays to the pedestal. In monkey A, we observed that the wire bundles on four of the most laterally located arrays (arrays 1, 2, 3 and 4) were severed. Furthermore, the electrodes were detached from their base on array 6, and the wire bundle of array 12 was severed during dissection. The remaining ten arrays remained connected to the pedestal.
In both monkeys, the fixed brain and explanted 1024-channel implant were stored in 30% sucrose in phosphate-buffered saline. We observed deformations of the cortical surface of the implanted hemisphere due to the presence of the implant and encapsulating tissue, and created a digital model of the cortex prior to slicing of the brain for histology. We first produced a negative mould of the cortex in 2% agar, followed by a positive mould in silicone (OOMOO™, 25 Shore). We scanned the silicone model using a desktop 3D scanner (EinScan-SP, SHINING 3D) at a resolution of 50 μm, yielding a digital copy of the cortex, and post-processed it to yield a clean model.
We separated the two hemispheres and dissected two blocks, posterior to the lunate sulcus. We froze the blocks by submersion in isopentane cooled to −50 °C, and then cut them into 50 μm-thick sections in the frontal plane, using a cryo-microtome. We stained sections from the two hemispheres (implanted and control) using fluorescent Nissl (1:500; NeuroTrace™ 530/615 Red Fluorescent Nissl Stain, Invitrogen™). We imaged the fluorescent Nissl using a Leica SP8 Confocal microscope (10 × magnification) to evaluate the extent of changes observed in the cortical surface during gross sectioning.
2.12. Post-mortem impedances and scanning electron microscopy
In monkey L, as the explanted arrays were detached from the pedestal, one array was selected for closer examination. We chose array 8 as it was in the middle of the implanted arrays, and several of its electrodes (14/64) had been used for stimulation. We carried out sputter coating with 7 nm of Au (CCu-010, Safematic) and obtained scanning electron microscopy images (Helios 5, Thermo Fisher Scientific) at 1250× magnification, for 62/64 electrodes. Two of the electrode shafts were detached from the array and remained in the fibrotic tissue, hence we excluded them from imaging. For each electrode, we coded the silicon tip as intact or broken, and noted any pitting of the silicon surface. We examined SNR and impedance values obtained during the final in-vivo measurement (1299 d after implantation) for possible differences between intact and broken electrodes. We compared the identities of electrically stimulated electrodes with those that had visible pitting of the Si surface.
In monkey A, 10 of the 16 explanted arrays (arrays 5, 7–11, 13–16) remained connected to the pedestal via their wire bundles. The arrays were cleaned via immersion in contact lens solution for several days (Etos BV, Netherlands) followed by de-ionized water. The arrays were allowed to dry out after explantation. To test electrical conductance of the explanted device, the legs of the explanted pedestal and the intact Utah arrays were placed in a beaker of saline solution. The contact points on the land grid array of the pedestal were connected to an electronic interface board, providing a passive electrical connection to 32-channel Omnetics connectors. We used a nanoZ device to obtain impedance measurements from the ten connected arrays at 1 kHz. One of the channels on the nanoZ device was not functional, and measurements on that channel were discarded. Measurements from channels with high impedance values (>5000 kOhms, N = 4 channels) or that yielded clipped signals due to amplifier saturation (N = 111 channels) were also discarded.
3. Results
Our previous study demonstrated that a 1024-channel neuroprosthesis reliably induced discriminable percepts consisting of phosphenes in monkeys [33]. Here, we evaluated the effects of long-term implantation on the animals’ health, behaviour, phosphene perception, and visual perception, to better understand the challenges associated with chronic implantation in human patients. We assessed the efficacy of the hardware, the mechanical stability and integrity of the implant, and the quality of recorded neuronal signals. After the conclusion of behavioural experiments, we examined the effects of chronic implantation on the cortical tissue including the degree of tissue damage and gliosis induced by the device. The datasets used in this paper are summarized in table 1.
Table 1. Summary of datasets used. Number and type of data for each monkey and dataset, and time of data collection relative to array implantation (rounded to the nearest year).
| Dataset | Number/type of data | State of the animal | |
|---|---|---|---|
| Monkey L | Monkey A | ||
| Current thresholding | 102 sessions over 2 years | 69 sessions over 1 year | Performing a behavioural task with electrical stimulation |
| Visual detection task | 12 sessions in year 3 | 19 sessions in year 2 | Performing a behavioural task with visual stimulation |
| Visually evoked activity | 21 sessions over 2 years | 8 sessions over 1 year | Performing a behavioural task with visual stimulation |
| In-vivo impedance | 19 sessions over 2 years | 9 sessions over 1 year | Not performing a behavioural task |
| Ex-vivo impedance | NA | After 3 years | NA |
| Tissue dissection | After 3 years | After 3 years | NA |
| Histology | After 3 years | NA | NA |
| SEM | After 3 years | NA | NA |
3.1. Health and behaviour
The two monkeys were healthy throughout the implantation period. On all counts, their behaviour and appearance were normal throughout the course of the study. Their weight was monitored regularly and fell within the expected range for the age of the animals. The implant was well attached to the skull for the duration of the experiments and occasional signs of local skin infection at the margin between the skin and the implant were treated (see methods).
3.2. Phosphene induction
Previous studies showed that stimulation of the visual cortex via multiple electrodes generates phosphenes that form discriminable percepts [59], such as lines and letters [19, 33, 35, 60]. Here, we examined the number of electrodes that successfully evoked phosphenes over time, to determine the efficacy and longevity of the prosthesis and evaluate the potential of using this technology for a future clinical device.
We first determined the minimal current that gave rise to the perception of phosphenes, on individual electrodes, using a current thresholding task. The monkeys initiated a trial by fixating on a dot at the centre of the screen. On 50% of the trials, after a variable interval (ranging from 300 to 700 ms), we delivered microstimulation to V1 via a single electrode, and the monkey made a saccade to the phosphene to obtain a reward. The other 50% of trials were catch trials in which no stimulation was delivered, and the animal simply maintained fixation.
We varied the current amplitude to determine current thresholds on a subset of channels across the implantation period. To do so, we identified electrodes with impedances of <150 and <300 kOhms, in monkeys L and A, respectively (the cut-off impedance was set at a higher value for monkey A than for monkey L due to the higher impedance levels in this monkey). Current thresholding was carried out for a total of 300 and 372 channels across 102 and 69 sessions in monkeys L and A, respectively (figure 2(b), left).
To evaluate the number of electrodes that successfully elicited phosphenes, we pooled sessions within an earlier and a later period (monkey L, early period: days 229–246, N = 137 electrodes, late period: day 845, N = 219 electrodes; monkey A, early: 47–64, N = 198 electrodes, late: 144–166, N = 280 electrodes). These periods were 20 months apart in monkey L and only 3 months apart in monkey A, due to differences between the monkeys in the time required to carry out other experiments. We tallied the number of electrodes that either yielded measurable thresholds or failed to elicit phosphenes.
Note that the main purpose of the current thresholding task was to carry out phosphene detection and phosphene shape discrimination tasks, described in a separate study [33]. Electrodes were selected for stimulation such that the receptive fields of the stimulated neurons collectively formed a shape, such as a line or a letter. Hence, we did not carry out current thresholding across all the electrodes periodically, could not determine the precise date on which stimulation failure occurred on a given channel, and do not have an overview of all effective and ineffective electrodes.
We found that for monkey L, the number of electrodes that were tested and effective decreased from 98% (134/137) to 24% (53/219). Similarly, for monkey A, the number of effective electrodes decreased from 93% (185/198) to 5% (13/280) (figure 2(b), right). The cortical locations of the electrodes that had been tested and their efficacy in generating phosphenes are illustrated in figure 2(c).
We also compared current thresholds between early and late periods, for channels that had been tested and produced phosphenes in both periods. The loss of functional electrodes was accompanied by a significant increase in current thresholds in monkey L, but not in monkey A (monkey L: μearly = 19 ± 17 (SD) μA; μlate= 80 ± 71 μA, t(26) = -5.1295, p < .001; monkey A: μearly = 65 ± 45 μA; μlate= 60 ± 58 μA, t(11) = 0.361, p = .725, paired-sample t -test).
We hypothesized that the decreases in the number of effective channels may have been due to biological factors, such as tissue encapsulation of the electrodes, or to mechanical factors, such as degradation of the electrodes or connector. We therefore carried out a behavioural task to assess the monkeys’ level of vision throughout their visual field, and assessed indicators of signal quality, including SNR and peak-to-peak voltage, to identify potential changes in the recordings and the time course of these changes. Finally, we examined the histology of the visual cortex and the electromechanical integrity of the explanted prosthesis.
3.3. Visual detection task
Two to three years after implantation, we trained the monkeys to report the luminance of a visual stimulus and noticed relatively poor performance in the visual field region in which electrodes had been implanted. We therefore suspected that there was damage to the visual cortex. To examine the extent of loss of visual function, we trained the animals on a visual detection task in which they had to report the presence or absence of a visual stimulus. The monkeys started a trial by directing their gaze to a fixation spot at the centre of the screen. They had to make an eye movement to a small (0.2 dva diameter) visual stimulus (figure 3(a)) that was presented at one of several locations on a grid across the lower visual field (38 by 23 locations, see methods). We identified visual field locations corresponding to implanted versus non-implanted regions of cortex, defining ‘conglomerate RFs’ as the region of the visual field that corresponded to the collective RF locations across the electrodes (black outlines in figures 3(b) and (c)). We classified each stimulus as being positioned either inside or outside the conglomerate RFs.
We tested monkey L three years after array implantation. While task accuracy was 92.6 ± 0.5% (mean ± SEM) for stimuli outside the conglomerate RFs, it dropped to 65.2 ± 1.6% for stimuli inside (t(217) = 23, p < .001) (figure 3(b)). Similarly, in monkey A (tested two years after array implantation), task accuracy outside the conglomerate RFs was 90.1 ± 0.6% but 63.7 ± 3.2% inside (t(134) = 14.20, p < .001, two-sample t-test). These decreases in accuracy were accompanied by increased reaction times (figure 3(c)). The mean RT in monkey L was 151.6 ± 1.3 ms at control locations and 210.1 ± 3.4 ms at conglomerate RF locations (t(217) = − 20.07, p < .001). In monkey A, it was 153.1 ± 1.2 ms at control locations and 200.1 ± 8.2 ms at RF locations (t(134) = −10.61, p < .001, two-sample t-test). Hence, after several years, the implant caused significant impairments in accuracy in the visual task and increased reaction times, at the V1 visual field representation corresponding to array implantation.
3.4. Signal-to-noise ratio (SNR) of the visually driven response
To evaluate the quality of the electrode–tissue interface, we measured visually evoked responses of neurons recorded via the electrodes (figure 4). On each trial, we presented a high-contrast checkerboard stimulus to the monkeys and measured the SNR (defined in the methods) of visually driven neuronal responses in area V1. A high SNR is indicative of a functional electrode that delivers good neuronal signals, whereas a low SNR may indicate electrode failure, connection failure, poor contact between the electrode and the neuronal tissue, and/or tissue gliosis that increases the distance between the electrode and the surrounding neurons.
We plotted SNR values of all functional electrodes as a function of days after the surgery (figure 5(a)) and examined the spatial distribution of SNR values across all the arrays during example early and late sessions (figure 5(b)). In the period following implantation, a large proportion of channels showed high SNR values of >1 (1019/1024 and 979/1024 channels, at 75 and 69 d after surgery in monkeys L and A, respectively), indicating good signal quality (yellow in figure 5(b)). However, in both monkeys, SNR decreased over time (blue in figure 5(b)). For the statistical tests, we combined the data across the first two sessions and the last two sessions, which were 22 months apart for monkey L and 12 months for monkey A. SNRs decreased significantly in both animals (monkey L: F(1,4094) = 1504, p < .001; monkey A: F(1,4094) = 1327, p < .001, one-way ANOVA). The number of electrodes with SNR >1 also decreased over time (supplementary figure 2(a), monkey L: t(19) = − 5.223, p < .001, monkey A: t(6) = − 2.833, p = .0299, linear regression).
Figure 5. Changes in signal quality and electrode impedance with time.
(a), SNR of the visually driven response elicited by a checkerboard stimulus in monkey L (upper row) and monkey A (lower row) relative to implantation date. Violin plots show data averaged across 6 time-bins. Blue line: best-fit line using linear regression. Red circles indicate the example channel shown in figures 4(b)–(d). SNR decreased significantly with time (monkey L: F(1,4094) = 1504, p < .001; monkey A: F(1,4094) = 1327, p < .001). (b), SNR values across all arrays during an example early (left) and late (right) session (indicated by the arrows in (a)). (c), Peak-to-peak voltages of action potentials relative to the implantation date. Red circles indicate the example channel shown in figures 4(b)–(d). The number of high-amplitude channels decreased significantly with time (monkey L: χ(1,1024) = 369.5, p < .001; monkey (a): χ(1,1024) = 172.4, p < .001). (d), Peak-to-peak voltage at each electrode during example early and late sessions. (e), Impedance values as a function of time after the implantation, for electrodes with an impedance of <2000 kOhms, measured at 1 kHz. Impedance on this subset of electrodes decreased significantly with time (monkey L: F(1,4009) = 36.6, p < .001; monkey A: F (1,4094) = 2633, p < .001). (f): Impedance values during example early and late sessions.
In summary, the decrease in phosphene perception was accompanied by a decrease in SNR over the years. The deterioration occurred more gradually in monkey L than in monkey A.
3.5. Peak-to-peak voltage of detected action potentials
As another measure of recording quality, we examined the amplitude of the recorded action potentials (in μV) [54]. The mean peak-to-peak voltage of detected action potentials decreased significantly with time in monkey L (t(18) = −4.694, p < .001). In monkey A, we observed a sharp drop during the first few months, after which it stabilized at a low value (during the first six sessions, distributed over 13 months of implantation: t(4) = − 3.0197, p = .0392; all sessions: t(4) = —2.678, p = .0553, linear regression, figures 5(c) and (d)). We also examined the number of high-amplitude channels (>100 μV peak-to-peak voltage) per session, and found that they decreased significantly with time in both monkeys, from 313/1024 channels at day 75, to 0 channels at day 1299 in monkey L (χ(1,1024) = 369.5, p < .001, Chi-square test) and from 159 channels at day 33, to 0 at day 145 in monkey A (χ(1,1024) = 172.4, p < .001, supplementary figure 2(b)).
3.6. Impedance values throughout implantation
Electrode impedance depends on numerous factors, including the health and proximity of biological tissue to the electrode, electrode and implant materials, and the physical integrity of the electrode and its connections. A sudden increase in impedance may indicate that an electrical connection has been severed, while gradual changes may point to fibrous encapsulation of the implant. However, the relationship between impedance and recording quality is complex and remains only partially understood [61]. Previous studies reported that gradual declines in neuronal signal quality are accompanied by decreases in impedance [62], and also that encapsulation of electrodes can lead to lower impedances [63]. Hence, impedance is often measured prior to and during implantation, providing an indicator of electrode integrity and the stability of the electrode–tissue interface [64].
The impedance values followed a bimodal distribution in both monkeys. The majority of channels (97.9% in monkey L and 99.4% in monkey A, at day 88 and 33, respectively) had an impedance of <2000 kOhms. However, others had an impedance of >3000 kOhms (supplementary figure 2(c), bottom) and we assumed that these channels had non-functional electrodes or broken connections. The number of channels with an impedance larger than 3000 kOhms increased over time (monkey L: 22/1024 channels on day 88 and 98/1024 channels on day 727; monkey A: 6/1024 channels on day 33 and 34/1024 channels on day 386). However, the identity of these high-impedance channels changed, with only 5 and 3 channels in common between early and late sessions in monkeys L and A, respectively. These high-impedance channels were excluded from subsequent analysis [23].
Next, we examined the channels with impedances of <2000 kOhms and observed a general decrease in impedance values in both animals, with a particularly rapid decline in monkey A (figures 5(e) and (f)). To quantify these observations, we combined data across the first and last two measurement sessions, which were 21 months apart in monkey L and 12 months apart in monkey A. In both animals, we observed a significant decrease in impedance with time (one-way ANOVA with time as factor; monkey L: F(1,4009) = 36.6, p < .001; monkey A: F(1,4094) = 2633, p < .001). These results, taken together, suggest that there were two categories of channels, a higher-impedance group that may correspond to non-functional electrodes, and a lower-impedance group with electrodes that remained partly functional but for which impedance decreased over time.
3.7. Tissue dissection and implant integrity
We sacrificed the monkeys 3–3.5 years after implantation. In both monkeys, two of the legs of the titanium pedestal were partially covered by bone, indicating good integration between the pedestal and skull. The skull underlying and adjacent to the dental cement flanking the transcranial wire bundles was replaced with softer, whitish tissue spanning approximately 26 and 19 mm in diameter in monkeys L and A, respectively.
We dissected the tissue mass encapsulating the implants to reveal the arrays, electrodes, wire bundles, and reference wires. The relative positions of the arrays were similar to those during implantation (figure 6(a)). The histoacrylate tissue glue that had been applied to wire bundles and the sides of arrays during surgery to hold them in place was still clearly visible (figure 6(b), bottom).
Figure 6. Tissue response and histology.
(a), Photos of the brain and implant in monkey (a). Top: encapsulated arrays and wire bundles. Bottom: rows of arrays after explantation. (b), Top: close-up of partially encapsulated arrays. Bottom: tissue glue on explanted array and wire bundle, indicated by green arrows. (c), Photographs showing the surface of the visual cortex in monkeys L (top) and (a) (bottom). (d), Histological slice in monkey L, revealing lesioned cortex at implantation location, spanning the entire depth of dorsal V1 and underlying white matter. White lines demarcate white- and grey-matter boundaries. In the macaque brain, V1 cortex is folded, with part of V1 at the surface of the brain and the folded part forming a second layer underneath. The implant caused a large lesion in V1 cortex, revealing the underlying folded V1 cortex (layers of cortex are labelled). (e), Coronal slice from the co-registered NMT v2 template shown in G), corresponding to the dotted line in (f) and plane in (g). The overlay shows the approximate location of the histological slice from (d). S: superior; I: inferior; L: left; R: right. F, Fixed and extracted partial brain from monkey L (including occipital and parietal lobes), with visible damage to the implanted left hemisphere. Dotted line indicates approximate location of slice made during histology. A: anterior; P: posterior. G, 3D rendering of NMT v2 MRI template, registered to anatomical T1-weighted brain scan for monkey L before electrode array implantation. H, SNR obtained on electrodes with exposed versus encapsulated tips, combined across 10 arrays (5 per monkey). SNR was significantly higher on electrodes with exposed tips t(638) = −9.330, p < .001).
3.8. Macroscopic and microscopic cortical damage
In both monkeys, the cortical surface of the implanted hemisphere was deformed, suggesting that it had been pushed downwards by the encapsulating tissue. Rows of depressions produced a scalloped appearance (figure 6(c)). Distinct depressions were identifiable for 9 of the 16 arrays in monkey L, ranging from 1.7 to 3.3 mm in depth, and for 8 arrays in monkey A, ranging from 1.9 to 5.3 mm in depth. The cortex of the non-implanted hemisphere appeared to be normal.
Macroscopic and microscopical analysis revealed that the cortex in monkey L was lesioned at the location of the electrode arrays. To visualize the extent of the lesion in monkey L, we overlaid the histological slice of the implanted region of cortex on a pre-surgical T1-weighted MRI scan, to which we co-registered a standard rhesus macaque template (methods) (figures 6(d)–(g)). The lesion spanned the entire depth of dorsal V1, as well as part of the underlying white matter (figures 6(d) and (e)). To correct for post-mortem shrinkage of the tissue, we scaled the histological section to match that of the pre-surgical scan. The extent of tissue damage can be seen in figure 6(e).
The cortical damage caused by the implants was in keeping with the loss of neuronal signals, the decreased number of phosphene-producing electrodes, and the poorer visual performance in the corresponding region of the visual field.
3.9. Electrode tip encapsulation
During tissue dissection, we found that newly formed tissue encapsulated the arrays and wires (figure 6(a)), flanking the upper and lower surfaces of the arrays and electrodes. The tissue mass was firmly attached to the dura but could be separated from it with tweezers. Five arrays in each of the monkeys (monkey L: arrays 4, 6, 8, 14, 15; monkey A: arrays 2, 6, 12, 14, 16) were only partially encapsulated, leaving several electrode tips exposed (figure 6(b), top).
As expected, electrodes with more tip encapsulation had lower SNR, an effect that was confirmed for seven of 10 arrays (ps < .01, Student’s unpaired t-test, Bonferonni correction, see supplementary table 1 for list of p values) and also when electrodes were pooled across monkeys and arrays. The SNRs of exposed and encapsulated electrodes were 3.1 ± 1.9 and 1.7 ± 1.0 (mean ± SD), respectively (figure 6(h), t(638) = — 9.330, p < .001, unpaired t-test). There was no significant difference in impedance between electrodes with exposed versus encapsulated tips (monkey L: t(318) = 1.9, p = .06; monkey A: t(318) = 1.0, p = .3, unpaired t-test). We also did not observe a difference in SNR between electrodes that had been stimulated and those that had not.
3.10. Scanning electron microscopy and electrode impedance
We performed scanning electron microscopy on 62/64 electrodes from one array (array 8, figures 7(a)–(c)) in monkey L, and observed loss of the IrOx coating on 61/62 electrodes. Pitting of the exposed Si surface was observed on 13/62 electrodes (figure 7(c), inset). The Si tip itself remained intact in 5 electrodes and was damaged in the other 57 electrodes (figure 7(c), compare upper panel to middle and lower panel).
Figure 7. Explanted arrays.
(a), Photograph of array 8, explanted from monkey L. (b), Close-up SEM image of array 8. (c), Scanning electron microscopy images of example electrodes on this array with missing or damaged IrOx layer, broken Si tip (middle), and pitting of Si surface (middle inset). (d), Photograph of arrays explanted from monkey (a).
The in-vivo electrode impedances (measured 1299 d after surgery) were lower for electrodes with intact than with broken Si tips (μintact: 479.5 ± 17.7 (SD) kOhms, μbroken: 503.0 ± 6.3, t(60) = − 2.93, p = .0047, unpaired t-test), implying that higher in-vivo impedances may indicate tip damage. There was no significant relationship between tip damage and SNR (t(60) = − 0.021, p = .983, unpaired t-test), and no effect of pitting on either SNR (t(60) = — 0.931, p = .356) or impedance (t(60) = −1.51, p = .137). There was also no relation between pitting and electrical stimulation (χ(2,62) = 0.166, p = .684, Chi-square test).
In monkey A, we examined in-vivo and ex-vivo impedances on the ten arrays that remained connected to the pedestal via their wire bundle (figure 7(d)). To our surprise, the impedance increased following explantation, from 45 ± 41 (mean ± SD) to 68 ± 84 kOhms (t(501) = − 5.4, p < .001, paired t-test), even though we removed connective tissue and cleaned the electrodes.
4. Discussion
Utah arrays have proven to be effective for both recording from motor cortex and stimulation of somatosensory cortex over many years in humans (>1500 d [54]), motivating us to consider their suitability for stimulation of the visual cortex with 1024-channel prosthesis. We monitored the efficacy of the device, neuronal signal quality, and the behaviour and general well-being of two monkeys over ~3 years of implantation, as well as the tissue response.
The animals remained healthy throughout the implantation period, despite occasional signs of inflammation, which was kept under control by cleaning of the skin and the implant. However, across several years of implantation, the numbers of channels yielding reports of phosphenes during microstimulation decreased, and in one animal, the minimal amount of current necessary to elicit a phosphene increased. Furthermore, the SNR and the peak-to-peak voltage of the electrophysiological signals decreased over ~ 15 months in the first monkey and ~4 months in the second monkey, matching the time course of the decline in the efficacy of phosphene generation. When we excluded the channels with high impedance values (>3000 kOhms), we observed decreases in the impedance of the remaining channels over the course of our study.
Post-mortem analyses revealed that the arrays and wire bundles were almost fully encapsulated, insulating them from the cortex after 3–3.5 years of implantation. The newly formed fibrotic tissue deformed the cortex, causing a visual impairment at the corresponding region of the visual field, in the form of decreases in accuracy and longer reaction times on a stimulus detection task.
Our analysis of electrode integrity after the experiment revealed degradation of the IrOx deposition layer, electrode tip breakage, and pitting of the electrode surface. Similarly, across three arrays in an nonhuman primate (NHP), Patel et al found that their arrays remained largely intact but individual electrodes showed signs of tip breakage and cracking, 590–848 d after implantation [65].
4.1. Implications for clinical translation
Silicon-based arrays such as the Utah array have been a staple of electrophysiology since the 1990s, allowing acute and chronic recording and stimulation of neuronal tissue in humans and NHPs. Such implants remain stable for months to years, allowing neuroscientists to observe and modulate brain activity within the same regions of tissue or groups of neurons for extended periods of time. These arrays have yielded significant breakthroughs in fundamental neuroscience and clinically applied technologies, allowing the generation of visual percepts in the blind [19] and enabling paralysed people to regain control over their muscles [66, 67], communicate [68], and control a computer cursor [69] or robotic arm [70–72] with their thoughts.
To date, only a small number of human patients have received intracortical Utah array implants (18 out of 48 patients having been chronically implanted for >30 d as of September 2018) [73] and the individual arrays contain 96 channels, which, in the case of a visual prosthesis, would provide limited phosphene coverage of visual space (~ 3 dva [19]). Hence, it remains unknown whether a high-channel-count device such as the 1024-channel implant that was used in monkeys [33] would be suitable for vision restoration in a clinical setting.
In NHPs, the longevity and efficacy of 96-channel Utah arrays varies substantially between subjects. Our results are consistent with previous studies demonstrating that signal quality decreases and tissue gliosis builds up over a period of months to years [62], a process that is accompanied by cortical atrophy, macrophage infiltration and neuronal necrosis [74]. These effects are thought to be caused by the presence of arrays rather than the delivery of stimulation because there are no histological differences between stimulated and non-stimulated tissue [74, 75], or behavioural differences in sensitivity to stimulation between heavily versus sparingly stimulated electrodes [76], and stimulation has even been reported to increase SNRs [77]. In our study, we did not observe a detrimental effect of stimulation either.
4.2. Causes of implant failure
The known causes of implant failure can be classified into three categories [62]. The first is material failure, e.g. degradation of insulating material on the probe or electrode tip breakage. The second is mechanical failure, e.g. damage to the wire bundle or connector, and the third is biological failure, caused by tissue trauma during initial electrode insertion and chronic immune system reactions to a foreign object. A survey of 78 silicon-based microelectrode arrays (including the Utah array) across 27 monkeys [62] showed that implant failure typically occurred within a year of implantation, due to mechanical issues such as problems with the connector. In the case of biological failures, progressive meningeal encapsulation of arrays was observed, separating the electrodes from the brain tissue. Encapsulation causes a gradual decline in spike amplitude over several years and damage to the electrodes causes decreases in their impedance. Furthermore, a recent study with a Utah array in a human patient [78] revealed proliferation of the meninges, fibrosis, lymphocytic infiltrates, astrogliosis, and foreign body reaction around the electrodes, combined with microhemorrhages, neuronal loss, and subcortical white matter necrosis. A second study on Utah arrays in humans found that longer periods of implantation were accompanied by greater array encapsulation [64]. However, IrOx delamination and cracking of the insulation layer did not prevent recording of neural signals. Our results are consistent with these previous findings, and we additionally documented deficits in visual acuity that accompanied the tissue damage.
In our study, signal quality declined gradually, indicating that material or biological reasons were the primary factors for the declining efficacy. Signal quality is particularly important for applications requiring neuronal read-out and decoding, such as motor control following paralysis [54, 79]. For applications involving stimulation, signal quality provides an indicator of electrode proximity to the neurons, but may be less critical for device functionality that depends on the efficacy of stimulation.
Numerous interacting factors are thought to affect in-vivo impedances, including electrode surface area, glial encapsulation, protein adsorption, stimulation waveforms, and the integrity of electrode insulation layers and electrode coating [61, 80]. Previous studies have documented an initial increase in electrode impedance during the first week of implantation [64, 81, 82], followed by a gradual decrease [23, 62, 75, 81, 82]. As our in-vivo impedance measurements began 1–3 months after implantation, we could not observe the initial increase seen in previous studies, but we did observe a subsequent decrease. We did not find a significant correlation between in-vivo SNR and ex-vivo electrode impedance, indicating that impedance may not be a reliable indicator of signal quality. Furthermore, we did not find an effect of degree of tip encapsulation on electrode impedance, implying that encapsulation does not substantially alter impedance values. We note, however, that we did not monitor encapsulation of the electrode tips in vivo, neither did we examine tissue adherence to the tips microscopically. On an explanted array that underwent scanning electron microscopy, we observed that electrodes with broken tips had higher in-vivo impedance values than those with intact tips, confirming that impedance is an indicator of electrode integrity.
The degree of electrode tip encapsulation predicted loss of SNR, in accordance with the hypothesis that the declines in SNR and microstimulation efficacy were caused by the growth of encapsulation tissue. Hence, the implant failure was caused by the tissue response rather than insufficient long-term stability of the device. The biological encapsulation of arrays and extrusion of electrodes from the cortex poses a challenge for long-term implantation and it is important to better understand their root causes and possible mitigation strategies to allow for safe and effective chronic use in the future.
The amount of array encapsulation and tissue damage that we observed seems to exceed that reported in previous studies using Utah arrays. We note that our implantation methods differ from the standard approaches used in previous studies (both clinical and pre-clinical) in five aspects, which may contribute to the differences observed: (1) the high density of the arrays, which were spaced closer together than in previous studies. (2) The use of tissue glue to secure the arrays to the cortex, which may have been toxic. (3) The reduction in relative motion between the arrays, as the tissue glue joined the arrays and wire bundles into a larger platform. (4) The tethering of arrays to the skull via wire bundles and the presence of micromotion between the stiff electrodes and softer brain tissue, which may have led to tissue scarring [83]. (5) Mechanical compression of the visual cortex by the 1024-channel device and encapsulating tissue.
We found that the tissue glue formed hard, jagged crystals that were still present upon explantation (figure 6(b), bottom). However, meningeal encapsulation of Utah arrays (such as that seen in figures 7(c) and (d) of Barrese et al [62]) has been widely reported in NHPs, making the application of tissue glue unlikely to be the sole reason for encapsulation. The volume of the implant and its rigidity is a likely cause of the newly formed scar tissue, which probably contributed to the cortical deformation and damage. In addition, tethering may have played a role: in clinical implantations of small numbers of Utah arrays, neurosurgeons typically take great care to minimize tension on the wire bundle during placement of each array and to provide strain relief between the skull and array. In our monkeys, the wire bundles ran directly from the craniotomy to the arrays with little strain relief, possibly inducing friction between the electrodes and the tissue, which may have contributed to the tissue encapsulation.
Future studies should aim to decrease the tissue response and encapsulation. A possible solution would be to position the arrays and wire bundles such that tension on the wire bundles is minimized. Furthermore, the use of novel probe designs and materials [84–88], such as thin-film polymers, could lead to a reduction in implant volume and provide a closer match in stiffness (Young’s modulus) between the probes and surrounding tissue. If these advances serve to temper immune system reactions and improve device biocompatibility, they may usher in the next generation of brain interfaces for functional vision restoration.
Supplementary Material
Acknowledgments
We thank our research technician, Kor Brandsma, and our biotechnician, Anneke Ditewig, for technical and surgical support; our biotechnician, Lex Beekman; Matthew Self and Feng Wang for assistance during surgeries; Chris van der Togt and Matthew Self for custom-written Matlab scripts; Aitor Morales-Gregorio for analysis scripts; and Florian Solzbacher, Marcus Gerhardt, Stephen Hou, Rob Franklin, Sherman Wiebe, Vinh Ngo, and others at Blackrock Neurotech for scientific and technical collaborations.
Funding
This work was supported by NWO (STW Grant Number P15-42 ‘NESTOR’; ALW Grant Number 823-02-010 and Cross-over Grant Number 17619 ‘INTENSE’), the European Union (ERC Grant Numbers 339490 ‘Cortic_al_gorithms’ and 101052963 ‘NUMEROUS,’ H2020 Research and Innovation programme Grant Number 899287 ‘NeuraViper’), the Human Brain Project (Grant Number 650003), and BrainLinks-BrainTools, Cluster of Excellence funded by the German Research Foundation (DFG, EXC 1086), currently funded by the Federal Ministry of Economics, Science and Arts of Baden Württemberg within the sustainability program for projects of the excellence initiative.
Footnotes
Conflict of interest
P R and X C are co-founders and shareholders of a neurotechnology start-up, Phosphoenix BV (Netherlands) (https://phosphoenix.nl).
Data availability statement
The data cannot be made publicly available upon publication because the cost of preparing, depositing and hosting the data would be prohibitive within the terms of this research project. The data that support the findings of this study are available upon reasonable request from the authors.
References
- [1].Teutsch SM, McCoy MA, Woodburyand RB, Welp A, editors. National Academies of Sciences, Engineering, and Medicine. Making Eye Health a Population Health Imperative: Vision for Tomorrow. National Academies Press; Washington, DC: 2016. [PubMed] [Google Scholar]
- [2].Roska B, Sahel J-A. Restoring vision. Nature. 2018;557:359–67. doi: 10.1038/s41586-018-0076-4. [DOI] [PubMed] [Google Scholar]
- [3].Lewis PM, Rosenfeld JV. Electrical stimulation of the brain and the development of cortical visual prostheses: an historical perspective. Brain Res. 2016;1630:208–24. doi: 10.1016/j.brainres.2015.08.038. [DOI] [PubMed] [Google Scholar]
- [4].Button J, Putnam T. Visual responses to cortical stimulation in the blind. J Iowa Med Soc. 1962;52:17–21. [Google Scholar]
- [5].Brindley GS, Lewin WS. The sensations produced by electrical stimulation of the visual cortex. J Physiol. 1968;196:479–93. doi: 10.1113/jphysiol.1968.sp008519. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [6].Bak M, Girvin JP, Hambrecht FT, Kufta CV, Loeb GE, Schmidt E. Visual sensations produced by intracortical micro stimulation of the human occipital cortex. Med Biol Eng Comput. 1990;28:257–9. doi: 10.1007/BF02442682. [DOI] [PubMed] [Google Scholar]
- [7].Dobelle WH, Mladejovsky MG, Girvin JP. Artificial vision for the blind: electrical stimulation of visual cortex offers hope for a functional prosthesis. Science. 1974;183:440–4. doi: 10.1126/science.183.4123.440. [DOI] [PubMed] [Google Scholar]
- [8].Dobelle WH, Mladejovsky MG, Evans JR, Roberts TS, Girvin JP. “Braille” reading by a blind volunteer by visual cortex stimulation. Nature. 1976;259:111–2. doi: 10.1038/259111a0. [DOI] [PubMed] [Google Scholar]
- [9].Dobelle WH, Turkel J, Henderson DC, Evans JR. Mapping the projection of the visual field onto visual cortex in man by direct electrical stimulation. Am Soc Artif Intern Organs. 1978;24:15–7. [PubMed] [Google Scholar]
- [10].Evans J, Gordon J, Abramov I, Mladejovsky MG, Dobelle WH. Brightness of phosphenes elicited by electrical stimulation of human visual cortex. Sens Process. 1979;3:82–94. [PubMed] [Google Scholar]
- [11].Dobelle WH. Artificial vision for the blind by connecting a television camera to the visual cortex. Am Soc Artif Intern Organs J. 2000;46:3–9. doi: 10.1097/00002480-200001000-00002. [DOI] [PubMed] [Google Scholar]
- [12].Lee HW, Hong SB, Seo DW, Tae WS, Hong SC. Mapping of functional organization in human visual cortex. Neurology. 2000;54:849–54. doi: 10.1212/wnl.54.4.849. [DOI] [PubMed] [Google Scholar]
- [13].Murphey DK, Maunsell JHR, Beauchamp MS. Perceiving electrical stimulation of identified human visual areas. Proc Natl Acad Sci. 2009;106:5389–93. doi: 10.1073/pnas.0804998106. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [14].Rushton DN, Brindley GS. In: Physiological Aspects ofClinical Neurology. Rose FC, editor. Blackwell Scientific Publications; 1977. Short-and long-term stability of cortical electrical phosphenes; pp. 123–53. [Google Scholar]
- [15].Schmidt E, Bak MJ, Hambrecht FT, Kufta CV, ORourke DK, Vallabhanath P. Feasibility of a visual prosthesis for the blind based on intracortical microstimulation of the visual cortex. Brain. 1996;119:507–22. doi: 10.1093/brain/119.2.507. [DOI] [PubMed] [Google Scholar]
- [16].Talalla A, Bullara L, Pudenz R. Electrical stimulation of the human visual cortex. Can J Neurol Sci. 1974;1:236–8. doi: 10.1017/s031716710001982x. [DOI] [PubMed] [Google Scholar]
- [17].Winawer J, Parvizi J. Linking electrical stimulation of human primary visual cortex, size of affected cortical area, neuronal responses, and subjective experience. Neuron. 2016;92:1213–9. doi: 10.1016/j.neuron.2016.11.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [18].Bosking WH, Sun P, Ozker M, Pei X, Foster BL, Beauchamp MS, Yoshor D. Saturation in phosphene size with increasing current levels delivered to human visual cortex. J Neurosci. 2017;37:7188. doi: 10.1523/JNEUROSCI.2896-16.2017. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [19].Fernández E, et al. Visual percepts evoked with an intracortical 96-channel microelectrode array inserted in human occipital cortex. J Clin Invest. 2021;131:e151331. doi: 10.1172/JCI151331. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [20].Bartlett JR, Deyoe EA, Doty RW, Lee BB, Lewine JD, Negrao N, Overman WH. Psychophysics of electrical stimulation of striate cortex in macaques. J Neurophysiol. 2005;94:3430–42. doi: 10.1152/jn.00406.2005. [DOI] [PubMed] [Google Scholar]
- [21].Bradley DC, et al. Visuotopic mapping through a multichannel stimulating implant in primate V1. J Neurophysiol. 2005;93:1659–70. doi: 10.1152/jn.01213.2003. [DOI] [PubMed] [Google Scholar]
- [22].DeYoe EA, Lewine JD, Doty RW. Laminar variation in threshold for detection of electrical excitation of striate cortex by macaques. J Neurophysiol. 2005;94:3443–50. doi: 10.1152/jn.00407.2005. [DOI] [PubMed] [Google Scholar]
- [23].Davis TS, Parker RA, House PA, Bagley E, Wendelken S, Normann RA, Greger B. Spatial and temporal characteristics of V1 microstimulation during chronic implantation of a microelectrode array in a behaving macaque. J Neural Eng. 2012:9065003. doi: 10.1088/1741-2560/9/6/065003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [24].Dagnino B, Gariel-Mathis MA, Roelfsema PR. Microstimulation of area V4 has little effect on spatial attention and on the perception of phosphenes evoked in area V1. J Neurophysiol. 2015;113:730–9. doi: 10.1152/jn.00645.2014. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [25].Murphey DK, Maunsell JHR. Behavioral detection of electrical microstimulation in different cortical visual areas. Curr Biol. 2007;17:862–7. doi: 10.1016/j.cub.2007.03.066. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [26].Murphey DK, Maunsell JHR. Electrical microstimulation thresholds for behavioral detection and saccades in monkey frontal eye fields. Proc Natl Acad Sci. 2008;105:7315–20. doi: 10.1073/pnas.0710820105. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [27].Ni AM, Maunsell JHR. Microstimulation reveals limits in detecting different signals from a local cortical region. Curr Biol. 2010;20:824–8. doi: 10.1016/j.cub.2010.02.065. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [28].Tehovnik EJ, Slocum WM, Schiller PH. Saccadic eye movements evoked by microstimulation of striate cortex. Eur J Neurosci. 2003;17:870–8. doi: 10.1046/j.1460-9568.2003.02489.x. [DOI] [PubMed] [Google Scholar]
- [29].Tehovnik EJ, Slocum WM. Depth-dependent detection of microampere currents delivered to monkey V1. Eur J Neurosci. 2009;29:1477–89. doi: 10.1111/j.1460-9568.2009.06695.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [30].Tolias AS, Sultan F, Augat M, Oeltermann A, Tehovnik EJ, Schiller PH, Logothetis NK. Mapping cortical activity elicited with electrical microstimulation using fMRI in the macaque. Neuron. 2005:48901–11. doi: 10.1016/j.neuron.2005.11.034. [DOI] [PubMed] [Google Scholar]
- [31].Torab K, Davis TS, Warren DJ, House PA, Normann RA, Greger B. Multiple factors may influence the performance of a visual prosthesis based on intracortical microstimulation: nonhuman primate behavioural experimentation. J Neural Eng. 2011;8:1–19. doi: 10.1088/1741-2560/8/3/035001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [32].Troyk P, Bak M, Berg J, Bradley D, Cogan S, Erickson R, Kufta C, McCreery D, Schmidt E, Towle V. A model for intracortical visual prosthesis research. Artif Organs. 2003;27:1005–15. doi: 10.1046/j.1525-1594.2003.07308.x. [DOI] [PubMed] [Google Scholar]
- [33].Chen X, Wang F, Fernández E, Roelfsema PR. Shape perception via a high-channel-count neuroprosthesis in monkey visual cortex. Science. 2020;370:1191. doi: 10.1126/science.abd7435. [DOI] [PubMed] [Google Scholar]
- [34].Tehovnik EJ, Slocum WM. Microstimulation of macaque V1 disrupts target selection: effects of stimulation polarity. Exp Brain Res. 2002;148:233–7. doi: 10.1007/s00221-002-1312-5. [DOI] [PubMed] [Google Scholar]
- [35].Oswalt D, et al. Multi-electrode stimulation evokes consistent spatial patterns of phosphenes and improves phosphene mapping in blind subjects. Brain Stimul. 2021;14:1356–72. doi: 10.1016/j.brs.2021.08.024. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [36].Cha K, Horch KW, Normann RA, Boman DK. Reading speed with a pixelized vision system. J Opt Soc Am A. 1992;9:673–7. doi: 10.1364/josaa.9.000673. [DOI] [PubMed] [Google Scholar]
- [37].Hayes JS, Yin VT, Piyathaisere D, Weiland JD, Humayun MS, Dagnelie G. Visually guided performance of simple tasks using simulated prosthetic vision. Artif Organs. 2003;27:1016–28. doi: 10.1046/j.1525-1594.2003.07309.x. [DOI] [PubMed] [Google Scholar]
- [38].Perez Fornos A, Sommerhalder J, Rappaz B, Safran AB, Pelizzone M. Simulation of artificial vision, III: do the spatial or temporal characteristics of stimulus pixelization really matter? Investig Ophthalmol Vis Sci. 2005;46:3906–12. doi: 10.1167/iovs.04-1173. [DOI] [PubMed] [Google Scholar]
- [39].Pérez Fornos A, Sommerhalder J, Pittard A, Safran AB, Pelizzone M. Simulation of artificial vision: IV. Visual information required to achieve simple pointing and manipulation tasks. Vision Res. 2008;48:1705–18. doi: 10.1016/j.visres.2008.04.027. [DOI] [PubMed] [Google Scholar]
- [40].Srivastava NR, Troyk PR, Dagnelie G. Detection, eye-hand coordination and virtual mobility performance in simulated vision for a cortical visual prosthesis device. J Neural Eng. 2009;6:035008–25. doi: 10.1088/1741-2560/6/3/035008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [41].Bourkiza B, Vurro M, Jeffries A, Pezaris JS. Visual acuity of simulated thalamic visual prostheses in normally sighted humans. PLoS One. 2013;8:e73592-13. doi: 10.1371/journal.pone.0073592. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [42].Vurro M, Crowell AM, Pezaris JS. Simulation of thalamic prosthetic vision: reading accuracy, speed, and acuity in sighted humans. Front Hum Neurosci. 2014;8:1–14. doi: 10.3389/fnhum.2014.00816. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [43].Killian NJ, Vurro M, Keith SB, Kyada MJ, Pezaris JS. Perceptual learning in a non-human primate model of artificial vision. Sci Rep. 2016;6:36329. doi: 10.1038/srep36329. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [44].Klink PC, Chen X, Vanduffel W, Roelfsema PR. Population receptive fields in nonhuman primates from whole-brain fMRI and large-scale neurophysiology in visual cortex. eLife. 2021;10:e67304. doi: 10.7554/eLife.67304. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [45].Chen X, Morales-Gregorio A, Sprenger J, Kleinjohann A, Sridhar S, van Albada SJ, Grün S, Roelfsema PR. 1024-channel electrophysiological recordings in macaque V1 and V4 during resting state. Sci Data. 2022;9:77. doi: 10.1038/s41597-022-01180-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [46].Chen X, Possel JK, Wacongne C, van Ham AF, Klink PC, Roelfsema PR. 3D printingand modelling of customized implants and surgical guides for non-human primates. J Neurosci Methods. 2017;286:38–55. doi: 10.1016/j.jneumeth.2017.05.013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [47].van d, er Togt C, Klink C, Papale P, Teeuwen R. VisionandCognition/Tracker: Public Release. 2022. [Google Scholar]
- [48].Brainard DH. The psychophysics toolbox. Spat Vis. 1997;10:433–6. [PubMed] [Google Scholar]
- [49].Pelli DG. The VideoToolbox software for visual psychophysics: transforming numbers into movies. Spat Vis. 1997;10:437–42. [PubMed] [Google Scholar]
- [50].Kleiner M, Brainard DH, Pelli D. What’s new in Psychtoolbox-3? Perception. 2007;36:1–16. [Google Scholar]
- [51].Weber EH. Tastsinn und gemeingefühl. Wagner R, Vieweg F, und sohn, editors. Handwörterbuch der Physiologie mit Rücksicht auf physiologische Pathologie. 1846;2:481–588. [Google Scholar]
- [52].Supèr H, Roelfsema PR. Chronic multiunit recordings in behaving animals: advantages and limitations. Prog Brain Res. 2005;147:263–82. doi: 10.1016/S0079-6123(04)47020-4. [DOI] [PubMed] [Google Scholar]
- [53].Jonas Violin plots for plotting multiple distributions (distributionPlot.m) 2023. MATLAB Central File Exchange. Retrieved June 26, 2023. available at: http://www.mathworks.com/matlabcentral/fileexchange/23661-violin-plots-for-plotting-multiple-distributions-distributionplot-m.
- [54].Hughes CL, Flesher SN, Weiss JM, Downey JE, Boninger M, Collinger JL, Gaunt RA. Neural stimulation and recording performance in human sensorimotor cortex over 1500 days. J Neural Eng. 2021;18:045012. doi: 10.1088/1741-2552/ac18ad. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [55].Downey JE, Schwed N, Chase SM, Schwartz AB, Collinger JL. Intracortical recording stability in human brain-computer interface users. J Neural Eng. 2018;15:046016. doi: 10.1088/1741-2552/aab7a0. [DOI] [PubMed] [Google Scholar]
- [56].Wood F, Black MJ, Vargas-Irwin C, Fellows M, Donoghue JP. On the variability of manual spike sorting. IEEE Trans Biomed Eng. 2004;51:912–8. doi: 10.1109/TBME.2004.826677. [DOI] [PubMed] [Google Scholar]
- [57].Li X, Morgan PS, Ashburner J, Smith J, Rorden C. The first step for neuroimaging data analysis: DICOM to NIfTI conversion. J Neurosci Methods. 2016;264:47–56. doi: 10.1016/j.jneumeth.2016.03.001. [DOI] [PubMed] [Google Scholar]
- [58].Jung B, Taylor PA, Seidlitz J, Sponheim C, Perkins P, Ungerleider LG, Glen D, Messinger A. A comprehensive macaque fMRI pipeline and hierarchical atlas. NeuroImage. 2021;235:117997. doi: 10.1016/j.neuroimage.2021.117997. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [59].Bosking WH, Oswalt DN, Foster BL, Sun P, Beauchamp MS, Yoshor D. Percepts evoked by multi-electrode stimulation of human visual cortex. Brain Stimul. 2022;15:1163–77. doi: 10.1016/j.brs.2022.08.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [60].Beauchamp MS, Oswalt D, Sun P, Foster BL, Magnotti JF, Niketeghad S, Pouratian N, Bosking WH, Yoshor D. Dynamic stimulation of visual cortex produces form vision in sighted and blind humans. Cell. 2020;181:774–5. doi: 10.1016/j.cell.2020.04.033. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [61].Salatino JW, Ludwig KA, Kozai TDY, Purcell EK. Glial responses to implanted electrodes in the brain. Nat Biomed Eng. 2017;1:862–77. doi: 10.1038/s41551-017-0154-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [62].Barrese JC, Rao N, Paroo K, Triebwasser C, Vargas-Irwin C, Franquemont L, Donoghue JP. Failure mode analysis of silicon-based intracortical microelectrode arrays in non-human primates. J Neural Eng. 2013;10:066014. doi: 10.1088/1741-2560/10/6/066014. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [63].Cody PA, Eles JR, Lagenaur CF, Kozai TDY, Cui XT. Unique electrophysiological and impedance signatures between encapsulation types: an analysis of biological Utah array failure and benefit of a biomimetic coating in a rat model. Biomaterials. 2018;161:117–28. doi: 10.1016/j.biomaterials.2018.01.025. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [64].Woeppel K, Hughes C, Herrera AJ, Eles JR, Tyler-Kabara EC, Gaunt RA, Collinger JL, Cui XT. Explant analysis of Utah electrode arrays implanted in human cortex for brain-computer-interfaces. Front Bioeng Biotechnol. 2021;9:759711. doi: 10.3389/fbioe.2021.759711. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [65].Patel P R, et al. Utah array characterization and histological analysis of a multi-year implant in non-human primate motor and sensory cortices. J Neural Eng. 2023;20:014001. doi: 10.1088/1741-2552/acab86. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [66].Bouton CE, et al. Restoring cortical control of functional movement in a human with quadriplegia. Br J Ophthalmol. 2016;533:247–50. doi: 10.1038/nature17435. [DOI] [PubMed] [Google Scholar]
- [67].Ajiboye AB, et al. Restoration of reaching and grasping movements through brain-controlled muscle stimulation in a person with tetraplegia: a proof-of-concept demonstration. Lancet. 2017;389:1821–30. doi: 10.1016/S0140-6736(17)30601-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [68].Willett FR, Avansino DT, Hochberg LR, Henderson JM, Shenoy KV. High-performance brain-to-text communication via handwriting. Nature. 2021;593:249–54. doi: 10.1038/s41586-021-03506-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [69].Truccolo W, Friehs GM, Donoghue JP, Hochberg LR. Primary motor cortex tuning to intended movement kinematics in humans with tetraplegia. J Neurosci. 2008;28:1163. doi: 10.1523/JNEUROSCI.4415-07.2008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [70].Hochberg LR, Serruya MD, Friehs GM, Mukand JA, Saleh M, Caplan AH, Branner A, Chen D, Penn RD, Donoghue JP. Neuronal ensemble control of prosthetic devices by a human with tetraplegia. Nature. 2006;442:164–71. doi: 10.1038/nature04970. [DOI] [PubMed] [Google Scholar]
- [71].Hochberg LR, et al. Reach and grasp by people with tetraplegia using a neurally controlled robotic arm. Br J Ophthalmol. 2012;485:372–5. doi: 10.1038/nature11076. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [72].Collinger JL, Wodlinger B, Downey JE, Wang W, Tyler-Kabara EC, Weber DJ, McMorland AJ, Velliste M, Boninger ML, Schwartz AB. High-performance neuroprosthetic control by an individual with tetraplegia. Lancet. 2013;381:557–64. doi: 10.1016/S0140-6736(12)61816-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [73].Bullard AJ, Hutchison BC, Lee J, Chestek CA, Patil PG. Estimating risk for future intracranial, fully implanted, modular neuroprosthetic systems: a systematic review of hardware complications in clinical deep brain stimulation and experimental human intracortical arrays. Neuromodulation. 2020;23:411–26. doi: 10.1111/ner.13069. [DOI] [PubMed] [Google Scholar]
- [74].Rajan AT, Boback JL, Dammann J, Tenore FV, Wester BA, Otto KJ, Gaunt RA, Bensmaia SJ. The effects of chronic intracortical microstimulation on neural tissue and fine motor behavior. J Neural Eng. 2015;12:066018. doi: 10.1088/1741-2560/12/6/066018. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [75].Chen KH, Dammann JF, Boback JL, Tenore FV, Otto KJ, Gaunt RA, Bensmaia SJ. The effect of chronic intracortical microstimulation on the electrode-tissue interface. J Neural Eng. 2014;11:026004–14. doi: 10.1088/1741-2560/11/2/026004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [76].Callier T, Schluter EW, Tabot GA, Miller LE, Tenore FV, Bensmaia SJ. Long-term stability of sensitivity to intracortical microstimulation of somatosensory cortex. J Neural Eng. 2015;12:056010. doi: 10.1088/1741-2560/12/5/056010. [DOI] [PubMed] [Google Scholar]
- [77].Otto KJ, Johnson MD, Kipke DR. Voltage pulses change neural interface properties and improve unit recordings with chronically implanted microelectrodes. IEEE Trans Biomed Eng. 2006;53:333–40. doi: 10.1109/TBME.2005.862530. [DOI] [PubMed] [Google Scholar]
- [78].Szymański LJ, Kellis S, Liu CY, Jones KT, Andersen RA, Commins D, Lee B, McCreery DB, Miller CA. Neuropathological effects of chronically implanted, intracortical microelectrodes in a tetraplegic patient. J Neural Eng. 2021;18:0460b9. doi: 10.1088/1741-2552/ac127e. [DOI] [PubMed] [Google Scholar]
- [79].Collinger JL, et al. Collaborative approach in the development of high-performance brain-computer interfaces for a neuroprosthetic arm: translation from animal models to human control. Clin Transl Sci. 2014:752–59. doi: 10.1111/cts.12086. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [80].Woeppel K, Yang Q, Cui XT. Recent advances in neural electrode-tissue interfaces. Curr Opin Biomed Eng. 2017:421–31. doi: 10.1016/j.cobme.2017.09.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [81].Parker RA, Davis TS, House PA, Normann RA, Greger B. The functional consequences of chronic, physiologically effective intracortical microstimulation. Prog Brain Res. 2011;194:145–65. doi: 10.1016/B978-0-444-53815-4.00010-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [82].Williams JC, Hippensteel JA, Dilgen J, Shain W, Kipke DR. Complex impedance spectroscopy for monitoring tissue responses to inserted neural implants. J Neural Eng. 2007;4:410–23. doi: 10.1088/1741-2560/4/4/007. [DOI] [PubMed] [Google Scholar]
- [83].Biran R, Martin DC, Tresco PA. The brain tissue response to implanted silicon microelectrode arrays is increased when the device is tethered to the skull. J Biomed Mater Res A. 2007;82:169–78. doi: 10.1002/jbm.a.31138. [DOI] [PubMed] [Google Scholar]
- [84].Weltman A, Yoo J, Meng E. Flexible, penetrating brain probes enabled by advances in polymer microfabrication. Micromachines. 2016;7:180. doi: 10.3390/mi7100180. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [85].Song E, Li J, Won SM, Bai W, Rogers JA. Materials for flexible bioelectronic systems as chronic neural interfaces. Nat Mater. 2020;19:590–603. doi: 10.1038/s41563-020-0679-7. [DOI] [PubMed] [Google Scholar]
- [86].Luan L, et al. Ultraflexible nanoelectronic probes form reliable, glial scar-free neural integration. Sci Adv. 2017;3:e1601966. doi: 10.1126/sciadv.1601966. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [87].Wei X, Luan L, Zhao Z, Li X, Zhu H, Potnis O, Xie C. Nanofabricated ultraflexible electrode arrays for high-density intracortical recording. Adv Sci. 2018;21:1700625–9. doi: 10.1002/advs.201700625. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [88].Zhao Z, Zhu H, Li X, Sun L, He F, Chung JE, Liu DF, Frank L, Luan L, Xie C. Ultraflexible electrode arrays for months-long high-density electrophysiological mapping of thousands of neurons in rodents. Nat Biomed Eng. 2023;7:520–32. doi: 10.1038/s41551-022-00941-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
The data cannot be made publicly available upon publication because the cost of preparing, depositing and hosting the data would be prohibitive within the terms of this research project. The data that support the findings of this study are available upon reasonable request from the authors.







