Abstract
Vision restoration with retinal implants is limited by indiscriminate simultaneous activation of many cells and cell types, which is incompatible with reproducing the neural code of the retina. Recent work has shown that primate retinal ganglion cells (RGCs), which transmit visual information to the brain, can be directly electrically activated with single-cell, single-spike, cell-type precision – however, this possibility has never been tested in the human retina. Here, the electrical activation properties of identified RGC types in the human retina were examined using large-scale, multi-electrode recording and stimulation ex vivo and were compared directly to extensive results from macaque. Precise activation was in many cases possible without activating overlying axon bundles, at low stimulation current levels similar to those observed in macaque. The major RGC types could be identified and targeted based on their distinctive electrical signatures. The measured electrical activation properties of RGCs, combined with a dynamic stimulation algorithm, was sufficient to produce an evoked visual signal that was nearly optimal given the constraints of the interface. These results suggest the possibility of high-fidelity vision restoration using bi-directional epiretinal implants.
INTRODUCTION
Extracellular electrical stimulation of neurons has been widely used for scientific investigation of the nervous system and for the treatment of debilitating neurological conditions. Epiretinal implants, for example, electrically activate retinal ganglion cells (RGCs) in order to restore vision to people blinded by photoreceptor loss (Humayun et al. 2012; Goetz and Palanker 2016). However, existing clinical devices provide limited restoration of visual function due in part to indiscriminate activation of many cells and cell types (Goetz and Palanker 2016), a limitation common to all existing neural implants. Recently, experiments in isolated macaque monkey retina have demonstrated precise, selective electrical activation of RGCs of the major types at very low current levels, in many cases with single-cell, single-spike resolution (Sekirnjak et al. 2008a; L. H. Jepson et al. 2013; Lauren H. Jepson, Hottowy, Mathieson, et al. 2014; Richard, Goetz, and Chichilnisky 2015; Grosberg et al. 2017). These findings support the possibility of delivering high-quality artificial vision by approximately reproducing the neural code (Lauren H. Jepson, Hottowy, Weiner, et al. 2014; Shah et al. 2019), and could open the door to a new generation of high-fidelity neural implants in other parts of the nervous system. However, this precise, targeted electrical activation of RGCs has never been performed in the human retina. Thus it remains unclear whether the promising findings in the macaque can be harnessed to develop high-resolution retinal implants for vision restoration.
Here, large-scale multi-electrode stimulation and recording, combined with cell type identification using visual stimulation, were used to determine the electrical activation properties of populations of RGCs in isolated human retina, and the findings were compared to results from dozens of macaque retinas in the same experimental conditions (Sekirnjak et al. 2008a; L. H. Jepson et al. 2013; Lauren H. Jepson, Hottowy, Weiner, et al. 2014; Grosberg et al. 2017). The results reveal that the electrical activation properties of the major human RGC types are well-suited to precise extracellular reproduction of naturalistic visual signals: low electrical activation thresholds, selectivity of activation, identification of distinct cell types based on their electrical properties, and effectiveness of stimulus optimization algorithms for artificial vision. These results, which are qualitatively and quantitatively similar to findings in the macaque retina, demonstrate the ability to finely monitor and control RGC activity and support the development of high-resolution epiretinal implants.
RESULTS
Electrical and visual stimulation of identified RGC types in the human retina
To probe the focal electrical activation of the major human RGC types, simultaneous stimulation and recording with a large-scale high-density multi-electrode array system (512 electrodes, 60 μm pitch), combined with visual stimulation, were performed in an isolated human retina using procedures developed previously for macaque retina ((Sekirnjak et al. 2008a; L. H. Jepson et al. 2013; Grosberg et al. 2017), see Methods). To identify the four major RGC types in the human retina, white noise visual stimulation was performed, and reverse correlation was used to summarize the spatiotemporal receptive field properties of each cell (Chichilnisky 2001; Chichilnisky and Kalmar 2002; Field et al. 2007). These properties, and the mosaic spatial organization of functionally identified cell types (Fig. 1, side panels), uniquely identified the ON-parasol, OFF-parasol, ON-midget and OFF-midget RGC types (Kling et al. 2020; Chichilnisky and Kalmar 2002; Field et al. 2007). These are the numerically dominant RGC types in the human and non-human primate retina, accounting for ~65% of the entire visual signal transmitted to the brain (Dacey 2004; Rodieck 1998). In this study, analysis was restricted to these four cell types.
A brief (~0.1 ms) weak (~1 μA) pulse of current delivered extracellularly through a single electrode was frequently able to evoke a single spike in one or a few human RGCs with sub-millisecond temporal precision, raising the possibility of high-fidelity vision restoration. To quantify the probabilistic firing of each RGC in response to electrical stimulation, a triphasic current pulse (Fig. 1 B&E, top inset) was delivered repeatedly through a single electrode. In the 3 ms time window after the current pulse, the recorded voltage waveform on the stimulating electrode and nearby electrodes generally took one of two forms: electrical artifact alone, or electrical artifact with one or more evoked spikes superimposed (Fig. 1 B&E, bottom inset). These spikes were identified by clustering the recorded voltage waveforms and subtracting the average of the artifact-only traces from the traces containing an evoked spike. Each evoked spike waveform was then assigned to the cell with the most similar spike waveform recorded during visual stimulation (Fig. 1 B&E, see Methods). These steps were carried out using a novel, automated graph-based spike-sorting algorithm (see Methods). For a given cell, the variation in the time of the evoked spike from trial to trial was small (~0.03 ms SD; Fig. 1 C&F), as expected with the directly electrically elicited spikes produced in the present experimental conditions (Sekirnjak et al. 2006). Increases in current amplitude produced a progressively greater probability of evoking a spike, a relationship that was summarized by a sigmoidal activation curve (Fig. 1 D&G). The activation threshold was defined as the current level that produced an interpolated spike probability of 0.5.
Electrical activation characteristics of human RGCs are similar macaque
Spatial maps of the sensitivity to electrical stimulation for each recorded cell revealed activation at distinct cellular compartments (Fig. 2A, middle). The average spike waveforms recorded on all electrodes in the absence of electrical stimulation were used to identify the locations of somas and axons, based on their amplitude, biphasic or triphasic temporal structure, and propagation over space (Fig. 2A, top; (Petrusca et al. 2007)). These features broadly resembled the spatiotemporal spike waveforms observed in macaque RGCs (Fig. 2B, top). The spatial maps revealed that each RGC could be activated at several locations near the soma and axon (Fig. 2 A&B). For both human and macaque retina, spiking response probabilities had a sigmoidal relationship to stimulating current amplitude, with similar thresholds for axon and soma (Fig. 2 A&B, bottom). In general, electrodes near the dendrites did not evoke spikes in the current range tested (Madugula et al. 2021).
To compare electrical response characteristics across many cells of different cell types, 1807 activation thresholds resulting from somatic and axonal stimulation in the four major human RGC types were examined over 5 retinal preparations. Thresholds for all four types were in a similar range (~0.7–3.7 μA), regardless of whether the stimulating electrode was located over the soma or the axon (Fig 2 C). Activation thresholds aggregated over hundreds of RGCs from 18 macaque recordings overlapped substantially with those of human RGCs (Fig. 2 C&D; (L. H. Jepson et al. 2013)). Specifically the mean ± standard deviation across recordings of the median threshold of each recording for OFF-midget, ON-midget, OFF-parasol, and ON-parasol cells was, respectively, 1.9 ± 0.34 μA, 2.1 ± 0.38 μA, 2.3 ± 0.43 μA, and 2.2 ± 0.44 μA across 18 macaque preparations, and 2.3 ± 0.35 μA, 2.5 ± 0.38 μA, 2.6 ± 0.49 μA, and 2.4 ± 0.35 μA across 5 human preparations. The variation in activation thresholds likely arises from variation in the distance between the electrode and the site of spike initiation on the cell (Madugula et al. 2021; Sekirnjak et al. 2008b; Guo et al. 2019).
Human RGCs can be selectively targeted and electrically activated
To test whether it is possible for an individual human RGC to be selectively activated without activating other nearby cells, the activation curves of a collection of RGCs in a small area of a single recording were determined in response to current passed through a single electrode (Fig. 3). For each sample target cell tested, adjacent non-target cells were identified based on the proximity of their receptive fields, as a proxy for the proximity of their somas (Kuffler 1953).
To examine selectivity within a cell type, the activation curve of the target cell was first compared to the activation curves of the adjacent cells in the mosaic of the same type obtained with the same stimulating electrode (Fig. 3A). Note that spike sorting could only be performed reliably in a subset (742/1050) of the parasol and midget cells identified with visual stimulation (see Methods), limiting investigation to one or two regions of the retina that contained locally complete mosaics of each cell type. Examples of target cell activation at current amplitudes that did not activate any of the neighboring non-target RGCs of the same type were identified for each of the four major cell types (Fig. 3B). These examples represent the pattern observed in the overwhelming fraction (~98%) of activated cells of each type.
To further test whether selectivity across cell types could be achieved, an example target OFF-midget cell and RGCs of all four major types with overlapping or nearby receptive fields were analyzed. Selective activation of the target OFF-midget cell was achieved without activating the other cells (Fig. 3C), similar to previous findings in the macaque (L. H. Jepson et al. 2013). To determine the prevalence of this kind of selective activation, activation thresholds of all measured cells were collected across cell types and preparations. Out of the 22%, 24%, 42%, and 41% of all recorded OFF-midget, ON-midget, OFF-parasol, and ON-parasol cells that could be activated using at least one electrode delivering current within the tested stimulus amplitude range, 71%, 81%, 93%, and 89% respectively could be activated without eliciting spikes any other recorded cell.
Reconstituting high-resolution vision requires not only selective activation of individual RGCs in local regions, but also potentially requires avoiding axons that run in bundles across the retinal surface and convey visual signals from distant, unidentified cells [9]. To test whether this is possible, bundle activation thresholds were measured at each electrode. This was accomplished by identifying the lowest current amplitude that produced bi-directionally propagating electrical activity (Grosberg et al. 2017) that reached opposite edges of the array (rather than terminating at a soma on the array), a signature of axon bundle activation (Tandon et al. 2021). Bundle activation thresholds were then compared to RGC activation thresholds on the same electrodes. In the 4 retinal preparations tested, only a minority of electrodes (27%) activated individual RGCs at current levels below bundle activation threshold (Fig. 3D), confirming the substantial challenge of bundle activation (see Discussion).
To determine the potential impact of axon bundles on the ability to selectively activate single cells, activation thresholds were compared to bundle thresholds. In human retina preparations, 228/742 (31%) of analyzable cells (all four types) were selectively activated below the bundle threshold at 279/1260 stimulation electrodes tested. Comparison to data from 18 macaque preparations revealed a similar distribution of RGC and bundle activation thresholds (Fig. 3B), with 664/1948 (34%) cells selectively activated at 869/2753 stimulation electrodes without bundle activation. This undesirable axon bundle activation limits the selectivity of epiretinal stimulation. However, with appropriate calibration, the electrodes that activate individual RGCs at current levels below bundle threshold can be identified and used (see Discussion).
Identification of cell types for optimal electrical stimulus delivery
Effectively utilizing high-resolution electrical stimulation in a clinical implant requires identifying and targeting functionally distinct RGC types without the ability to measure light-evoked responses. In the macaque retina, cell type identification using only their electrical properties has been demonstrated (Richard, Goetz, and Chichilnisky 2015). To test whether this is also possible in the human retina, recorded electrical features were used to distinguish the four major RGC types. Axon conduction velocity, estimated from the EIs of recorded cells (Fig. 4A, see Methods), correctly distinguished 250/251 parasol and midget cells in one recording (Fig. 4A), and 141/149 cells in a second recording (not shown) (Li et al. 2015). Within the parasol and midget cell classes, the autocorrelation function (ACF) of the recorded spike train was used to distinguish ON and OFF cells (see Methods, (Rhoades et al. 2019; Field et al. 2007; Devries and Baylor 1997)). The ACFs of ON-parasol and OFF-parasol cells were visibly distinct, and k-means clustering (k = 2) of projections onto the first seven principal components enabled cell type separation that was correct for 86/89 cells in one recording (Fig. 4B) and 72/84 cells in a second recording (not shown). Discrimination of ON-midget from OFF-midget cells based on ACFs was ineffective in one recording (277/423 cells, not shown), but was effective in a second recording (176/184 cells, Fig. 4C). Although this variability requires further characterization and may pose a challenge in clinical implants (see Discussion), the results demonstrate that recorded electrical features of cells, such as EIs and ACFs, have the potential to enable cell type identification.
To assess whether identified RGC activation curves could be used to guide optimal electrical stimulation strategies for vision restoration, a newly developed stimulation algorithm and assessment metric were employed (Fig. 4D, (Shah et al. 2019)). To produce high-fidelity artificial vision, precise RGC activity evoked by individual electrodes must be combined across the array to reproduce the rich spatiotemporal response patterns similar to those evoked by natural visual stimuli. However, in general this cannot be achieved simply by passing current through multiple electrodes simultaneously, because currents delivered by different electrodes often combine nonlinearly to influence firing (Lauren H. Jepson, Hottowy, Mathieson, et al. 2014). A recently developed approach uses temporally dithered current pulses (Shah et al. 2019) to address this problem, exploiting the relatively slow temporal integration of visual perception (tens of milliseconds, see (Wandell 1995)) compared to the high temporal precision of epiretinal stimulation (~0.1 ms) and electronic hardware (Fig. 1 C&F). Briefly, a target visual stimulus is converted into a sequence of single-electrode stimuli, each probabilistically evoking spikes in one or more target cells. The perceived reconstructed image is assumed to depend only on the total number of spikes generated by each cell within the integration time of the visual system (here, we assume 50 ms). This approach was simulated using measured activation curves and a linear decoding model of the resulting perceived image, with a sequence of stimuli chosen to reduce the error maximally at each time step (see Methods). This procedure resulted in an expected mean-squared error of 37% relative to the random checkerboard target images (Fig. 4E, green bars and line). This was substantially smaller than the error between two randomly selected target images (170%; Fig. 4E, red bars and line) and only slightly larger than a lower bound on the optimal stimulation algorithm (36%; Fig. 4E, blue arrow; see Methods for details). The similarity of these results to previous findings in macaque retina (Shah et al. 2019) suggests that this efficient stimulation approach may translate effectively for vision restoration in humans.
DISCUSSION
The present results reveal that high-fidelity electrical stimulation of RGCs in the peripheral human retina is possible, closely matching findings in macaque retina, a potentially crucial finding for epiretinal implant design Electrical activation of the four numerically dominant cell types -- ON-parasol, OFF-parasol, ON-midget and OFF-midget -- with sub-millisecond precision and low activation thresholds, was very similar to macaque (Fig. 1, 4; (L. H. Jepson et al. 2013)). In some cases, activation of a single RGC without activating neighboring RGCs (Fig. 3; (L. H. Jepson et al. 2013)) or axon bundles (Fig. 3; (Grosberg et al. 2017)) was possible, providing evidence for cellular-level control of the neural code. It was also possible to distinguish the four major cell types using only electrical features (Fig. 4; (Richard, Goetz, and Chichilnisky 2015)) rather than light response properties which would not be available in a blind person. Finally, simulation of a temporal dithering strategy approached the performance of an optimal stimulation algorithm (Shah et al. 2019). Below, we discuss the applicability of the present results to a future retinal implant, as well as caveats and potential extensions.
These results suggest that future retinal implants could exploit focal RGC stimulation to provide high-fidelity artificial vision to the blind. Existing implants that directly stimulate RGCs are capable of eliciting coarse light percepts, but provide little restoration of useful vision (Humayun et al. 2012; J. D. Weiland, Cho, and Humayun 2011; Goetz and Palanker 2016). A major limitation of these devices is that their large stimulating electrodes result in indiscriminate activation of multiple cells and cell types. A faithful replication of the neural code of the retina instead requires the ability to stimulate individual RGCs of each major type in distinct, naturalistic temporal patterns. The previous findings in the macaque retina (L. H. Jepson et al. 2013; Grosberg et al. 2017; Sekirnjak et al. 2008a) and now in the human retina collectively demonstrate the possibility of such control over RGC activation, in some cases with single-cell, single-spike precision.
Axon bundles pose a major challenge for accurately reproducing the neural code with epiretinal stimulation: only a minority of targeted human RGCs (Fig. 3D) could be activated without activating axon bundles, as in macaque retina (Fig. 3E), consistent with perceptual reports from human patients with epiretinal implants (Nanduri 2011). Previous work in macaque retina showed that nearly half of the cells that could be activated without activating their neighbors could also be activated without activating axon bundles (Grosberg et al. 2017). Although this proportion was difficult to estimate reliably in the human data because of the limited number of analyzable cells, the present findings in the human retina are qualitatively consistent with the macaque findings (Fig. 3D&E).. As in the macaque data, the present findings suggest that many electrodes will not be able to avoid activating axon bundles, and therefore that a calibration procedure to identify and avoid those electrodes will be crucial for a clinical implant. An alternative approach could involve surgically severing incoming axon bundles on the distal side of the array during device implantation, inducing axon degeneration (although the possibility of unwanted side-effects is a concern). Another approach might be to implant the device at other retinal locations such as the raphe region, which has a relatively low density of axon bundles – results in macaque indicate that a larger fraction of RGCs in the raphe can be activated without axon bundles (Grosberg et al. 2017). Finally, as ongoing work suggests, increasing the electrode density of the MEA increases the number of activation sites for each cell, significantly expanding the opportunities for selective activation (Gogliettino et al. 2022).
High-fidelity visual reconstruction relies on cell type identification, but the light response properties that can be exploited for this purpose in a healthy retina (Fig. 1; (Kling et al. 2020)) are unavailable in the retina of a blind person. Previous work in macaque retina (Richard, Goetz, and Chichilnisky 2015) and the present work (Fig. 4) show that features of the electrical image (EI) and the spike train autocorrelation function (ACF) can be used to distinguish the four numerically dominant cell types, without analysis of light responses. One feature of the EI -- axon conduction velocity -- reliably separated parasol cells from midget cells (Fig. 4A) consistent with well-known biophysical distinctions between these cell types in the macaque retina (Fukuda et al. 1988; Li et al. 2015). Features of the ACF separated the ON and OFF types within the parasol and midget cell classes (Fig. 4 B&C). However, because the temporal structure of ACFs varies between retinas, these features may be difficult to use for identifying (rather than merely distinguishing) cell types (see (Field et al. 2007; Rhoades et al. 2019)). This suggests that further analysis of EI features, or patient feedback about the perceived brightness of phosphenes evoked by electrical stimulation, could be important for identifying cell types in the clinic. In addition, ON and OFF midget cells were reliably separated based on ACFs in one recording but not in the other (see Results), again motivating further investigation of EI features. Finally, cells of other types were not considered in this analysis, but may be important for the function of a clinical implant.
Changes in the retina during degeneration could introduce additional challenges. First, the electrical activity used here for cell type identification was light-driven, whereas an implant in a blind person would rely on recording spontaneous activity. Spontaneous activity in the major RGC types in anesthetized macaques is high (20–30 Hz) (Troy and Lee 1994), but has not been measured in humans. Some studies have indicated that spontaneous RGC activity increases during retinal degeneration (Margolis et al. 2008; Pu, Xu, and Zhang 2006; Margolis and Detwiler 2011), however, results in a rat model of photoreceptor degeneration indicate that spontaneous activity increases in OFF cells but declines in ON cells (Sekirnjak et al. 2011). Second, it is unclear whether the structure of the ACF changes during degeneration. It seems unlikely that ON and OFF cell ACFs would become much more similar to one another, unless the distinctions between them in the healthy retina are primarily a result of presynaptic activity that is lost during degeneration, which is unlikely based on previous work (Sekirnjak et al. 2011). However, changes during degeneration could make it difficult to identify (as opposed to distinguish) cell types based on ACFs. Third, it is unclear how EIs would be affected by degeneration, although their overall form probably depends mostly on the morphological structure and ion channel distribution of the cell, which may remain relatively stable (but see (Chen et al. 2013; Walston et al. 2013)). Finally, for clinical application it will be critical to verify that electrical stimulation thresholds in the degenerated retina are comparable to those in the healthy retina, as has been previously demonstrated in a rat model of retinal degeneration (Sekirnjak et al. 2009).
Caveats about the extent of the present data are also worth highlighting. Due to the scarcity of healthy human donor retinas, analysis of electrical responses was restricted to only five human retinal preparations from three donors. Although comparison to the macaque revealed many similarities, the data are insufficient to quantify the variability across human retinas. Additionally, due to the wide-range of pre-existing health conditions of each human donor, as well as the variable timing and details of enucleation, the apparent health of the retina was variable and may have resulted in the loss of some cell types (e.g. some OFF cells in Fig. 1).
The present results are compatible with combining the activation of individual RGCs over space and time to reproduce the complex spatiotemporal patterns of activity that occur in natural vision. Prior work in macaque has shown that spatiotemporal patterns of activity in small groups of cells can be reproduced with high fidelity (Lauren H. Jepson, Hottowy, Weiner, et al. 2014). More recently, closed-loop methods have been developed to minimize the difference between a target visual image and an estimate of the perceived image obtained through electrical activation, based on pre-calibrating the activation of RGCs of different types and temporal dithering during stimulation (Shah et al. 2019). The performance of this method in the present human data resembles results in macaque (see Results), suggesting that it can be applied to a future implant.
We speculate that, given the putative biophysical similarity between RGCs and spiking neurons in the brain (Fohlmeister, Coleman, and Miller 1990; Greenberg et al. 1999), the two principal results of this study – fine extracellular control of spiking in human neurons and quantitative similarity to the macaque – will extend to other parts of the nervous system. The ability to finely control activity in neural circuits with electronic implants could significantly advance our understanding of human neural processes and advance treatments for a wide range of nervous system disorders.
MATERIALS AND METHODS
Retinas and preparation
Human eyes were obtained from three brain-dead donors (29 year-old hispanic male, 27 year-old hispanic male, 47 year-old caucasian female) through Donor Network West (San Ramon, CA). Macaque eyes were obtained from terminally anesthetized animals sacrificed by other laboratories, in accordance with Institutional Animal Care and Use Committee guidelines. Following enucleation the eyes were hemisected, the vitreous was removed in room light, and the eye cup was stored in oxygenated Ames’ solution (Sigma) at 33°C. Electrophysiological data were recorded from portions of the retina, as described previously (L. H. Jepson et al. 2013; Grosberg et al. 2017). Small (~3×3mm) segments of peripheral retina (10–14 mm temporal equivalent eccentricity from the fovea) were isolated from the sclera, detached from the pigment epithelium, and held RGC side down on a multielectrode array (see below). In one recording (Fig. 4 A&B) the pigment epithelium remained attached (12 mm from the fovea on the superior vertical meridian). For macaque preparations, the retina was detached from the pigment epithelium and eccentricities ranged from 8 to 12 mm temporal equivalent (Chichilnisky and Kalmar 2002).
Electrophysiological recording and visual stimulation
Recording and stimulation were performed with a custom 512-electrode (10μm diameter, 60μm pitch, 1.7mm2) recording and stimulation system sampling at 20kHz, as described previously (Litke et al. 2004; Pawel Hottowy et al. 2008; Paweł Hottowy et al. 2012; Grosberg et al. 2017). Spikes recorded from individual neurons during visual stimulation were identified and segregated using standard spike sorting techniques (Litke et al. 2004; Lee et al., n.d.; Pachitariu et al., n.d.). To identify the type of each recorded cell, the retina was visually stimulated with a binary white noise stimulus, and the spike-triggered average (STA) stimulus was computed for each RGC (Chichilnisky 2001; Chichilnisky and Kalmar 2002). The STA summarizes the spatial, temporal, and chromatic structure of the light response. The spatial receptive fields and time courses obtained from the STA were used to identify the distinct cell types (Fig. 1), as described previously (Chichilnisky and Kalmar 2002; Field et al. 2007; Rhoades et al. 2019; Kling et al. 2020). Electrical images (EIs), obtained by averaging thousands of spatiotemporal voltage patterns over the array at the times of the identified spikes from each RGC (Litke et al. 2004; Petrusca et al. 2007) were used to infer the spatial location of the soma and axon (Fig. 3) and to identify electrically elicited spikes (see below) (L. H. Jepson et al. 2013).
Electrical stimulation and spike sorting
Electrical stimuli were triphasic current waveforms, consisting of a negative current stimulating phase lasting 50 μs (one sample) preceded and followed by charge-balancing positive phases of equal duration, with relative amplitudes 2:−3:1 (Fig. 1 A&D, top inset), passed through one electrode at a time. At each electrode, forty current amplitudes in the range 0.1 to 4.1 μA were delivered twenty-five times each (L. H. Jepson et al. 2013; Grosberg et al. 2017).
An automated spike sorting method was used to identify human and macaque RGC responses to electrical stimulation. The method resembles the procedure used to classify spikes manually in previous work (Sekirnjak et al. 2006, [a] 2008; L. H. Jepson et al. 2013; Grosberg et al. 2017; Lauren H. Jepson, Hottowy, Weiner, et al. 2014; Lauren H. Jepson, Hottowy, Mathieson, et al. 2014). Briefly, for each stimulating electrode, a set of potentially activatable target RGCs was identified, based on light-evoked spike waveforms featuring negative peak amplitudes larger than the noise threshold for that electrode (twice the standard deviation of the recorded electrical noise, see below). For each target RGC, a set of recording electrodes with light-evoked spike waveforms exceeding the noise threshold was identified. Then, for each stimulus amplitude, across all recording electrodes for all target RGCs, voltage traces recorded in the 3 ms period following current pulses delivered by the stimulating electrode were collected and grouped using unsupervised clustering. For each pair of clusters, signals were subtracted, aligned, and averaged to obtain residuals. These residuals were iteratively compared to each of the recorded light-evoked waveforms of all target cells on all recording electrodes to identify the set of cells contributing to each stimulation trial for each amplitude. The clustering approach enabled the algorithm to identify spikes in recorded traces containing bundle activity, because the latter is consistent across stimulation trials [9] and therefore was identified as an electrical artifact. The accuracy of the algorithm was assessed by comparing identified activation curves with activation curves obtained using manual spike sorting [6,9]. Across 227 activation curves (see below) obtained from 5 different human retina preparations and 1657 activation curves across 18 different macaque retina preparations, 94.3% of automatically identified thresholds were within 0.2 μA of the corresponding manually identified threshold.
To enable accurate spike assignment, only cells with recorded absolute spike amplitudes of at least 60 μV on at least one electrode were analyzed, because spikes with lower amplitudes were difficult to visually distinguish from noise. This threshold was empirically supported by quantification of the automated spike sorting error rate (relative to manual spike sorting) as a function of recorded spike amplitude. Even after filtering cells by this threshold, in some cases large electrical stimulation artifacts, axon bundle activation, or other biological activity made it difficult to assign spikes to identified cells with confidence. These cells were manually examined and excluded from further analysis. Of the 1050 parasol and midget cells identified during visual stimulation across human retinal preparations, 742 were analyzable by the above criteria.
In general, electrodes that recorded large-amplitude EI waveforms from a particular cell (> ~45 μV for axonal electrodes, > ~95 μV for somatic electrodes) could elicit a spike in that cell. However, in many cases spike sorting was complicated by-sorting was often difficult or impossible in the context of simultaneous axon bundle activity and electrical artifact. The completeness of spike sorting is explored in more detail in (Madugula et al. 2021)
For each analyzed cell, spike probabilities were computed over the twenty-five repeats of each stimulus, and were modeled as a function of current amplitude by a sigmoidal relationship:
where a is the current amplitude, p(a) is the spike probability, and k and b are free parameters. Fitted curves were used to compute the activation threshold, defined as the current amplitude producing a spike probability of 0.5.
Estimation of axon bundle activation thresholds
For each stimulating electrode, axon bundle activation thresholds were estimated using a method previously described (Tandon et al. 2021). Bundle activation can be detected by bidirectional propagation of an evoked electrical signal that, unlike the activity of a single cell, increases progressively in amplitude with increasing stimulation current (Grosberg et al. 2017). Human observers visually inspected a movie of recorded voltage on the array for a period of 2 ms after electrical stimulation. Bundle activation threshold was defined as the lowest stimulus amplitude at which bidirectional activity that increased with stimulating current reached at least two edges of the array, implying that the signal originated at least partly in the axons of cells with somas off the array. For a small number of electrodes near the edges of the array, bidirectional activity was not easily discerned. At these electrodes, the bundle activation threshold was defined as the lowest current level at which unidirectional activity grew in amplitude with current level, was clearly larger than the typical single-axon signal obtained from EIs (~35 μV), and propagated to a single distant edge of the array.
Distinguishing midget and parasol cells using axon conduction velocity
The axon conduction velocity of each cell was estimated using axonal EI waveforms upsampled tenfold in time to improve peak spike time estimation (Fig. 3, top; see (Petrusca et al. 2007; Li et al. 2015)). Among all the electrodes recording axonal signals from a given cell, the distance between each pair of electrodes was divided by the corresponding time difference of the negative peaks of the EI waveforms, producing a collection of velocity estimates. The conduction velocity for the cell was estimated by computing a weighted average of these pairwise estimates, with the weight for each pair of electrodes given by the product of the peak EI amplitudes on the electrodes. Electrode pairs were excluded if the difference in time at minimum voltage was less than the sampling interval (0.05 ms). Only velocity estimates corresponding to the largest ten weight values for each cell were used. EIs that were visibly corrupted by errors in spike sorting or that contained fewer than eight axonal electrodes were excluded from analysis. With this filtering, analysis was restricted to 251 of the 520 cells in one recording and 149 of the 270 cells in a second recording.
Distinguishing ON and OFF cells using ACFs
The autocorrelation function (ACF) of the recorded spike times for each cell was used to discriminate ON and OFF cells (see (Rhoades et al. 2019; Field et al. 2007)). For each cell class (midget, parasol) principal components analysis was performed on the L2-normalized ACFs of all cells, and k-means clustering (k = 2) was performed over the projections onto the top seven principal components. A cell was considered correctly separated if it was assigned to a cluster in which its type was the most numerous.
Analysis of temporal dithering for optimizing artificial vision
The temporal dithering algorithm uses the measured responses to electrical stimulation to select a sequence of stimuli intended to produce perception matching a target visual image as closely as possible (Shah et al. 2019). This approach is based on the assumption that visual perception is determined by the total number of spikes from each RGC within the integration time of the visual system (~50 ms; see (Wandell 1995)), during which many stimuli can be applied. Specifically, the approach requires a dictionary containing elements representing the spike probabilities of all cells for each distinct electrical stimulus tested (in this case, each electrode and current level), a target visual image, and a decoder which computes an estimate of the visual image from the spike counts of all cells during the integration time window. Responses of ON and OFF parasol cells that could be stimulated by at least one electrode were used to construct the dictionary. Due to the limited number of analyzable cells, dictionary elements that activated axon bundles were permitted in the analysis, although this would not be appropriate for a clinical implant.
White noise images were chosen as targets for reconstruction. To compute spatial reconstruction filters for each cell, light response properties (Fig. 1) were first used to simulate responses to flashed white noise images. The response of each RGC was simulated by computing the inner product between the stimulus and the spatial component of the STA and then rectifying the result. The STAs of all cells were then multiplied by a common scalar such that the average parasol cell firing rate matched experimental data (~3 spikes on average per 100 ms flashed image in the peripheral retina). Finally, optimal linear reconstruction filters were computed using least-squares regression between the simulated responses and the stimuli.
To simulate the temporal dithering approach, a sequence of electrodes and stimulating current amplitudes was chosen greedily, maximizing the expected reduction in mean squared error between the target and linearly decoded image in each stimulation time step. The performance of the algorithm was measured as relative mean squared error (mean squared error divided by mean squared intensity of the target image) over the pixels covered by the receptive fields of all cells used. The error of the algorithm was compared to a lower bound on the error of an optimal algorithm, in which the entire stimulation sequence was optimized to minimize the error between the target and decoded image (Shah et al. 2019).
Acknowledgements:
Human eyes were provided by Donor Network West (San Ramon, CA). We are thankful for the cooperation of Donor Network West and all of the organ and tissue donors and their families, for giving the gift of life and the gift of knowledge, by their generous donations. We thank J. Carmena, T. Moore, W. Newsome, M. Taffe, S. Morairty, J. Horton, and the California National Primate Research Center for providing macaque retinas. We thank K. Jensen, M. Allen, and K. Tinajero, K. Berry, K. Williams, B. Morsey, J. Frohlich, and M. Kitano for helping obtain access to macaque retinas and metadata. We thank D. Palanker, F. Rieke, S. Mitra, P. Li, T. Carnevale, M. Hines, F. Rattay, P. Tandon, E. Wu, R. Vilkhu, V. Fan, M. Zaidi, C. Rhoades, N. Brackbill, G. Goetz, S. Wienbar, and the Stanford Artificial Retina team for helpful discussions. We thank R. Samarakoon and S. Kachiguine for technical assistance. We thank L. Jepson, P. Li, M. Greshner, G. Field, J. Gautier, A. Heitman, and G. Goetz for participating in data collection.
Funding:
NIH NEI F30-EY030776-03 (SM)
Polish National Science Centre grant DEC-2013/10/M/NZ4/00268 (PH)
Pew Charitable Trust Scholarship in the Biomedical Sciences (AS)
a donation from John Chen (AML)
Stanford Medicine Discovery Innovation Award (EJC)
Research to Prevent Blindness Stein Innovation Award (EJC)
Wu Tsai Neurosciences Institute Big Ideas (EJC)
NIH NEI R01-EY021271 (EJC)
NIH NEI R01-EY029247 (EJC)
NIH NEI P30-EY019005 (EJC)
References
- Chen Zhongshan, Song Yanping, Yao Junping, Weng Chuanhuang, and Zheng Qin Yin 2013. “Alterations of Sodium and Potassium Channels of RGCs in RCS Rat with the Development of Retinal Degeneration.” Journal of Molecular Neuroscience: MN 51 (3): 976–85. [DOI] [PubMed] [Google Scholar]
- Chichilnisky EJ 2001. “A Simple White Noise Analysis of Neuronal Light Responses.” Network 12 (2): 199–213. [PubMed] [Google Scholar]
- Chichilnisky EJ, and Rachel S. Kalmar. 2002. “Functional Asymmetries in ON and OFF Ganglion Cells of Primate Retina.” The Journal of Neuroscience. 10.1523/jneurosci.22-07-02737.2002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dacey Dennis M. 2004. “Origins of Perception: Retinal Ganglion Cell Diversity and the Creation of Parallel Visual Pathways.” In The Cognitive Neurosciences, 3:281–301. MIT Press, Cambridge. [Google Scholar]
- Devries SH, and Baylor DA. 1997. “Mosaic Arrangement of Ganglion Cell Receptive Fields in Rabbit Retina.” Journal of Neurophysiology 78 (4): 2048–60. [DOI] [PubMed] [Google Scholar]
- Field Greg D., Sher Alexander, Gauthier Jeffrey L., Greschner Martin, Shlens Jonathon, Litke Alan M., and Chichilnisky EJ. 2007. “Spatial Properties and Functional Organization of Small Bistratified Ganglion Cells in Primate Retina.” The Journal of Neuroscience: The Official Journal of the Society for Neuroscience 27 (48): 13261–72. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fohlmeister JF, Coleman PA, and Miller RF. 1990. “Modeling the Repetitive Firing of Retinal Ganglion Cells.” Brain Research 510 (2): 343–45. [DOI] [PubMed] [Google Scholar]
- Fukuda Y, Watanabe M, Wakakuwa K, Sawai H, and Morigiwa K. 1988. “Intraretinal Axons of Ganglion Cells in the Japanese Monkey (Macaca Fuscata): Conduction Velocity and Diameter Distribution.” Neuroscience Research 6 (1): 53–71. [DOI] [PubMed] [Google Scholar]
- Goetz GA, and Palanker DV. 2016. “Electronic Approaches to Restoration of Sight.” Reports on Progress in Physics 79 (9): 096701. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gogliettino Alex R., Madugula Sasidhar S., Grosberg Lauren E., Vilkhu Ramandeep S., Brown Jeff, Nguyen Huy, Kling Alexandra, et al. 2022. “High-Fidelity Restoration of Visual Signals by Electrical Stimulation in the Central Primate Retina.” bioRxiv. 10.1101/2022.05.24.493162. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Greenberg RJ, Velte TJ, Humayun MS, Scarlatis GN, and de Juan E Jr. 1999. “A Computational Model of Electrical Stimulation of the Retinal Ganglion Cell.” IEEE Transactions on Bio-Medical Engineering 46 (5): 505–14. [DOI] [PubMed] [Google Scholar]
- Grosberg Lauren E., Ganesan Karthik, Goetz Georges A., Madugula Sasidhar S., Bhaskhar Nandita, Fan Victoria, Li Peter, et al. 2017. “Activation of Ganglion Cells and Axon Bundles Using Epiretinal Electrical Stimulation.” Journal of Neurophysiology 118 (3): 1457–71. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Guo Tianruo, Tsai David, Chih Yu Yang Amr Al Abed, Twyford Perry, Fried Shelley I., Morley John W., Suaning Gregg J., Dokos Socrates, and Lovell Nigel H.. 2019. “Mediating Retinal Ganglion Cell Spike Rates Using High-Frequency Electrical Stimulation.” Frontiers in Neuroscience 13 (April): 413. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hottowy Pawel, Władysław Dąbrowski, Andrzej Skoczeń, and Piotr Wiącek 2008. “An Integrated Multichannel Waveform Generator for Large-Scale Spatio-Temporal Stimulation of Neural Tissue.” Analog Integrated Circuits and Signal Processing. 10.1007/s10470-007-9125-x. [DOI] [Google Scholar]
- Hottowy Paweł, Andrzej Skoczeń Deborah E. Gunning, Kachiguine Sergei, Mathieson Keith, Sher Alexander, Piotr Wiącek Alan M. Litke, and Władysław Dąbrowski. 2012. “Properties and Application of a Multichannel Integrated Circuit for Low-Artifact, Patterned Electrical Stimulation of Neural Tissue.” Journal of Neural Engineering. 10.1088/1741-2560/9/6/066005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Humayun Mark S., Dorn Jessy D., Lyndon da Cruz Gislin Dagnelie, Sahel José-Alain, Stanga Paulo E., Cideciyan Artur V., et al. 2012. “Interim Results from the International Trial of Second Sight’s Visual Prosthesis.” Ophthalmology 119 (4): 779–88. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jepson Lauren H., Hottowy Paweł, Mathieson Keith, Gunning Deborah E., Władysław Dąbrowski Alan M. Litke, and Chichilnisky EJ. 2014. “Spatially Patterned Electrical Stimulation to Enhance Resolution of Retinal Prostheses.” The Journal of Neuroscience: The Official Journal of the Society for Neuroscience 34 (14): 4871–81. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jepson Lauren H., Hottowy Pawel, Weiner Geoffrey A., Dabrowski Władysław, Litke Alan M., and Chichilnisky EJ. 2014. “High-Fidelity Reproduction of Spatiotemporal Visual Signals for Retinal Prosthesis.” Neuron. 10.1016/j.neuron.2014.04.044. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jepson LH, Hottowy P, Mathieson K, Gunning DE, Dabrowski W, Litke AM, and Chichilnisky EJ. 2013. “Focal Electrical Stimulation of Major Ganglion Cell Types in the Primate Retina for the Design of Visual Prostheses.” Journal of Neuroscience. 10.1523/jneurosci.4967-12.2013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kling Alexandra, Gogliettino Alex R., Shah Nishal P., Wu Eric G., Brackbill Nora, Sher Alexander, Litke Alan, Silva Ruwan A., and Chichilnisky EJ. 2020. “Functional Organization of Midget and Parasol Ganglion Cells in the Human Retina.” 10.1101/2020.08.07.240762. [DOI]
- Kuffler SW 1953. “Discharge Patterns and Functional Organization of Mammalian Retina.” Journal of Neurophysiology 16 (1): 37–68. [DOI] [PubMed] [Google Scholar]
- Lee Jinhyung, Mitelut Catalin, Shokri Hooshmand, Kinsella Ian, Dethe Nishchal, Wu Shenghao, Li Kevin, et al. n.d. “YASS: Yet Another Spike Sorter Applied to Large-Scale Multi-Electrode Array Recordings in Primate Retina.” 10.1101/2020.03.18.997924. [DOI]
- Li Peter H., Gauthier Jeffrey L., Schiff Max, Sher Alexander, Ahn Daniel, Field Greg D., Greschner Martin, Callaway Edward M., Litke Alan M., and Chichilnisky EJ. 2015. “Anatomical Identification of Extracellularly Recorded Cells in Large-Scale Multielectrode Recordings.” The Journal of Neuroscience: The Official Journal of the Society for Neuroscience 35 (11): 4663–75. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Litke AM, Bezayiff N, Chichilnisky EJ, Cunningham W, Dabrowski W, Grillo AA, Grivich M, et al. 2004. “What Does the Eye Tell the Brain?: Development of a System for the Large-Scale Recording of Retinal Output Activity.” IEEE Transactions on Nuclear Science. 10.1109/tns.2004.832706. [DOI] [Google Scholar]
- Madugula Sasidhar S., Vilkhu Ramandeep, Shah Nishal P., Grosberg Lauren E., Kling Alexandra, Gogliettino Alex R., Nguyen Huy, et al. 2021. “Inference of Electrical Stimulation Sensitivity from Recorded Activity of Primate Retinal Ganglion Cells.” bioRxiv. 10.1101/2021.10.22.465478. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Margolis David J., and Detwiler Peter B.. 2011. “Cellular Origin of Spontaneous Ganglion Cell Spike Activity in Animal Models of Retinitis Pigmentosa.” Journal of Ophthalmology 2011. 10.1155/2011/507037. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Margolis David J., Newkirk Gregory, Euler Thomas, and Detwiler Peter B.. 2008. “Functional Stability of Retinal Ganglion Cells after Degeneration-Induced Changes in Synaptic Input.” The Journal of Neuroscience: The Official Journal of the Society for Neuroscience 28 (25): 6526–36. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Nanduri D. 2011. “Prosthetic Vision in Blind Human Patients: Predicting the Percepts of Epiretinal Stimulation.” Edited by Weiland J, University of Southern California. http://digitallibrary.usc.edu/cdm/ref/collection/p15799coll3/id/214215. [Google Scholar]
- Pachitariu Marius, Steinmetz Nicholas A., Kadir Shabnam N., Carandini Matteo, and Harris Kenneth D.. n.d. “Fast and Accurate Spike Sorting of High-Channel Count Probes with KiloSort.” In Advances in Neural Information Processing Systems. http://papers.nips.cc/paper/6325-fast-and-accurate-spike-sorting-of-high-channel-count-probeswith-kilosort. [Google Scholar]
- Petrusca Dumitru, Grivich Matthew I., Sher Alexander, Field Greg D., Gauthier Jeffrey L., Greschner Martin, Shlens Jonathon, Chichilnisky EJ, and Litke Alan M.. 2007. “Identification and Characterization of a Y-like Primate Retinal Ganglion Cell Type.” The Journal of Neuroscience: The Official Journal of the Society for Neuroscience 27 (41): 11019–27. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pu Mingliang, Xu Liang, and Zhang Hong. 2006. “Visual Response Properties of Retinal Ganglion Cells in the Royal College of Surgeons Dystrophic Rat.” Investigative Ophthalmology & Visual Science 47 (8): 3579–85. [DOI] [PubMed] [Google Scholar]
- Rhoades Colleen E., Shah Nishal P., Manookin Michael B., Brackbill Nora, Kling Alexandra, Goetz Georges, Sher Alexander, Litke Alan M., and Chichilnisky EJ. 2019. “Unusual Physiological Properties of Smooth Monostratified Ganglion Cell Types in Primate Retina.” Neuron 103 (4): 658–72.e6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Richard Emile, Goetz Georges A., and Chichilnisky EJ. 2015. “Recognizing Retinal Ganglion Cells in the Dark.” In Advances in Neural Information Processing Systems 28, 2476–84. Curran Associates, Inc. [Google Scholar]
- Rieke F, Warland D, de RR van Steveninck Ruyter, and Bialek W. 1997. Spikes: Exploring the Neural Code. Cambridge, MA: MIT Press. [Google Scholar]
- Rodieck RW 1998. The First Steps in Seeing. New York, NY: Oxford University Press. [Google Scholar]
- Sekirnjak Chris, Hottowy Pawel, Sher Alexander, Dabrowski Wladyslaw, Litke Alan M., and Chichilnisky EJ. 2008a. “High-Resolution Electrical Stimulation of Primate Retina for Epiretinal Implant Design.” The Journal of Neuroscience: The Official Journal of the Society for Neuroscience 28 (17): 4446–56. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sekirnjak Chris, Hottowy Pawel, Sher Alexander, Dabrowski Wladyslaw, Litke Alan M., and Chichilnisky EJ. 2008b. “High-Resolution Electrical Stimulation of Primate Retina for Epiretinal Implant Design.” The Journal of Neuroscience: The Official Journal of the Society for Neuroscience 28 (17): 4446–56. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sekirnjak Chris, Hottowy Pawel, Sher Alexander, Dabrowski Wladyslaw, Litke AM, and Chichilnisky EJ. 2006. “Electrical Stimulation of Mammalian Retinal Ganglion Cells with Multielectrode Arrays.” Journal of Neurophysiology 95 (6): 3311–27. [DOI] [PubMed] [Google Scholar]
- Sekirnjak Chris, Hulse Clare, Jepson Lauren H., Hottowy Pawel, Sher Alexander, Dabrowski Wladyslaw, Litke AM, and Chichilnisky EJ. 2009. “Loss of Responses to Visual but Not Electrical Stimulation in Ganglion Cells of Rats with Severe Photoreceptor Degeneration.” Journal of Neurophysiology 102 (6): 3260–69. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sekirnjak Chris, Jepson Lauren H., Hottowy Pawel, Sher Alexander, Dabrowski Wladyslaw, Litke AM, and Chichilnisky EJ. 2011. “Changes in Physiological Properties of Rat Ganglion Cells during Retinal Degeneration.” Journal of Neurophysiology 105 (5): 2560–71. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shah Nishal P., Madugula Sasidhar, Grosberg Lauren, Mena Gonzalo, Tandon Pulkit, Hottowy Pawel, Sher Alexander, Litke Alan, Mitra Subhasish, and Chichilnisky EJ. 2019. “Optimization of Electrical Stimulation for a High-Fidelity Artificial Retina.” 2019 9th International IEEE/EMBS Conference on Neural Engineering (NER). 10.1109/ner.2019.8716987. [DOI] [Google Scholar]
- Tandon Pulkit, Bhaskhar Nandita, Shah Nishal, Madugula Sasi, Grosberg Lauren, Fan Victoria H., Hottowy Pawel, et al. 2021. “Automatic Identification of Axon Bundle Activation for Epiretinal Prosthesis.” IEEE Transactions on Neural Systems and Rehabilitation Engineering: A Publication of the IEEE Engineering in Medicine and Biology Society 29 (December): 2496–2502. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Troy JB, and Lee BB. 1994. “Steady Discharges of Macaque Retinal Ganglion Cells.” Visual Neuroscience 11 (1): 111–18. [DOI] [PubMed] [Google Scholar]
- Walston Steven, Lee Eun-Jin, Humayun Mark, and Weiland James. 2013. “Comparison of Ankyrin-G Labeling of Axon Initial Segments on Ganglion Cells in Normal and Degenerate Rat Retina.” Investigative Ophthalmology & Visual Science 54 (15): 1055–1055. [Google Scholar]
- Wandell Brian A. 1995. Foundations of Vision. Oxford University Press, Incorporated. [Google Scholar]
- Weiland James D., Cho Alice K., and Humayun Mark S.. 2011. “Retinal Prostheses: Current Clinical Results and Future Needs.” Ophthalmology 118 (11): 2227–37. [DOI] [PubMed] [Google Scholar]
- Mena Gonzalo E., et al. “Electrical stimulus artifact cancellation and neural spike detection on large multi-electrode arrays.” PLoS computational biology 13.11 (2017): e1005842. [DOI] [PMC free article] [PubMed] [Google Scholar]