Abstract
We report a novel vibration control technique of an artificial auditory cochlear epithelium that mimics the function of outer hair cells in the organ of Corti. The proposed piezoelectric and trapezoidal membrane not only has the acoustic/electric conversion and frequency selectivity of the previous device developed mainly by one of the authors and colleagues, but also has a function to control local vibration according to sound stimuli. Vibration control is achieved by applying local electrical stimuli to patterned electrodes on an epithelium made using micro-electro-mechanical system technology. By choosing appropriate phase differences between sound and electrical stimuli, it is shown that it is possible to both amplify and dampen membrane vibration, realizing better control of the response of the artificial cochlea. To be more specific, amplification and damping are achieved when the phase difference between the membrane vibration by sound stimuli and electrical stimuli is zero and , respectively. We also demonstrate that the developed control system responds automatically to a change in sound frequency. The proposed technique can be applied to mimic the nonlinear response of the outer hair cells in a cochlea, and to realize a high-quality human auditory system.
Keywords: artificial cochlea, MEMS, piezoelectric material, outer hair cell
1. Introduction
Hearing is important to infants in terms of acquiring language and sentiment education. However, one in a thousand new-born infants suffers congenital deafness. Meanwhile, the ability of adults to hear diminishes gradually and never recovers spontaneously. There is thus an increasing demand for artificial cochleae, which are devices that support patients with sensorineural hearing loss. The present study deals with the development of a novel technique that allows the design of a higher-quality artificial cochlea to be combined with previous devices developed by one of the authors [1,2,3].
The vibration of sound is collected and amplified by outer and middle ears, and transmitted to the inner ear. The frequency of sound is then distinguished by cochlear epithelium in the inner ear [4], and the vibration of sound is converted into electrical signals by inner hair cells to stimulate nerves, which are sensory cells on the epithelium. Because damaged hair cells do not regenerate spontaneously [5], cochlear implants [6,7] are used to effectively overcome sensorineural hearing loss due to cochlear damage . However, commercially available cochlear-implant devices require patients to wear external equipment such as microphones, sound processors, and batteries. To remove such burdens on patients and to increase patients’ quality of life, a self-contained artificial cochlea has been proposed by one of the authors and their colleagues [1,2,3]. Recent advances in the fabrication technologies of micro-electro-mechanical systems have allowed the development of an artificial cochlear epithelium without an external power supply [1,2,8,9,10,11,12,13,14,15,16,17,18,19]. Electrical signals in these devices are generated by the deformation of a trapezoidal piezoelectric membrane induced by sound stimuli. Such a mechanical generation of electrical signals has been proposed as an energy harvester [20] or flow sensor [21] in biological systems, and its performance as a micro-electro-mechanical-system-fabricated acoustic transducer has been quantitatively investigated [22,23]. Moreover, a method of fixing the device in the cochlea has also been proposed by one of the authors [24] to show the feasibility of the artificial cochlear epithelium made of piezoelectric materials.
In addition to having frequency selectivity and converting vibration to electrical signals, the cochlea amplifies signals through active feedback [25,26,27]. In fact, the cochlear basilar membrane has a nonlinear response to sound stimuli, and this response is attributed to the functions of the outer hair cells in the organ of Corti [28,29,30,31,32,33]; that is, the outer hair cells have the function of controlling the sound level to be recognized. To be more specific, a weak sound input is amplified and a strong input is damped. Thanks to these nonlinear responses, human hearing has a wide dynamic range from 0 to 120 dB in amplitude, although the range of displacement of the cochlear epithelium is from 0.1 to 10 nm [30]. Since the nonlinear response is partly realized by the mechanical feature of the basilar membrane [30], it is important to mimic this feature in engineering the artificial cochlea. In fact, an attempt to mimic the nonlinear response has been made using a cantilever model with dimensions of 470 × 38 mm [34]. It is shown in Reference [34] that a cubic damping term with respect to the cantilever velocity in the control signal realizes the nonlinear response of the cantilever velocity against a disturbance. Moreover, the nonlinear response had similar characteristics with human hearing.
The present paper reports the development of an artificial cochlear epithelium which controls the local vibration according to sound stimuli, on the basis of our preceding study [2]. To be more specific, the preceding study [2] mimicked the function of the basilar membrane and inner hair cells, while the present study also mimics the function of outer hair cells. The development of such a control technique is expected to produce a device that realizes the nonlinear response. Moreover, the control technique can be used to better understand the cochlear mechanism by providing an experimental method that replicates the cochlear behavior.
The artificial cochlear epithelium in the present study is a trapezoidal piezoelectric membrane with patterned Al electrodes [2], where each electrode has two small Al plates for the electrical output and feedback input. The resonance frequency of the device varies locally according to the longitudinal position, achieving the function of frequency selectivity. The patterned electrodes have two functions. One is to recognize sound stimuli through the piezoelectric effect induced by the local deformation of the membrane, while the other is to control local vibration through the inverse piezoelectric effect by applying external electrical stimuli. It is found that the local membrane vibration can be amplified or damped by choosing appropriate phase differences between the electrical and sound stimuli. Using these amplification and damping controls, the nonlinear response that partly realizes the wide dynamic range of human hearing is obtained. Such techniques for recognition and control can be applied to the development of the artificial cochlear epithelium, which mimics functions of the basilar membrane, inner hair cells, and outer hair cells. These functions are needed to achieve the high performance of the human cochlea, having a wide range frequency selectivity from 20 to 20,000 Hz and a wide dynamic range from 0 to 120 dB.
2. Experimental Method
2.1. Fabrication of the Artificial Cochlear Epithelium
We first give an overview of the developed device. We use a piezoelectric membrane having a fixed boundary conditions with a trapezoidal shape as shown in Figure 1a. To control the vibration of the membrane, we apply electrical stimuli to patterned electrodes fabricated on the piezoelectric membrane. The patterned electrodes can also be used to recognize the vibration amplitude. Note that in previous studies [1,2], the electrodes were used to generate the electrical signals to stimulate nerves, mimicking the function of the inner hair cells. In the present study, however, the electrodes are used for feedback control to also mimic the function of the outer hair cells. The vibrations induced by sound and electrical stimuli are expected to be superposed. The piezoelectric material used in this study is a polyvinylidene difluoride (PVDF), because PVDF is biologically compatible [8]. We describe the fabrication method and details of the device in the following.
Figure 1.
(a) Schematic and (b) photograph of the artificial cochlear epithelium fabricated in this paper. The patterned electrodes were fabricated on a polyvinylidene difluoride (PVDF) piezoelectric membrane with thickness of 40 µm; (c) Overview of the experimental setup. The multichannel analog output module in the data acquisition (DAQ) system was used to apply the sound and electrical stimuli with a desired phase difference. The DAQ system was also used to analyze the electrical output from the device and the results of laser Doppler vibrometer (LDV) measurement. These analyzed data were used in feedback control; (d) Details of the mirror system in panel (c) to observe the exact position of the laser for LDV measurement; (e) Photograph of an acyclic part used to fix the microphone.
The device has patterned Al electrodes, as shown in Figure 1a,b. Electrodes have two functions, and are referred to as recognition and control electrodes accordingly. Six pairs of recognition and control electrodes are fabricated on the PVDF membrane. The backside of the PVDF membrane is completely covered by Al deposition and is electrically grounded. The number of electrode pairs was chosen so that local amplitude control can be demonstrated while minimizing the complexity of the device.
The Cartesian coordinate system is defined as in Figure 1a, and the x-coordinates of the center of the i-th control electrode, , are set as mm, mm, mm, mm, mm, and mm. The dimensions of the recognition electrodes (0.5 × 1.0 mm centered at mm) are the same as those in our previous study [2], while those of control electrodes are smaller (0.2 mm) to achieve a better localization of electrical stimuli. The distance between recognition and control electrodes is 0.2 mm. This value of distance was chosen to be small in order to apply electrical stimuli near the recognition electrodes, but the distance should be large enough to achieve a stable electrode-patterning process on the PVDF membrane. The electrode pattern is designed so that geometrical symmetry is preserved but the main feature of the recognition electrode is the same as that in our previous study [2]. To be more precise, the pattern is symmetric with respect to the x-axis, except for the small gap indicated in the magnified figure of Figure 1a. The electrodes with diagonal lines are prepared to have geometrical symmetry, and were not used in this study.
The device was fabricated by attaching the PVDF membrane to a stainless-steel plate with a trapezoidal slit using double-sided tape (No. 500, Nitto Denko, Osaka, Japan). The fabrication process is summarized in the Appendix. The method of assembly was carefully chosen so that the device will not degrade with time. The slit has length mm in the x-direction, and short and long sides in the y-direction are = 2 mm and = 4 mm in length, as shown in Figure 1a. The length in the y-direction of the trapezoidal membrane is therefore expressed as . These values are the same as those in Reference [2].
2.2. Experimental Setup
An overview of the experimental setup is shown in Figure 1c. The data acquisition (DAQ) system consists of a controller (NI PXIe-1082, NI PIXIe-8840, National Instruments, Austin, TX, USA), multichannel analog output module (NI PIXIe-6738, National Instruments, Austin, TX, USA) for sound and electrical stimuli, and a vibration module (NI PIXIe-6738, National Instruments, Austin, TX, USA) for data analysis. The device was fixed on an x–y auto-stage, which was also controlled by the DAQ system. A laser Doppler vibrometer (LDV; AT3600, AT0023, Graphtec, Tokyo, Japan) was used to measure the vibration of the device. The laser was irradiated through a mirror system (Figure 1d), where a camera (DCC1645C, Thorlabs, Newton, NJ, USA) and light-emitting diode as a light source (LEDD18/M565L3, Thorlabs, Newton, NJ, USA) were installed to precisely observe the position of the laser (i.e., the measuring point). The electrical signal from the DAQ system was magnified by an amplifier (HSA4-14, NF, Yokohama, Japan ) and applied to a speaker (FX102, Fostex, Tokyo, Japan). Here, was set to , where , , and t are respectively the voltage amplitude, frequency of sound stimuli, and time variable. A microphone (377C01, 426B03, 480C02, Piezotronics, Depew, NY, USA) was used to evaluate the magnitude of the sound stimuli, (dB SPL). To measure near the membrane, we fabricated the acyclic part as shown in Figure 1e. Sound came from A in Figure 1e through a tube connected to a speaker, and passed to B (the device) and C (the microphone). The distance between point B and the membrane was set to less than 4 mm. The electrical signal from the DAQ system was applied to the i-th control electrode, where
| (1) |
The parameter is the phase difference between the signals for sound and electrical stimuli. Details are given in Section 3.2. The electrical outputs from the i-th recognition electrodes and their amplitudes were stored in the DAQ system.
3. Results and Discussion
3.1. Frequency Selectivity
First of all, we will briefly present the function of frequency selectivity of the present device. More detailed investigations of the function of frequency selectivity (e.g., a comparison with the Wentzel–Kramers–Brillouin (WKB) asymptotic solution and the effect of the surrounding fluid) were conducted in our previous study [2]. Figure 2 shows the amplitude distribution of membrane vibration in the x–y plane. Here, the vibration was induced by sound stimuli with = 4.6, 5.6, 6.6, and 8.2 kHz. These frequencies are close to the resonant frequencies of second, third, fourth, and fifth electrodes, respectively, which will be presented in Section 3.2.1. Contours show the relative amplitude normalized by the maximum value for each . The resonant positions, at which the maximum value is obtained, are indicated by white dots. For each , the resonant positions were different, and we thus conclude that the present device has frequency selectivity. Owing to the vibration mode in the x-direction and/or higher frequency modes, a couple of peaks were observed for each . This tendency became prominent as increased and was the same as that of the previous device [2], but is not observed in the mammalian cochlear epithelium [33]. The duplication of the full details of the vibration modes observed in the mammalian cochlear epithelium will require the geometry and boundary condition to be mimicked. This difficulty is inherent to the membrane vibration, and its solution is our ultimate goal of future research. The development of a device that has simpler vibration modes and a clear one-to-one relation between the resonant position and frequency will help provide a solution.
Figure 2.
Amplitude distribution of membrane vibration in the x–y plane induced by sound stimuli with = 4.6, 5.6, 6.6, and 8.2 kHz. Contours show the relative amplitude normalized by the maximum value for each . The resonant positions, at which the maximum value was obtained, are indicated by white dots. For each , the resonant positions were different, and we thus conclude that the present device had frequency selectivity. Owing to the vibration mode in the x-direction, a couple of peaks were observed for each . This tendency is the same as that observed for a previous device [2] developed by one of the authors.
3.2. Local Vibration Control Using Electrical Stimuli
This section describes the results of local vibration control using electrical stimuli. Section 3.2.1 determines parameters needed for vibration control, while Section 3.2.2 and Section 3.2.3 present examples of local vibration control.
3.2.1. Search for Resonant Frequencies and Control Parameters
We first show that electrical stimuli induce vibration of the membrane and can be used to determine resonant frequencies at position of the control electrodes by changing in Equation (1) continuously. Note that we measured the vibration of the membrane using an LDV and obtained the amplitude for the frequency component f through Fourier analysis.
Figure 3a shows the amplitude of membrane vibration on the fifth electrode ( mm) induced by electrical stimuli applied to that electrode with different frequencies 4 kHz 6 kHz and V. The amplitude reached a maximum at kHz, and we thus conclude that the resonant frequency at the position of the fifth electrode was kHz. Before going into further detail, we will compare the experimental results with a theoretical prediction. Assume that the trapezoidal membrane can be considered as sequential beams of length ; that is, we neglect the vibration mode in the x-direction. Then, according to the linear theory of transverse vibration of a beam with fixed ends [35], we obtain the first-order resonant frequency as , where E is the modulus of elasticity, the mass density, the cross-sectional area with h the thickness of the membrane, and the moment of inertia of the cross section about the x-axis. In other words, , which is introduced for notational convenience, should be independent from x; that is, m· s. The experimental values of for positions of the electrodes used in the present study were obtained as m· s. The standard deviation was 3%, and we thus conclude that the linear theory predicts the resonant frequency of the electrodes well. Although the above discussion using beam theory is simple, the main feature of the device’s frequency selectivity is retained. Further details such as vibration mode and phase will be investigated in future work.
Figure 3.
(a) Vibration amplitude at the fifth electrode ( mm) for electrical stimuli applied to the fifth electrode with frequency . The resonant frequency can be determined by sweeping the frequency in Equation (1); (b) Phase dependence on the vibration amplitude at the fifth electrode under sound stimuli with and electrical stimuli with . The amplitude is at a maximum and nm for a certain phase , while the amplitude is at a minimum and nm for an another phase . The appropriate choice of leads to amplification or damping control of the membrane vibration.
In Figure 3a, the amplitude was 3 nm at most, and it will be seen throughout the paper that the amplitude was on the order of 1 nm. Note that the present LDV equipment ensured a measurement of amplitude on the order of 1 nm for the frequency range from 1 to 100 kHz, which includes the frequencies treated in the present paper. According to the linear theory, we assumed that the sound-stimuli-induced vibration and the electrical-stimuli-induced vibration can be superposed when both stimuli are applied. The resonant frequencies of the device varied slightly when the device was unmounted from the experimental system and mounted again later. Therefore, the measurements of were checked and adjusted again before each experiment. For the second, third, fourth, and fifth electrodes (which are mainly discussed in the present paper), the average resonant frequencies were, respectively, kHz, kHz, kHz, and kHz. Note that the most important frequency range in daily life is between 1 kHz and 3 kHz [36], and is lower than the resonant frequencies obtained for the present device. Because the resonant frequency is proportional to the membrane thickness h as explained above, a device with a thinner membrane will be suitable for a lower hearing range, and this will be a topic of our future work. The C values for these four electrodes are given as m· s, m· s, m· s, and m· s. Note that these four electrodes are suitable for the validation of the proposed technique in the present paper because the first and sixth electrodes are close to the fixed ends in the x-direction and are affected by boundary conditions.
For vibration control using electrical stimuli, we must choose appropriate parameters , , and contained in Equation (1) according to the sound stimuli. Here, as a test case, we determined these parameters such that the vibration of the membrane at the fifth electrode was amplified twice when sound stimuli at the resonant frequency, , were applied. To be more precise, was chosen so that nm when V, and was chosen so that nm at most when both sound and electrical stimuli were applied. The frequency of electrical stimuli should be the same as , otherwise no clear amplification or damping is expected in the present linear regime. We finally chose from the measurement. Figure 3b presents the amplitude for different phases when both sound and electrical stimuli were applied. It is clear that the amplitude was at a maximum and nm for a certain phase , while the amplitude was at a minimum and nm for another phase . In this manner, we can determine the phase difference of electrical stimuli for each control electrode to amplify/dampen the vibration. Note that the vibration of the membrane induced only by the sound stimuli and that only by the electrical stimuli had the same phase when there was amplification and had the opposite phase when there was damping.
Finally, we make some comments on the above experiments. It would be better if we could have predicted the values of and by measuring all the phase shifts in the experimental setup (e.g., by measuring the distance from the speaker and the phase shift in the electrical circuits). However, because the speaker has a typical dimension of 100 mm and it is difficult to define the distance from the speaker to the device, we measured and determined and experimentally. We could have attached an oscillator to the stainless-steel plate instead of the sound stimuli to induce the vibration of the membrane and to measure the piezoelectric output. However, this would have complicated the LDV analysis because we would have to distinguish the vibration of the membrane and that of the stainless-steel plate. Moreover, experiments with sound stimuli are more appropriate because our device is applied to a hearing device.
3.2.2. Improvement of The Response of The Device through Vibration Control
This section presents the ability to control the vibration of the membrane by applying electrical stimuli. The amplitude was measured by the LDV for the entire range of x (i.e., 0 mm 30 mm). In the following, is determined such that the electrical stimuli amplify the vibration by a factor of two with . To be more precise, was chosen so that with , where is the amplitude at with all set to zero. The goal of this section is to amplify the vibration at the -th electrode. We therefore refer to the -th electrode as a target electrode. Resonant frequencies and phases , were measured for all electrodes, prior to the experiments described below.
-
(A)
Only the sound stimuli with is applied.
-
(B)
In addition to protocol (A), electrical stimuli are applied to the -th electrode with .
-
(C)
In addition to protocol (B), electrical stimuli are applied to the -th electrode with .
Protocol (A) leads to the usual response of the device to sound stimuli. Protocol (B) tries to amplify the vibration at the resonant position. However, amplifying the vibration at the resonant position may lead to amplification of the vibration at off-resonant positions. Protocol (C) is similar to protocol (B), but the additional electrical stimuli suppress the vibration of off-resonant positions close to the resonant position, leading to better frequency selectivity. We set , 4, and 5 and carried out each experiment five times.
The results for , 4, and 5 are respectively presented in Figure 4, Figure 5 and Figure 6. In each figure, panel (a) shows the amplitude distribution for the entire range of x while panel (b) is the magnified view around . The plots show averages for five trials with the error bars representing standard deviations.
Figure 4.
Vibration amplitude distribution for protocol (A): only sinusoidal sound stimuli with kHz; protocol (B): sound and electrical stimuli applied to the third electrode; and protocol (C): sound and electrical stimuli applied to the second to fourth electrodes. (a) Entire view and (b) magnified version near . Protocol (B) succeeded in amplifying at resonant position mm. In addition to the amplification in Protocol (B), Protocol (C) damped of neighboring positions and , where there were damping controls with opposite phases for the second and fourth electrodes.
Figure 5.
Vibration amplitude distribution for protocol (A): only sinusoidal sound stimuli with kHz; protocol (B): sound and electrical stimuli applied to the fourth electrode; and protocol (C): sound and electrical stimuli applied to the third to fifth electrodes. (a) Entire view and (b) magnified version near . Protocol (B) succeeded in amplifying at resonant position mm. In addition to the amplification in Protocol (B), Protocol (C) suppressed of neighboring positions and , where there were damping controls with opposite phases for the third and fifth electrodes.
Figure 6.
Vibration amplitude distribution for protocol (A): only sinusoidal sound stimuli with kHz; protocol (B): sound and electrical stimuli applied to the fifth electrode; and protocol (C): sound and electrical stimuli applied to the fourth to sixth electrodes. (a) Entire view and (b) magnified version near . Protocol (B) succeeded in amplifying at resonant position mm. In addition to the amplification in Protocol (B), Protocol (C) damped of neighboring positions and , where there were damping controls with opposite phases for the fourth and sixth electrodes.
We first focus on Figure 4, where the target electrode is the third electrode. The frequency of sound stimuli was set to the resonant frequency at the position of the third electrode, = 13 mm (i.e., kHz). The result of protocol (A) shows that the amplitude was 4.6 nm at the electrode position of mm, which was slightly smaller than the amplitude nm at mm, even though the sound stimuli were set to the resonant frequency at mm. This is attributed to the fact that the width in the y-direction, , was larger for mm. Note that the amplitude tended to be larger if the width was wider. Moreover, we observed local maxima at mm and mm. These local maxima were related to the oscillation mode in the x direction, which can also be observed in Figure 2 with kHz and in Reference [2]. At this stage, the amplitude at the resonant position was not prominent. We then tried protocol (B), where the electrical stimuli of kHz were applied in addition to the sound stimuli. We observed an obvious amplification as a result of the electrical stimuli, and the amplitude at was 8.9 nm. We finally tried protocol (C), applying the electrical stimuli of kHz with and . Figure 4b shows that the amplitudes at and were successfully suppressed.
Figure 5 with the target electrode being the fourth electrode shows a situation similar to that of Figure 4 with the target electrode being the third electrode. The resonant frequency was kHz. For protocol (A), the amplitude at mm was at a maximum (4.0 nm), although we saw smaller peaks at mm and mm. As in the case of Figure 4, these smaller peaks must be due to the higher vibration mode at larger x, as also seen in Figure 2 with kHz. With the electrical stimuli at the fourth electrode in protocol (B), the amplitude at was amplified to 7.9 nm. However, the small peaks at mm and mm were also amplified. For protocol (C), where the sinusoidal electrical stimuli with opposite phase were applied to the third and fifth electrodes, the amplitudes at and were lower, but the amplitude at also decreased from 7.9 to 6.7 nm.
The case where the target electrode was the fifth electrode is described in Figure 6, which should be compared with Figure 4 and Figure 5 for the target electrode being the third and fourth electrodes, respectively. The resonant frequency was kHz. The amplitude at was 2.3 nm in protocol (A). As in the cases of and , we observed a smaller peak at mm. The electrical stimuli of the fifth electrode in protocol (B) led to the amplification of amplitude at , and nm was obtained. However, the smaller peak at mm was also amplified. In protocol (C), where damping control was carried out for the fourth and sixth electrodes, the amplitudes at and were lower as shown in Figure 6b.
To quantify the effect of vibration control using electrical stimuli, we define a parameter as
| (2) |
where is the maximum amplitude for all x, and and are positions such that the amplitude becomes half of . If is large, the amplitude at the resonant electrode is high and localized; that is, the response of the device is improved and can be considered as a variant of Q factors. The response factors (, 4, and 5) for the above protocols are summarized in Table 1. For and 5, a comparison of protocols (A) and (B) shows that in protocol (B) became 2.2 times that in protocol (A). This is because we set such that the amplitude doubled in amplifying control. For , the increase in in protocol (B) was prominent, and the ratio between in protocols (B) and (A) took the value 1.67/0.35 = 4.77. This is because the peak near the maximum amplitude was not sharp when only sound was applied (protocol (A)), as shown in Figure 5 . We therefore conclude that vibration control worked well for better frequency selectivity, especially when the spatial response of the artificial cochlear epithelium was not sharp. The comparison between the response factor for protocols (B) and (C) showed that additional damping control increased for and 5, but slightly reduced for . This decrease was due to the suppressed maximum amplitude in protocol (C) for . To increase the value, it is necessary to predict the motion of the trapezoidal membrane induced by localized electrical stimuli.
Table 1.
Response factor for protocols (A), (B), and (C) with , 4, and 5.
| Protocol (A) | Protocol (B) | Protocol (C) | |
|---|---|---|---|
| Sound Stimuli | On | On | On |
| Electrical Stimuli Applied to the -th Electrode for Amplification Control |
Off | On | On |
| Electrical Stimuli Applied to the -th Electrodes for Damping Control |
Off | Off | On |
| 0.90 | 2.00 | 2.42 | |
| 0.35 | 1.67 | 1.53 | |
| 0.42 | 0.91 | 0.99 | |
The sound pressure level in the above experiments is now described. We chose the magnitude of sound stimuli such that the amplitude was on the order of 1 nm, because the amplitude of the vibration of the basilar membrane typically falls in this range. For , 4, and 5, were obtained as 92, 69, and 93 dB SPL. These are within the the wide dynamic range of human hearing from 0 to 120 dB SPL.
3.2.3. Nonlinear Response of the Device to Sound
Human hearing has a dynamic range from 0 to 120 dB in amplitude, although the range of displacement of the cochlear epithelium is from 0.1 to 10 nm. Therefore, the magnitude of the pressure disturbance over times (from 20 Pa to 20 Pa) is compressed to the amplitude range over 100 times (0.1 nm to 10 nm). Such a compression is caused by the outer hair cells in the organ of Corti, which elongate and shorten according to sound stimuli to control the movement of basilar membrane [33]. In Reference [34], using a cantilever device, a nonlinear feedback control which realizes the same compression rate as the human hearing is achieved by introducing a cubic damping term with respect to the cantilever velocity in the control signal. Here, we demonstrate that the same compression rate can be achieved using our MEMS-fabricated artificial cochlea.
Without any electrical stimuli, our device showed a linear response to the sound; that is, , where p is the magnitude of the pressure disturbance induced by sound. Figure 7 shows the amplitude at the position of the fifth electrode when a sound stimuli with resonant frequency at this position, kHz, was applied. It is seen that, without electrical stimuli, the amplitude showed a linear response to the sound pressure level. Note that the sound pressure level is related to p as , where Pa is the lowest-level of human hearing. To realize the nonlinear response, we applied an electrical stimuli to the fifth electrode, where the magnitude of the electrical signal and the phase are shown in the inset. As shown in Figure 7, the amplitude with electrical stimuli was amplified for dB SPL and was damped for dB SPL, realizing the nonlinear response. The lines are the fitting curves to the experimental results shown by symbols. We used and as fitting curves for the results without electrical stimuli and those with electrical stimuli, respectively. This simple demonstration shows that the present concept of mimicking outer hair cells is feasible within the range of sound pressure level investigated. However, as shown in the inset of Figure 7, electrical signal with a couple of volts are necessary to dampen large vibration. Therefore, the device performance is limited by the electrical power supply.
Figure 7.
Relationship between amplitude at and sound pressure level for kHz. The case with sound stimuli showed a linear response, while the case with both sound and electrical stimuli showed a nonlinear response with a power . The electrical signal used in the experiment is plotted in the inset.
3.3. Recognition of Vibration Using Electrical Outputs
Owing to the vibration of the membrane, the i-th recognition electrodes generate an electrical output with amplitude . We measured and investigated their relation to the vibration amplitude of the membrane and the magnitude of the sound stimuli shown in Figure 1c. Note that is proportional to the magnitude of the strain of the piezoelectric membrane, which is closely related to the vibration amplitude .
We present results for two cases, kHz and kHz, and analyze for , 2, ⋯, 6. The results for these two frequencies are respectively shown in Figure 8 and Figure 9. Figure 8a shows the relationship between amplitude at (i = 1, 2, ⋯, 6) measured by the LDV and sound pressure level for kHz. It is seen that the amplitude had a linear relationship with , as expected. Figure 8b presents the relationship between electrical output (i = 1, 2, ⋯, 6) and amplitude at for kHz. is linearly correlated with . However, the coefficients of proportionality depend on the electrode; that is, when we define a displacement–output conversion factor (V/m), changes according to i. The conversion factor tends to be smaller for larger . This is because the same amplitude results in larger deformation of the membrane when is smaller. In Section 3.4, we use to recognize the electrode with maximum amplitude. The values of are necessary for correct displacement–output conversion and feedback control.
Figure 8.
(a) Relationship between amplitude at (i = 1, 2, ⋯, 6) and sound pressure level for kHz. The membrane vibration increased with the sound pressure level applied to the artificial cochlear epithelium. (b) Relationship between electrical output (i = 1, 2, ⋯, 6) and amplitude at for kHz. Amplitude and electrical output from the recognition electrodes had a linear relationship.
Figure 9.
(a) Relationship between amplitude at (i = 1, 2, ⋯, 6) and sound pressure level for kHz. The membrane vibration increased with the sound pressure level applied to the artificial cochlear epithelium; (b) Relationship between electrical output (i = 1, 2, ⋯, 6) and amplitude at for kHz. Amplitude and electrical output from the recognition electrodes had a linear relationship.
Figure 9a confirms the linear relationship between amplitude and for kHz; that is, the magnitude of the membrane vibration is proportional to that of sound stimuli. Figure 9b clearly shows that , but the values of are different from those in Figure 8b. For kHz, the conversion factor tends to be smaller for larger , as in the case of kHz. This indicates that the amplitude and have a non-trivial relationship. Further studies on the dimensions of the electrode and strain field are needed to clarify this relationship. This topic is left as future work, because the main goal of the present paper is to show the feasibility of vibration control using electrical stimuli.
3.4. Mimicking the Function of Outer Hair Cells by Electrical Feedback Control
This section describes the results of feedback control of vibration by applying electrical stimuli to the control electrodes and using the electrical output from the recognition electrodes, which are presented in Figure 1a. A schematic diagram of the experiment is described in Figure 10a. The parameters of the electrical stimuli, such as , were determined before the experiment in the same manner as in Section 3.2.2. As described in Section 3.3, it was necessary to determine to relate the output voltage from the recognition electrodes and the amplitude . These values of for each electrode and for each frequency were obtained prior to the following experiment.
Figure 10.
(a) Schematic diagram of the feedback control experiment. The experiments comprised recognition and control stages. We carried out two cycles of these stages sequentially as shown in Figure 10a. In the first and second cycles, sound stimuli with and were applied, respectively. The frequency of sound was changed between the first and second cycles to demonstrate that the present system responds to the frequency change. In the recognition stage, the electrical output was automatically measured to find the resonant position. In the control stage, the electrical stimuli were applied to amplify the vibration of the resonant position found in the recognition stage. Amplitude distribution in (b) the first cycle and (c) the second cycle. In the first cycle shown in panel (b), the fifth electrode was detected as the resonant position in the recognition stage, and the amplitude of vibration was amplified only near the fifth electrode in the control stage. In the second cycle shown in panel (c), the fourth electrode was detected as the resonant position in the recognition stage, and the amplitude of vibration was amplified only near the fourth electrode in the control stage.
The experiment comprised recognition and control stages. We carried out two cycles of these stages sequentially, as shown in Figure 10a. In the first and second cycles, sound stimuli with and were applied, respectively. The frequency of sound was changed between the first and second cycles to demonstrate that the present system responded to the frequency change. As a comprehensible demonstration, we chose for the first cycle and for the second cycle, but other frequencies can be chosen. In the recognition stage, no electrical stimuli were applied and electrical measurements of were automatically made to find the resonant position. In the present demonstration, these resonant positions for first and second cycles were respectively and . Note that the LDV measurements were also made to confirm that the amplitude was magnified/damped as expected, but were not used for feedback control. Each stage took tens of seconds because the x–y auto-stage moved at a speed of 7 mm·s to the measurement position (i.e., , , 2, ⋯, 6) and waited five seconds before the measurement of vibration. The purpose of the present study was to develop and confirm a prototype principle of mimicking the outer hair cell as a first step. This waiting time was necessary for precise measurement because any tiny oscillation may affect the result. In the control stage, electrical stimuli were applied to amplify the vibration of the resonant position found in the recognition stage. As in protocol (C) described in Section 3.2.2, damping control was also carried out for neighboring electrodes. The results of the first and second cycles are respectively shown in Figure 10b,c. In the recognition stage of the first cycle, the position of the fifth electrode was detected as the resonant position as seen from the values of the modified electrical output . The electrical stimuli were then applied in the control stage of the first cycle to yield a prominent peak at the fifth position. Between the first and second cycles ( 50 s), the frequency of sound changed to . The measurement of electrical outputs in the recognition stage of the second cycle yielded that was the maximum and the position of the fourth electrode was thus detected as a resonant position. In the control stage of the second cycle, we successfully amplified the vibration at the fourth electrode while suppressing amplification at the neighboring electrodes (third and fifth), although the fifth electrode was slightly amplified.
We define another response factor as
| (3) |
In the above four experiments, for the first/second cycles and recognition/control states, values were obtained as given in Table 2. The table shows that the value was higher in the control stage and the magnification ratios were 4.03 and 3.64 for the first and second cycles, respectively. These results indicate that the present experimental system was capable of increasing the performance of frequency selectivity of the artificial cochlear epithelium by mimicking the function of outer hair cells.
Table 2.
Response factor for recognition/control stages of the first/second cycles presented in Figure 10.
| Recognition Stage | Control Stage | ||
|---|---|---|---|
| First Cycle | 2.35 ± 0.06 | 9.48 ± 0.49 | 4.03 |
| Second Cycle | 1.64 ± 0.03 | 5.96 ± 0.15 | 3.64 |
4. Conclusions
We propose an artificial cochlear epithelium which mimics the function of an outer hair cell using feedback electrical stimuli. The main outcomes of the present paper are summarized as follows.
On the basis of a previous device [2], we developed a new design of an artificial cochlear epithelium with recognition and control electrodes. These electrodes are used to mimic the functions of the basilar membrane, inner hair cells, and outer hair cells.
Recognition of the resonant position and control of the vibration amplitude at the resonant position are realized using the electrode pattern of the present device. The method uses the local electrical stimuli through patterned electrodes fabricated on a PVDF membrane with a trapezoidal support. Parameters of the electrical stimuli were experimentally determined for each electrode to improve the response of the artificial cochlear epithelium.
A demonstration of the feedback control of membrane vibration was carried out by alternating the frequency of sound stimuli during a single run of the experiment. The present device automatically responds to a change in the sound frequency and amplifies the vibration amplitude at the resonant position.
There are ways to improve the present control method. Firstly, it is important to design the recognition electrodes to evaluate the amplitude of membrane vibration quantitatively. That is to say, one needs to control values of the displacement–output conversion factor of the i-th electrode (i.e., in Section 3.3) by changing the dimensions of the recognition electrodes. As an alternative solution, one may use a machine-learning technique to search for appropriate control parameters of electrical stimuli (e.g., ) and to construct a database of . Another important direction of improvement is minimization of the experimental setup. We constructed an automation system for the present study, but the system obviously cannot be integrated with an actual artificial cochlea. It is necessary to develop an equivalent circuit system using micro-fabrication technologies for further investigation, such as animal tests. To sustain electrical power to activate devices, one may consider using an endocochlear potential maintained in the cochlea [37,38], which has also been proposed as a biological battery [39]. The cochlear shape is important in low-frequency hearing [40,41], and thus evaluation of the device in an environment similar to that of the cochlea is also necessary for the optimal design of wide-range frequency selectivity.
Acknowledgments
This research is supported by the Japan Agency for Medical Research and Development under Grant Number JP17gm0810004.
Appendix A. Fabrication of the PVDF Membrane with Patterned Electrodes
The fabrication method of the patterned electrode on the PVDF membrane is described as follows and summarized in Figure A1. An Al thin film with thickness of 50–60 nm was deposited on both sides of a PVDF membrane with thickness of 40 µm (KF piezo film, Kureha, Tokyo, Japan). The PVDF membrane was attached to a glass substrate for the following photolithography process. A positive photoresist (AZ5214E, Merck, Darmstadt, Germany) was spin-coated on the PVDF membrane at 3000 rpm. After a prebake for 10 min at 80 degrees, the membrane was exposed to ultraviolet light at 6 mJ/cm through a photomask. To expose the membrane uniformly, three glass diffuser plates were placed between the light source and membrane. The exposed photoresist was developed by immersing the membrane in developer solution (AZ300MIF, Merck, Darmstadt, Germany) for 8 min. During the development process, the Al film except for the area covered by the cured photoresist was etched, and the PVDF membrane with a patterned electrode was thus obtained as shown in Figure 1b. Finally, the membrane was immersed in ethanol for 2 min to remove the photoresist. The Al thin film on the backside of the PVDF membrane is protected and maintained by the glass substrate.
Figure A1.
Fabrication process of the PVDF membrane with patterned electrodes. (a) Al-deposited piezoelectric membrane; (b) Spincoating of photoresist AZ5214-E; (c) Covering the photomask; (d) Exposure to ultraviolet light; (e) Removing the photomask; (f) Development and etching; (g) Lifting off.
Author Contributions
T.T. and S.K. conceived and designed the research; T.T, A.N., and H.Y. constructed the measurement system and performed the experiments; T.T. and A.N. analyzed the data; T.T. and S.K. wrote the paper.
Conflicts of Interest
The authors declare no conflict of interest.
References
- 1.Inaoka T., Shintaku H., Nakagawa T., Kawano S., Ogita H., Sakamoto T., Hamanishi S., Wada H., Ito J. Piezoelectric materials mimic the function of the cochlear sensory epithelium. Proc. Natl. Acad. Sci. USA. 2011;108:18390–18395. doi: 10.1073/pnas.1110036108. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Shintaku H., Nakagawa T., Kitagawa D., Tanujaya H., Kawano S., Ito J. Development of piezoelectric acoustic sensor with frequency selectivity for artificial cochlea. Sens. Actuators A Phys. 2010;158:183–192. doi: 10.1016/j.sna.2009.12.021. [DOI] [Google Scholar]
- 3.Kawano S., Ito J., Nakagawa T., Shintaku H. Artificial Sensory Epithelium. 9,566,428. U.S. Patent. 2017 Feb 14;
- 4.Von Békésy G., Wever E.G. Experiments in Hearing. Volume 8 McGraw-Hill; New York, NY, USA: 1960. [Google Scholar]
- 5.Warchol M.E., Lambert P.R., Goldstein B.J., Forge A., Corwin J.T. Regenerative proliferation in inner ear sensory epithelia from adult guinea pigs and humans. Science. 1993;259:1619–1622. doi: 10.1126/science.8456285. [DOI] [PubMed] [Google Scholar]
- 6.Clark G.M., Tong Y., Black R., Forster I., Patrick J., Dewhurst D. A multiple electrode cochlear implant. J. Laryngol. Otol. 1977;91:935–945. doi: 10.1017/S0022215100084607. [DOI] [PubMed] [Google Scholar]
- 7.Zeng F.G. Trends in cochlear implants. Trends Amplif. 2004;8:1–34. doi: 10.1177/108471380400800102. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Shintaku H., Tateno T., Tsuchioka N., Tanujaya H., Nakagawa T., Ito J., Kawano S. Culturing neurons on MEMS fabricated P (VDF-TrFE) films for implantable artificial cochlea. J. Biomech. Sci. Eng. 2010;5:229–235. doi: 10.1299/jbse.5.229. [DOI] [Google Scholar]
- 9.Shintaku H., Kobayashi T., Zusho K., Kotera H., Kawano S. Wide-range frequency selectivity in an acoustic sensor fabricated using a microbeam array with non-uniform thickness. J. Micromech. Microeng. 2013;23:115014. doi: 10.1088/0960-1317/23/11/115014. [DOI] [Google Scholar]
- 10.Shintaku H., Inaoka T., Nakagawa T., Kawano S., Ito J. Electrically evoked auditory brainstem response by using bionic auditory membrane in guinea pigs. J. Biomech. Sci. Eng. 2013;8:198–208. doi: 10.1299/jbse.8.198. [DOI] [Google Scholar]
- 11.Kim S., Song W.J., Jang J., Jang J.H., Choi H. Mechanical frequency selectivity of an artificial basilar membrane using a beam array with narrow supports. J. Micromech. Microeng. 2013;23:095018. doi: 10.1088/0960-1317/23/9/095018. [DOI] [Google Scholar]
- 12.Tateno T., Nishikawa J., Tsuchioka N., Shintaku H., Kawano S. A hardware model of the auditory periphery to transduce acoustic signals into neural activity. Front. Neuroeng. 2013;6:12. doi: 10.3389/fneng.2013.00012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Jang J., Kim S., Sly D.J., O’fleary S.J., Choi H. MEMS piezoelectric artificial basilar membrane with passive frequency selectivity for short pulse width signal modulation. Sens. Actuators A Phys. 2013;203:6–10. doi: 10.1016/j.sna.2013.08.017. [DOI] [Google Scholar]
- 14.Tanujaya H., Shintaku H., Kitagawa D., Adianto A., Susilodinata S., Kawano S. Experimental and analytical study approach of Artificial basilar membrane prototype (ABMP) J. Eng. Technol. Sci. 2013;45:61–72. doi: 10.5614/j.eng.technol.sci.2013.45.1.5. [DOI] [Google Scholar]
- 15.Tanujaya H., Kawano S. Experimental study of vibration of prototype auditory membrane. Appl. Mech. Mater. 2014;493:372–377. doi: 10.4028/www.scientific.net/AMM.493.372. [DOI] [Google Scholar]
- 16.Lee H.S., Chung J., Hwang G.T., Jeong C.K., Jung Y., Kwak J.H., Kang H., Byun M., Kim W.D., Hur S., et al. Flexible inorganic piezoelectric acoustic nanosensors for biomimetic artificial hair cells. Adv. Funct. Mater. 2014;24:6914–6921. doi: 10.1002/adfm.201402270. [DOI] [Google Scholar]
- 17.Jang J., Lee J., Woo S., Sly D.J., Campbell L.J., Cho J.H., O’fLeary S.J., Park M.H., Han S., Choi J.W., et al. A microelectromechanical system artificial basilar membrane based on a piezoelectric cantilever array and its characterization using an animal model. Sci. Rep. 2015;5:12447. doi: 10.1038/srep12447. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Jang J., Jang J.H., Choi H. Biomimetic artificial basilar membranes for next-generation cochlear implants. Adv. Healthc. Mater. 2017;6:1700674. doi: 10.1002/adhm.201700674. [DOI] [PubMed] [Google Scholar]
- 19.Jang J., Jang J.H., Choi H. MEMS flexible artificial basilar membrane fabricated from piezoelectric aluminum nitride on an SU-8 substrate. J. Micromech. Microeng. 2017;27:075006. doi: 10.1088/1361-6439/aa7236. [DOI] [Google Scholar]
- 20.Dagdeviren C., Yang B.D., Su Y., Tran P.L., Joe P., Anderson E., Xia J., Doraiswamy V., Dehdashti B., Feng X., et al. Conformal piezoelectric energy harvesting and storage from motions of the heart, lung, and diaphragm. Proc. Natl. Acad. Sci. USA. 2014;111:1927–1932. doi: 10.1073/pnas.1317233111. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Asadnia M., Kottapalli A.G.P., Karavitaki K.D., Warkiani M.E., Miao J., Corey D.P., Triantafyllou M. From biological cilia to artificial flow sensors: Biomimetic soft polymer nanosensors with high sensing performance. Sci. Rep. 2016;6:32955. doi: 10.1038/srep32955. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Ko S.C., Kim Y.C., Lee S.S., Choi S.H., Kim S.R. Micromachined piezoelectric membrane acoustic device. Sens. Actuators A Phys. 2003;103:130–134. doi: 10.1016/S0924-4247(02)00310-2. [DOI] [Google Scholar]
- 23.Luo Y., Gan R., Wan S., Xu R., Zhou H. Design and analysis of a MEMS-based bifurcate-shape piezoelectric energy harvester. AIP Adv. 2016;6:045319. doi: 10.1063/1.4948592. [DOI] [Google Scholar]
- 24.Tona Y., Inaoka T., Ito J., Kawano S., Nakagawa T. Development of an electrode for the artificial cochlear sensory epithelium. Hear. Res. 2015;330:106–112. doi: 10.1016/j.heares.2015.08.007. [DOI] [PubMed] [Google Scholar]
- 25.Gold T., Pumphrey R.J. Hearing. I. The cochlea as a frequency analyzer. Proc. R. S. Lon. B Biol. Sci. 1948;135:462–491. doi: 10.1098/rspb.1948.0024. [DOI] [Google Scholar]
- 26.Gold T. Hearing. II. The physical basis of the action of the cochlea. Proc. R. S. Lond. B Biol. Sci. 1948;135:492–498. doi: 10.1098/rspb.1948.0025. [DOI] [Google Scholar]
- 27.Kemp D.T. Evidence of mechanical nonlinearity and frequency selective wave amplification in the cochlea. Arch. Oto Rhino Laryngol. 1979;224:37–45. doi: 10.1007/BF00455222. [DOI] [PubMed] [Google Scholar]
- 28.Rhode W.S. Observations of the vibration of the basilar membrane in squirrel monkeys using the Mössbauer technique. J. Acoust. Soc. Am. 1971;49:1218–1231. doi: 10.1121/1.1912485. [DOI] [PubMed] [Google Scholar]
- 29.Russell I., Nilsen K. The location of the cochlear amplifier: spatial representation of a single tone on the guinea pig basilar membrane. Proc. Natl. Acad. Sci. USA. 1997;94:2660–2664. doi: 10.1073/pnas.94.6.2660. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Robles L., Ruggero M.A. Mechanics of the mammalian cochlea. Physiol. Rev. 2001;81:1305–1352. doi: 10.1152/physrev.2001.81.3.1305. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Duke T., Jülicher F. Active traveling wave in the cochlea. Phys. Rev. Lett. 2003;90:158101. doi: 10.1103/PhysRevLett.90.158101. [DOI] [PubMed] [Google Scholar]
- 32.Dong W., Olson E.S. Detection of cochlear amplification and its activation. Biophys. J. 2013;105:1067–1078. doi: 10.1016/j.bpj.2013.06.049. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Reichenbach T., Hudspeth A. The physics of hearing: fluid mechanics and the active process of the inner ear. Rep. Prog. Phys. 2014;77:076601. doi: 10.1088/0034-4885/77/7/076601. [DOI] [PubMed] [Google Scholar]
- 34.Joyce B.S., Tarazaga P.A. Mimicking the cochlear amplifier in a cantilever beam using nonlinear velocity feedback control. Smart Mater. Struct. 2014;23:075019. doi: 10.1088/0964-1726/23/7/075019. [DOI] [Google Scholar]
- 35.Shabana A.A. Theory of Vibration: Volume II: Discrete and Continuous Systems. Springer Science & Business Media; Heidelberg/Berlin, Germany: 2012. [Google Scholar]
- 36.Merchant S.N., Nadol J.B. Schuknecht’s Pathology of the Ear. People’s Medical Publishing House-USA; Shelton, CT, USA: 2010. p. 128. [Google Scholar]
- 37.Nin F., Hibino H., Murakami S., Suzuki T., Hisa Y., Kurachi Y. Computational model of a circulation current that controls electrochemical properties in the mammalian cochlea. Proc. Natl. Acad. Sci. USA. 2012;109:9191–9196. doi: 10.1073/pnas.1120067109. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Adachi N., Yoshida T., Nin F., Ogata G., Yamaguchi S., Suzuki T., Komune S., Hisa Y., Hibino H., Kurachi Y. The mechanism underlying maintenance of the endocochlear potential by the K+ transport system in fibrocytes of the inner ear. J. Physiol. 2013;591:4459–4472. doi: 10.1113/jphysiol.2013.258046. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Mercier P.P., Lysaght A.C., Bandyopadhyay S., Chandrakasan A.P., Stankovic K.M. Energy extraction from the biologic battery in the inner ear. Nat. Biotechnol. 2012;30:1240–1243. doi: 10.1038/nbt.2394. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Manoussaki D., Chadwick R.S. Effects of geometry on fluid loading in a coiled cochlea. SIAM J. Appl. Math. 2000;61:369–386. doi: 10.1137/S0036139999358404. [DOI] [Google Scholar]
- 41.Manoussaki D., Chadwick R.S., Ketten D.R., Arruda J., Dimitriadis E.K., O’Malley J.T. The influence of cochlear shape on low-frequency hearing. Proc. Natl. Acad. Sci. USA. 2008;105:6162–6166. doi: 10.1073/pnas.0710037105. [DOI] [PMC free article] [PubMed] [Google Scholar]











