- 1Department of Materials Science and Engineering, Center of Single Atom-based Semiconductor Device, Pohang University of Science and Technology, Pohang, South Korea
- 2School of Electronics Engineering, Kyungpook National University, Dague, South Korea
Oscillatory neural network (ONN)-based classification of clustered data relies on frequency synchronization to injected signals representing input data, showing a more efficient structure than a conventional deep neural network. A frequency tunable oscillator is a core component of the network, requiring energy-efficient, and area-scalable characteristics for large-scale hardware implementation. From a hardware viewpoint, insulator-metal transition (IMT) device-based oscillators are attractive owing to their simple structure and low power consumption. Furthermore, by introducing non-volatile analog memory, non-volatile frequency programmability can be obtained. However, the required device characteristics of the oscillator for high performance of coupled oscillator have not been identified. In this article, we investigated the effect of device parameters of IMT oscillator with non-volatile analog memory on coupled oscillators network for classification of clustered data. We confirmed that linear conductance response with identical pulses is crucial to accurate training. In addition, considering dispersed clustered inputs, a wide synchronization window achieved by controlling the hold voltage of the IMT shows resilient classification. As an oscillator that satisfies the requirements, we evaluated the NbO2-based IMT oscillator with non-volatile Li-based electrochemical random access memory (Li-ECRAM). Finally, we demonstrated a coupled oscillator network for classifying spoken vowels, achieving an accuracy of 85%, higher than that of a ring oscillator-based system. Our results show that an NbO2-based oscillator with Li-ECRAM has the potential for an area-scalable and energy-efficient network with high performance.
Introduction
Von-Neumann computing architecture has a drawback of inefficient data transportation between memory and processor, referred to Von-Neumann bottleneck. Thus, bioinspired new computing architecture has gained enormous attention, anticipating low power consumption, and parallel processing (Mead, 1990). Several artificial neural networks (ANNs) have been developed inspired by brain function. Among these, an oscillatory neural network (ONN) is composed of coupled oscillators, motivated by the synchronization of oscillatory neural signals to cognize complex information in neural binding. Oscillator-based network shows complex non-linear dynamics, which can be utilized in various applications such as classification of clustered data (Romera et al., 2018; Dutta et al., 2019), associative memory system (Levitan et al., 2012; Shibata et al., 2012), pattern recognition (Nikonov et al., 2015; Vodenicarevic et al., 2016), and Nondeterministic polynomial (NP)-hard problem solver (Parihar et al., 2017; Dutta et al., 2021).
For the classification of clustered data, a coupled oscillator-based spoken vowel classification system has been reported (Romera et al., 2018; Dutta et al., 2019). Spoken vowel signals have formant frequencies, which are peaks in the frequency spectrum. The set of formant frequencies depends on the vowel, which is a feature of the input signal. Thus, input vowel signals are transformed into a two-dimensional domain in the form of frequency, spreading multiple frequency clusters. The frequencies are injected into coupled oscillators network, resulting in a synchronization map with trained nature frequencies of the network. Consequently, vowels are clustered according to states in the synchronization map. Compared to conventional ANN such as multilayer perceptron, recurrent neural network (RNN), and long short-term memory (LSTM), coupled oscillator network has a simple structure and a small number of trained parameters with a comparable recognition rate (Romera et al., 2018). Therefore, an oscillator-based spoken vowel classification system has the advantage of computing power efficiency.
To implement these systems by the conventional CMOS technology, an oscillator is composed of a ring oscillator and a current-based digital-to-analog converter (DAC) to tune oscillation frequency to the trained value (Nikonov et al., 2020). Thus, many transistors and high operation power are required, resulting in the limitation of a large-scale system.
In this regard, spin-torque oscillator (STO) (Romera et al., 2018), insulator-metal transition (IMT) device (Lee et al., 2018; Dutta et al., 2019), and ovonic threshold switch (OTS) device (Lee et al., 2020) have been reported to overcome the limitations of conventional CMOS-based oscillator. Among the abovementioned oscillators, the IMT-based oscillator has a simpler structure and lower power consumption than the others. In particular, the NbO2-based IMT oscillator shows stable oscillation due to the drift-free threshold switching characteristics of NbO2 (Park et al., 2017). In an IMT oscillator, the oscillation frequency is determined by the resistance of the load resistor (Chen et al., 2016). Therefore, frequency controllability can be obtained by adjusting variable resistors such as transistor and resistive random access memory (RRAM) (Lee et al., 2018; Dutta et al., 2019). An additional memory device is required to store trained natural frequencies of coupled oscillators. NbO2-based IMT oscillator with non-volatile RRAM and Li-based electro-chemical random access memory (Li-ECRAM) has frequency storable characteristics (Lee et al., 2018; Lee et al., 2022). Thus, compared to the volatile transistor as load, non-volatile memory is advantageous in terms of the simplicity of hardware. Although frequency storable IMT oscillator with non-volatile analog memory has been proposed, the effects of device parameters of IMT and memory device are not identified in terms of network performance.
This study investigated the effect of device parameters on the performance of coupled oscillator networks to classify clustered data. As a result, the Li-ECRAM device is an appropriate oscillation load for high learning accuracy. Finally, we evaluated spoken vowel classification based on a nanoscale oscillator with NbO2 and Li-ECRAM, showing high learning accuracy.
Materials and Methods
Measurement and Simulation Platform
The electrical characteristics of NbO2-based IMT device and Li-ECRAM were measured using a Keysight B1500A semiconductor device parameter analyzer with Waveform Generator/Fast Measurement Unit (WGFMU) module. Input current pulses for programming conductance of Li-ECRAM were generated by Keithley B2635B. We used a Keysight 81160A Pulse Function Arbitrary Noise Generator to generate injected sine waves. Output waveforms of oscillators were measured by a Keysight DSOX4154A oscilloscope. Simulation Program with Integrated Circuit Emphasis (SPICE) simulations of coupled oscillators were performed by using Synopsis HSPICE 2020.06.
NbO2-Based Insulator-Metal Transition Device
The NbO2-based IMT device with a metal-oxide-metal (MIM) stack has been fabricated using the following process. First, a 20-nm-thick NbO2 layer was fabricated on a TiN plug with a 100 nm diameter, as shown in Figure 1A. For a thin NbO2 deposition, we used radio frequency (RF) magnetron reactive sputtering with Nb metal target in an O2/Ar gas mixture in the ratio of 1/15 at room temperature. Then, a W top electrode was deposited by direct current (DC) magnetron sputtering. Figure 1B shows the hysteresis current–voltage (I–V) characteristics of the NbO2 device using a triangle shape with a 10 μs width. The IMT device transforms from an insulating state to a metallic state when the applied voltage exceeds the threshold voltage (Vth). In contrast, after transition, if the applied voltage is smaller than the hold voltage (Vhold), the IMT device goes back to the initial insulating state.
Figure 1. (A) TEM image of NbO2-based IMT device. (B) I–V characteristic of the NbO2-based IMT device. (C) Schematic diagram of NbO2-based oscillator. (D) Output waveform of NbO2-based oscillator when load resistor is 10 kΩ. (E) Schematic diagram of injection locking with input signal. (F) Output frequency as a function of input frequency. Colored region is synchronization window. (G) Fast Fourier transformation (FFT) result of input and output frequency. In FFT analysis, sampling rate is 400 Ms−1.
NbO2-Based Insulator-Metal Transition Oscillator
Figure 1C presents a schematic of an NbO2-based IMT oscillator. When the load resistor is connected, two stable states exist owing to the hysteresis characteristics of NbO2 in the following condition (Chen et al., 2016):
where Ri is the insulating resistance of NbO2, Rm is the metallic resistance of NbO2, RL is load resistance, and VDD is supply voltage.
Therefore, the oscillator’s output showed self-sustained oscillation between VDD-Vth and VDD-Vhold, accompanying the charging and discharging of the load capacitor (CL), as shown in Figure 1D. The oscillation frequency is determined by the charging and discharging time. When the resistance condition is Ri > > RL > > Rm, the charging time is significantly shorter than the discharging time. Thus, the oscillation frequency is dominant on discharging time and represented as follows:
where GL is the conductance of the load resistor (= 1/RL).
We then evaluated injection locking to external sine wave, a crucial phenomenon of coupled oscillator-based systems, as shown in Figure 1E. Injection locking is a phenomenon in which the frequency of an oscillator is synchronized (locked) with injected frequency when the injection frequency is within the synchronization range (locking range). Sinewave with 1.4 V high level and 1.1 V low level was injected through a coupled capacitor (Cc). When frequency within the synchronization window (W) close to the natural frequency (170 kHz) was injected, the output frequency is locked to the input frequency, as shown in the colored region of Figure 1F. Thus, input and output frequency was synchronized, resulting in equal peak frequency in FFT results of input and output oscillation, as shown in Figure 1G. In contrast, an input frequency greater than 210 kHz, out of the synchronization window, caused a mismatch with the output, meaning asynchronization.
Coupled Oscillator-Based Classification of Clustered Data
Based on the injection locking phenomenon of coupled oscillators when input within the synchronization window is injected, we investigated the effect of device parameters on 4-coupled oscillators with NbO2 devices for classification of clustered data by SPICE simulation, as shown in Figure 2A. In the simulation, we used Verilog-A NbO2 compact model fitted from I to V characteristics (Lee et al., 2019), as shown in Figure 1B, load capacitance (CL) is 400 pF, and coupling capacitance (Cc) is 200 pF. Furthermore, we introduced analog memory as a load resistor to obtain frequency tunability as shown in Figure 2B. Two-dimensional clustered input frequencies (fA, fB) are injected simultaneously through coupling capacitors. After injection, output frequencies (f1–f4) of each oscillator are checked synchronizations with the input frequencies through synchronization-detecting circuits (Vodenicarevic et al., 2016). Then, input frequencies are mapped and labeled according to the synchronization state. In this system, classifiable regions correspond to overlapped areas with synchronization windows in the synchronization map. For example, the A4B1 region representing oscillators 4 and 1 is synchronized with input frequencies fA and fB, respectively, as shown in Figure 2C. Input data within the region are classified as the same cluster. Therefore, for accurate classification, oscillation frequencies must be trained for classified regions to cover input data. We trained the natural frequencies (fN) of oscillators by gradient descent algorithm (Romera et al., 2018; Dutta et al., 2019). The conductance of analog memory composing NbO2-based oscillators must be trained to obtain optimized nature frequencies. Figure 2D shows the flowchart for the training of conductance. First, the conductance of load resistors was randomized within a limited range (40 μS–200 μS). Then, training inputs are injected to calculate the error (ϵ) between input frequencies and corresponding output frequencies (fout). Training input is the input frequency set [fA, fB] and label of oscillators (L) with which oscillator the input is synchronized. For example, labels for input corresponding to A1B4 region of synchronization map are LA = [1, 0, 0, 0] and LB = [0, 0, 0, 1]. Therefore, the error is calculated as follows:
Figure 2. (A) Four-coupled oscillators configuration of a clustered data classification using (B) NbO2-based oscillator with analog memory device. (C) Synchronization map of before and after training. W is synchronization window and classifiable region is overlapped area with synchronization windows (W × W). (D) Flow chart of conductance update for classification of clustered data. (E) Normalized conductance response to applied number of pulses. (F) Training and test dataset with input variation.
Mean-squared error was used as a loss function (L):
where N is the number of oscillators (= 4). According to equation (2), the natural frequency of coupled oscillators (fN) is linearly proportional to the conductance of the load resistor (GL). Then, the amount of conductance update was calculated by gradient descent as follows:
where η is the learning rate and Gi is the load conductance of ith oscillator. In a perceptron neural network with analog memory-based synapse devices, such as RRAM and phase change random access memory, the synaptic weight corresponding to the conductance of analog memory is updated by applying identical pulses proportional to the amount of weight update. An identical pulse scheme is a practical method, because a non-identical pulse scheme requires heavier circuitry than the identical pulse scheme (Tsai et al., 2018). Therefore, the applied number of pulses to update the conductance of analog memories is calculated as follows:
where Pi is the applied number of pulses of ith analog device. The conductance update process is iterated until the conductance of analog memories saturates to the optimal value. The conductance change characteristics of analog memory under identical pulses are essential to update accuracy, and conductance modulation behavior was modeled as a normalized exponential function (Chen et al., 2017).
where Gup is a function of increasing conductance, Gdown is a function of decreasing conductance, A is the parameter determining non-linear behavior, and B is different in Gup and Gdown, as shown in Figure 2E. Then, we considered fitting function in simulation. Figure 2F shows the training and test datasets, with 20 inputs for each cluster (a total of 5 clusters) with variation (σ).
Effect of Non-linearity (A)
To investigate the effect of non-linearity on network performance, we evaluated classification accuracy with various non-linearities, as shown in Figure 3A. We assumed that the non-linearity of up and down conductance response was symmetric owing to confirm non-linearity only. Classification accuracy was degraded as the non-linearity was higher. If the non-linearity is high, conductance changes significantly even if the number of pulses is small. Consequently, the output frequencies proportional to the conductance of analog memory do not converge to the optimal value when non-linearity is high, as shown in Figure 3B. Therefore, linear conductance modulation under identical pulses is crucial to improve classification accuracy.
Figure 3. (A) Classification accuracy as a function of non-linearity. The non-linearity of the up and down conductance response is symmetric. (B) Output frequency of 3rd oscillator as a function of training iteration in various non-linearity. (C) Classification accuracy as a function of input variation. To investigate only the effect of input variation, conductance response is linear with the number of pulses. (D) Synchronization map with narrow synchronization window (Vhold = 0.55 V); 25% of clustered data was within the classifiable region due to narrow W. (E) Synchronization window and classification accuracy with various hold voltage of NbO2 device. Synchronization window was simulated in the configuration shown in Figure 1E. (F) Synchronization map with wide synchronization window (Vhold = 0.65 V). 94% of clustered data can be classified owing to wide classifiable region.
Effect of Input Variation and Hold Voltage
Figure 3C shows the classification accuracy as a function of input variation. High input variation worsened accuracy because the classifiable region cannot cover clustered data. When input variation was 50 kHz, only 25% of clustered data were covered by the classification region as shown in Figure 3D. To widen the classifiable region, a wide synchronization window is required. According to Alder’s equation (Bhansali and Roychowdhury, 2009) representing an injection locking phenomenon, locking range fL corresponding to synchronization window is inversely proportional to the amplitude of the oscillator:
where Vi is the amplitude of injected sinuous signal and Vosc is the amplitude of the oscillator. As shown in Figure 1D, the amplitude of the NbO2-based oscillator is Vth-Vhold. Thus, the synchronization window widened with and enlarged Vhold, improving classification accuracy, as shown in Figure 3D. Enlarged Vhold (= 0.65 V) leads to a broad classifiable region, which covers 94% of clustered data, as shown in Figure 3F. Therefore, immunity of input variation can be obtained by an enlarged Vhold of NbO2.
Li-Based Electrochemical Random Access Memory
In terms of conductance linearity, Li-ECRAM is the most appropriate analog memory as load. Since Li-ECRAM exhibits linear conductance modulation (Fuller et al., 2017; Tang et al., 2018), it shows linear frequency modulation in an NbO2-based oscillator with the device (Lee et al., 2022). A three-terminal Li-ECRAM device was fabricated on a SiO2 wafer. First, W source and drain were deposited by DC magnetron sputtering. The distance between source and drain corresponding to channel length was 100 nm. Then, a 50-nm-thick WO3 channel material was deposited by RF magnetron reactive sputtering with W metal target in an O2/Ar gas mixture in the ratio of 1/5 at room temperature. Consecutively, 100-nm-thick Li3PO4 electrolyte and 30-nm-thick Si reservoir were deposited by RF magnetron sputtering. Finally, the W gate was deposited by DC magnetron sputtering. An optical microscope image of the fabricated device is shown in Figure 4A. Figure 4B shows the device structure of Li-ECRAM and the bias schematic for channel conductance modulation. When a positive current is applied, Li-ions in electrolyte were injected into the channel. Then, W6+ valance state changes to W5 +, increasing channel conductance (Niklasson et al., 2004). In contrast, when a negative current is applied, Li-ions in the channel are extracted from the electrolyte, decreasing channel conductance. Figure 4C shows the conductance response to applied identical gate current pulses. The amplitude of input gate pulses (IG) for changing conductance up and down was 10 and –10 nA, respectively, and the pulse width was 0.5 s. Drain–source voltage (VDS) was applied to measure channel conductance (GDS). Conductance change has a reasonably linear relationship with the applied number of pulses, showing a low non-linearity factor (Aup = 0.55, Adown = −0.67). The conductance switching of LI-ECRAM is driven by the applied charge. Conductance response is linearly proportional to the number of pulses related to the applied ones (Fuller et al., 2017; Tang et al., 2018). As shown in Figure 3A, accuracy degradation is slightly degraded in using Li-ECRAM as oscillation load compared to ideal linear case.
Figure 4. (A) Optical microscope image and (B) device structure of Li-ECRAM. (C) Conductance response to identical pulses. Low non-linearity (Aup = 0.55, Adown = −0.67) is obtained. (D) Frequency programming scheme and oscillator scheme of NbO2-based oscillator with Li-ECRAM. (E) Real-time measurement of oscillation frequency modulation. N represents applied number of pulses in programming scheme. (F) Magnified figure of output waveform in (E). (G) Frequency modulation with applied number of pulses.
NbO2-Based Oscillator With Li-Based Electrochemical Random Access Memory Load
In the configuration of the NbO2-based oscillator with Li-ECRAM, two devices are connected in series. Figure 4D shows the operation scheme for frequency programming and oscillation. In the programming scheme, gate pulses for modulation of channel conductance are applied to the gate side of Li-ECRAM. The current is applied to the gate to determine conductance changes, and supply voltage is not applied (GND). In the oscillation scheme, the supply voltage is applied, and oscillation occurs, as shown in Figure 1D. Figure 4E shows the real-time measurement of frequency programming (programming-oscillation-programming-oscillation). First, we applied two programming pulses and then confirmed 230 kHz oscillation, as shown in Figure 4F. Nine programming pulses were applied, and the oscillator exhibited 310 kHz oscillation. In this way, the oscillation frequency can be tuned. As a result, the oscillation frequency is a function of the applied number of pulses, as shown in Figure 4G.
Results
Spoken Vowel Classification Using NbO2-Based Oscillator With Li-Based Electrochemical Random Access Memory
Using four-coupled oscillators with NbO2-based oscillators connected to Li-ECRAM, we evaluated the classification of the spoken vowel. American English vowel dataset with 5 vowels from 20 different females was used in the simulation (Hillenbrand, 1995). To utilize a coupled oscillator network for the classification of clustered data, input frequencies must be within the frequency range of an NbO2-based oscillator with Li-ECRAM. Thus, linear transformation must process formant frequencies of spoken vowels to match with the oscillator’s frequency range (Romera et al., 2018; Dutta et al., 2019), as shown in Figure 5A. The conductance of Li-ECRAMs was trained by the gradient descent learning rule mentioned in the “NbO2-based IMT oscillator” section and converged after five cycles, as shown in Figure 5B. After training, oscillation frequencies were programmed for the classifiable region of the synchronization map to catch input vowel data, as shown in Figure 5C. Figure 5D shows the classification accuracy of networks with various oscillators. In this comparison, the CMOS-based ring oscillator exhibited a non-linearity of 1.78, extracted from frequency modulation characteristics with digital input code to DAC (Nikonov et al., 2020). Due to the high non-linearity of the CMOS-based oscillator, classification accuracy is low (69%). Introducing Li-ECRAM as oscillation load with low non-linearity (0.55/–0.67), the accuracy improved by 74%. Furthermore, an accuracy of 85% was obtained by adjusting the Vhold of NbO2 for input variation immunity. In a multilayer perceptron with a similar number of trained parameters to an oscillator-based network, only an accuracy below 65% was achieved (Romera et al., 2018).
Figure 5. (A) Dataset of spoken vowel. Formant frequencies of spoken vowel is processed by linear transformation to match frequency of NbO2-based oscillator with Li-ECRAM. (B) Conductance of Li-ECRAMs as function of training iteration. After five iterations, channel conductance of Li-ECRAMs converge to the optimal value. (C) Synchronization map after training. Most of clustered data are covered by classifiable region. (D) Introducing Li-ECRAM and adjusting Vhold of NbO2, 85% classification accuracy can be obtained.
Benchmark
We benchmarked oscillators for the coupled oscillator-based spoken vowel classification system as shown in Table 1. The small number of components means the scalability of the oscillator. CMOS-based ring oscillator has additional circuitry to tune the oscillation frequency (buffer, DAC) (Nikonov et al., 2020). STO consists of a magnetic tunnel junction (MTJ) and a bias tee to separate the injection input current (Romera et al., 2018). However, IMT oscillators [VO2-based (Dutta et al., 2019) and our proposed oscillator] require only a TS device, an oscillation load (NMOS, Li-ECRAM), and a capacitor. Linear frequency modulation corresponds to the linear conductance change of our proposed oscillator. CMOS-based oscillator shows non-linear frequency modulation with digital cord input to a DAC. The VO2-based oscillator is also not linearly proportional to the gate voltage because the channel resistance is not linearly related to the gate voltage. STO shows slight linear frequency modulation to the input current amplitude. However, the proposed oscillator has linear frequency modulation characteristics. The frequency programmability is the ability to store frequency itself. Frequencies of each oscillator must have trained values in the classification process. In cases of CMOS-based, STO, and VO2-based oscillators, information about the amplitude of analog input for frequency tuning is stored in additional memory devices. However, in the case of our oscillator, the conductance of Li-ECRAM related to frequency can be stored itself. Therefore, our proposed oscillator has a simpler structure than other reported oscillators owing to the simple configuration and unnecessariness of DAC and additional memory devices. Finally, our most uncomplicated hardware system has comparable classification accuracy to other systems. Therefore, our classification system with a simple configuration, area, and energy-efficient oscillator promises for large-scale hardware implementation.
Conclusion
In this study, we identified the effect of device parameters of IMT oscillator with non-volatile analog memory device as oscillation load on the performance of coupled oscillator network. Non-linear conductance response of analog memory to identical pulses causes a divergence of conductance update in training iteration. Thus, the linear conductance response of analog memory to programming pulses was essential for the accurate training of natural frequencies. Furthermore, a narrow classifiable region of the synchronization map proportional to the synchronization window cannot cover injected input with large variation, reducing classification accuracy. Large Vhold inducing a large oscillation amplitude is required to widen the classifiable region. As a result of the investigation, Li-ECRAM as oscillation load is the potential for high network performance owing to linear conductance modulation characteristics. Finally, we evaluated the oscillatory network for spoken vowel classification with an NbO2-based IMT device and Li-ECRAM, achieving high classification accuracy (85%).
Data Availability Statement
The original contributions presented in this study are included in the article/supplementary material, further inquiries can be directed to the corresponding author/s.
Author Contributions
All authors listed have made a substantial, direct, and intellectual contribution to the work and approved it for publication.
Funding
This work was supported by the National Research Foundation of Korea (NRF) under grant 2018R1A3B1052693.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Acknowledgments
The EDS tool was supported by IC Design Education Center (IDEC), South Korea.
References
Bhansali, P., and Roychowdhury, J. (2009). “Gen-Adler: The generalized Adler’s equation for injection locking analysis in oscillators,” in Proc. IEEE Asia and South Pacific Design Automation Conference (Piscataway: IEEE). doi: 10.1109/ASPDAC.2009.4796533
Chen, P. Y., Peng, X., and Yu, S. (2017). “NeuroSim+: An integrated device-to-algorithm framework for benchmarking synaptic devices and array architectures”. 2017 IEEE International Electron Devices Meeting (IEDM) (Piscataway: IEEE). doi: 10.1109/IEDM.2017.8268337
Chen, P. Y., Seo, J., and Yu, S. (2016). Compact Oscillation Neuron Exploiting Metal-Insulator-Transition for Neuromorphic Computing. Proc. IEEEE/ACM Int. Conf. Comput.-Aided Design (ICCAD).
Dutta, S., Khanna, A., Assoa, A. S., Paik, H., Schlom, D. G., Toroczkai, Z., et al. (2021). An Ising Hamiltonian solver based on coupled stochastic phase-transition nano-oscillators. Nat. Elec. 4, 502–512. doi: 10.1038/s41928-021-00616-7
Dutta, S., Khanna, A., Chakraborty, W., Gomez, J., Joshi, S., Datta, S., et al. (2019). “Spoken vowel classification using synchronization of phase transition nano-oscillators”. 2019 Symposium on VLSI Circuits T128–T129.(Piscataway: IEEE). doi: 10.23919/VLSIC.2019.8777988
Fuller, E. J., Gabaly, F. E., Leonard, F., Agarwal, S., Plimpton, S. J., Jacobs-Gedrim, R. B., et al. (2017). Li-ion synaptic transistor for low power analog computing. Adv. Mater. 29:1604310. doi: 10.1002/adma.201604310
Hillenbrand, J. M. (1995). American English Vowels Database. Available online at: https://homepages.wmich.edu/~hillenbr/voweldata.html
Lee, D., Cha, E., Park, J., Sung, C., Moon, K., and Hwang, H. (2018). “NbO2-Based Frequency Storable Coupled Oscillators for Associative Memory Application”. IEEE Journal of the Electron Devices Society, 6, 250–253. doi: 10.1109/JEDS.2018.2793342
Lee, D., Kwak, M., Moon, K., Choi, W., Park, J., Yoo, J., et al. (2019). Various threshold switching devices for integrate and fire neuron application. Adv. Electron Mater 5:1800866. doi: 10.1002/aelm.201800866
Lee, D., Lee, J., Lee, S., Lee, C., Heo, S., and Hwnag, H. (2022). “Novolatile Frequency-Programmable Oscillator with NbO2 and Li-based Electro-Chemical Random Access Memory for Coupled Oscillator-Based Temporal Pattern Recognition System”, IEEE Electron Device Letters (Piscataway: IEEE). doi: 10.1109/LED.2022.3172124
Lee, M., Cho, S., Kim, S., Kwak, J., Ju, H., Yi, Y., et al. (2020). Simple artificial neuron using an ovonic threshold switch featuring spike frequency adaptation and chaotic activity. Phys. Rev. Appl. 13:064056. doi: 10.1103/PhysRevApplied.13.064056
Levitan, S. P., Fang, Y., Dash, D. H., Shibata, T., Nikonov, D. E., and Bourianoff, G. I. (2012). “Non-Boolean associative architectures based on nano-oscillators”. 2012 13th International Workshop on Cellular Nanoscale Networks and their Applications (Piscataway: IEEE), 1–6. doi: 10.1109/CNNA.2012.6331473
Mead, C. (1990). “Neuromorphic electronic systems”, Proceedings of the IEEE (Piscataway: IEEE). doi: 10.1109/5.58356
Niklasson, G. A., Berggren, L., and Larsson, A.-L. (2004). Electrochromic tungsten oxide: the role of defects. Sol. Energy Mater. Sol. Cells 84, 315–328. doi: 10.1016/j.solmat.2004.01.045
Nikonov, D. E., Csaba, G., Porod, W., Shibata, T., Voils, D., Hammerstrom, D., et al. (2015). “Coupled-oscillator associative memory array operation for pattern recognition.” IEEE Journal on Exploratory Solid-State Computational Devices and Circuits (Piscataway: IEEE), 85–93. doi: 10.1109/JXCDC.2015.2504049
Nikonov, D. E., Kurahashi, P., Ayers, J. S., Li, H., Kamgaing, T., Dogimis, G. C., et al. (2020). “Convolution Inference via Synchronization of a Coupled CMOS oscillator Array.” IEEE Journal on Exploratory Solid-State Computational Devices and Circuits (Piscataway: IEEE), 170–176. doi: 10.1109/JXCDC.2020.3046143
Park, J., Hadamek, T., Posadas, A. B., Cha. E., Demkov, A. A., and Hwang, H. (2017). Multi-layered NiOy/NbOx/NiOy fast drift-free threshold switch with high Ion/Ioff ratio for selector application. Sci. Rep. 7, 1–8. doi: 10.1038/s41598-017-04529-4
Parihar, A., Shulka, N., Jerry, M., Datta, S., and Raychowdhury, A. (2017). Vertex coloring of graph via phase dynamics of coupled oscillatory networks. Sci. Rep. 7, 1–11. doi: 10.1038/s41598-017-00825-1
Romera, M., Talatchian, P., Tsunegi, S., Araujo, F. A., Cros, V., Bortolotti, P., et al. (2018). Vowel recognition with four coupled spin-torque nano-oscillators. Nature 563, 230–234. doi: 10.1038/s41586-018-0632-y
Shibata, T., Zhang, R., Levitan, S. P., Nikonov, D., and Bourianoff, G. (2012). “CMOS Supporting Circuitries for Nano-Oscillator-Based Associative Memories”. 2012 13th International Workshop on Cellular Nanoscale Networks and their Applications (Piscataway: IEEE) 29–31. doi: 10.1109/CNNA.2012.6331464
Tang, J., Bishop, D. M., Kim, S., Copel, M., Gokmen, T., Todorov, T., et al. (2018). “ECRAM as scalable synaptic cell for high-speed, low-power neuromorphic computing”. 2018 IEEE International Electron Devices Meeting (IEDM) (Piscataway: IEEE) doi: 10.1109/IEDM.2018.8614551
Tsai, H., Ambriogio, S., Narayanan, P., Shelby, R. M., and Burr, G. W. (2018). Recent progress in analog memory-based accelerators for deep learning. J. Phys. D: Appl. Phys. 51:283001. doi: 10.1088/1361-6463/aac8a5
Keywords: oscillatory neural network, coupled oscillator, insulator-metal transition, electro-chemical random access memory, spoken vowel, classification of spoken vowel
Citation: Lee D, Kwak M, Lee J, Woo J and Hwang H (2022) Linear Frequency Modulation of NbO2-Based Nanoscale Oscillator With Li-Based Electrochemical Random Access Memory for Compact Coupled Oscillatory Neural Network. Front. Neurosci. 16:939687. doi: 10.3389/fnins.2022.939687
Received: 09 May 2022; Accepted: 03 June 2022;
Published: 30 June 2022.
Edited by:
Shimeng Yu, Georgia Institute of Technology, United StatesReviewed by:
Yao-Feng Chang, Intel, United StatesDashan Shang, Institute of Microelectronics (CAS), China
Copyright © 2022 Lee, Kwak, Lee, Woo and Hwang. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Hyunsang Hwang, aHdhbmdoc0Bwb3N0ZWNoLmFjLmty