- 1College of Information Engineering and Automation, Haihang Building, South Campus, Civil Aviation University of China, Tianjin, China
- 2Tianjin Binhai International Airport, Tianjin, China
Memristor is a kind of synaptic element with nanometer size and continuously variable memristance. The bridge synaptic circuit constructed by the memristor has a simple structure and precise control. In practice, because of the non-linear characteristics of memristor, it is not easy to control synaptic circuit and errors in weights appear. Therefore, a novel memristor synaptic circuit is proposed in this paper, called the dual-mode memristor bridge synaptic neural network. The proposed method can make the weights more linear by controlling the input voltages and make the outputs more linear by using symmetrical positive and negative pulses. Therefore, the proposed synaptic circuit is easier to be controlled. In this paper, the numerical simulations are conducted and verify the feasibility. Furthermore, the simulation experiments are conducted for edge extraction of grayscale birds’ images in the airport for bird recognition applied for the bird repelling applications.
Introduction
Artificial neural networks have always been a hot field of research. Since the human brain has hundreds of millions of neurons and synapses [1], it is very important to realize synaptic circuits in order to build a machine similar to the brain. Due to the dynamic characteristics of synapses and the requirements of nanometer size, it is difficult to make breakthroughs. It was not until the emergence of the memristor that it brought new developments in the fields of electronics and neuroscience [2]. Memristor is a basic circuit element proposed by Professor S. T. Cai in 1971 based on the complete principle of the circuit theory system. In 2008, scientists working in the HP laboratory developed a physical model of the memristor [3] and verified the memristor’s passiveness, non-linearity, nano-scale size, information non-volatility, and other characteristics through physical experiments. Because the memristor has unique physical characteristics, it can be used in many fields such as artificial neural networks and image processing [4–7].
In artificial neural networks, a large number of research results indicate that the memristor can be used to simulate artificial synapses [8, 9]. Furthermore, because of its characteristics, the memristor synaptic circuits are promising. Among them, the most widely studied analog synapse structure is a memristive bridge structure, which has the advantages of simple structure, precise control, and high integration. In the cellular neural network [10], weight simulation can be realized by digital multiplication circuits and analog multiplication circuits. For the traditional CMOS digital multiplication circuits, they occupy large areas and consume a lot of energy. However, the bridge synapse circuits constructed by the memristor are simple and convenient and have high efficiency and low energy consumptions. There are two types of classic memristive bridge synaptic circuits, called type I memristive bridge circuit and type Ⅱ memristive bridge circuit. Literature [11] proposed the synaptic bridge circuit composed of four identical memristors. The synaptic weight simulations are realized by controlling the relationship among four memristors. This structure can realize three types of synaptic weights such as positive, negative, and zero. Literature [12] proposed the synaptic bridge circuit composed of five identical memristors. Four memristors are used to control the weight whether positive or negative, and the last memristor realizes the simulation of synaptic weights. The circuit cannot achieve zero synaptic weight. At the same time, literature [12] also mentioned the phenomenon of non-linearization of the memristance for the simulated synapse circuit, which will cause errors of the weight in the simulation. In literature [13], the bipolar pulse method is used to overwhelm the non-linearity of the memristance. However, it uses a synaptic bridge circuit composed of five identical memristors, which cannot be expressed as zero for synaptic weight. Literature [14] proposed a bridge synaptic circuit composed of three identical memristors and two MOS transistors, which made up the deficiency that the weight of synaptic circuits could not be zero composed of five identical memristors; however, it does not overwhelm the non-linearization of the memristor. The hardware realization for image processing has great meaning for bird repelling application for airports. Because the memristor has the characteristics of low energy consumption and fast processing speed, the neural network along with the memristor for image processing has the advantages of simple structure, low energy consumption, and fast processing speed in hardware implementation, and it can effectively solve the task of image processing of bird images in order to assist bird repelling.
Edge extraction is one of the fundamental tasks in computer vision. There are many effective and efficient methods to solve this problem; however, these methods have high complexity and are difficult to implement in hardware. Therefore, the method that combines the memristor and neural network can not only meet the hardware implementation but also complete the edge extraction tasks for vision or image processing [15–18]. Literature [17] established a neural network with memristive bridge synapses and used networks to process gray-scale images. Literature [18] proposed a memristive cellular neural network that combines a memristive device and a cellular neural network, through which the edges of color pictures can be extracted effectively. However, the above-mentioned literature adopted linear memristor models, without considering the non-linear factors of memristors.
Bird strikes are huge threats for modern civil aviation which bring about huge amounts of harm for life and economic losses. Therefore, researchers and relevant departments are currently eager to find suitable bird repellent methods. The current bird repelling generally depends on the radar to obtain bird information and then uses the corresponding bird repelling equipment. However, the information shown on the radar is only associated with approximate bird flying directions and cannot identify the type and the number of birds. The more the detailed bird information obtained, the more effective the targeted bird repelling methods adopted. The image processing method can identify bird species and the number of birds counting according to birds' images flying around or through the airports.
The main contribution of this paper is to propose a new dual-mode memristive bridge synaptic circuit to simulate synaptic weights and construct a dual-mode memristive bridge synaptic neural network by combining the dual-mode memristive bridge synaptic circuit with the cellular neural network. Furthermore, the proposed network is applied to edge extraction for images. The proposed method can better solve the weight simulation errors caused by non-linear memristor, thus speeding up the edge extraction and improving the accuracy of obtaining the cellular neural network template.
The paper is arranged as follows. In Preliminary, the linear and non-linear memristors are modeled mathematically, and the corresponding simulations are conducted. Synaptic Circuit-Based on Memristor proposes a new type of memristive bridge synapse circuit and a dual-mode memristive bridge synapse circuit. These two circuits, respectively, overwhelm the non-linearization of the synapse weights and output voltages to reduce the weight simulation errors. In the Dual-Mode Memristive Synaptic Neural Network and its Application in Image Processing, this paper introduces a dual-mode memristive bridge neural network, the corresponding method is performed on bird images. The last section concludes the paper.
Preliminary
HP Memristor Model
The physical model of the HP memristor is shown in Figure 1. It is composed of two layers of titanium dioxide (TiO2) film sandwiched between two metal platinum electrodes.
Based on the definition in literature [3], the resistance value of the HP memristor, M(t), is defined as
where ω(t) is the thickness of the current doped layer and D is the total thickness of the two TiO2 films.
For an ideal memristor model, its ion drift model is
where
Since the physical memristor is a nanometer-sized circuit component, the memristor can generate a huge electric field when applying a tiny voltage. Therefore, the ion movement inside the memristor owns significant non-linear characteristics. Therefore, when Eq. 3 is multiplied by the non-linear window function, Eq. 3 is rewritten as
where f(x) is the window function.
The window function used in this paper is [4]
where p is a positive integer and p is used to describe the degree of non-linearity. This paper selects p = 1 as the window function for obvious non-linearity analysis.
Mathematical models of controlled memristor mainly include two kinds. One is a charge-controlled memristor, and the other is a magnetic flux-controlled memristor. This paper mainly introduces charge-controlled linear memristor and non-linear memristor.
Mathematical Model of Charge-Controlled Linear and Non-Linear Memristor
According to the equation
where M (0) is the initial memristance which is
According to the equation
where
Numerical Simulations
This section will use MATLAB to simulate characteristics of the two types of memristors mentioned in the above section. The parameters of the two types of memristors are listed as follows:
Figure 2 shows the relationship between the memristance changes and the amount of charge or flux for different types of linear and non-linear memristor models. The characteristic curve of the non-linear memristor tends to the physical experiment result provided in [12] which shows that the mathematical model of the non-linear memristor is reasonable.
Figure 3 shows that the non-linear charge-controlled memristor model also has a hysteresis effect. Furthermore, both models demonstrate the typical current-voltage hysteresis loop of the memristor with i = 2 × 10−4sin(2πt).
FIGURE 3. The hysteresis loop of the HP memristor under i = 2 × 10−4sin(2πt) for linear and non-linear charge-controlled memristor models.
Synaptic Circuit-Based on Memristor
Dual-Mode Memristor Synaptic Circuit
This paper designs a dual-mode memristor bridge circuit as shown in Figure 4.
In Figure 4, the dual-mode switching is realized by a single-pole double-throw switch S1. Switch S1 has two interfaces K1 and K2 and a pulse conversion control signal interface. The control signal interface is imposed by signal PA which makes S1 switch between K1 and K2 for control and output modes. The positive and negative pulses are generated by switching through single-pole double-throw switches S2 and S3 and single-pole single-throw switch S4. Switch S2 has two interfaces K3, K4, and switch S3 has two interfaces K5, K6; the two-pulse conversion control signal interface is imposed by signals PB and PC, respectively. The single-pole single-throw switch S4 has a pulse conversion control signal interface imposed by the pulse control signal PD. The portion of the circuit for obtaining the output voltage is composed of MOS transistors T1 and T2. The turn-on voltages of the MOS transistors T1 and T2 are both VT, and the gate voltages of the two transistors are both V1. In the control phase, in order to obtain the zero output voltage, let V1<VT. Otherwise, in the output phase, let V1>VT. The conditions of switches in the two modes are shown in Table 1.
There are two modes of dual-mode memristor bridge synaptic circuit, control mode, and output mode. The control mode is to make the non-linear memristor reach the required memristance faster so that the memristor can obtain the required synapse weights. The output mode is to obtain the required output with the minimum influence on the memristor’s change. The dual-mode memristor bridge synapse circuit is an improvement of the type I memristive bridge circuit as shown in Figure 5.
As shown in Figure 4, in the control mode, the equations for calculating the memristances of M1-M4 in the control phase are listed as follows:
In the output mode, when the input voltage is VinN, the output voltage equation of the dual-mode memristor bridge synaptic circuit as shown in Figure 4 is derived as Eq. 13 according to the voltage division Eqs 14, 15:
Let
where ω satisfies
Control Mode and Output Mode Algorithm
According to Eqs 9–12, we can know there are two methods to make the synaptic weight change more linear for the non-linear memristor. One is to increase the duration of tv with the input Vin unchanged. The other is to change the input Vin and keep the duration of tv unchanged. Because of the timeliness requirement of the synapse circuit, the paper employs the method by varying the input Vin in the control mode.
In order to obtain the more accurate models, this paper uses the simulated annealing method random search algorithm to select a suitable input Vin because of its simple structure and the fast search speed.
When the input Vint is sampled in a sufficiently small interval, Ts, by dividing the duration of tT. Then, the simulated annealing method can be used to obtain a more accurate input voltage Vint. This method is applied to the memristive bridge synapse circuit as shown in Figure 4.
The detailed specific steps are listed as follows.
Step 1: Set the initial input voltage Vint, temperature T, end temperature Tz, the maximum number of iterations L for each temperature T, the interval time Ts and the maximum value of the input voltage that is changed at each moment through measurement. The input voltage is selected at each moment between the initial input voltage and the maximum voltage.
Step 2: T = jT, j is the descent rate and j∈(0, 1), n is the number of iterations. To obtain the evaluation function for each iteration,
Step 3: Select a new input voltage Vin at time tT randomly within the set voltage range. Then, calculate the memristances and evaluation function of the non-linear memristor
Step 4: If
Step 5: If
Step 6: If
Step 7: If n < L, return to Step 3.
Step 8: If T < Tz, terminate the algorithm; otherwise return to Step 2.
According to the above steps, the same parameters of memristors are set for the non-linear memristor and the linear memristor bridge synapse circuits as shown in Eq. 8.
As shown in Figure 6, when the simulated annealing method selects an accurate input voltage, the memristance M1 coming from the non-linear memristive bridge synapse circuit can be significantly linearized.
FIGURE 6. The memristance M1 comparison among the linear and non-linear memristor models with and without using improved simulated annealing method.
It can be seen from Figure 7 that the output voltage of the non-linear memristor bridge synapse circuit is not linear by using improved simulated annealing method, and the absolute values of output voltages are much greater than those of the linear memristor bridge synapse circuit as the time goes further because of non-linearity of the input voltage.
FIGURE 7. The output voltage changes for linear and non-linear memristor models with and without using improved simulated annealing method.
As mentioned above, when an input voltage or current works on the memristor, the memristance will change. However, if positive and negative pulses are applied on the memristor, the effect of input voltage applied on memristance can be reduced according to the memristance measurement method mentioned in [19]. Therefore, the output mode must be able to automatically switch the voltage direction as shown in Figure 4. As illustrated in Table 1 and Figure 4, in the positive pulses, the current flows from C to D, and the output voltage is obtained. In the negative pulse, the current flows from D to C, which is opposite to the current flow of the positive pulse, and no voltage is outputted.
According to Eqs 8–16, the output voltage changes for models are obtained and shown in Figure 8.
FIGURE 8. The comparison of output voltages for linear memristor circuit (the blue line), non-linear memristor circuit with improved simulated annealing method (the red line) and with dual modes (the orange line).
As shown in Figure 8, the red line represents the output voltage for the non-linearity because only the control mode works. If the output mode is added, the line of output voltages becomes more linear as shown in the orange line. This simulation verifies that the dual-mode memristor synapse circuit can realize that both synapse weights and the output voltages can be linearized. The speed of obtaining weights can be accelerated by using the proposed method mentioned in this paper.
Dual-Mode Memristive Synaptic Neural Network and Its Application in Image Processing
Dual-Mode Memristive Synaptic Neural Network
Based on the analyses in the previous section, dual-mode memristive bridge synapses can more efficiently simulate weights which can be applied to image processing template operators in cellular neural networks. The cellular neural network uses different template operators to transform the input image into the desired output image. Therefore, the synaptic circuit mentioned in the previous section can be used to construct a new type of memristive bridge neural network, which can be employed in image processing. Since the input of the traditional memristive bridge neural network is a fixed value, the memristor exhibits non-linearity which forms the template slowly, and the synapse weight difference is big. Therefore, the dual-mode memristive synaptic neural network can shape the template faster with higher accuracy compared to the traditional memristive bridge neural network.
As shown in Figure 9, the circuit is mainly divided into three parts such as dual-mode memristive bridge synaptic circuit, differential pair circuit, and effective load circuit.
1) Dual-mode memristive bridge synaptic circuit
FIGURE 9. Dual-mode memristive bridge synaptic neural network. (A) Dual-mode memristive bridge synaptic circuit. (B) Differential pair circuit. (C) Effective load circuit.
As shown in Figure 9A, this synapse circuit in the control mode changes the input voltage to make the synapse weight change like a linear trend. In the output mode, by generating symmetrical positive and negative pulses, the synaptic weight of the memristive synapse circuit is minimally affected, and the expected template operator can be obtained faster. The entire neural network is composed of multiple dual-mode memristive bridge synaptic circuits, and the synaptic circuits are independent of each other.
2) Differential pair circuit
As shown in Figure 9B, the differential circuit is located on the right side of the dual-mode memristive bridge synapse circuit, which is a differential amplifier composed of transistors. The corresponding function is to convert the output voltage of the dual-mode memristive bridge synapse circuit into current.
3) Effective load circuit
As shown in Figure 9C, the effective load circuit is located on the right side of the differential pair circuit. It is connected in series with each dual-mode memristive bridge synaptic circuit. This circuit coverts the current coming from the differential pair circuit into the voltage signal through the resistive load.
Application in Image Processing
In the field of bird repelling for airports, bird characteristics recognition requires edge extraction from bird images. This paper combines a dual-mode memristive bridge synaptic neural network with a cellular neural network template to realize the edge extraction of these pictures. The commonly used cellular neural network template is 3 × 3, so this paper uses the synaptic neural network with nine dual-mode memristive bridges as shown in Figure 9 to implement. In each circuit, the corresponding output value can be obtained by inputting different pulse signals.
The template based on edge extraction includes
The parameters of the memristor in Figure 9 are listed in Eq. 8. The parameters of MOS tube in Figure 9 is VT = 3v.
The pixels of an image with M×N are inserted into a cellular neural network with a template size of 3 × 3; the pixels are iterated according to the following equation:
where vx is the state value, vy is the output value, and vu is the input value, 1 ≤ i ≤ M, 1 ≤ j ≤ N,
When |vx|>1, stop iteration and output vy.
Figure 10A shows the results of edge extraction by using the non-linear memristive bridge synaptic circuit. The results of edge extraction of bird image are realized by using this template for the dual-mode memristive bridge synaptic neural network as shown in Figure 10B. The response speed of edge extraction is faster for the dual-mode memristive bridge synaptic neural network than that of the non-linear memristive circuit. The comparison of some indexes of the two methods is shown in Table 2.
FIGURE 10. Comparison of edge extraction results for two different methods. (A) Edge extraction results by using a traditional non-linear memristive bridge synaptic neural network. (B) Edge extraction results by using a dual-mode memristive bridge synaptic neural network.
As shown in Figure 10, the iteration times, t, for obtaining templates by using the proposed dual-mode memristive bridge synaptic neural network are between 30 and 40, while the iteration times for obtaining templates in using traditional non-linear memristive bridge synaptic neural network are between 40 and 50. It is obvious that the dual-mode memristive bridge synaptic neural network is faster than the traditional non-linear memristive bridge synaptic neural network for templates recognized.
In this paper, the performance index FOM (Figure Of Merit) will be used to quantitatively compare different edge extraction algorithms, where the FOM equation is listed as follows:
where Qi is the number of edge pixels of the original template. Qt is the actual number of edge pixels detected.
According to Table 2, it can be seen that the FOM value obtained by the proposed method in this paper is larger than that of the traditional method, indicating that the edge extraction effect of the proposed method is better. The iteration times of the proposed method are also smaller than those of the traditional method. Therefore, compared to the traditional non-linear memristive bridge synaptic neural network, the dual-mode memristive bridge synaptic neural network has a more efficient performance in edge extraction.
Conclusion
This paper analyzes the memristance changes of different types of linear and non-linear memristor models in theory and verifies that the memristance changes of non-linear memristor models are much closer to the physical characteristics. Then, the paper proposes that the synaptic weight can be linearized by changing the input voltage for the non-linear memristive bridge synaptic circuits. Thus, the paper designs a method for the precise input voltage based on the simulated annealing method to make the change of the non-linear memristive bridge synaptic circuit more linear. However, when the input voltage is changed, the corresponding output voltage is also changed, and the non-linearity is aggravated. Therefore, a dual-mode memristive bridge synaptic circuit is proposed because the symmetrical positive and negative pulses put the least effects on the synaptic weight which makes the output voltages and synapse weights linearized. Finally, a dual-mode memristive bridge synapse circuit is used to form the proposed neural network in this paper which is used to extract edges for bird images. According to the simulation results, the response time and the weights of the dual-mode memristive bridge synaptic neural network performs faster and more precisely than those of the traditional one. Therefore, the dual-mode memristive bridge synaptic circuit neural network is expected to be more real-time and to solve more complex image processing.
Data Availability Statement
The original contributions presented in the study are included in the article/supplementary material; further inquiries can be directed to the corresponding author.
Author Contributions
RW and ZZM designed the research. HS and YYW guided the research. All authors contributed to the interpretation of the results, discussions, and editing of the manuscript. Furthermore, all authors have read and agreed to the published version of the manuscript.
Funding
This work was supported by the Civil Aviation Science and Technology Project (MHRD20150220).
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors, and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
1. Deng YB (2021). Brain-like Computing and Neural Morphologic Devices with Circuits. Appl Res Comput 38 1–12. [2021-07-08]. doi:10.19734/j.issn.1001-3695.2020.04.0349
2. Chua L (1971). Memristor-the Missing Circuit Element. IEEE Trans Circuit Theor 18: 507–19. doi:10.1109/tct.1971.1083337
3. Strukov DB, Snider GS, Stewart DR, Williams RS (2008). The Missing Memristor Found. Nature 453: 80–3. doi:10.1038/nature06932
4. Lin H, Wang C, Hong Q, Sun Y (2020). A Multi-Stable Memristor and its Application in a Neural Network. IEEE Trans Circuits Syst 67(12): 3472–6. doi:10.1109/tcsii.2020.3000492
5. Wang CH (2020). Research Progress on Chaos, Memory and Neural Network Circuits Based on Memristor. J Electro Inf Techn 42(4): 795–810. doi:10.11999/JEIT190821
6. Shang M, Wang X, Li M (2020). A Memristor-Based Generalization and Differentiation Circuit Design and the Application in Recognition). 2020 39th Chinese Control Conference (CCC), Shenyang, China, July 27–29, 2020. doi:10.23919/CCC50068.2020.9189222
7. Pannu JS, Raj S, Fernandes SL, Chakraborty D, Rafiq S, Cady N, et al. (2020). Design and Fabrication of Flow-Based Edge Detection Memristor Crossbar Circuits1.IEEE Trans Circuits Syst 67(5):961–965. doi:10.1109/tcsii.2020.2984155
8. Tan Y, Wang C (2020). A Simple Locally Active Memristor and its Application in HR Neurons.Chaos 30(5, 053118). doi:10.1063/1.5143071
9. Meng FY, Shu-Kai D, Li-Dan W, Xiao-Fang H, Zhe-Kang D, (2015). An Improved WOx Memristor Model with Synapse Characteristic Analysis. Acta Phys Sin 64: 148501. 10.7498/aps.64.148501
10. Chua LO, Yang L (1988). Cellular Neural Networks: Theory. IEEE Trans Circuits Syst 35: 1257–72. doi:10.1109/31.7600
11. Kim H, Sah MP, Yang C, Roska T, Chua LO (2012). Memristor Bridge Synapses. Proc IEEE 100: 2061–70. doi:10.1109/jproc.2011.2166749
12. Kim H, Sah M, Yang C, Roska T, Chua LO, (2011). Neural Synaptic Weighting with a Pulse-Based Memristor Circuit. IEEE Trans Circ Syst Regular Pap 59: 148–58. doi:10.1109/tcsi.2011.2161360
13. Guang F (2017). Research and Application if Neural Network Circuit Based on Memristor Bridge Synapse. [master’s thesis]. Chongqing (China): Southwest University.
14. Chen J (2018). Memristor Electronic Synapse-Based Neural Network and its Application. [master’s thesis]. Chongqing (China): Southwest University.
15. Wen CB (2020). Design of a Global-Value Perceptual Neuron Based on Memristor. Chin J Sensors Actuators 33(09):1299–304. 10.3969 /j.issn.1004–1699.2020.09.012
16. Tang H (2020). Research on Design of Memristive Multilayer Neural Network and its Application. [Master’s thesis]. Chengdu (China): University of Electron Science and Technology of China.
17. Dong Z (2019). Memristor Based Circuit Analysis and its Applications in Neuromorphic Systems. [Dissertation]. Hangzhou (China): Zhejiang University.
Keywords: memristor, synaptic circuit, image processing, cellular neural network, recognition
Citation: Wang R, Mu Z, Sun H and Wang Y (2021) Dual-Mode Memristor Synaptic Circuit Design and Application in Image Processing. Front. Phys. 9:690944. doi: 10.3389/fphy.2021.690944
Received: 05 April 2021; Accepted: 05 July 2021;
Published: 18 August 2021.
Edited by:
Viet-Thanh Pham, Phenikaa University, VietnamCopyright © 2021 Wang, Mu, Sun and Wang. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Hui Sun, aC1zdW5AY2F1Yy5lZHUuY24=