- 1Department of Civil, Chemical, Environmental, and Materials Engineering (DICAM), University of Bologna, Bologna, Italy
- 2Department of Structural Engineering, University of California, San Diego, San Diego, CA, United States
- 3Active, Responsive, Multifunctional, and Ordered-materials Research (ARMOR) Laboratory, University of California San Diego, La Jolla, CA, United States
Pressure mapping has garnered considerable interest in the healthcare and robotic industries. Low-cost and large-area compliant devices, as well as fast and effective computational algorithms, have been proposed in the last few years to facilitate distributed pressure sensing. One approach is to use electrical impedance tomography (EIT) to reconstruct the contact pressure distribution of piezoresistive materials. While tremendous success has been demonstrated, conventional algorithms may be unsuitable for real-time monitoring due to its computational demand and runtime. Moreover, the low resolution of reconstructed images is a well-known issue related to the regularization strategies typically employed for traditional EIT methods. Therefore, in this study, two different supervised machine learning (ML) approaches, namely, radial basis function networks and deep neural networks, were employed to efficiently solve the inverse EIT problem and improve the resolution of reconstructed pressure maps. The demonstration of high-resolution pressure mapping, specifically, for identifying pressure hotspots, was achieved using a carbon nanotube-based thin film integrated with foam.
1 Introduction
An ever-increasing number of devices, mainly in healthcare and robotic industries, employ pressure mapping strategies to visualize the contact distribution on its sensing surfaces. For instance, pressure sensing can detect prolonged localized pressures in patients with limited mobility who may develop ulcers due to the difficulty of shifting their weight. Such ulcers can cause tissue necrosis and can lead to death in the most severe cases. Another example is that pressure mapping is largely employed in the automation field to mimic the feeling of touch in sophisticated human-inspired robots. In these applications, high mapping resolution and real-time sensing are of primary importance.
Conventional pressure mapping systems often employ dense grids of discrete transducers or electrodes. In these cases, the mapping resolution is proportional to the density, complexity, and cost of the distributed transducers (Wu et al., 2016; Nela et al., 2018). The need to overcome these limitations, as well as to achieve miniaturization and conformability to complex surfaces, have motivated the development of pressure sensing systems in the form of films (Shirinov and Schomburg, 2008; Nela et al., 2018), textiles (Ryu et al., 2018; Kim et al., 2019), paint (Li et al., 2021), and foams (Wu et al., 2016). Many of these pressure-sensitive materials have been made possible by leveraging the unique material properties of carbon nanotubes (Huang et al., 2017; Nela et al., 2018; Kim et al., 2019; Li et al., 2021), carbon black (Wu et al., 2016), graphene nanosheets (Tao et al., 2017), and conductive polymers (Shirinov and Schomburg, 2008; Ding et al., 2018), among many others (Zang et al., 2015).
Recently, several studies have demonstrated the efficacy of electrical impedance tomography (EIT) and electrical resistance tomography (ERT) for inferring the conductivity distribution of a surface or a solid using only boundary voltage measurements (Gupta et al., 2017; Duan et al., 2019; Tallman and Smyl, 2020; Li et al., 2021; Lin et al., 2021). For this reason, one of the first applications of EIT has been for noninvasive medical imaging, such as for assessing regional lung aeration (Frerichs et al., 2017). On the other hand, recent studies in the mechanical and civil engineering fields have shown how EIT can be effectively employed to detect material discontinuities and strain states that alter the original conductivity of the inspected material (Loh et al., 2009). Because conductivity is pre-calibrated to applied strains, the resulting conductivity distribution of piezoresistive materials can be used to directly visualize the magnitudes and locations of strain concentrations or distributions of strain. In this context, several fabric-based devices were proposed for pressure sensing (Yao and Soleimani, 2012; Duan et al., 2019; Lee et al., 2021; Lin et al., 2021). For instance, Yao and Soleimani (2012) presented a knitted fabric whose conductivity increases with applied pressure. EIT conductivity mapping was employed to identify pressure distributions. Wang et al. (2016) proposed a nanocomposite sensitive fabric. Specifically, a piezoresistive multi-walled carbon nanotube-latex thin film was integrated with flexible fabric. The identification of pressure hotspots was confirmed, and the sensing performance of this device was found to be stable even after handwashing. More recently, Dai and Thostenson (2019) used EIT to map pressure distributions on a relatively large sensing device made of a nonwoven elastomeric composite coated with carbon nanotubes. Out-of-plane loads induced in-plane Poisson expansion of the coated sensing material and showed acceptable resolution performance. Liu et al. (2021) employed a flexible hydrogel-based sensor to reconstruct high-resolution pressure maps. Although some of these materials can be easily produced in laboratories, the dimensions of the sensing area must be known during the fabrication process. As a consequence, these sensing devices are case-specific, and different applications require custom fabrication.
Since the inverse problem in EIT typically involves least squares-based methods, these conventional algorithms may be unsuitable for real-time pressure mapping due to the extensive computational runtime of matrix inversion operations. Moreover, the low resolution of reconstructed images is a well-known issue related to the regularization strategies typically employed by these EIT methods. Instead, machine learning (ML)-based techniques have been applied to solve the strongly nonlinear EIT problem, mainly in the medical field. Duan et al. (2019) applied machine learning to correct the pressure distribution of fabric using the spatiotemporal total variation algorithm and confirmed near-real-time pressure mapping. Lin et al. (2020) showed that an end-to-end artificial neural network (ANN) approach is faster and generally provides more accurate results with respect to hybrid procedures that employ ML to solve parts of the traditional algorithms, although being less general. Radial basis function networks (RBFNs) have demonstrated excellent generalization capabilities and require a small computational footprint to operate, which has thus become particularly suitable for mobile sensing applications. In addition, Wang et al. (2021) has also shown the superior robustness of RBFNs to noise. Husain et al. (2021) recently proposed a tactile sensing solution employing an RBFN followed by segmentation techniques for object recognition. However, end-to-end solutions based on RBFNs that exploit their low computational cost are still rarely used due to the typical low resolution of the outcome.
This study aims to build on the rich body of work in ML-based EIT methods and to compare the spatial conductivity mapping performance of end-to-end RBFN and deep ANN versus the “traditional” total variation method (TV) (Holder, 2004). In particular, the focus is on reconstructing the strain distribution of a smart foam for pressure hotspot monitoring applications. A pressure-sensitive smart foam was prepared by integrating a piezoresistive carbon nanotube-based thin film with a commercially available foam. Different from other sensing devices, in this case, the sensing film is obtained simply by spray-coating the substrate with an airbrush. This solution is thus easily scalable, since the area and shape of the sensing region only depend on the geometry of the substrate.
Pressure sensing tests were performed, while EIT boundary voltage measurements were acquired for different scenarios. The same datasets were used and processed by the RBFN, ANN, and TV-based algorithms to obtain the corresponding conductivity maps for comparison. For the ML-based approaches, a data normalization strategy and noise-assisted regularization process were proposed to obtain robust and accurate conductivity reconstruction.
2 Electrical Impedance Tomography Background
EIT is a soft-field imaging method that uses applied electrical excitations and measurements obtained along the boundaries of a conductive body to estimate its distribution of electrical properties. In short, EIT consists of the forward and inverse problems. The former involves calculating the voltage distribution on the boundary of the interrogated body when the boundary electrical excitation and the spatial conductivity properties of the body itself are known a priori. On the other hand, the inverse problem consists of estimating the conductivity distribution using boundary current excitations and voltage measurements. The EIT inverse problem can be solved when an alternating current excitation is applied and both voltage magnitudes and phases are recorded. In the case of a direct current (DC) excitation, the EIT problem specializes to become electrical resistance tomography (ERT).
2.1 ERT Forward Problem
Let
Let
In this study, electrical current and voltage were applied and measured, respectively, at discrete electrodes, using a finite element (FE) model. In a FE formulation, the region in which the problem is solved is segmented into a finite number of elements. A collection of these elements is herein called “mesh,” and this work employed linear triangular elements. In the FE solution, a weak formulation of the differential Eq. 1 was solved at the mesh nodes using the complete electrode model (CEM) (Holder, 2004). The solution was thus interpolated over each element using shape functions along the edges of the elements. For more details about the FE implementation, the reader can refer to the referenced works (Holder, 2004; Gupta et al., 2017).
2.2 ERT Inverse Problem
The inverse problem, as formulated by Calderón (2006), consists of recovering
where
Several methods have been proposed to solve the inverse problem using a priori information, which mainly consist of regularization criteria (Holder, 2004) that constrain the solution to rule out the variations that cause instability. These methods, which are briefly described in Section 3, generally require the calculation and inversion of a sensitivity matrix that represents the derivative of the voltage measurements with respect to a conductivity parameter. However, complex inversion operations may hinder portable applications where the computational footprint of processing devices is generally limited.
3 Regularization Approaches
Given a current interrogation pattern, consider the matrix of measured boundary voltages
Considering difference imaging, the voltage measurement used as an input to the inverse EIT problem can be defined as
where
Here, the symbol
and can be practically implemented in an iterative procedure (Holder, 2004).
To date, the L2 norm has mainly been used on the error minimization term of Eq. 4 to reduce computational complexity (Tallman and Smyl, 2020). Thereby, it was considered in this study to represent potential portable applications in devices with a small computational footprint. Besides, quadratic regularization functionals have proven particularly effective in reducing oscillations in reconstructed conductivity (Holder, 2004). However, most of these methods typically favor smoothly varying distributions. On the other hand, the total variation functional can also regularize non-smooth profiles, preserving the edges between conductivity artifacts and background conductivity (Holder, 2004; Tallman and Smyl, 2020). Thus, the TV method was used in this work for comparison to reconstruct small and sharp conductivity variations effectively.
4 Machine Learning Approach
In this section, two alternative ML techniques, namely, an artificial deep neural network (DNN) and a radial basis function network (RBFN), were employed to solve the inverse problem. Since supervised learning algorithms were used, specific considerations were necessary for the construction of a training dataset. Herein, the architecture of the ML tools is described, as well as their training process.
4.1 Preparation of the Training Dataset
DNNs and RBFNs have gained considerable interest in the last decades and are currently some of the most popular supervised ML tools used for regression due to their effectiveness in solving nonlinear problems. A training dataset representing examples of input-output pairs must be used to train the ML tools in the preliminary training phase. Then, in the application phase, the trained network can generate an output based only on input data, following the structure learned from the training set.
Let
where
In this work, a training set was assembled by simulating random polygonal areas with reduced conductivity, as described in Algorithm 1. This study assumed that applied loads only involved a conductivity reduction in the hotspot region. The sprayed sensing film was compact and thin; therefore, applied loads do not involve a substantial reduction of inter-particle space (and the resulting conductivity increment). On the other hand, the in-plane dilation of the substrate due to the applied out-of-plane loads generated a stretching of the sensing film, which dilated in the specimen’s plane and reduced its thickness due to Poisson’s effect, thus increasing resistivity.
Algorithm 1. Construction of the training set.
The simulated data included in the training set can be different from real-world data, which generally includes noise due to measurement errors and imperfections in the sensing surface or the electrodes. Two strategies to improve the quality of the reconstructed conductivity were adopted in this study. The first concerns the normalization shown in Eq. 6, which is aimed at making the experimental and simulated data comparable in terms of their voltage magnitude. This way, the normalized voltage is still representative of the relative conductivity variation (i.e., minor voltage differences should represent modest conductivity variations). On the other hand, jitter was included in the training set to aid generalization and noise tolerance (Reed and Marks, 1998). Here, jitter indicates the addition of noise in the input of the training set (hence, onwith
where
4.2 Deep Neural Network
In this study, the Sheffield measurement protocol (Loyola et al., 2013) was employed, which is also known as the adjacent interrogation pattern and generates
The first ML tool employed in this work consists of a DNN with three hidden layers, each containing
The forward propagation of the network in the central hidden layers can be written as
where
4.3 Radial Basis Function Network
RBFN is a feedforward neural network with a single hidden layer, which uses a radial basis function (RBF) as a nonlinear activation function for each neuron. In this work, an RBFN with the number of neurons smaller than the space of the output (
where
where
where
Where
5 Pressure Mapping
Pressure mapping tests were performed to compare the performance of ML-based methods versus conventional ERT. A piezoresistive nanocomposite-enhanced foam was prepared with boundary electrodes to facilitate ERT boundary current excitations and voltage measurements. Pressure hotspots were applied to the specimens in order to induce localized resistivity changes, while ERT measurements were obtained. In addition to solving the ERT inverse problem, the ML-based methods were trained and then tested for comparison purposes. In this section, the fabrication process of the sensing specimen is described in detail, and the results obtained from the experimental tests are reported and discussed.
5.1 Nanocomposite-Enhanced Foam Fabrication
The pressure-sensitive surface used in this study was fabricated by depositing a piezoresistive thin film onto a soft substrate, consisting of the Smartfoam (15DC-3G), produced by Nano Composite Products (NCP, Orem, UT). The piezoresistive film is a latex-based ink containing multi-walled carbon nanotubes (MWCNT) (with an outer diameter of 8 nm and purchased from NanoIntegris). Specifically, the MWCNT-latex ink was prepared and fabricated according to the procedure described by Wang and Loh (2016) and briefly reported herein (Figure 1).
First, 2 wt.% of poly (sodium 4-styrenesulfonate) (PSS) (Sigma-Aldrich) was dissolved in deionized (DI) water. Second, 0.339 g of MWCNT and 0.806 g of N-methyl-2-pyrrolidinone (NMP) (Sigma-Aldrich) were mixed with 33.855 g of 2 wt.% PSS solution. The mixture was then immersed in an ice bath and subjected to high-energy tip ultrasonication (5 s on and 5 s off; 6.35 mm tip; 30 min at 30% amplitude) for 1 h to disperse the MWCNTs. Last, the sprayable ink was finalized by adding an appropriate amount of latex solution (Kynar Aquatec) and DI water to the MWCNT dispersion.
The MWCNT-latex ink was manually spray-coated onto 214 × 230 mm2 Smartfoam specimens (3 mm thick) using a Paasche airbrush. Each specimen was then air-dried at room temperature for at least 12 h before use. After the thin film was completely dry, multi-strand wires were deployed along the boundaries of the specimen using copper tape and silver epoxy (provided by MG Chemicals) to form the electrodes. A total of 26 electrodes arranged in a 6 × 7 pattern was prepared as shown in Figure 2A. Since the foam was flexible and soft, the specimen was fixed to a rigid 3D-printed PLA support.
![www.frontiersin.org](https://www.frontiersin.org/files/Articles/862796/fmats-09-862796-HTML/image_m/fmats-09-862796-g002.jpg)
FIGURE 2. (A) Schematic of the sensing specimen and ERT boundary electrodes (B) test setup for applying pressure hotspots (C) 3D-printed shapes to control contact area; and (D) location of hotspots and coordinates of their centers. All dimensions are shown in millimeters.
Since the deposition process only involved spraying the sensing material onto the foam substrate, fabrication was easily scalable. However, it is worth noting that the resolution of conductivity images reconstructed by EIT is generally related to the properties (size and impedance) and the number of electrodes. From a practical point of view, increasing the number of electrodes leads to a longer vector of voltage measurements, which generally needs a more extensive set of trainable variables (i.e., number of RBFs in the RBFN and number of neurons and/or layers in the DNN) to reconstruct conductivity distributions at a high resolution. Moreover, large sensing areas involve longer distances in the interrogation process, increasing material resistance and, therefore, leading to smaller voltage measurements in electrodes far from those used for current injection. This may lead to a higher dependency of the results on instrumentation noise and amplify the effects of unevenly distributed conductivity (e.g., due to material defects). However, in general, these issues can be addressed by increasing the magnitude of the injected current.
5.2 Applied Pressure Test Setup
Prior to the start of any test, baseline ERT measurements of the unstrained nanocomposite-enhanced foam were obtained. ERT measurements were collected using a customized data acquisition (DAQ) system consisting of a Keithley 6221 AC/DC generator (for boundary current excitations) coupled with a Keysight 34980A multifunctional switch with an embedded digital multimeter (for switching and boundary voltage measurement). MATLAB was used to control the DAQ system using the adjacent interrogation pattern. It should be mentioned that DC was injected across a pair of boundary electrodes, while voltage magnitudes across all other adjacent pairs were recorded.
Two sets of pressure sensing tests were performed, both using the setup illustrated in Figure 2B. Test #1 was aimed at investigating whether the proposed sensing solution could accurately determine the location of pressure hotspots. In order to keep the contact area as constant as possible throughout the test, the S1 3D-printed polylactic acid (PLA) disc represented in Figure 2C with a diameter of 10 mm was inserted between a weight and the sensing specimen. A mass of 200 g was placed at 16 different positions on the nanocomposite-enhanced foam as shown in Figure 2D, and ERT measurements were obtained for each position. Test #2 aimed to characterize the accuracy of identifying different pressure shapes. In this case, three 3D-printed PLA shapes (i.e., S2, S3, and S4 shown in Figure 2C) were placed at different positions on the sensing surface. Specifically, a mass of 500 g was used for shape S2, 1 kg for shape S3, and 4 kg for shape S4. Similar to Test #1, ERT measurements were recorded after each pressure hotspot was introduced.
The foam substrate used in this study was relatively thin compared to the dimensions of the sensing area and baseplates. Besides, the latex enhanced the elastic properties of the sensing film and allowed it to adapt to foam deformation without developing significant stresses on its outer surface. Therefore, shear effects due to applied loads and in-plane stretching of the sensing surface that could arise far from the applied pressure hotspot are limited as compared to the deformation of the MWCNT-latex film in the loaded region. For this reason, the expected conductivity variations obtained through ERT were almost coincident with the shape of PLA baseplates. This result remains valid for foam substrates with a modest thickness or relatively high Poisson’s ratio.
5.3 Training Dataset for ML Methods
As explained in Section 4.1, the dataset used to train the 2 ML methods was built by numerically solving the forward problem. The nanocomposite-enhanced foam was modeled according to Figure 3A, with 9716 elements for the FE model and electrodes modeled as void areas. CEM conditions were imposed at the boundary of each electrode (i.e., at the interface between the sensing film and the silver epoxy) as shown in Figure 3A. The experimental test setup is shown in Figure 3B, and the specimen resembles the FE model.
It is pointed out that, while unevenly distributed material may generate spatial differences in the conductivity distribution for real specimens, the training dataset was generated considering a uniform conductivity in “unloaded” regions. However, only variations in conductivity with respect to the baseline configuration are assessed by difference imaging. Therefore, if a complex conductivity pattern constitutes the baseline configuration, and an additional effect (e.g., due to load) perturbs locally the baseline conductivity distribution, only the artifact generated by the perturbing phenomenon is reconstructed by EIT. However, applying a given load to different locations may lead to different conductivity variations based on the effective distribution of the sensing material. The normalization criterion proposed in Section 4.1 aims at minimizing this effect and the differences between the simulations and real experiments.
A set of
The network was trained using the extended training set (i.e., including jitter, see Eq. 8) that contains 75,000 different cases, using the Adam optimization algorithm (Kingma and Ba, 2015). The initial learning rate was set to 0.001, since higher values led to convergence issues. Indeed, at the beginning of the training process, a large value was employed to escape spurious local minima and accelerate training. Then, a decay in the learning rate of 1/10 was considered when the root mean square reconstruction error was almost constant (i.e., after 10 epochs) to avoid oscillation around local minima. The authors also noticed that the reconstruction error was almost constant after two drops. Therefore, a total of 30 epochs was selected. The denominator offset was set to 10−8, and the decay rate of the gradient moving average was 0.9, while the batch size was 128. These parameters are recurrent in training applications (Kingma and Ba, 2015) and the results showed to be slightly affected by different values.
On the other hand, the RBF network consists of a single fully connected layer containing 100 neurons activated by Gaussian RBFs. The centers of the kernel functions were selected as the centers of 100 clusters determined using the k-means algorithm on the jittered training dataset, while the spread parameter
Typically, the training set is adequate for regression problems if it uniformly spans the space of the input features. Therefore, the training samples must be designed such that their shape and size represent a comprehensive set of the expected pressure hotspots (in size, shape, and location). From the perspective of scalability, if the sensing area becomes larger but the size of the expected hotspots is the same, the size of the training dataset should increase to include samples that span the input space uniformly and densely.
5.4 Results and Discussion
First, Test #1 was performed, and the datasets were used for solving the ERT inverse problem using difference imaging and the TV method. Figure 4 plots the conductivity distribution changes between each applied pressure hotspot with respect to the baseline. Specifically, an
On the other hand, Figures 5, 6 show the results for Test #1 when the ERT datasets were processed using the DNN and the RBFN methods, respectively. Specifically, the elements in the output vector generated by the ML algorithms are represented on a 2D map corresponding to the respective mesh elements. Compared to the results of Figure 4, the DNN-based method provides a much higher resolution of detecting pressure hotspots, where the actual size and location of the baseplate are generally accurately identified, while noise artifacts are minimized (Figure 5). The reconstruction process takes on average 0.005 s using the trained DNN running on the same hardware system (i.e., less than two orders of magnitude as compared to the TV method). This considerable improvement in computing performance is due to the nature of the feedforward process employed by DNN to solve the ERT inverse problem, which does not require performing demanding matrix inversion operations.
The results obtained using RBFN in Figure 6 have a visibly lower resolution as compared to DNN (Figure 5). Although hotspot location in each image is generally well estimated, noise artifacts are more regular as compared to the results of the TV method (Figure 4). The main advantage of the RBFN-based method is its computational time, which was significantly lower and was on average 0.003 s for each reconstruction. Moreover, due to the limited number of neurons employed in the network, the RBFN has 100 weights for each output value or 369,000 weights in total. In contrast, DNN uses over 21 million weights and is difficult to track, especially when these algorithms are implemented and executed using portable computing nodes such as microcontrollers.
The DNN, with a higher number of trainable variables, has shown superior ability in accurately correlating slight and localized variations in the input (voltage measurements) to complex conductivity patterns. On the other hand, a limited set of RBFs constitutes a basis for describing the conductivity distribution in RBFNs, which can only provide a general yet robust reconstruction of the conductivity variation. The relatively large spread factor of the RBFs improves the generalization ability but makes the reconstruction of complex patterns and sharp peaks in predicted conductivity particularly challenging. Nevertheless, in general, due to the lower sensitivity to minor variations of the voltage data, RBFNs are less sensitive to noise.
Overall, both ML methods provided conductivity reduction magnitudes that are almost proportional to those obtained by the TV method, which confirmed the efficacy of the adopted normalization process. However, the estimated magnitude was not only dependent on the load but also on the location on the sensing surface. This result could be due to the uneven thickness (and hence resistance) of the sensing specimen or local phenomena that affected areas close to the electrodes.
Second, the results for Test #2 are shown in Figure 7, where Test #2 corresponded to the case when different contact pressure patterns were applied to the nanocomposite-enhanced foam. Different weights were placed onto rectangular, triangular, and figure-eight baseplates and on the sensing specimens. Figure 7 shows that, although DNN generally provides a more accurate localization and shape reconstruction for small pressure hotspots, it behaves worse for distributed loads, as is visible from the results for the figure-eight baseplate. On the other hand, good reconstruction for large distributed loads obtained through the RBFN confirms its superior generalization ability. Indeed, the maximum size of the polygons representing pressure hotspots in the training set is 70 mm, lower than the maximum size of shape S4. In this case, the result obtained using the DNN may be less accurate since the training set did not include enough samples representative of the real condition, which could only be generated by randomly combining several closely-spaced polygons.
6 Conclusion
Pressure mapping was demonstrated using a nanocomposite-enhanced soft foam and the use of 2 ML tools, namely a DNN and an RBFN algorithm, to solve the ERT inverse problem. The DNN method provided accurate results for the identification of small hotspots while also allowing accurate shape reconstruction of the shape of the baseplate used to apply the load. Larger and more complex pressure regions are localized but without accurate shape information. On the other hand, although the RBFN did not allow accurately localize small pressure hotspots, it was more robust for identifying larger applied pressure regions. Both ML techniques performed better than the traditional total variation method, especially in terms of computational efficiency, with a runtime two orders of magnitude lower than the traditional method. The RBFN required a much smaller physical memory and computational footprint than the DNN, since network weights are about 58 times fewer and makes them more suitable for portable applications such as healthcare and robotic. The easy deployment of the sensing film, together with the modest runtime and satisfactory accuracy of the ML-based mapping algorithms, make the proposed solution promising for portable applications (e.g., running on low-cost microcontrollers), especially when the exact shape of the pressure hotspot is not of fundamental interest, such as in most medical applications.
Data Availability Statement
The raw data supporting the conclusion of this article will be made available by the authors, without undue reservation.
Author Contributions
All authors conceived the idea. SL and KL contributed to specimen design and fabrication. SL and SQ conducted the experiments. SQ and YS implemented the algorithms. SQ and YS analyzed the results, while SQ wrote the draft paper while collecting input from all other authors. KL supervised the research and edited the manuscript.
Funding
This research was partially supported by the United States Office of Naval Research (ONR) under grant number N00014-20-1-2329 (principal investigator: KL), as well as the University of California San Diego, Jacobs School of Engineering. SQ (working under Ph.D. advisor Prof. Luca Landi), and his visiting scholar appointment at UC San Diego and the ARMOR Lab, was supported by the University of Bologna, through the Marco Polo program.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
An, G. (1996). The Effects of Adding Noise during Backpropagation Training on a Generalization Performance. Neural Comput. 8, 643–674. doi:10.1162/neco.1996.8.3.643
Baltopoulos, A., Polydorides, N., Pambaguian, L., Vavouliotis, A., and Kostopoulos, V. (2013). Damage Identification in Carbon Fiber Reinforced Polymer Plates Using Electrical Resistance Tomography Mapping. J. Compos. Mater. 47, 3285–3301. doi:10.1177/0021998312464079
Bishop, C. M. (1995). Training with Noise Is Equivalent to Tikhonov Regularization. Neural Comput. 7, 108–116. doi:10.1162/neco.1995.7.1.108
Calderón, A. P. (2006). On an Inverse Boundary Value Problem. Comput. Appl. Math. 25, 133–138. doi:10.1590/S0101-82052006000200002
Dai, H., and Thostenson, E. T. (2019). Large-Area Carbon Nanotube-Based Flexible Composites for Ultra-Wide Range Pressure Sensing and Spatial Pressure Mapping. ACS Appl. Mater. Inter. 11, 48370–48380. doi:10.1021/acsami.9b17100
D. Holder (Editor) (2004). Electrical Impedance Tomography - Methods, History and Applications (Boca Raton, FL, United States: CRC Press).
Ding, Y., Yang, J., Tolle, C. R., and Zhu, Z. (2018). Flexible and Compressible PEDOT:PSS@Melamine Conductive Sponge Prepared via One-Step Dip Coating as Piezoresistive Pressure Sensor for Human Motion Detection. ACS Appl. Mater. Inter. 10, 16077–16086. doi:10.1021/acsami.8b00457
Duan, X., Taurand, S., and Soleimani, M. (2019). Artificial Skin through Super-Sensing Method and Electrical Impedance Data from Conductive Fabric with Aid of Deep Learning. Sci. Rep. 9, 8831. doi:10.1038/s41598-019-45484-6
Frerichs, I., Amato, M. B. P., van Kaam, A. H., Tingay, D. G., Zhao, Z., Grychtol, B., et al. (2017). Chest Electrical Impedance Tomography Examination, Data Analysis, Terminology, Clinical Use and Recommendations: Consensus Statement of the TRanslational EIT developmeNt stuDy Group. Thorax 72, 83–93. doi:10.1136/thoraxjnl-2016-208357
Gupta, S., Gonzalez, J. G., and Loh, K. J. (2017). Self-Sensing Concrete Enabled by Nano-Engineered Cement-Aggregate Interfaces. Struct. Health Monit. 16, 309–323. doi:10.1177/1475921716643867
Huang, Z., Gao, M., Yan, Z., Pan, T., Khan, S. A., Zhang, Y., et al. (2017). Pyramid Microstructure with Single Walled Carbon Nanotubes for Flexible and Transparent Micro-Pressure Sensor with Ultra-high Sensitivity. Sensors Actuators A: Phys. 266, 345–351. doi:10.1016/j.sna.2017.09.054
Husain, Z., Madjid, N. A., and Liatsis, P. (2021). Tactile Sensing Using Machine Learning-Driven Electrical Impedance Tomography. IEEE Sensors J. 21, 11628–11642. doi:10.1109/JSEN.2021.3054870
Kim, K., Jung, M., Jeon, S., and Bae, J. (2019). Robust and Scalable Three-Dimensional Spacer Textile Pressure Sensor for Human Motion Detection. Smart Mater. Struct. 28, 065019. doi:10.1088/1361-665X/ab1adf
Kingma, D. P., and Ba, J. L. (2015). “Adam: A Method for Stochastic Optimization,” in 3rd International Conference on Learning Representations, ICLR 2015 - Conference Track Proceedings, San Diego, CA, USA, 7–9 May 2015.
Lee, H., Park, K., Kim, J., and Kuchenbecker, K. J. (2021). Piezoresistive Textile Layer and Distributed Electrode Structure for Soft Whole-Body Tactile Skin. Smart Mater. Struct. 30, 085036. doi:10.1088/1361-665X/ac0c2e
Li, S., Lin, Y.-A., and Loh, K. J. (2021). “Pressure Mapping Using a Smart Nanocomposite Foam and Electrical Impedance Tomography,” in Nano-, Bio-, Info-Tech Sensors and Wearable Systems, California, United States, 22–27 March 2021. Editor J. Kim (SPIE), 5. doi:10.1117/12.2582872
Lin, Y. A., Zhao, Y., Wang, L., Park, Y., Yeh, Y. J., Chiang, W. H., et al. (2021). Graphene K‐Tape Meshes for Densely Distributed Human Motion Monitoring. Adv. Mater. Technol. 6, 2000861. doi:10.1002/admt.202000861
Lin, Z., Guo, R., Zhang, K., Li, M., Yang, F., Xu And, S., et al. (2020). Neural Network-Based Supervised Descent Method for 2D Electrical Impedance Tomography. Physiol. Meas. 41, 074003. doi:10.1088/1361-6579/ab9871
Liu, Z., Zhang, T., Yang, M., Gao, W., Wu, S., Wang, K., et al. (2021). Hydrogel Pressure Distribution Sensors Based on an Imaging Strategy and Machine Learning. ACS Appl. Electron. Mater. 3, 3599–3609. doi:10.1021/acsaelm.1c00488
Loh, K. J., Hou, T.-C., Lynch, J. P., and Kotov, N. A. (2009). Carbon Nanotube Sensing Skins for Spatial Strain and Impact Damage Identification. J. Nondestruct Eval. 28, 9–25. doi:10.1007/s10921-009-0043-y
Loyola, B. R., Saponara, V. L., Loh, K. J., Briggs, T. M., O'Bryan, G., and Skinner, J. L. (2013). Spatial Sensing Using Electrical Impedance Tomography. IEEE Sensors J. 13, 2357–2367. doi:10.1109/JSEN.2013.2253456
Nela, L., Tang, J., Cao, Q., Tulevski, G., and Han, S.-J. (2018). Large-Area High-Performance Flexible Pressure Sensor with Carbon Nanotube Active Matrix for Electronic Skin. Nano Lett. 18, 2054–2059. doi:10.1021/acs.nanolett.8b00063
Reed, R. D., and Marks, R. J. (1998). Neural Smithing: Supervised Learning in Feedforward Artificial Neural Networks. Cambridge, MA, USA: MIT Press.
Ryu, H., Park, S., Park, J.-J., and Bae, J. (2018). A Knitted Glove Sensing System with Compression Strain for Finger Movements. Smart Mater. Struct. 27, 055016. doi:10.1088/1361-665X/aab7cc
Shirinov, A. V., and Schomburg, W. K. (2008). Pressure Sensor from a PVDF Film. Sensors Actuators A: Phys. 142, 48–55. doi:10.1016/j.sna.2007.04.002
Tallman, T. N., and Smyl, D. J. (2020). Structural Health and Condition Monitoring via Electrical Impedance Tomography in Self-Sensing Materials: A Review. Smart Mater. Struct. 29, 123001. doi:10.1088/1361-665X/abb352
Tao, L.-Q., Zhang, K.-N., Tian, H., Liu, Y., Wang, D.-Y., Chen, Y.-Q., et al. (2017). Graphene-Paper Pressure Sensor for Detecting Human Motions. ACS Nano 11, 8790–8795. doi:10.1021/acsnano.7b02826
Wang, H., Liu, K., Wu, Y., Wang, S., Zhang, Z., Li, F., et al. (2021). Image Reconstruction for Electrical Impedance Tomography Using Radial Basis Function Neural Network Based on Hybrid Particle Swarm Optimization Algorithm. IEEE Sensors J. 21, 1926–1934. doi:10.1109/JSEN.2020.3019309
Wang, L., Gupta, S., Loh, K. J., and Koo, H. S. (2016). Distributed Pressure Sensing Using Carbon Nanotube Fabrics. IEEE Sensors J. 16, 4663–4664. doi:10.1109/JSEN.2016.2553045
Wang, L., and Loh, K. J. (2016). Spray-Coated Carbon Nanotube-Latex Strain Sensors. Sci. Lett. J. 5, 234.
Wu, X., Han, Y., Zhang, X., Zhou, Z., and Lu, C. (2016). Large-Area Compliant, Low-Cost, and Versatile Pressure-Sensing Platform Based on Microcrack-Designed Carbon Black@Polyurethane Sponge for Human-Machine Interfacing. Adv. Funct. Mater. 26, 6246–6256. doi:10.1002/adfm.201601995
Yao, A., and Soleimani, M. (2012). A Pressure Mapping Imaging Device Based on Electrical Impedance Tomography of Conductive Fabrics. Sens Rev. 32, 310–317. doi:10.1108/02602281211257542
Keywords: carbon nanotube, contact pressure, difference imaging, electrical impedance tomography, piezoresistive, sensor, supervised machine learning
Citation: Quqa S, Shu Y, Li S and Loh KJ (2022) Pressure Mapping Using Nanocomposite-Enhanced Foam and Machine Learning. Front. Mater. 9:862796. doi: 10.3389/fmats.2022.862796
Received: 26 January 2022; Accepted: 04 April 2022;
Published: 12 May 2022.
Edited by:
Veerappan Mani, King Abdullah University of Science and Technology, Saudi ArabiaReviewed by:
Hamid Ghaednia, Harvard Medical School, United StatesHashim Hassan, Purdue University, United States
Copyright © 2022 Quqa, Shu, Li and Loh. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Kenneth J. Loh, kenloh@ucsd.edu