- 1School of Agricultural Engineering, Jiangsu University, Zhenjiang, China
- 2Institute of Agricultural Facilities and Equipment, Jiangsu Academy of Agricultural Sciences, Nanjing, Jiangsu, China
- 3Key Laboratory of Horticultural Equipment, Ministry of Agriculture and Rural Affairs, Nanjing, China
- 4Department of Environmental Systems Science, Institute of Agricultural Sciences, Eidgenössische Technische Hochschule (ETH) Zürich, Zürich, Switzerland
Pear anthracnose, caused by Colletotrichum bacteria, is a severe infectious disease that significantly impacts the growth, development, and fruit yield of pear trees. Early detection of pear anthracnose before symptoms manifest is of great importance in preventing its spread and minimizing economic losses. This study utilized hyperspectral imaging (HSI) technology to investigate early detection of pear anthracnose through spectral features, vegetation indices (VIs), and texture features (TFs). Healthy and diseased pear leaves aged 1 to 5 days were selected as subjects for capturing hyperspectral images at various stages of health and disease. Characteristic wavelengths (OWs1 and OWs2) were extracted using the Successive Projection Algorithm (SPA) and Competitive Adaptive Reweighted Sampling (CARS) algorithm. Significant VIs were identified using the Random Forest (RF) algorithm, while effective TFs were derived from the Gray Level Co-occurrence Matrix (GLCM). A classification model for pear leaf early anthracnose disease was constructed by integrating different features using three machine learning algorithms: Support Vector Machine (SVM), Extreme Learning Machine (ELM), and Back Propagation Neural Network (BPNN). The results showed that: the classification identification model constructed based on the feature fusion performed better than that of single feature, with the OWs2-VIs-TFs-BPNN model achieving a highest accuracy of 98.61% in detection and identification of pear leaf early anthracnose disease. Additionally, to intuitively and effectively monitor the progression and severity of anthracnose in pear leaves, the visualization of anthracnose lesions was achieved using Successive Maximum Angle Convex Cone (SMACC) and Spectral Information Divergence (SID) techniques. According to our research results, the fusion of multi-source features based on hyperspectral imaging can be a reliable method to detect early asymptomatic infection of pear leaf anthracnose, and provide scientific theoretical support for early warning and prevention of pear leaf diseases.
1 Introduction
Pear trees are highly susceptible to pathogenic infections throughout their growth cycle, with anthracnose fungus being the most significant threat (Huang et al., 2015; Zhang and Xie, 2019). This fungus is highly contagious and presents a severe risk to pear leaves. If anthracnose is not detected and treated promptly, it can lead to widespread outbreaks, significantly reducing fruit quality and production, ultimately resulting in substantial economic losses (Luo, 2018). Therefore, early detection of pear leaf anthracnose is important for timely treatment, which helps ensure healthy harvests and keeps pear farming profitable.
In the current landscape of detecting pear leaf anthracnose, primary methodologies include manual visual inspection, thermal infrared imaging, machine vision, and spectral analysis. Despite their effectiveness, each approach has its limitations. Manual visual inspection, for instance, is highly subjective and often results in delayed detection of disease progression, affecting timely intervention (Hu et al., 2022; Zhang et al., 2023). Thermal infrared imaging, while useful, is affected by ambient temperature and humidity, which can compromise its accuracy (Zhu et al., 2018; Rippa et al., 2024; Masri et al., 2017). Machine vision, on the other hand, is restricted to external characteristics and fails to provide insights into internal leaf conditions (Chen et al., 2018; Palei et al., 2023; Kim et al., 2020). Spectral analysis, although capable of internal assessment, lacks the ability to detect external features (Zahir et al., 2022; Li et al., 2013). Pathogenic infections in plants result in changes to both internal physiological characteristics and external texture features, producing distinct spectral signatures divergent from healthy states. To detect diseases at an early stage, when symptoms are mild, it is crucial to monitor changes in both the internal and external aspects of the plant. Hyperspectral imaging (HSI) technology effectively combines the strengths of machine vision and spectral analysis, enabling the simultaneous collection of both spectral and visual data. This comprehensive integration can capture changes in both the internal and external aspects of plants, making the technology highly sensitive to subtle variations and crucial for the early detection of plant diseases (Zhang et al., 2021; Xie et al., 2018).
In recent years, numerous researchers have explored the early detection of plant diseases using spectral characteristics based on HSI technology. Kong et al. (2018) achieved early detection of oilseed rape leaf spot disease using a combination of HSI technology, chemometrics, and various machine learning algorithms. Hernández et al. (2024) utilized spectral features as input variables to establish an early detection model for grapevine downy mildew using Convolutional Neural Networks (CNN), with the accuracy of 99%. Huang et al. (2023) devised an SG-SVM model for early detection of sugarcane leaf spots and rust diseases. Tang et al. (2023) amalgamated the global and local spectral features, employing Support Vector Machine (SVM) to establish an early detection model for citrus anthracnose, achieving an average detection accuracy of 91.97%. When plants are infected with pathogens, various vegetation indices (VIs) such as internal moisture, pigment content, and structure will change as well, which usually have a close relationship with spectra count of different specific wavelengths, serving as features for early detection of plant diseases (Guo et al., 2024). Abdulridha et al. (2020) conducted detection of various stages of powdery mildew in pumpkins, discovering that Water Index (WI) and Photochemical Reflectance Index (PRI) accurately classified asymptomatic, early, and advanced stages of powdery mildew under laboratory conditions. Su et al. (2024) utilized six VIs, including Normalized Pigment Chlorophyll Index (NPCI), Water Index (WI), Chlorophyll Index Rededge (CIrededge), Green Atmospherically Resistant Index (GARI), Normalized Difference Vegetation Index (NDVI), and Chlorophyll Index Green (CIgreen), to detect various stages of stripe rust in wheat. The results demonstrated the effectiveness of these indices in dynamically characterizing the severity of stripe rust infection. Texture, as a crucial feature, describes the spatial distribution of brightness among adjacent pixels and stands. After plant infection with pathogens, the leaves will exhibit morphological changes such as chlorophyll loss, deformation, curling, wilting, etc. Therefore, several studies have attempted to identify plant diseases using TFs extracted from images of the plants. Xie et al. (2015) proposed detection models for early blight and late blight in tomato leaves based on 8 texture features, combined with an Extreme Learning Machine (ELM) classifier. The accuracy of the models ranged from 69.9% to 71.8%. Zhu et al. (2017) extracted TFs using the Gray-Level Co-occurrence Matrix (GLCM) and constructed various machine learning models to identify healthy and diseased tobacco leaves at different stages. Among them, the Back Propagation Neural Network (BPNN) classifier achieved an impressive accuracy of up to 93.33% in the classification task. The aforementioned studies demonstrated the feasibility of utilizing TFs for early detection of plant diseases. Obviously, present research is primarily relied on HSI technology, utilizing a single feature combined with image processing techniques to achieve early detection of plant diseases. However, studies on early detection of plant diseases through the fusion of multi-source features are relatively limited.
In addition, HSI technology can also visualize the lesion, so as to intuitively and accurately understand the location of the lesion, infection mechanism and severity (Coliban et al., 2020). Guan et al. (2022) visualized the lesions on wheat leaves infected with powdery mildew 2-5 days after infection using Spectral Angle Mapper (SAM), monitoring the progression of powdery mildew over time. Pan et al. (2019) visualized the lesions of pear black spot disease using Maximum Likelihood method and Spectral Angle Mapper (SAM). Finding that SAM could obtain the occurrence rate of pear infection with black spot disease at different stages and the size of the infected area, realizing a real-time monitoring of the occurrence process of pear infection with black spot disease. Despite the crucial role of monitoring the occurrence process in disease prevention and control, there are currently no reports on the monitoring of the occurrence process of pear leaf anthracnose with a vivid and intuitive method, limiting the further development of precision pesticide application technology.
The current study aimed to use HSI technology to develop an early detection and identification model for pear leaf anthracnose. The objectives were threefold: (1) to extract and combine both internal physiological features (OWs1, OWs2, and VIs) and external texture features (TFs) to detect the disease at an early stage; (2) to evaluate different classification models (SVM, ELM, and BPNN) for optimizing detection results; (3) to visualize the progression of the disease using SMACC and SID techniques. The research will provide scientific theoretical support for the early prevention and precise treatment of pear leaf anthracnose disease.
2 Materials and methods
2.1 Experimental materials and inoculation of pathogens
Pear leaf samples were obtained from a pear orchard (32.04°N, 118.88°E) at the Jiangsu Academy of Agricultural Sciences, Jiangsu, China. The pear cultivar was ‘Sucui No.1’. In June 2023, under the guidance of plant protection personnel, healthy leaves of uniform size and relatively broad leaf surface area were randomly sampled, totaling 300 leaves. Then the leaves were immediately placed in a small cooler and transported to the laboratory for labelling and inoculation of anthracnose pathogen.
The anthracnose pathogen was provided by Plant Protection Research Institute of Jiangsu Academy of Agricultural Sciences, Jiangsu, China. During inoculation, each leaf was divided into two parts along the midrib, and a 5mm diameter fungal plug was inoculated on each side. The inoculated leaves were placed in a growth chamber for cultivation under the following conditions: temperature of 25°C, relative humidity of 85%, and simulated light for 12 hours then by 12 hours of darkness each day. The first day of pear leaf infection was defined as the day after the inoculation day.
2.2 Hyperspectral imaging data acquisition
Figure 1 showed the HSI system (GaiaSorter-Dual, Jiangsu Shuangli Hesheptic Technology Co., Ltd., Jiangsu, China), which primarily consisted of two hyperspectral cameras (a visible-light camera and a near-infrared camera), a data acquisition box, and a computer. This experiment only utilized the visible-light camera, model DUALTX_IR_GE_17, with a resolution of 1392×1040 pixels, a spectral range of 380-1010 nm, a spectral resolution of 3.8 nm, and a total of 256 spectral channels. The data acquisition box comprised 8 halogen lamps (50 W each) and a motorized linear stage. During the data collection, the distance between the pear leaf surface and the camera lens was set to 55 cm, the exposure time was 9 ms, and the motor speed was 0.69 cm/s.
The infection period of the pear leaf by the anthracnose fungus was 1 day, thus the day following inoculation was considered as the first day of infection. Prior to inoculation, hyperspectral images of the pear leaves were captured for healthy controls, with each sample labeled and numbered. Subsequently, hyperspectral images were collected continuously for 5 days post-inoculation, capturing the dynamic process of the pear leaves transitioning from healthy to the onset of infection until the appearance of distinct lesions. In total, 1800 hyperspectral images were collected.
To mitigate the impact of brightness variation on data and enhance the quality and reliability of spectral data, it was essential to perform black-and-white rectification on hyperspectral data before data processing.
Where, R is the corrected hyperspectral image; R0 is the original hyperspectral image; W is the full-white calibration image; B is the full-black calibration image.
2.3 Feature extraction and selection
2.3.1 Region of interest extraction and selection
In this study, the entire leaf area was considered as the region of interest (ROI) for extracting spectral information. However, the hyperspectral image collected contains both the leaf area and the background area. To extract the spectral information of the leaves, the background must first be removed. ENVI 5.3 software was used to extract the spectral reflectance of the pear leaves and the background area separately. As shown in Figure 2, the pear leaves exhibited a pronounced reflectance peak around 550 nm, which was significantly different from the background reflectance. Therefore, the grayscale image at the 551.2 nm band was used, and the leaves were extracted from the background using a thresholding method.
Extraction Process: First, the grayscale image at 551.2 nm band was obtained using ENVI 5.3 software (Figure 3A). Next, the thresholding algorithm was applied to create a binary mask image, setting the leaf area pixels to 1 and the background area pixels to 0 (Figure 3B). Then, the mask image was then applied to all bands of the original hyperspectral image, multiplying the pixel values to obtain the hyperspectral image containing only the pear leaf area (Figure 3C). Finally, the average spectral reflectance curve of the leaf area was calculated by averaging the reflectance values of all pixels within the leaf region (Figure 3D). Additionally, the spectral reflectance values at the beginning and end of the spectral curve exhibited frequent and significant fluctuations, which were considered noise bands and lacked practical research value. Therefore, the bands with substantial noise influence were excluded, consequently 245 bands between 400 and 1000 nm were selected for subsequent analysis.
Figure 3. Spectral information extraction process. (A) Grayscale image at 551.2nm, (B) Binarized mask image, (C) Specular highlight image after background removal, (D) Average spectral reflectance.
2.3.2 Feature wavelength extraction and selection
Each of the captured hyperspectral images contains 245 spectral bands, with substantial inter-band correlation and redundant information, significantly affecting the speed and accuracy of subsequent data processing for modeling. Hence, reducing the dimensionality of the original spectral data and extracting optimal feature wavelengths is essential (Raghavendra et al., 2021). In this study, the Sequential Projection Algorithm (SPA) and Competitive Adaptive Reweighted Sampling (CARS) were employed for feature wavelength extraction. The SPA algorithm effectively summarizes the variable information of the majority of original spectra with a sparse subset, greatly enhancing the speed and efficiency of modeling (Araújo et al., 2001). Not only does CARS effectively eliminate non-informative variables, but it also minimizes the impact of collinear variables on the model to the greatest extent (Li et al., 2009). The extraction of feature wavelengths was carried out using the Matlab R2022b software.
2.3.3 Vegetation indices extraction and selection
After being infected with anthracnose, the physiological characteristics of pear leaves change gradually, thereby altering their spectral reflectance (Pane et al., 2021). Spectral vegetation indices (VIs) are calculated using the reflectance of two or more wavelengths, enhancing the data differences between healthy and diseased samples (Sah et al., 2023; Dutta et al., 2024). This study initially selected 23 VIs related to leaf pigment, structure, and water content for the early detection of pear leaf anthracnose. The calculation formulas for each of these VIs were presented in Table 1.
To screen out the VIs that were significantly sensitive to pear leaf anthracnose, the Random Forest (RF) method was selected for feature selection. The random forest feature variable screening method has good robustness and stability. It constructs a random forest model, utilizes the bagging method and random attribute selection, evaluates the importance of each attribute, and then selects the attributes with the greatest impact on the target variable, ranking the importance of all attributes (Jaiswal and Samikannu, 2017).
2.3.4 Texture feature extraction and selection
The leaf morphology of plants exhibits variation in response to the degree of anthracnose infection. Essentially, changes in pear leaf texture features (TFs) at different stages of infection can serve as a predictive indicator for the severity of anthracnose disease. In image processing, the TFs of images are typically obtained with method of Gray Level Co-occurrence Matrix (GLCM), which characterizes TFs based on pixel correlation in grayscale space and can convey directional, spatial, and range information regarding variations in image grayscale (Utaminingrum et al., 2022).
In order to improve the processing efficiency and accuracy, principal component analysis (PCA) was initially used to remove the redundant information of hyperspectral images (Licciardi and Chanussot, 2018). In this study, the first three principal components (PC1, PC2, and PC3) with a cumulative contribution of 99.5% were used as the objects for subsequent extraction of TFs. Eight TFs of Mean, Variance, Synergy, Contrast, Dissimilarity, Entropy, Second-order Moment and Correlation were selected for the followed TFs screening.
2.4 Model construction and performance evaluation
2.4.1 Model construction
Spectral features, VIs, and TFs data obtained from the 300 pear leaf sample images daily were randomly divided in a 2:1 ratio into training and testing sets. Three machine learning algorithms, Support Vector Machine (SVM), Extreme Learning Machine (ELM), and Back Propagation Neural Network (BPNN), were employed to structure an early classification model for anthracnose disease in pear leaves. The model construction was conducted using Matlab R2022b software.
SVM is characterized by its rapid computing speed, high classification accuracy, and strong generalization ability to samples, leading to its widespread application in statistical classification and regression analysis (Cervantes et al., 2020). In this study, SVM selected the Radial Basis Function (RBF) kernel, and employed grid search method to determine the optimal values of the penalty factor c and the kernel parameter g. ELM has emerged as a highly popular machine learning algorithm. During training, it requires no adjustments; simply setting the number of neurons in the hidden layer yields a unique optimal solution (Xu et al., 2019). In this study, ELM utilized the sigmoid function as the activation function of the hidden layer, with an optimal number of hidden layer nodes obtained through cross-validation. BPNN is a type of feedforward neural network capable of easily implementing complex nonlinear mapping functions with strong generalization capabilities, finds widespread applications (Asaad and Ali, 2019). In this study, the number of nodes in the input layer of BPNN was consistent with the number of input parameters of the sample, the number of nodes in the output layer was consistent with the number of classification, the activation function of the hidden layer was tanh, the maximum number of iterations of the network was set at 1000, and the target error was 0.01. The relationship between the number Y of nodes in the hidden layer and the number I of nodes in the input layer was calculated by the following formula (Kim, 2017).
2.4.2 Model performance evaluation
The model performance was evaluated via accuracy, recall, and precision. “Accuracy” refers to the proportion of samples correctly predicted out of the total samples. “Recall” indicates the ratio of correctly classified samples of a certain category to the actual number of samples in that category. “Precision” denotes the ratio of correctly classified samples of a certain category to the predicted number of samples in that category (Lamba et al., 2021).
Where, TP is the number of true positive; TN is the number of true negative; FP is the number of false positive; FN is the number of false negative.
With increasing emphasis on the accuracy of plant disease detection, accuracy was the primary evaluation metric in this study. The higher the accuracy, the better the model performance.
2.5 Lesion visualization
Sequential Maximum Angle Convex Cone (SMACC) is a faster and more automatic method to obtain endmember spectra. It starts with an endmember and increases in dimension. According to the angle between the end member and the existing cone, the new end member is identified. The data vector with the largest included angle with the existing cone is selected as the next endmember to expand the endmember set. Within a certain tolerance range, when all pixel vectors are within the convex cone, the algorithm terminates (Zhang, 2023; Nalawade et al., 2019).
Spectral Information Divergence (SID) is a spectral classification method. It calculates the local characteristics of spectra by spectral gradient, and then compares the overall characteristics of spectra by using information divergence to measure the degree of difference between different spectra, so as to determine their similarity or dissimilarity. By comparing the divergence of spectral information of different samples, the classification and identification of spectra can be realized (Chang, 1999).
3 Results
3.1 Spectral feature analysis and modeling
3.1.1 Spectral feature analysis
The spectral reflectance data of the pear leaf samples were collected within the 400-1000 nm wavelength range. To mitigate the impact of various noise sources on the raw spectral data, a Savitzky-Golay convolution smoothing (SG) method was employed to enhance the signal-to-noise ratio and improve the subsequent data analysis (Truyols and Schoenmakers, 2006).
Figure 4 depicted the average spectral reflectance curves for healthy leaves and leaves infected with anthrax from day 1 to day 5. The overall trend of the spectral curves for the healthy and infected leaves at different days was similar, exhibiting the typical spectral characteristics of green plants. At around 550 nm, there was a minimum in chlorophyll absorption, while at around 680 nm, there was a strong chlorophyll absorption, leading to the “red edge” phenomenon (Zhao et al., 2022). The spectral reflectance showed a significant increase in the 700-760 nm region, and then a more gradual change, forming a high reflectance platform after 760 nm. The peak value of the chlorophyll reflectance around 550 nm varies, which was consistent with the “loss of greenness” in the infected leaf samples. However, the difference between healthy leaves and leaves infected for 1-2 days was relatively small, likely due to the lack of visible lesions during the early stages of infection. In the 700-1000 nm spectral region, the reflectance of healthy leaves was significantly higher than that of the infected leaves as the disease progresses, which could be attributed to the damage to the leaf cell structure caused by the disease.
The feature wavelength of full-band spectrum was extracted by SPA. The SPA algorithm was run through Matlab R2022b, and the average spectral curves of ROI of all samples were screened. As shown in Figure 5A, when RMSE reached the minimum value (RMSE=0.3152), 12 feature wavelengths were determined. The feature wavelength of the full-band spectrum was extracted by CARS. As shown in Figure 5B, with the increase of sampling times, the number of wavelength variables rapidly decreased until it approached 0. In the RMSECV chart, it decreased as irrelevant wavelengths were removed, followed by an upward trend. When the RMSECV value was at its lowest, it indicated that irrelevant and collinear wavelengths had been removed, and 8 feature wavelengths had been selected.
Figure 5. Different algorithms for extracting feature wavelengths. (A) Extraction of SPA Feature Wavelengths, (B) Extraction of CARS Feature Wavelengths.
According to Figure 5 and Table 2, 12 feature wavelengths (OWs1) were extracted by SPA, and 8 feature features (OWs2) by CARS, reducing 95.1% and 96.7% wavelength count, respectively, eliminating the redundant information from ineffective wavelengths and significantly improving the speed of data processing.
3.1.2 Identification models with spectral features
In this study, full-spectrum, SPA, and CARS extracted feature wavelengths (OWs1 and OWs2) were used as input variables to construct classification models with SVM, ELM, and BPNN, respectively. The classification results of testing sets were presented in Table 3. The identification accuracy of the three models constructed based on the extraction wavelength of SPA and CARS exceeded that of the full-band model, signifying that the extraction of feature wavelengths not only markedly enhanced modeling speed but also augmented modeling accuracy. Among these, the OWs2-BPNN model demonstrated the most effective identification efficacy, achieving an accuracy of 95.13%.
Table 3. Classification results of identification models testing sets based on spectral characteristics.
3.2 Vegetation indices feature analysis and modeling
3.2.1 Vegetation indices feature analysis
Numerous studies have demonstrated that VIs can more comprehensively explain changes in vegetation growth, and models constructed using VIs can more effectively detect plant diseases (Zhao et al., 2020). This study selected 23 VIs related to plant disease, and used RF to screen for significant VIs features sensitive to pear leaf anthracnose, ranking the importance weights of each VI feature as shown in Figure 6.
To verify the effectiveness of VIs for early detection of pear leaf anthracnose and reduce redundant information, the top 4 VIs ranked by importance weight were selected as features for early detection of pear leaf anthracnose for further analysis, they were CIgreen, PSRI, NDVI, and SIPI. The box plots of these 4 VIs in the pear leaf samples throughout the experimental stages were shown in Figure 7. These 4 VIs exhibited a generally monotonic change in the pear leaf samples as the infection time progressed, which was consistent with the typical pattern of disease development in pear leaves infected with anthracnose.
Figure 7. The changing trend of four VIs samples in the whole experimental stage. (A) CIgreen, (B) PSRI, (C) NDVI, (D) SIPI.
3.2.2 Identification models with vegetation indices features
The four selected VIs screened through RF were utilized as input variables for constructing the classification models: SVM, ELM, and BPNN. The model classification results of testing sets were shown in Table 4. The identification accuracies of the three models were 88.06%, 92.39%, and 91.94%, respectively, indicating the effective utilization of VIs as input features for early detection of pear leaf spot disease. Among the models, the ELM model exhibited the best performance, with not only the highest accuracy but also superior recall and precision rates compared to the other two models.
3.3 Texture feature analysis and modeling
3.3.1 Texture feature analysis
In the experimental setup, a distance parameter of 1 was utilized for employing GLCM to extract TFs from images derived from the top 3 principal components. Analysis was conducted on four directional angles (0°, 45°, 90°, and 135°) with the results averaged. As illustrated in Figure 8, a total of 8 common TFs were extracted from the pear leaf images. And Mean, Dissimilarity, Entropy and Correlation were identified as particularly effective in accurately representing disease spot information. Consequently, 4 TFs were ultimately selected, yielding a total of 12 distinctive feature values that were used for building the classification model.
Figure 8. Eight common TFs. (A) Mean, (B) Variance, (C) Synergy, (D) Contrast, (E) Dissimilarity, (F) Entropy, (G) Second-order Moment, (H) Correlation.
3.3.2 Identification models with texture features
The SVM, ELM, and BPNN classification models were established based on the 12 distinctive features obtained above. Table 5 described the testing set classification results of the identification models, with the accuracy rates of 65.83%, 71.11%, and 68.06%, respectively, for the classification models. Compared to models based on spectral features and VIs, the performance of the models was relatively lower. This could be attributed to the subtle changes in external leaf texture during the early stages of pear leaf anthracnose. However, the results indicated the feasibility of using TFs for early detection of pear leaf anthracnose.
3.4 Identification models with multi-source features
Various combinations of feature wavelengths (OWs2), obtained through CARS extraction along with screened VIs and TFs, served as diverse inputs for constructing three classification models—SVM, ELM, and BPNN—for early detection of pear leaf anthracnose. It showed the results of detecting the testing set of multi-source feature fusion model in Table 6. Comparative analysis revealed enhanced identification accuracies across all models utilizing multi-source feature fusion compared to single-feature approaches; notably achieving over 90% accuracy when employing this method as a variable input—indicating that amalgamating multiple source features yields richer information pertinent to effective disease identification while enhancing overall model performance. Notably among these features was OWs2-VIs-TFs-BPNN which demonstrated superior efficacy in early detection of pear leaf anthracnose with an impressive accuracy rate reaching 98.61%.
Table 6. Classification results of identification models testing sets based on multi-source feature fusion.
3.5 Visualization analysis of pear leaf anthracnose lesions
The hyperspectral images of healthy and diseased pear leaves from day 1 to day 5 were initially processed using SMACC to extract endmember spectra, followed by mixed pixel decomposition using SID to obtain SID images. Subsequently, disease tissue identification was conducted based on predefined reference spectra by comparing each pixel in the image with each endmember and assigning values. A total of 4 endmembers were extracted, and the colors in the SID image were set to be consistent with their corresponding endmembers. Figure 9 displayed the 4 endmembers extracted based on SMACC. Endmember 1 (orange) represented the average spectrum of leaf veins, endmember 2 (green) signified the typical spectrum of healthy pear leaves, endmember 3 (red) represented the average spectrum of diseased leaf spots with lower reflectance, and endmember 4 (pink) corresponded to the average spectrum of dead leaf tissue, exhibiting reflectance curves no longer consistent with the typical spectral features of green plants.
Figure 10 illustrated the RGB and SID images of healthy and infected pear leaves from day 1 to 5. It could be observed that there were no discernible changes in the RGB images of the leaves from day 1 to 2. However, the SID images revealed the presence of minute lesions on the second day of infection. As time progresses, from day 3 to 5, symptoms of pear leaf anthracnose became increasingly prominent in the RGB images. Concurrently, in the corresponding SID images, the red lesions increased on the third day, pink necrotic leaves appeared on the fourth day, and by the fifth day, leaf infection reached its peak throughout the entire experimental phase. In conclusion, compared to the RGB images, the SID images effectively identified the symptoms of pear leaf anthracnose through changes in spectral characteristics rather than lesion size. As time progresses, the visualization of pear leaf anthracnose lesions became more effective.
Figure 10. RGB images and SID images of healthy and infected pear leaves from 1 to 5 days. (A) RGB-Healthy, (B) SID-Healthy, (C) RGB-Infected Day 1, (D) SID-Infected Day 1, (E) RGB-Infected Day 2, (F) SID-Infected Day 2, (G) RGB-Infected Day 3, (H) SID-Infected Day 3, (I) RGB-Infected Day 4, (J) SID-Infected Day 4, (K) RGB-Infected Day 5, (L) RGB-Infected Day 5.
4 Discussion
4.1 Importance of correct feature wavelength extraction
Hyperspectral data usually contain a lot of redundant information and highly correlated wavelength information, so it is very important to extract the feature wavelength (Siedliska et al., 2018; Lin et al., 2014). With the rapid development of computer technology, there are many methods to extract feature wavelength. However, the feature wavelengths used in different studies are quite different. Liu et al. (2022) used SPA algorithm to extract the feature wavelength when monitoring the anthracnose of infected pear leaves, and found that the important bands related to anthracnose were between 400-460nm. Wang et al. (2014) used the first-order differential to screen the spectral bands, and determined that the important bands related to tea anthracnose were between 680-780 nm. It can be seen that the feature wavelength bands of the same disease are very different, which may be due to different plant species or different extraction methods of feature wavelength. Therefore, in this study, in order to explore the influence of different feature methods on the detection of the same disease of the same plant species, SPA and CARS were used to extract the feature wavelength of pear leaf anthracnose. It was found that the feature bands extracted by SPA algorithm were concentrated in 400-560nm and 710-1000nm, while the feature bands extracted by CARS algorithm were concentrated in 710-1000nm. After modeling and analysis, it was found that CARS algorithm was superior to SPA algorithm, and the model constructed by CARS algorithm had higher recognition accuracy. Therefore, different extraction methods of feature wavelength have great influence on disease research and detection, and many methods are needed to study, and it is more important to choose the correct extraction method of feature wavelength.
4.2 Advantages of multi-source feature fusion in early detection of plant diseases
In previous studies, Zhu et al. (2019); Liang et al. (2023); Chen et al. (2021) and Gao et al. (2022) used single spectral feature to identify and detect rice sheath blight, sclerotinia sclerotiorum of rapeseed, verrucous mildew disease of agaricus bisporus and gray mold disease of tomato respectively, which could accurately identify the diseases in the obvious stage, but could not accurately identify them in the early stage. This was because in the early stage of the disease, the lesion was not obvious and the spectral features had not changed significantly. It was difficult to realize the early detection of diseases only by using a single spectral feature (Nguyen et al., 2021). However, in this study, besides spectral features, VIs and TFs were also considered. The early changes of pear leaf anthracnose were captured from many aspects, and the early accurate identification of pear leaf anthracnose was realized by building a model with multi-source feature fusion. This provided a theoretical basis for the early prevention and control of pear leaf diseases in the future. The fusion of multi-source features can better capture the subtle changes of disease symptoms in many aspects, thus providing greater possibilities for early and accurate detection of plant diseases (Zhang et al., 2020; Ren et al., 2020). However, at present, there are few studies on early detection of plant diseases by multi-source feature fusion, and most of them are based on single spectral feature. Therefore, many factors should be considered in the study of early diseases in the future, such as VIs, TFs, chlorophyll and nitrogen content (Lalit and Purwar, 2022). Striving to achieve accurate detection of diseases in the early stage, so that diseases can be prevented in time and economic losses can be reduced. I believe that with the continuous progress of related technologies, the detection method of multi-source feature fusion will play a more important role in future agricultural production.
4.3 Function of lesion visualization
In the early stage of plant diseases, the disease spots are not obvious, so some infection symptoms cannot be clearly identified only from RGB images, and early detection cannot be realized through image processing (Terentev et al., 2022). In contrast, hyperspectral images contain much more information than RGB images, and some effective methods can be used to visualize them, so that the location of lesions in the early stage of diseases can be tracked (Lowe et al., 2017). Zhou et al. (2019) and Li et al. (2016) respectively visualized the early stage of barley rice blast and citrus rot through SAM. However, when using SAM to extract different endmembers, we needed to manually classify different endmembers according to the differences in spectral characteristics. Because the difference of early spectral characteristics was not obvious, it leaded to some errors in manual classification. Eventually, their experimental results were unclear in the early stage of disease spot visualization. In this study, SMACC method could automatically capture spectral differences and extract typical endmembers according to the changes of spectral features caused by anthracnose of pear leaves. Then, the mixed pixel decomposition was carried out by SID, and the SID image was obtained. From the SID image, we could clearly see the shape, distribution and scope of the early stage lesions, and realize the visualization of the early stage lesions of pear leaf anthracnose. However, some preliminary experiments needed to be done in advance to determine the number of typical endmembers extracted before the formal experiment, which was helpful to better visualize the phenotype of the lesion. In a word, the effective visualization method of disease spots can accurately monitor the course of disease and provide scientific basis for the early prediction and prevention of subsequent plant diseases.
5 Conclusion
This study, based on HSI technology, utilized a combination of multi-source features and three machine learning models to enable early detection of pear leaf anthracnose. Healthy pear leaves and leaves infected with the disease for 1 to 5 days were used as the research subjects. Spectral reflectance was extracted from hyperspectral images in the range of 400 nm to 1000 nm. 12 and 8 feature wavelengths (OWs1 and OWs2) were respectively extracted using SPA and CARS. Then, 4 VIs were chosen via RF, and twelve TFs were extracted using GLCM after dimensionality reduction through PCA. Three types of features with different fusion methods were used as variable inputs to construct classification identification models (SVM, ELM, and BPNN). The results showed that the models constructed using multi-source feature fusion outperformed those using single features. Specifically, the OWs2-VIs-TFs-BPNN model exhibited the best performance in early detection of pear leaf anthracnose with an accuracy of 98.61%. Furthermore, SMACC and SID were employed to visualize the lesions on pear leaves at varying stages of anthracnose infection, enabling an intuitively monitoring of the disease progression. In summary, the early classification identification model and lesion visualization based on multi-source feature fusion provide scientific support for the early detection and precise treatment of pear leaf anthracnose. In future research, it would be valuable to explore the use of HSI technology combined with deep learning for the early detection of pear leaf diseases, and to apply these techniques in field environments.
Data availability statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Author contributions
YZ: Conceptualization, Methodology, Software, Visualization, Writing – original draft. YQ: Investigation, Methodology, Software, Writing – review & editing. MW: Methodology, Writing – review & editing. TX: Conceptualization, Investigation, Writing – review & editing. KH: Investigation, Validation, Writing – review & editing. YS: Investigation, Validation, Writing – review & editing. QY: Supervision, Writing – review & editing. XL: Supervision, Writing – review & editing. XHL: Conceptualization, Data curation, Investigation, Writing – review & editing. XLL: Funding acquisition, Project administration, Writing – review & editing.
Funding
The author(s) declare financial support was received for the research, authorship, and/or publication of this article. We acknowledge support from Shandong Province key research and development project (2022SFGC0204) and the China Agriculture Research System of MOF and MARA (CARS-28).
Acknowledgments
We would like to thank Wanxi Huang (Institute of Facilities and Equipment, Jiangsu Academy of Agricultural Sciences) for his valuable suggestions. We would also like to thank Yanan Zhao (Institute of Plant Protection, Jiangsu Academy of Agricultural Sciences) for the experimental materials.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
Abdulridha, J., Ampatzidis, Y., Roberts, P., Kakarla, S. C. (2020). Detecting powdery mildew disease in squash at different stages using UAV-based hyperspectral imaging and artificial intelligence. Biosyst. Engineering 197, 135–148. doi: 10.1016/j.biosystemseng.2020.07.001
Aghdam, M. J., Momayezi, M. R., Bagheri, N., Azizi, P., Nasri, M. (2024). Nitrogen assessment by remote sensing and multispectral imagery in maize (Zea mays L.). J. Plant Sci. Biotechnol. 27, 31–41. doi: 10.1007/s12892-023-00211-6
Araújo, M. C. U., Saldanha, T. C. B., Galvao, R. K. H., Yoneyama, T., Chame, H. C., Visani, V. (2001). The successive projections algorithm for variable selection in spectroscopic multicomponent analysis. Chemometrics Intelligent Lab. Systems 57, 65–73. doi: 10.1016/S0169-7439(01)00119-8
Asaad, R. R., Ali, R. I. (2019). Back Propagation Neural Network (BPNN) and sigmoid activation function in multilayer networks. Acad. J. Nawroz University 8, 216–221. doi: 10.25007/ajnu.v8n4a464
Babar, M. A., Reynolds, M. P., Ginkel, M. V., Klatt, A. R., Raun, W. R., Stone, M. L. (2006). Spectral reflectance to estimate genetic variation for inseason biomass, leaf chlorophyll, and canopy temperature in wheat. Plant Sci 46, 1046–1057. doi: 10.2135/plantsci2005.0211
Cervantes, J., Lamont, F. G., Mazahua, L. R., Lopez, A. (2020). A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing 408, 189–215. doi: 10.1016/j.neucom.2019.10.118
Chandel, A. K., Khot, L. R., Sallato, B. (2021). Apple powdery mildew infestation detection and mapping using high-resolution visible and multispectral aerial imaging technique. Sci Horticult 287, 110228. doi: 10.1016/j.scienta.2021.110228
Chang, C. I. (1999). “Spectral information divergence for hyperspectral image analysis.” in Ieee 1999 International Geoscience and Remote Sensing Symposium. Igarss’99 (cat. No. 99ch36293) (IEEE), 509–511. doi: 10.1109/IGARSS.1999.773549
Chappelle, E. W., Kim, M. S., McMurtrey, J. E. (1992). Ratio analysis of reflectance spectra (RARS): an algorithm for the remote estimation of the concentrations of chlorophyll a, chlorophyll b, and carotenoids in soybean leaves. Remote Sens. Environment 39, 239–247. doi: 10.1016/0034-4257(92)90089-3
Chen, B. Q., Wu, Z. H., Li, H. Y., Wang, J. (2018). Progress in the agricultural application of machine vision technology. Sci. Technol. Review 36, 54–65. doi: 10.3981/j.issn.1000-7857.2018.11.006
Chen, Z. H., Huang, L., Wen, Z. Q., Wen, D., Wang, S. N., Liao, X. L., et al. (2021). Early diagnosis of agaricus bisporus diseases based on hyperspectral imaging technology. Fujian J. Agric. Sci. 36, 1365–1372. doi: 10.19303/j.issn.1008-0384.2021.11.015
Coliban, R. M., Marincas, M., Hatfaludi, C., Ivanovici, M. (2020). Linear and non-linear models for remotely-sensed hyperspectral image visualization. Remote Sensing 12, 2479. doi: 10.3390/rs12152479
Dutta, A., Tyagi, R., Cyattopadhyay, A., Chatterjee, D., Sarkar, A., Lall, B., et al. (2024). Early detection of wilt in cajanus cajan using satellite hyperspectral images: development and validation of disease-specific spectral index with integrated methodology. Comput. Electron. Agricult 219, 108784. doi: 10.1016/j.compag.2024.108784
Gamon, J. A., Penuelas, J., Field, C. B. (1992). A narrow-waveband spectral index that tracks diurnal changes in photosynthetic efficiency. Remote Sens. Environment 41, 35–44. doi: 10.1016/0034-4257(92)90059-S
Gao, R. H., Feng, L., Zhang, Y., Yuan, J. D., Wu, H. R., Gu, J. Q. (2022). Early detection of tomato gray mold based on multidimensional random forest hyperspectral image. Spectrosc. Spectral Analysis 42, 3226–3234. doi: 10.3964/j.issn.1000-0593(2022)10-3226-09
Gitelson, A. A., Gritz, Y., Merzlyak, M. N. (2003). Relationships between leaf chlorophyll content and spectral reflectance and algorithms for non-destructive chlorophyll assessment in higher plant leaves. J. Plant Physiol. 160, 271–282. doi: 10.1078/0176-1617-00887
Gitelson, A. A., Viña, A., Ciganda, V., Rundquist, D. C., Arkebauer, T. J. (2005). Remote estimation of canopy chlorophyll content in plants. Geophysical Res. Lett. 32, L08403. doi: 10.1029/2005GL022688
Guan, T. X., Li, Q. K., Shao, Y. Y., Shi, Y. K. (2022). Early diagnosis and pathogenesis monitoring of wheat powdery mildew caused by blumeria graminis using hyperspectral imaging. Comput. Electron. Agricult 197, 106921. doi: 10.1016/j.compag.2022.106921
Guo, A. T., Huang, W. J., Wang, K., Qian, B. X., Cheng, X. Z. (2024). Early monitoring of maize northern leaf blight using vegetation indices and plant traits from multiangle hyperspectral data. Agriculture 14, 1311. doi: 10.3390/agriculture14081311
Haboudane, D., Miller, J. R., Pattey, E., Tejada, P. J. Z., Strachan, I. B. (2004). Hyperspectral vegetation indexs and novel algorithms for predicting green LAI of plant canopies: modeling and validation in the context of precision agriculture. Remote Sens. Environment 90, 337–352. doi: 10.1016/j.rse.2003.12.013
Hernández, I., Gutiérrez, S., Tardaguila, J. (2024). Image analysis with deep learning for early detection of downy mildew in grapevine. Sci Horticult 331, 113–125. doi: 10.1016/j.scienta.2024.113155
Hu, X. P., Hu, X. M., Ma, L. J., Huang, C., Zhou, Y. L., Xu, X. M. (2022). Advances in plant disease monitoring and early warning research. J. Plant Protection 49, 298–315. doi: 10.13802/j.cnki.zwbhxb.2021.2021134
Huang, Y. Q., Liu, X. H., Huang, Z. Y., Qian, W. Q., Liu, S. Y., Qiao, X. (2023). Early identification techniques for sugarcane leaf early blight and rust based on hyperspectral imaging. Trans. Chin. Soc. Agric. Machinery 54, 259–267. doi: 10.6041/j.issn.1000-1298.2023.04.026
Huang, X. Z., Zhang, C. H., Zeng, S. M., Chen, C. C., Lin, J. N., Chen, X. M., et al. (2015). Correlation analysis between pear leaf diseases and premature leaf drop. Plant Protection 41, 160–164. doi: 10.3969/j.issn.0529-1542.2015.04.031
Jaiswal, J. K., Samikannu, R. (2017). “Application of random forest algorithm on feature subset selection and classification and regression.” in 2017 World Congress on Computing and Communication Technologies (WCCCT). (IEEE) 65–68. doi: 10.1109/WCCCT.2016.25
Kim, P. (2017). MATLAB Deep Learning: with machine learning, neural networks and artificial intelligence. Apress 130, 151. doi: 10.1007/978-1-4842-2845-6
Kim, W. S., Lee, D. H., Kim, Y. J. (2020). Machine vision-based automatic disease symptom detection of onion downy mildew. Comput. Electron. Agricult 168, 105099. doi: 10.1016/j.compag.2019.105099
Kong, W. W., Zhang, C., Cao, F., Liu, F., Luo, S. M., Tang, Y., et al. (2018). Detection of sclerotinia stem rot on oilseed rape (Brassica napus L.) leaves using hyperspectral imaging. Sensors 18, 1764. doi: 10.3390/s18061764
Lalit, R., Purwar, R. K. (2022). Crowd abnormality detection using optical flow and GLCM-based texture features. J. Inf. Technol. Res. (JITR) 15, 1–15. doi: 10.4018/JITR.20220101110
Lamba, M., Gigras, Y., Dhull, A. (2021). Classification of plant diseases using machine and deep learning. Open Comput. 12, 491–508. doi: 10.1515/comp-2020-0122
Li, J. B., Huang, W. Q., Tian, X., Wang, C. P., Fan, S. X., Zhao, C. J. (2016). Fast detection and visualization of early decay in citrus using Vis-NIR hyperspectral imaging. Comput. Electron. Agricult 127, 582–592. doi: 10.1016/j.compag.2016.07.016
Li, H. D., Liang, Y. Z., Xu, Q. S., Cao, D. S. (2009). Key wavelengths screening using competitive adaptive reweig-hhted sampling method for multivariate calibration. Analytica Chim Acta 648, 77–84. doi: 10.1016/j.aca.2009.06.046
Li, X. L., Ma, Z. H., Zhao, L. L., Li, H. J., Wang, H. G. (2013). Early diagnosis of wheat stripe rust and leaf rust based on near infrared spectroscopy. Spectrosc. Spectral Analysis 33, 2661–2665. doi: 10.3964/j.issn.1000-0593(2013)10-2661-05
Liang, W. J., Feng, H., Jiang, D., Zhang, W. Y., Cao, J., Cao, H. X. (2023). Early identification of sclerotinia sclerotiorum by hyperspectral image combined with deep learning. Spectrosc. Spectral Analysis 43, 2220–2225. doi: 10.3964/j.issn.1000-0593(2023)07-2220-06
Licciardi, G., Chanussot, J. (2018). Spectral transformation based on nonlinear principal component analysis for dimensionality reduction of hyperspectral images. Eur. J. Remote Sensing 51, 375–390. doi: 10.1080/22797254.2018.1441670
Lin, Y., Huang, Y. B., Loraamm, R. W., Nie, C. W., Wang, J. H., Zhang, J. C. (2014). Spectral analysis of winter wheat leaves for detection and differentiation of diseases and insects. Field Crops Res. 156, 199–207. doi: 10.1016/j.fcr.2013.11.012
Liu, L., Tao, H. Y., Fang, J., Zheng, W. J., Wang, L. L., Jin, X. (2022). Identification of pear leaf anthracnose and black spot diseases based on near-infrared hyperspectral imaging. Trans. Chin. Soc. Agric. Machinery 53, 221–230. doi: 10.6041/j.issn.1000-1298.2022.02.023
Lowe, A., Harrison, N., French, A. P. (2017). Hyperspectral image analysis techniques for the detection and classification of the early onset of plant disease and stress. Plant Methods 13, 80. doi: 10.1186/s13007-017-0233-z
Luo, Z. X. (2018). Occurrence and control of pear anthracnose, an infectious disease in pear trees. Modern Agric. Sci. Technol 01, 128–130. doi: 10.3969/j.issn.1007-5739.2018.01.083
Masri, A. A., Hau, B., Dehne, H. W., Mahlein, A. K., Oerke, E. C. (2017). Impact of primary infection site of Fusarium species on head blight development in wheat ears evaluated by IR-thermography. Eur. J. Plant Pathol 147, 855–868. doi: 10.1007/s10658-016-1051-2
Merzlyak, M. N., Gitelson, A. A., Chivkunova, O. B., Rakitin, V. Y. (1999). Non-destructive optical detection of pigment changes during leaf senescence and fruit ripening. Physiol Plantarum 106, 135–141. doi: 10.1034/j.1399-3054.1999.106119.x
Nalawade, D. B., Solankar, M. M., Surase, R. R., Varpe, A. B., Vibhute, A. D., Dhumal, R. K., et al. (2019). Hyperspectral remote sensing image analysis with SMACC and PPI algorithms for endmember extraction. Recent Trends Image Process. Pattern Identification 2019, 319–328. doi: 10.1007/978-981-13-9181-1_28
Nguyen, C., Sagan, V., Maimaitiyiming, M., Maimaitijing, M., Bhadra, S., Kwasniewski, M. T. (2021). Early detection of plant viral disease using hyperspectral imaging and deep learning. Sensors 21, 742. doi: 10.3390/s21030742
Palei, S., Behera, S. K., Sethy, P. K. (2023). A systematic review of citrus disease perceptions and fruit grading using machine vision. Proc. Comput. Sci 218, 2504–2519. doi: 10.1016/j.procs.2023.01.225
Pan, T. T., Chyngyz, E., Sun, D. W., Paliwal, J., Pu, H. B. (2019). Pathogenetic process monitoring and early detection of pear black spot disease caused by Alternaria alternata using hyperspectral imaging. Postharvest Biol. Technol. 154, 96–104. doi: 10.1016/j.postharvbio.2019.04.005
Pane, C., Manganiello, G., Nicastro, N., Cardi, T., Carotenuto, F. (2021). Powdery mildew caused by Erysiphe cruciferarum on wild rocket (Diplotaxis tenuifolia): hyperspectral imaging and machine learning modeling for non-destructive disease detection. Agriculture 11, 337. doi: 10.3390/agriculture11040337
Patrick, A., Pelham, S., Culbreath, A., Holbrook, C. C., Godoy, I. J. D., Li, C. Y. (2017). High throughput phenotyping of tomato spot wilt disease in peanuts using unmanned aerial systems and multispectral imaging. IEEE Instrumentation Measurement Magazine 20, 4–12. doi: 10.1109/MIM.2017.7951684
Penuelas, J., Baret, F., Filella, I. (1995). Semi-empirical indexs to assess carotenoids/chlorophyll a ratio from leaf spectral reflectance. Photosynthetica 31, 221–230. doi: 10.5555/19960700514
Penuelas, J., Gamon, J. A., Fredeen, A. L., Merino, J., Field, C. B. (1994). Reflectance indexs associated with physiological changes in nitrogen-and water-limited sunflower leaves. Remote Sens. Environment 48, 135–146. doi: 10.1016/0034-4257(94)90136-8
Penuelas, J., Llusia, J., Pinol, J., Filella, I. (1997). Photochemical reflectance index and leaf photosynthetic radiation-use-efficiency assessment in mediterranean trees. Int. J. Remote Sensing 18, 2863–2868. doi: 10.1080/014311697217387
Qiu, C. R., Liao, G. P., Tang, H. Y., Liu, F., Liao, X. Y., Zhang, R., et al. (2018). Derivative parameters of hyperspectral NDVI and its application in the inversion of rapeseed leaf area index. Appl. Sci. 8, 1300–1312. doi: 10.3390/app8081300
Raghavendra, A., Guru, D. S., Mahesh, K. R. (2021). Mango internal defect detection based on optimal wavelength selection method using NIR spectroscopy. Artif. Intell. Agricult 5, 43–51. doi: 10.1016/j.aiia.2021.01.005
Ren, G. X., Wang, Y. J., Ning, J. M., Zhang, Z. Z. (2020). Using near-infrared hyperspectral imaging with multiple decision tree methods to delineate black tea quality. Spectrochimica Acta Part A: Mol. Biomol Spectroscopy 237, 118047. doi: 10.1016/j.saa.2020.118407
Rippa, M., Pasqualini, A., Manganiello, G., Woo, S. L., Mormile, P., Pane, C. (2024). Infrared imaging to assess the wild rocket (Diplotaxis tenuifolia) response to fusarium wilt in the early stages of infection. ACS Agric. Sci. Technol 4, 544–553. doi: 10.1021/acsagscitech.3c00582
Sah, S. S., Maulud, K. N. A., Sharil, S., Karim, O. A., Pradhan, B. (2023). Monitoring of three stages of paddy growth using multi-spectral vegetation index derived from UAV images. Egyptian J. Remote Sens. Space Sci. 26, 989–998. doi: 10.1016/j.ejrs.2023.11.005
Siedliska, A., Baranowski, P., Zubik, M., Mazurek, W., Sosnowska, B. (2018). Detection of fungal infections in strawberry fruit by VNIR/SWIR hyperspectral imaging. Postharvest Biol. Technol 139, 115–126. doi: 10.1016/j.postharvbio.2018.01.018
Su, B. F., Liu, D. Z., Chen, Q. F., Han, D. J., Wu, J. H. (2024). A method for identifying wheat stripe rust resistance levels based on time series vegetation indexs. Trans. Chin. Soc. Agric. Engineering 40, 155–165. doi: 10.11975/j.issn.1002-6819.202311040
Tang, Y., Yang, J. P., Zhuang, J. J., Hou, C. J., Mao, A. M., Ren, J., et al. (2023). Early detection of citrus anthracnose caused by colletotrichum gloeosporioides using hyperspectral imaging. Comput. Electron. Agricult 21, 108348. doi: 10.1016/j.compag.2023.108348
Terentev, A., Dolzhenko, V., Fedotov, A., Eremenko, D. (2022). Current state of hyperspectral remote sensing for early plant disease detection: a review. Sensors 22, 757. doi: 10.3390/s22030757
Truyols, G. V., Schoenmakers, P. J. (2006). Automatic selection of optimal Savitzky-Golay smoothing. Analytical Chem. 78, 4598–4608. doi: 10.1021/ac0600196
Utaminingrum, F., Sarosa, S. J. A., Karimc, C., Gapsari, F., Wihandika, R. C. (2022). The combination of gray level co-occurrence matrix and backpropagation neural network for classifying stairs descent and floor. ICT Express 8, 151–160. doi: 10.1016/j.icte.2021.05.010
Wang, X. Q., Ran, L., Peng, P., Cui, Z. L. (2014). Analysis of the hyperspectral characteristics of tea leaves under anthracnose disease stress. Plant Protection 40, 13–17. doi: 10.3969/j.issn.0529-1542.2014.06.003
Xie, Y. P., Chen, F. N., Zhang, J. C., Zhou, B., Wang, H. J., Wu, K. H. (2018). Study on monitoring of common crops diseases based on hyperspectral technology. Spectrosc. Spectral Analysis 38, 2233–2240. doi: 10.3964/j.issn.1000-0593(2018)07-2233-08
Xie, C., Shao, Y. N., Li, X. L., He, Y. (2015). Detection of early blight and late blight diseases on tomato leaves using hyperspectral imaging. Sci. Rep. 5, 16564. doi: 10.1038/srep16564
Xu, R., Liang, X., Qi, J. S., Li, Z. Y., Zhang, S. C. (2019). Preface, progress, and trends in extreme learning machines. J. Comput. Sci. Technol 42, 1640–1670. doi: 10.11897/SP.J.1016.2019.01640
Zahir, S. A. D. M., Omar, A. F., Jamlos, M. F., Azmi, M. A. M., Muncan, J. (2022). A review of visible and near-infrared (Vis-NIR) spectroscopy application in plant stress detection. Sensors Actuators A: Physical 338, 113468. doi: 10.1016/j.sna.2022.113468
Zhang, B. (2023). Unmixing of hyperspectral image mixed pixels. J. Remote Sensing 27, 2882–2883. doi: 10.11834/jrs.20233402
Zhang, L. X., Han, M. Y., Ding, J. Q., Li, K. Y. (2023). Research progress on intelligent diagnosis and prescription recommendation technology of crop diseases. Trans. Chin. Soc. Agric. Machinery 54, 1–18. doi: 10.6041/j.issn.1000-1298.2023.06.001
Zhang, S. L., Xie, Z. H. (2019). Current status, trends, problems, and countermeasures of pear industry development in China. J. Fruit Sci 36, 1067–1072. doi: 10.13925/j.cnki.gsxb.20190033
Zhang, N., Yang, G. J., Pan, Y. C., Yang, X. D., Chen, L. P., Zhao, C. J. (2020). A review of advanced technologies and development for hyperspectral-based plant disease detection in the past three decades. Remote Sensing 12, 3188. doi: 10.3390/rs12193188
Zhang, N., Yang, G. J., Zhao, C. J., Zhang, J. C., Yang, X. D., Pan, Y. C., et al. (2021). Progress and prospects in hyperspectral remote sensing of plant pests and diseases. J. Remote Sensing 25, 403–422. doi: 10.11834/jrs.20210196
Zhao, H. Q., Yang, C. H., Guo, W., Zhang, L. F., Zhang, D. Y. (2020). Automatic estimation of plant disease severity levels based on vegetation index normalization. Remote Sensing 12, 1930. doi: 10.3390/rs12121930
Zhao, X. H., Zhang, J. H., Huang, Y. B., Tian, Y. Y., Yuan, L. (2022). Detection and discrimination of disease and insect stress of tea plants using hyperspectral imaging combined with wavelet analysis. Comput. Electron. Agricult 193, 106717. doi: 10.1016/j.compag.2022.106717
Zhou, R. Q., Jin, J. J., Li, Q. M., Su, Z. Z., Yu, X. J., Tang, Y., et al. (2019). Early detection of magnaporthe oryzae-infected barley leaves and lesion visualization based on hyperspectral imaging. Frontiers 9. doi: 10.3389/fpls.2018.01962
Zhu, W. J., Chen, H., Ciechanowska, I., Spaner, D. (2018). Application of infrared thermal imaging for the rapid diagnosis of plant disease. IFAC-PapersOnline 51, 424–430. doi: 10.1016/j.ifacol.2018.08.184
Zhu, H. Y., Chu, B. Q., Zhang, C., Liu, F., Jiang, L. J., He, Y. (2017). Hyperspectral imaging for presymptomatic detection of tobacco disease with successive projections algorithm and machine-learning classifiers. Sci. Rep. 7, 4125. doi: 10.1038/s41598-017-04501-2
Keywords: hyperspectral imaging, pear leaves, anthracnose, multi-source features, classification model, visualization
Citation: Zhang Y, Li X, Wang M, Xu T, Huang K, Sun Y, Yuan Q, Lei X, Qi Y and Lv X (2024) Early detection and lesion visualization of pear leaf anthracnose based on multi-source feature fusion of hyperspectral imaging. Front. Plant Sci. 15:1461855. doi: 10.3389/fpls.2024.1461855
Received: 09 July 2024; Accepted: 23 September 2024;
Published: 08 October 2024.
Edited by:
Thomas Thomidis, International Hellenic University, GreeceReviewed by:
Sayantan Sarkar, Texas A&M AgriLife Research, United StatesDongmei Chen, Hangzhou Dianzi University, China
Copyright © 2024 Zhang, Li, Wang, Xu, Huang, Sun, Yuan, Lei, Qi and Lv. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Yannan Qi, qiyn1020@163.com; Xiaolan Lv, lxlanny@126.com