- 1Department of Biochemistry and Molecular and Cell Biology of Plants, Estación Experimental del Zaidín, Spanish National Research Council (CSIC), Granada, Spain
- 2Department of Plant Physiology, Facultad de Farmacia, University of Granada, Granada, Spain
A rapid diagnosis of black rot in brassicas, a devastating disease caused by Xanthomonas campestris pv. campestris (Xcc), would be desirable to avoid significant crop yield losses. The main aim of this work was to develop a method of detection of Xcc infection on broccoli leaves. Such method is based on the use of imaging sensors that capture information about the optical properties of leaves and provide data that can be implemented on machine learning algorithms capable of learning patterns. Based on this knowledge, the algorithms are able to classify plants into categories (healthy and infected). To ensure the robustness of the detection method upon future alterations in climate conditions, the response of broccoli plants to Xcc infection was analyzed under a range of growing environments, taking current climate conditions as reference. Two projections for years 2081–2100 were selected, according to the Assessment Report of Intergovernmental Panel on Climate Change. Thus, the response of broccoli plants to Xcc infection and climate conditions has been monitored using leaf temperature and five conventional vegetation indices (VIs) derived from hyperspectral reflectance. In addition, three novel VIs, named diseased broccoli indices (DBI1-DBI3), were defined based on the spectral reflectance signature of broccoli leaves upon Xcc infection. Finally, the nine parameters were implemented on several classifying algorithms. The detection method offering the best performance of classification was a multilayer perceptron-based artificial neural network. This model identified infected plants with accuracies of 88.1, 76.9, and 83.3%, depending on the growing conditions. In this model, the three Vis described in this work proved to be very informative parameters for the disease detection. To our best knowledge, this is the first time that future climate conditions have been taken into account to develop a robust detection model using classifying algorithms.
Introduction
The cultivation of broccoli (Brassica oleracea var. italica) has become increasingly attractive and profitable. It is highly regarded for its nutritional value and also its antioxidant and anticancer properties (Owis, 2015). In Spain, the production of broccoli has increased exponentially in the last decades, and it is expected to continue rising in future. In 2018, broccoli crop yields reached up to 561,000 tons in Spain, and most of them were exported to European countries (latest available data reported by Ministerio de Agricultura, Pesca y Alimentación, www.mapa.gob.es).
Pests and plant diseases are a great challenge in modern agriculture and the main cause of production and economic losses in agriculture worldwide (Savary et al., 2012). Current practices and social activities, such as intensified monoculture in large areas, the use of genetically uniform plant varieties, and international trading of agricultural commodities, contribute largely to the widespread of plant disease epidemics and rapid pathogen evolution (Zhan et al., 2015). Like other Brassica crops, broccoli plants are susceptible to infection by fungi (Alternaria leaf spot, anthracnose, blackleg, or mildews), some viruses (virus mosaic), and bacteria (black rot, soft rots, bacterial leaf spots). Among the bacterial pathogens, Xanthomonas campestris is one of the most important in brassicas (Mansfield et al., 2012; Ekman et al., 2014; Dep. Primary Industries and Regional Development, Government Western Australia 2018, www.agric.wa.gov.au/broccoli/diseases-vegetable-brassicas). The most notable pathovar of X. campestris is campestris (Xcc), which is the causal agent of black rot of crucifers and affects all cultivated brassicas. Indeed, and according to the report elaborated by EIP-AGRI Focus Group for the European Commission, Xcc is a threat to the production of broccoli, cauliflower, and cabbage throughout Europe (2016, Integrated Pest Management for Brassica, https://ec.europa.eu/eip/agriculture/en/publications/eip-agri-focus-group-ipm-brassica-final-report). Moreover, Xcc can be subdivided into nine races on the basis of the responses they induce on different cultivars. Among the nine races described for Xcc, races 1 and 4 are considered the most virulent and spread worldwide (Fargier and Manceau, 2007; Tortosa et al., 2018).
Precision agriculture demands the development of imaging sensor-based methods of detection and diagnosis of plant stress, including diseases. Several optical sensors are currently implemented to monitor crop fields (Aasen et al., 2019; Gerhards et al., 2019; Maes and Steppe, 2019; Pérez-Bueno et al., 2019a; Kashyap and Kumar, 2021; Pineda et al., 2021). Their applicability at lab scale and in high-throughput platforms by proximal sensing, and in the field by remote sensing, makes them particularly useful. However, the data provided by imaging sensors are large and complex and, consequently, difficult to interpret. Hence, improving our ability to extract useful information from these vast datasets requires the use of machine learning algorithms (Sperschneider, 2020). Machine learning is a subset of artificial intelligence (AI), consisting of algorithms that are able to learn patterns from a database of known samples and, based on those patterns, identify or categorize new samples. In agriculture, these algorithms can assist in the monitoring and decision-making processes of crop management (Chlingaryan et al., 2018; Golhani et al., 2018; Liakos et al., 2018; Gao et al., 2020). Thus, the implementation of imaging sensors and AI is a pivotal tool for crop management based on digital agriculture (Talaviya et al., 2020; Jung et al., 2021). However, alteration in growth conditions due to climate change imposes an additional challenge to plant disease detection methods based on AI. The expected rises in CO2 concentration and temperature associated to climate change would have an impact on agriculture, affecting plants and pathogen physiology (Trivedi et al., 2022) and their geographical distribution (Aidoo et al., 2021). For that reason, potential future climate should be considered as an experimental variable to develop more robust detection methods.
Thermography and multi/hyperspectral reflectance imaging are the most common sensors applied in agriculture (Zarco-Tejada et al., 2018; Maes and Steppe, 2019; Pérez-Bueno et al., 2019b). On the one hand, canopy to air differential temperature (TC-TA) is an indirect measurement of the vegetation transpiration rate (Scarth et al., 1948; Milthorpe and Spencer, 1957; Fuchs and Tanner, 1966) and is widely used in proximal and remote sensing for stress detection, as recently reviewed by Pineda et al. (2021). On the other hand, the high spectral resolution of hyperspectral reflectance imaging allows the creation of a growing collection of vegetation indices (VIs). These VIs are transformations of two or more spectral bands which allow reliable temporal and spatial inter-comparisons of vegetation attributes. Thus, VIs are quite simple and effective parameters to quantitatively and qualitatively evaluate vegetation traits such as vigor, fitness, and pigment composition, among other applications (Huete et al., 2002).
In fact, many VIs can be found in the literature. One of the most widely used is the normalized difference vegetation index (NDVI), which is related to vitality of canopies (Tucker, 1979; Pettorelli, 2013). Other VIs correlate with a wide range of plant physiological traits. For example, the photochemical reflectance index (PRI) correlates with photosynthetic activity (Gamon et al., 1992); the carotenoid reflectance index (CRI) (Gitelson et al., 2002) and the anthocyanin reflectance index (ARI) (Gitelson et al., 2001) are related to pigment contents; and the water balance index (WBI) is connected to water content in leaves (Peñuelas et al., 1993). Indeed, recent works have implemented VIs to the study of plants infected by Xanthomonas spp. Abdulridha et al. (2019) used a collection of VIs (ARI and NDVI among them) implemented on classifying algorithms to successfully identify tangerine plants infected by X. citri pv. citri. Similarly, NDVI values correlated well with the extension of the lesions caused by X. campestris pv. oryzae on rice leaves (Zhang et al., 2022). Moreover, several works have compared the association between climate change and the interannual variability registered on NDVI in several locations around the world (Kalisa et al., 2019; Bagherzadeh et al., 2020; Zhao et al., 2021). Nonetheless, new reflectance parameters could be defined for a given purpose to maximize differences when standard VIs are not sensitive enough (Miao et al., 2007; Mahlein et al., 2013; Zhang et al., 2017; El-Hendawy et al., 2019; Jia et al., 2019; Yuan et al., 2019).
The main aim of this work was to develop an efficient method for the detection of Xcc infection in broccoli plants based on thermal and hyperspectral reflectance imaging on individual leaves. For this purpose, six parameters were recorded: leaf temperature (particularly TC-TA) and five already known VIs. Moreover, three novel VIs specifically designed for detecting the Xcc infection were extracted from the reflectance spectra of healthy and diseased broccoli leaves. They were named diseased broccoli indices (DBI1-DBI3). This set of nine parameters were implemented on a selection of algorithms widely used on precision agriculture for their success in classifying infected plants: the multilayer perceptron-based artificial neural network (MLP), the support vector machine (SVM), and the k-nearest neighbor (kNN). Finally, the suitability of the trained models was evaluated by comparing their performances in correctly classifying new samples as healthy or diseased leaves under a range of climate conditions, including intermediate and extreme climate change scenarios, as well as current climate conditions. Furthermore, the relevance of every input parameter for the detection of Xcc infection in broccoli plants was evaluated.
Materials and Methods
Plant Growth at Different Climate Conditions
Growth conditions under two possible future climate change scenarios were chosen taking into account the 5th Assessment Report by the Intergovernmental Panel on Climate Change (AR5; IPCC, 2014). In that assessment, a range of projections of greenhouse gases emissions responding to both socio-economic development and climate policy was considered. Future climate conditions were estimated based on representative concentration pathways (RCPs), depending on potential scenarios of greenhouse gases emissions and their atmospheric concentrations, air pollutant emissions, and land use for the year 2100. Thus, current climate conditions (CCC) were compared to future scenarios, being RCP 8.5 the most extreme scenario, meaning most dramatic increase in CO2 levels and subsequent global warming. In turn, the so called RCP 4.5 would represent an intermediate scenario between CCC and RCP 8.5 and was considered by the AR5 as the most probable scenario by 2100.
The C3 broccoli plants (Brassica oleracea var. italic cv. calabrese natalino) were grown in a growth chamber in a 16/8-h day/night regime with 60% relative humidity, 200 mol photon m−2 s−1 of PAR light. The ambient temperature and CO2 concentrations (Table 1) were chosen according to the data regionalized by the Spanish State Meteorology Agency (AEMet) for Region of Murcia (largest Spanish broccoli producer) for current climate conditions and those corresponding to RCP 4.5 and RCP 8.5 in years 2081–2100. Day and night temperatures correspond to the average values in Region of Murcia during the growing season. For each experiment, plants were sown and grown at the corresponding CCC, RCP 4.5, or RCP 8.5 conditions.
Table 1. Climatic conditions assessed for broccoli growth: CCC (current climate conditions), RCP 4.5, and RCP 8.5 (Representative Concentration Pathways 4.5 and 8.5) regionalized for Region of Murcia for years 2081–2100.
Bacterial Growth and Inoculation
Xanthomonas campestris pv campestris (Xcc) race 1 and race 4 were grown for 24 h at 28°C in LB (Luria-Bertani) plates. Bacterial suspensions were prepared in sterile 10 mM MgCl2 at 108 colony-forming units per ml (cfu mL−1) by adjusting the optical density at 600 nm to 0.1.
The third leaf of four-week-old plants (under CCC or RCP 4.5) or five-week-old plants (in case of RCP 8.5) was mock-inoculated with sterile 10 mM MgCl2 or inoculated with bacterial suspension by clipping four secondary veins per leaf with rat tooth tweezers previously dipped in the corresponding solution (Figure 1). For each experiment, twelve plants per treatment (CCC and RCP 4.5) and four plants per treatment (RCP 8.5) were inoculated. Leaves were imaged at 1, 2, 3, 6, and 9 days post-inoculation (dpi). At least two experiments per climate condition were carried out, providing similar results.
Figure 1. Timecourse of symptoms evolution of mock-control, Xcc race 1-infected, and Xcc race 4-infected broccoli plants at current climate conditions (A; CCC), and the representative concentration pathways RCP 4.5 (B) and RCP 8.5 (C). White arrows indicate the inoculation points. For simplicity, they have only been shown in mock-controls leaves at CCC. Dpi, days post-inoculation.
Thermal Imaging
Thermal images of whole leaves were recorded using a FLIR A305sc camera (FLIR Systems, Wilsonville, OR, USA) vertically positioned 30 cm above the leaf, according to Pérez-Bueno et al. (2016). For each measurement, 10 thermal images were collected in the plant growth chamber over 10 s. These images were averaged to extract temperature values for whole leaves. Image processing was carried out using the FLIR ResearchIR v. 3.4 software.
Hyperspectral Reflectance Imaging
Reflectance spectra (400–1,000 nm) of broccoli leaves were recorded using a Pika L hyperspectral imaging camera (Resonon, Bozeman, MT, USA) in the visible (400–700 nm) to near-infrared spectral range (700–1,000 nm), with a spectral sampling at 2.1 nm and a spectral resolution (full width at half maximum) of 3.7 nm. The camera was positioned vertically 45 cm over the sample, which was placed on a translation stage. Thus, a datacube with 281 images was built for each attached leaf.
Leaves were illuminated with four calibrated xenon lamps with homogeneous light intensity between 400 and 1,000 nm, positioned above the samples and around the camera. Previous to leaf measurements, dark and light corrections were made in darkness and illuminating a white homogenous calibration tile provided by Resonon, respectively. Dark and light corrections, build-up of datacubes and analysis, were carried out with the software Spectronon v. 2.134 (Resonon).
Reflectance spectra averaged for whole leaves were obtained and used to calculate images corresponding to several widely used VIs, as summarized in Table 2. To avoid overfitting of machine learning models, only not redundant VIs were selected.
Data Analysis
Numerical data obtained from thermal and reflectance images (including reflectance spectra and VIs) were managed using Microsoft Office Excel 2016 (Microsoft Corporation, Redmond, WA, USA). Aiming to design a simple method of detection, values were averaged from whole leaves rather than regions of interest.
Two-tailed Student's t-test (Microsoft Excel) was performed to compare, for every treatment and at every dpi assayed: (a) spectra reflectance profiles; (b) values of novel VIs (DBIs). The null hypothesis was that there were no differences between treatments. This hypothesis was considered false at p < 0.05, and variables were treated as different when p-value was below this value. Figure graphs were plotted using Microsoft Excel.
Classification Analysis by Machine Learning
Data collected through whole experiments were organized in databases (Microsoft Excel), one per climate condition. Each database contained values of selected parameters (TC-TA, NDVI, PRI, ARI, CRI, WBI, DBI1, DBI2, and DBI3) at every dpi (1–9 dpi) and treatment (mock-control, Xcc race 1-, and Xcc race 4-infected plants). In addition, data were rescaled from zero to one to ensure comparison between treatments and days, according to the equation: rescaled value = (x-minimum)/maximum. Then, the three databases were randomly partitioned into training and test datasets, in a proportion of 7:3, respectively (Table 3). This partition was carried out using a seed that ensured that every category (treatment and dpi) was well represented in both datasets. The experimental data were analyzed by the free version of KNIME v. 4.3.2 (KNIME AG, Zurich, Switzerland; www.knime.com; Berthold et al., 2008).
Three models were built for each one of the three growing conditions by analyzing the corresponding databases with three supervised classifying algorithms: MLP, SVM, and kNN. MLP is a network inspired by biological neural networks in which different interconnected nodes (called neurons) organized in layers transmit information to each other, learning from both input and output data (Hahn, 2009; Behmann et al., 2015). In contrast, SVM distributes samples in a high-dimensional feature space defined by support vectors. In this case, new samples are categorized based on what side of hyperplanes they fall on (Behmann et al., 2015). Finally, kNNs assign proportional weights to the contributions of the sample neighbors based on distances. These weights determine to what category a new sample would most likely belong to (Blanzieri and Melgani, 2008).
Broccoli leaves were categorized into mock-control, Xcc race 1-, and Xcc race 4-infected plants using the classifying algorithms MLP, SVM, and kNN. The performance of classification was evaluated in terms of (i) sensitivity (true positive rate); (ii) specificity (true negative rate); (iii) accuracy (percentage of right guesses); and (iv) F-measure (harmonic mean of precision and sensitivity; where precision is the number of correct control samples divided by the number of all plants classified as “control”). All the three feedforward backpropagation MLPs tested were designed to have one hidden layer with four neurons (half the number of variables used to feed them). Higher number of hidden layers or their neurons did not result in an improvement of the performance. A polynomial kernel was used for the SVMs, with bias = 1 and gamma = 1. More complex spatial kernels did not improve the performance of the algorithm. Finally, the optimal number of neighbors for the kNN algorithm was k = 5 using the Euclidean distance. Regarding SVM and kNN libraries, we have used the basic nodes (SVM learner and K nearest neighbor, respectively) implemented on Knime software v. 4.3.2. This process was performed independently for each of the three climate conditions under study.
Finally, the global variable importance was calculated for each parameter (TC-TA, NDVI, PRI, ARI, CRI, WBI, DBI1, DBI2, and DBI3), that is, how informative was a given parameter for the model to make a correct decision. For such a purpose, global surrogate random forest (RF) models were trained to estimate the variable importance using the Global Feature Importance component developed for Knime software (https://hub.knime.com/knime/spaces/Examples/latest/00_Components/Model%20Interpretability/Global%20Feature%20Importance~xsR90ymhRbHOc78Z). RF was trained on the standardly pre-processed input data. Feature importance was then calculated by counting how many times it had been selected for a split and at which rank (level) among all available features (candidates) in the trees of the RF.
Results
Evolution of Symptoms Under a Range of Growth Conditions
Plants grown from sowing under CCC, RCP4.5, or RCP8.5 conditions were inoculated with Xcc race 1 or 4, and the evolution of symptoms was followed up to 9 dpi. At CCC and RCP 4.5, Xcc infection on broccoli plants consisted in chlorosis followed by a progressive necrosis of the tissue surrounding the inoculation site to finally reach the V-shaped lesions typical of this bacterial infection (Figure 1). Xcc race 4 caused the most severe symptoms, with necrosis at the clipping point starting at 3 dpi and evident at 6 dpi; chlorosis surrounded the inoculated area at 6 dpi, and V-shaped lesions were patent at 9 dpi. In contrast, Xcc race 1 produced similar symptoms in a slower time course, with a delay of 3 days. Mock-control leaves only displayed the actual lesions. It is worth noticing that there was no evolution in symptoms from 0 to 1 dpi under any of the assayed growth conditions.
The RCP 8.5 conditions affected the growth of broccoli plants, which displayed stunting and early senescence. Moreover, leaves were smaller and thicker than those of plants grown at CCC or RCP 4.5 conditions. At RCP 8.5, the evolution of the infection by either race resembled that described for Xcc race 4 under CCC. Moreover, Xcc race 1 was more virulent than Xcc race 4 at 9 dpi.
Novel VIs Could Discriminate Between Healthy and Xcc-Infected Broccoli Leaves
For every treatment (mock-control, Xcc race 1-, and Xcc race 4-infected), whole leaf reflectance spectra were registered at 1, 2, 3, 6, and 9 dpi. Those profiles revealed specific spectral patterns for each treatment, showing clear differences between them from the first timepoint measured (Figure 2; Supplementary Figures 1, 2). Thus, the use of VIs based on hyperspectral reflectance measurements seemed to be useful to distinguish between control and Xcc (race 1 or 4)-infected plants. The common VIs ARI, CRI, PRI, NDVI, and WBI were obtained from the spectra for every treatment and dpi measured and recorded in a database for each climate condition.
Figure 2. Spectral profiles of whole leaves of mock-control, Xcc race 1-infected, and Xcc race 4-infected broccoli plants at current climate conditions and at different days post-inoculation (dpi). Graphs represent mean values for every treatment. Sample size (n) is given for each timepoint and treatment: mock-control (green); Xcc race 1-infected (orange); and Xcc race 4-infected broccoli plants (purple). A, B, C, and D: 1, 3, 6, and 9 dpi, respectively.
In addition, novel VIs were designed, based on spectral differences between healthy and Xcc-infected broccoli leaves. Reflectance spectra were compared by Student's t-test in order to determine at which wavelengths reflectance values were statistically different (at least p < 0.05) between treatments. Thus, three spectral ranges were found to show maximal differences between treatments at every dpi tested: 400–500, 600–700, and 900–1000 nm. On the contrary, the regions 520–570 and 730–890 nm were very stable and not affected by the infection until 9 dpi. For this reason, they were selected for “normalization” of the designed parameters. Several wavelengths were chosen within these spectral regions of interest. To avoid redundancy of adjacent wavelengths in the reflectance spectra, only wavelengths separated by at least 40 nm were used in this process. Finally, the selected wavelengths were combined by different mathematical calculations (additions, subtractions, divisions, or combinations thereof) in order to find novel VIs showing statistical differences (p < 0.05 according to Student's t-test) between treatments along entire experiments at each climate condition. Among the large collection of proposed VIs, three of them, named diseased broccoli indices 1–3 (DBI1−3; Table 4), offered maximum significant differences between mock-control and Xcc-infected broccoli plants. It is worth noticing that DBI1−3 did not show statistically significant correlation with each other, meaning that DBI1−3 did not provide redundant information to the classifiers.
Identification of Xcc-Infected Leaves by Classificatory Algorithms
For each experimental condition, an independent database was built containing the values of selected parameters (TC-TA, NDVI, PRI, ARI, CRI, WBI, DBI1, DBI2, and DBI3) for every treatment and dpi assayed. The three databases were normalized and then randomly split in two datasets: training (70%) and testing (30%). Each of the three training dataset was used to feed supervised classifying algorithms (MLP, SVM, and kNN) to classify samples into the following categories: mock-control, Xcc race 1-, and Xcc race 4-infected leaves; each of the three testing dataset was used to calculate their performance of classification.
The MLPs provided the highest accuracy for every climate condition (Figure 3). They also provided the highest F-measure under every condition and, in general terms, the highest sensitivity. In contrast, SVM and kNN showed similar accuracies for CCC; however, these two algorithms were not able to identify control and infected samples at RCP 4.5 or RCP 8.5, with accuracies of 45–50% and rather low specificity. Moreover, any attempt of classification by MLP, SVM, or kNN into two categories (mock-control vs Xcc-infected) was inefficient. This was probably due to the underrepresentation of mock-control samples in the datasets (1/3 healthy vs. 2/3 of infected), whereas in three-category models, every group had the same size.
Figure 3. Performance of three algorithms for the classification of samples into the categories control, Xcc race 1-infected, and Xcc race 4-infected leaves in terms of overall accuracy (A), F-measure (B), sensitivity (C), and specificity (D) for each climate scenario. SVM, support vector machine; MLP, multilayer perceptron-based artificial neural network; kNN, k-nearest neighbors (k = 5 neighbors). CCC, current climate conditions; RCP 4.5 and 8.5, representative concentration pathways 4.5 and 8.5.
The suitability of the designed VIs for the identification of Xcc-infected leaves was evaluated in terms of global variable importance in the classifiers, calculated by a surrogate RF algorithm (Figure 4). The accuracies obtained for the fit of each RF were 85.7%, 87.2%, and 88.9% for CCC, RCP 4.5, and RCP 8.5, respectively. Under CCC, the most informative parameters were DBI1, DBI2, and WBI. In contrast, under RCP 4.5 conditions, TC-TA, DBI3, and PRI obtained the highest global variable importance. Finally, under RCP 8.5 conditions, DBI2, CRI, and NDVI were the most instructive parameters.
Figure 4. Global variable importance calculated using a global surrogate random forest (RF) model. CCC, current climate conditions; RCP 4.5 and 8.5, representative concentration pathways 4.5 and 8.5; ARI, anthocyanin reflectance index; CRI, carotenoid reflectance index; DBI1−3, disease broccoli index 1–3; NDVI, normalized difference vegetation index; PRI, photochemical reflectance index; TC-TA, normalized temperature; WBI, water balance index.
Discussion
Imaging techniques appear to be essential for precision agriculture due to their fast time-spatial response to biotic and abiotic stress in a non-destructive manner (Barón et al., 2016; Mahlein, 2016). In the last years, thermal and (multi- or hyper-) reflectance imaging sensors have been broadly used for monitoring stress in crop fields. Furthermore, sustainable agriculture is increasingly relying on AI (such as classifying algorithms) coupled with computer vision, to solve farming issues and to promote the automation of decision-making process (Tian et al., 2020; Nabwire et al., 2021). However, these methods require basic research to define informative parameters that efficiently report the health state and fitness of a particular crop. This work aims to define optimal VIs and classifiers for the detection of Xcc-infected broccoli leaves. Furthermore, the robustness of those models was analyzed under climate conditions mimicking those expected for Region of Murcia in years 2081–2100.
According to Fargier and Manceau (2007), when a cultivar of a brassica is infected by Xcc, a collection of polymorphisms is obtained depending on the race inoculated. In the case of broccoli plants used for this study (B. oleracea var. italic cv. calabrese natalino), the symptoms developed under CCC triggered by races 1 and 4 were similar. However, Xcc race 1 showed a slower timecourse than race 4 under the same ambient conditions. The process of undergoing climate change could affect considerably plant biochemistry and therefore plant defense responses. For this reason, it is relevant to include future climate conditions in disease detection studies. Indeed, each disease may respond differently to these variations, and thus, climate change would cause neutral, positive, or negative effects on plant responses to diseases (Trebicki et al., 2017; Velásquez et al., 2018; Cheng et al., 2019). According to the results reported here, symptoms caused by Xcc on susceptible broccoli plants would not be altered on an intermediate climate change scenario like RCP 4.5. These results are in accordance with previous works, as extensively reviewed by Gullino et al. (2018). However, the RCP 8.5 imposed a stress condition limiting or slowing down plant growth. It will be of particular interest to gain knowledge about the impact of combined high temperature and high CO2 on photosynthetic processes of the broccoli plant which, as a C3 species, is well adapted to mild temperatures. Nevertheless, further research would be needed to fully understand the impact of climate change on broccoli plant physiology (particularly on photosynthesis), as well as on the physiology of Xcc races, and/or their interaction with host plants.
In literature, a number of classic VIs derived from multispectral (and hyperspectral) imaging can be found. This VIs can be used to detect, classify, and quantify specific diseases with varying degrees of success (Lowe et al., 2017). However, high-resolution spectra recorded with hyperspectral imaging sensors allow the selection of an optimized set of wavelengths to maximize differences between healthy and infected plants. Those wavelengths can be used to create novel parameters specific for a given host–pathogen system or stress factor. This approach has already been demonstrated to be suitable to detect diseased plants when combined with AI algorithms. Thus, Mahlein et al. (2013) reported specific spectral disease indices for the detection of sugar beet plants infected with Cercospora leaf spot, sugar beet rust, or powdery mildew. Those indices improved disease detection and identification when implemented on classifiers. Similarly, Yuan et al. (2019) proposed a novel method for detecting anthracnose in tea plants based on hyperspectral imaging that included two new disease indices in the classificatory models. Moreover, the analysis of reflectance spectral data of healthy and diseased wheat ears allowed the creation of a novel index that demonstrated a stronger ability to determine the severity of the Fusarium head blight compared with other sixteen existing spectral indices (Zhang et al., 2020).
In this work, three novel VIs have been developed to successfully distinguish between healthy and Xcc-infected broccoli plants (Table 4). Leaf reflectance is a complex phenomenon dependent on biochemical and biophysical properties of the canopy leaves, which in turn are affected by growth conditions and diseases. Thus, the visible reflectance range (400–700 nm) is mostly influenced by the leaf pigment content; the reflectance in the near-infrared range (700–1100 nm) depends on water content and leaf structure, or internal scattering processes; and the short-wave infrared (1,100–2,500 nm) is influenced by the composition of leaf chemicals and water, as reviewed by Mahlein (2016). Since chlorophylls are the main pigments influencing reflectance spectrum at 400 and 690 nm, both DBI1 and DBI2 indices could be indicative of the severity of chlorosis. Moreover, DBI3 could be also related to the contents on chlorophylls and carotenes (Carter and Knapp, 2001).
DBI1, DBI2, and DBI3, together with thermal (TC-TA) and other common hyperspectral reflectance parameters (NDVI, PRI, ARI, CRI, and WBI), were implemented in three different supervised classifiers (MLP, SVM, and kNN) for each experimental condition. Since the learning process of each algorithm differs from each other, so will the quality of its predictions on the new samples. In this sense, it is a common procedure to compare the performance of several algorithms when sorting new samples (the validation datasets) after training on the same dataset. Metrics such as specificity (true negative rate), sensitivity (true positive rate), accuracy (percentage of right guesses), or F-measure (harmonic mean of precision and sensitivity) evaluate the performance of classification, that is, the estimation of the true risk of error of the output prediction of a machine learning algorithm (Shalev-Shwartz and Ben-David, 2014; Liakos et al., 2018). The MLPs were the most effective classifier, with the highest overall accuracy and F-measure under the three growing conditions assayed. The performance of the MLP models was comparable to that reported by other authors for disease detection classifiers. Indeed, an increasing number of studies apply classifiers to spectral data (including or not thermal parameters) to identify infected plants at conditions resembling CCC. For example, Sankaran et al. (2013) reported an accuracy of 87% when classifying citrus trees infected by Candidatus Liberibacter spp, a bacteria causing Huanglongbing disease. Zarco-Tejada et al. (2018) obtained accuracies of disease detection exceeding 80% when classifying Xylella fastidiosa-infected olive trees. This pathogen, alike Xcc, is a xylem bacterium. Abdulridha et al. (2020a,b) identified tomato plants infected with tomato yellow leaf curl virus, Xanthomonas perforans, or Corynespora cassiicola (a fungus) with 94–100% accuracy depending on the pathogen. Pérez-Bueno et al. (2019b) detected avocado trees suffering white root rot (caused by the fungus Rosellinia necatrix) with accuracies up to 82.5%. Nguyen et al. (2021) achieved accuracies ranging from 82 to 96.75% when identifying vines affected by the Grapevine vein-clearing virus. Similarly to the results here reported, Yuan et al. (2019) designed novel hyperspectral reflectance indices which help to identify Gloeosporium theae-sinesis Miyake-infected tea plants with 94 and 98% accuracies at pixel and leaf levels, respectively.
The performance of the models was affected differentially by growing conditions, depending on the classifier. In both RCPs, the accuracy of the classifiers decreased in all cases. However, the accuracy of models based on MLP only decreased from 88.1% at CCC to 76.9 and 83.3% for RCP 4.5 and RCP 8.5, respectively. This advantage of MLPs against SVM and kNN models could be related to the fact that MLPs are less affected by noise factors (compared to other algorithms), which in turn reduces significantly the influence of the unknown variability. Therefore, MLPs are usually more robust models that often outperform other classifying algorithms in solving a variety of classification problems (Basheer and Hajmeer, 2000; Bala and Kumar, 2017). To our best knowledge, this is the first time that machine learning classifiers have been applied to hyperspectral and thermal data taken under climate conditions mimicking those projected for the future in order to classify healthy and infected plants.
DBI1, DBI2, and DBI3 proved to be important features for plant classification according to a surrogate RF used for testing the global importance of variables. Overall, DBI1 and DBI2 were the most informative parameters of the set for CCC. However, the global variable importance varied for each parameter depending on the climate conditions. Under RCP 4.5 conditions, TC-TA and DBI3 were the most informative parameters. In contrast, DBI2 was the parameter with the highest global variable importance at RCP 8.5. This effect may be due to the impact of growing conditions on the symptomatology (degree of chlorosis and/or necrosis) of the infections, as discussed above.
Conclusion
The parameters DBI1, DBI2, and DBI3 here presented are good reporters for Xcc infection in broccoli leaves. Furthermore, the model based on MLP and the set of parameters DBI1, DBI2, and DBI3 along with common VIs (ARI, CRI, NDVI, PRI, and WBI) and TC-TA would be an effective procedure for the identification of Xcc-broccoli infected plants. In addition, this model proved to be robust regardless of the climate conditions.
Data Availability Statement
The original contributions presented in the study are included in the article/Supplementary Material. Further inquiries can be directed to the corresponding authors.
Author Contributions
MP, MLP-B, and MB conceived and designed the experiments and wrote the manuscript. MP and MP-B conducted the experiments. MP analyzed the data, interpreted the results, and mounted images. MB contributed to the materials, equipment, and analysis tools. All the authors reviewed it and approved the final version.
Funding
This work was supported by grant RTI2018-094652-B-I00 funded by MCIN/AEI/10.13039/501100011033 and by “ERDF: A way of making Europe”. The free open access publication was partially funded by Consejo Superior de Investigaciones Científicas (CSIC) through the Unidad de Recursos de Información Científica para la Investigación (URICI).
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher's Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary Material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpls.2022.790268/full#supplementary-material
Supplementary Figure 1. Spectral profiles of whole leaves of mock-control, Xcc race 1-infected, and Xcc race 4-infected broccoli plants at RCP 4.5 and at different days post-inoculation (dpi). Graphs represent mean values for every treatment. Sample size (n) is given for each timepoint and treatment: mock-control (green); Xcc race 1-infected (orange); and Xcc race 4-infected broccoli plants (purple).
Supplementary Figure 2. Spectral profiles of whole leaves of mock-control, Xcc race 1-infected, and Xcc race 4-infected broccoli plants at RCP 8.5 and at different days post-inoculation (dpi). Graphs represent mean values (n = 4) for every treatment and timepoint.
References
Aasen, H., Van Wittenberghe, S., Medina, N. S., Damm, A., Goulas, Y., Wieneke, S., et al. (2019). Sun-induced chlorophyll fluorescence II: review of passive measurement setups, protocols, and their application at the leaf to canopy level. Remote Sens. 11, 33. doi: 10.3390/rs11080927
Abdulridha, J., Ampatzidis, Y., Kakarla, S. C., and Roberts, P. (2020a). Detection of target spot and bacterial spot diseases in tomato using UAV-based and benchtop-based hyperspectral imaging techniques. Precis. Agric. 21, 955–978. doi: 10.1007/s11119-019-09703-4
Abdulridha, J., Ampatzidis, Y., Qureshi, J., and Roberts, P. (2020b). Laboratory and UAV-based identification and classification of tomato yellow leaf curl, bacterial spot, and target spot diseases in tomato utilizing hyperspectral imaging and machine learning. Remote Sens. 12, 2732. doi: 10.3390/rs12172732
Abdulridha, J., Batuman, O., and Ampatzidis, Y. (2019). UAV-based remote sensing technique to detect citrus canker disease utilizing hyperspectral imaging and machine learning. Remote Sens. 11, 1373. doi: 10.3390/rs11111373
Aidoo, O. F., Cunze, S., Guimapi, R. A., Arhin, L., Ablormeti, F. K., Tettey, E., et al. (2021). Lethal yellowing disease: insights from predicting potential distribution under different climate change scenarios. J. Plant Dis. Prot. 128, 1313–1325. doi: 10.1007/s41348-021-00488-1
Bagherzadeh, A., Hoseini, A. V., and Totmaj, L. H. (2020). The effects of climate change on normalized difference vegetation index (NDVI) in the Northeast of Iran. Model. Earth Syst. Environ. 6, 671–683. doi: 10.1007/s40808-020-00724-x
Bala, R., and Kumar, D. (2017). Classification using ANN: a review. Int. J. Comput. Intell. Res. 13, 1811–1820.
Barón, M., Pineda, M., and Pérez-Bueno, M. L. (2016). Picturing pathogen infection in plants. Z. Naturforsch. C 71, 355–368. doi: 10.1515/znc-2016-0134
Basheer, I. A., and Hajmeer, M. (2000). Artificial neural networks: fundamentals, computing, design, and application. J. Microbiol. Methods 43, 3–31. doi: 10.1016/S0167-7012(00)00201-3
Behmann, J., Mahlein, A.-K., Rumpf, T., Römer, C., and Plümer, L. (2015). A review of advanced machine learning methods for the detection of biotic stress in precision crop protection. Precis. Agric. 16, 239–260. doi: 10.1007/s11119-014-9372-7
Berthold, M. R., Cebron, N., Dill, F., Gabriel, T. R., Kötter, T., Meinl, T., et al. (2008). KNIME: The Konstanz Information Miner. Freiburg: Springer Berlin Heidelberg, 319–326.
Blanzieri, E., and Melgani, F. (2008). Nearest neighbor classification of remote sensing images with the maximal margin principle. IEEE Trans. Geosci. Remote 46, 1804–1811. doi: 10.1109/TGRS.2008.916090
Carter, G. A., and Knapp, A. K. (2001). Leaf optical properties in higher plants: linking spectral characteristics to stress and chlorophyll concentration. Am. J. Bot. 88, 677–684.
Cheng, Y. T., Zhang, L., and He, S. Y. (2019). Plant-microbe interactions facing environmental challenge. Cell Host Microbe 26, 183–192. doi: 10.1016/j.chom.2019.07.009
Chlingaryan, A., Sukkarieh, S., and Whelan, B. (2018). Machine learning approaches for crop yield prediction and nitrogen status estimation in precision agriculture: a review. Comput. Electron. Agric. 151, 61–69. doi: 10.1016/j.compag.2018.05.012
Ekman, J., Tesoriero, L., and Grigg, S. (2014). Pests, Diseases and Disorders of Brassica Vegetables: A Field Identification Guide. North Sydney, NSW: Horticulture Australia.
El-Hendawy, S. E., Al-Suhaibani, N. A., Elsayed, S., Hassan, W. M., Dewir, Y. H., Refay, Y., et al. (2019). Potential of the existing and novel spectral reflectance indices for estimating the leaf water status and grain yield of spring wheat exposed to different irrigation rates. Agric. Water Manag. 217, 356–373. doi: 10.1016/j.agwat.2019.03.006
Fargier, E., and Manceau, C. (2007). Pathogenicity assays restrict the species Xanthomonas campestris into three pathovars and reveal nine races within X. campestris pv. campestris. Plant Pathol. 56, 805–818. doi: 10.1111/j.1365-3059.2007.01648.x
Fuchs, M., and Tanner, C. B. (1966). Infrared thermometry of vegetation. Agron. J. 58, 597–601. doi: 10.2134/agronj1966.00021962005800060014x
Gamon, J. A., Peñuelas, J., and Field, C. B. (1992). A narrow-waveband spectral index that tracks diurnal changes in photosynthetic efficiency. Remote Sens. Environ. 41, 35–44. doi: 10.1016/0034-4257(92)90059-S
Gao, Z., Luo, Z., Zhang, W., Lv, Z., and Xu, Y. (2020). Deep learning application in plant stress imaging: a review. AgriEngineering 2, 430–446. doi: 10.3390/agriengineering2030029
Gerhards, M., Schlerf, M., Mallick, K., and Udelhoven, T. (2019). Challenges and future perspectives of multi-/hyperspectral thermal infrared remote sensing for crop water-stress detection: a review. Remote Sens. 11, 1240. doi: 10.3390/rs11101240
Gitelson, A. A., Merzlyak, M. N., and Chivkunova, O. B. (2001). Optical properties and nondestructive estimation of anthocyanin content in plant leaves. Photochem. Photobiol. 74, 38–45. doi: 10.1562/0031-8655(2001)074<0038:opaneo>2.0.co;2
Gitelson, A. A., Zur, Y., Chivkunova, O. B., and Merzlyak, M. N. (2002). Assessing carotenoid content in plant leaves with reflectance spectroscopy. Photochem. Photobiol. 75, 272–281. doi: 10.1562/0031-8655(2002)0750272ACCIPL2.0.CO2
Golhani, K., Balasundram, S. K., Vadamalai, G., and Pradhan, B. (2018). A review of neural networks in plant disease detection using hyperspectral data. Inf. Process. Agric. 5, 354–371. doi: 10.1016/j.inpa.2018.05.002
Gullino, M. L., Pugliese, M., Gilardi, G., and Garibaldi, A. (2018). Effect of increased CO2 and temperature on plant diseases: a critical appraisal of results obtained in studies carried out under controlled environment facilities. J. Plant Pathol. 100, 371–389. doi: 10.1007/s42161-018-0125-8
Hahn, F. (2009). Actual pathogen detection: sensors and algorithms – a review. Algorithms 2, 301–338. doi: 10.3390/a2010301
Huete, A., Didan, K., Miura, T., Rodriguez, E. P., Gao, X., and Ferreira, L. G. (2002). Overview of the radiometric and biophysical performance of the MODIS vegetation indices. Remote Sens. Environ. 83, 195–213. doi: 10.1016/S0034-4257(02)00096-2
IPCC (2014). AR5. Climate Change 2014: Synthesis Report. Contribution of Working Groups I, II and III to the Fifth Assessment Report of the Intergovernmental Panel on Climate Change. Geneva: IPCC. Available online at: https://www.ipcc.ch/report/ar5/syr/
Jia, M., Wang, Z., Wang, C., Mao, D., and Zhang, Y. (2019). A new vegetation index to detect periodically submerged mangrove forest using single-tide Sentinel-2 imagery. Remote Sens. 11, 2043. doi: 10.3390/rs11172043
Jung, J., Maeda, M., Chang, A., Bhandari, M., Ashapure, A., and Landivar-Bowles, J. (2021). The potential of remote sensing and artificial intelligence as tools to improve the resilience of agriculture production systems. Curr. Opin. Biotechnol. 70, 15–22. doi: 10.1016/j.copbio.2020.09.003
Kalisa, W., Igbawua, T., Henchiri, M., Ali, S., Zhang, S., Bai, Y., et al. (2019). Assessment of climate impact on vegetation dynamics over East Africa from 1982 to 2015. Sci. Rep. 9, 16865. doi: 10.1038/s41598-019-53150-0
Kashyap, B., and Kumar, R. (2021). Sensing methodologies in agriculture for monitoring biotic stress in plants due to pathogens and pests. Inventions 6, 29. doi: 10.3390/inventions6020029
Liakos, K. G., Busato, P., Moshou, D., Pearson, S., and Bochtis, D. (2018). Machine learning in agriculture: a review. Sensors 18, 2674. doi: 10.3390/s18082674
Lowe, A., Harrison, N., and French, A. P. (2017). Hyperspectral image analysis techniques for the detection and classification of the early onset of plant disease and stress. Plant Methods 13, 80. doi: 10.1186/s13007-017-0233-z
Maes, W. H., and Steppe, K. (2019). Perspectives for remote sensing with unmanned aerial vehicles in precision agriculture. Trends Plant Sci. 24, 152–164. doi: 10.1016/j.tplants.2018.11.007
Mahlein, A.-K. (2016). Plant disease detection by imaging sensors – parallels and specific demands for precision agriculture and plant phenotyping. Plant Dis. 100, 241–251. doi: 10.1094/pdis-03-15-0340-fe
Mahlein, A. K., Rumpf, T., Welke, P., Dehne, H. W., Plümer, L., Steiner, U., et al. (2013). Development of spectral indices for detecting and identifying plant diseases. Remote Sens. Environ. 128, 21–30. doi: 10.1016/j.rse.2012.09.019
Mansfield, J., Genin, S., Magori, S., Citovsky, V., Sriariyanum, M., Ronald, P., et al. (2012). Top 10 plant pathogenic bacteria in molecular plant pathology. Mol. Plant Pathol. 13, 614–629. doi: 10.1111/j.1364-3703.2012.00804.x
Miao, X., Gong, P., Swope, S., Pu, R., and Carruthers, R. (2007). Detection of yellow starthistle through band selection and feature extraction from hyperspectral imagery. Photogramm. Eng. Remote Sensing 73, 1005–1015.
Milthorpe, F. L., and Spencer, E. J. (1957). Experimental studies of the factors controlling transpiration. J. Exp. Bot. 8, 413–437. doi: 10.1093/jxb/8.3.413
Nabwire, S., Suh, H.-K., Kim, M. S., Baek, I., and Cho, B.-K. (2021). Review: application of artificial intelligence in phenomics. Sensors 21, 4363. doi: 10.3390/s21134363
Nguyen, C., Sagan, V., Maimaitiyiming, M., Maimaitijiang, M., Bhadra, S., and Kwasniewski, M. T. (2021). Early detection of plant viral disease using hyperspectral imaging and deep learning. Sensors 21, 742. doi: 10.3390/s21030742
Peñuelas, J., Filella, I., Biel, C., Serrano, L., and Savé, R. (1993). The reflectance at the 950–970 nm region as an indicator of plant water status. Int. J. Remote Sens. 14, 1887–1905. doi: 10.1080/01431169308954010
Pérez-Bueno, M. L., Pineda, M., and Barón, M. (2019a). Phenotyping plant responses to biotic stress by chlorophyll fluorescence imaging. Front. Plant Sci. 10:1135. doi: 10.3389/fpls.2019.01135
Pérez-Bueno, M. L., Pineda, M., Cabeza, F., and Barón Ayala, M. (2016). Multicolor fluorescence imaging as a candidate for disease detection in plant phenotyping. Front. Plant Sci. 7:1790. doi: 10.3389/fpls.2016.01790
Pérez-Bueno, M. L., Pineda, M., Vida, C., Fernández-Ortuño, D., Torés, J. A., De Vicente, A., et al. (2019b). Detection of white root rot in avocado trees by remote sensing. Plant Dis. 103, 1119–1125. doi: 10.1094/PDIS-10-18-1778-RE
Pineda, M., Barón, M., and Pérez-Bueno, M.-L. (2021). Thermal imaging for plant stress detection and phenotyping. Remote Sens. 13, 68. doi: 10.3390/rs13010068
Sankaran, S., Maja, J. M., Buchanon, S., and Ehsani, R. (2013). Huanglongbing (citrus greening) detection using visible, near infrared and thermal imaging techniques. Sensors 13, 2117–2130. doi: 10.3390/s130202117
Savary, S., Ficke, A., Aubertot, J.-N., and Hollier, C. (2012). Crop losses due to diseases and their implications for global food production losses and food security. Food Secur. 4, 519–537. doi: 10.1007/s12571-012-0200-5
Scarth, G. W., Loewy, A., and Shaw, M. (1948). Use of the infrared total absorption method for estimating the time course of photosynthesis and transpiration. Can. J. Res. 26c, 94–107. doi: 10.1139/cjr48c-010
Shalev-Shwartz, S., and Ben-David, S. (2014). Understanding Machine Learning: From Theory to Algorithms. Cambridge: Cambridge University Press.
Sperschneider, J. (2020). Machine learning in plant–pathogen interactions: empowering biological predictions from field scale to genome scale. New Phytol. 228, 35–41. doi: 10.1111/nph.15771
Talaviya, T., Shah, D., Patel, N., Yagnik, H., and Shah, M. (2020). Implementation of artificial intelligence in agriculture for optimisation of irrigation and application of pesticides and herbicides. Artif. Intell. Agric. 4, 58–73. doi: 10.1016/j.aiia.2020.04.002
Tian, H., Wang, T., Liu, Y., Qiao, X., and Li, Y. (2020). Computer vision technology in agricultural automation—a review. Inf. Process. Agric. 7, 1–19. doi: 10.1016/j.inpa.2019.09.006
Tortosa, M., Cartea, M. E., Rodríguez, V. M., and Velasco, P. (2018). Unraveling the metabolic response of Brassica oleracea exposed to Xanthomonas campestris pv. campestris. J. Sci. Food Agric. 98, 3675–3683. doi: 10.1002/jsfa.8876
Trebicki, P., Dáder, B., Vassiliadis, S., and Fereres, A. (2017). Insect–plant–pathogen interactions as shaped by future climate: effects on biology, distribution, and implications for agriculture. Insect Sci. 24, 975–989. doi: 10.1111/1744-7917.12531
Trivedi, P., Batista, B. D., Bazany, K. E., and Singh, B. K. (2022). Plant–microbiome interactions under a changing world: responses, consequences and perspectives. New Phytol. 234, 1951–1959. doi: 10.1111/nph.18016
Tucker, C. J. (1979). Red and photographic infrared linear combinations for monitoring vegetation. Remote Sens. Environ. 8, 127–150. doi: 10.1016/0034-4257(79)90013-0
Velásquez, A. C., Castroverde, C. D. M., and He, S. Y. (2018). Plant–pathogen warfare under changing climate conditions. Curr. Biol. 28, R619–R634. doi: 10.1016/j.cub.2018.03.054
Yuan, L., Yan, P., Han, W., Huang, Y., Wang, B., Zhang, J., et al. (2019). Detection of anthracnose in tea plants based on hyperspectral imaging. Comput. Electron. Agric. 167, 105039. doi: 10.1016/j.compag.2019.105039
Zarco-Tejada, P. J., Camino, C., Beck, P. S. A., Calderon, R., Hornero, A., Hernández-Clemente, R., et al. (2018). Previsual symptoms of Xylella fastidiosa infection revealed in spectral plant-trait alterations. Nat. Plants 4, 432–439. doi: 10.1038/s41477-018-0189-7
Zhan, J., Thrall, P. H., Papaïx, J., Xie, L., and Burdon, J. J. (2015). Playing on a pathogen's weakness: using evolution to guide sustainable plant disease control strategies. Annu. Rev. Phytopathol. 53, 19–43. doi: 10.1146/annurev-phyto-080614-120040
Zhang, C., Ren, H., Qin, Q., and Ersoy, O. K. (2017). A new narrow band vegetation index for characterizing the degree of vegetation stress due to copper: the copper stress vegetation index (CSVI). Remote Sens. Lett. 8, 576–585. doi: 10.1080/2150704X.2017.1306135
Zhang, D., Wang, Q., Lin, F., Yin, X., Gu, C., and Qiao, H. (2020). Development and evaluation of a new spectral disease index to detect wheat fusarium head blight using hyperspectral imaging. Sensors 20, 2260. doi: 10.3390/s20082260
Zhang, J., Feng, X., Wu, Q., Yang, G., Tao, M., Yang, Y., et al. (2022). Rice bacterial blight resistant cultivar selection based on visible/near-infrared spectrum and deep learning. Plant Methods 18, 49. doi: 10.1186/s13007-022-00882-2
Keywords: biotic stress, climate change, hyperspectral reflectance imaging, machine learning, thermography
Citation: Pineda M, Pérez-Bueno ML and Barón M (2022) Novel Vegetation Indices to Identify Broccoli Plants Infected With Xanthomonas campestris pv. campestris. Front. Plant Sci. 13:790268. doi: 10.3389/fpls.2022.790268
Received: 06 October 2021; Accepted: 23 May 2022;
Published: 23 June 2022.
Edited by:
Nam-Hai Chua, Temasek Life Sciences Laboratory, SingaporeReviewed by:
Mohsen Yoosefzadeh Najafabadi, University of Guelph, CanadaLuigi De Bellis, University of Salento, Italy
Copyright © 2022 Pineda, Pérez-Bueno and Barón. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Mónica Pineda, monica.pineda@eez.csic.es; María Luisa Pérez-Bueno, marisa.perez@ugr.es