Abstract
Hyperspectral imaging systems used in plant science or agriculture often have suboptimal signal-to-noise ratio in the blue region (400–500 nm) of the electromagnetic spectrum. Typically there are two principal reasons for this effect, the low sensitivity of the imaging sensor and the low amount of light available from the illuminating source. In plant science, the blue region contains relevant information about the physiology and the health status of a plant. We report on the improvement in sensitivity of a hyperspectral imaging system in the blue region of the spectrum by using supplemental illumination provided by an array of high brightness light emitting diodes (LEDs) with an emission peak at 470 nm.
Keywords: hyperspectral imaging, plant reflectance, blue LED array, signal-to-noise
1. Introduction
Hyperspectral imaging is commonly used to study the characteristics of plants in a certain environment, or their reaction to abiotic (drought, nutrient deficits, heavy metals) or biotic (plant diseases, pests, weeds) stress at different scales, from remote to proximal sensing [1,2]. The visible spectrum (VIS, 400–700 nm) is mainly influenced by the absorbance of leaf pigments (chlorophylls, carotenoids, xanthophylls, and anthocyanins) [3,4], and many studies focus on the use of visible reflectance in plant science. However the reflectance of light at blue wavelengths (400–500 nm) is often neglected due to technical limitations, despite relevant information on the optical properties of plants, such as absorbance maxima of chlorophyll a, chlorophyll b and ß-carotene being contained in this region of the electromagnetic spectrum. Changes in the composition of these pigments are a first indicator of plant stress and can be assessed by hyperspectral imaging [5] and, as a consequence, several vegetation indices, based on reflectance wavelength around 450 nm, have been introduced. For example, the Normalized Phaeophytinization Index (NPQI = (R415 − R435)/(R415 + R435)) [6] has been applied as an early detection of spider mites in apples. The Plant Stress Index (PSR = R430/R680) or the Structure Independent Pigment Index (SIPI = (R800 − R435)/(R800 + R680)) have been developed to evaluate the ratio among carotenoids and chlorophylls [6]. Mahlein et al. [7] found a high relevance of the blue reflection in correlation to the disease severity of powdery mildew and rust in sugar beet. However, the technical performance of different hyperspectral imaging or non-imaging sensors in the blue region is often limited by the noise versus the available signal. The spectral response of a hyperspectral system depends upon two principal factors, firstly, the spectral sensitivity of the hyperspectral camera sensor and, secondly, the spectral profile of the illuminating source, which is often a black body emitter [8]. Unfortunately, in the region between 400 and 500 nm, both the sensitivity of hyperspectral camera sensors and the amount of available light delivered by the illuminating source are typically low resulting in a poor signal-to-noise ratio for spectral signatures in this range. Nevertheless, these hyperspectral systems with halogen bulbs as a stable and diffuse light source are well established and proven equipment in manifold studies assessing plant properties non-invasively [9,10,11,12]. Therefore the objective of the present work was to improve the sensor signal by the addition of additional illumination in the blue region. A supplemental blue light-emitting diode (LED) lighting array with an emission peak at 470 nm was developed and tested under controlled conditions.
2. Experimental Section
2.1. Hyperspectral Measuring Setup
Hyperspectral images were recorded with a line scanning spectrograph (ImSpector V10E, Spectral Imaging Ltd., Oulu, Finland) covering the VIS and the NIR ranges from 400 to 1000 nm, with a spectral resolution of up to 2.8 nm and a spatial resolution of 0.12 mm per pixel, resulting in 210 hyperspectral bands (Figure 1a). As experimental plants sugar beets, cultivar Pauletta (KWS, Einbeck, Germany), diseased with Cercospora leaf spot and sugar beet rust were used (plant material was prepared according to [9]). Constant illumination was provided by six ASD-Pro-Lamps (Analytical Spectral Devices Inc., Boulder, CO, USA) (Figure 1b). The hyperspectral camera and the illumination system were installed on a motorized line scanner (Spectral Imaging Ltd.) to obtain a second spatial dimension. The camera settings and the control of the motorized line scanner were adapted using the SpectralCube software (Version 3.62, 2000, Spectral Imaging Ltd.). Hyperspectral images were recorded in a dark chamber in order to realize constant and reproducible illumination and measurement conditions. Normalization of raw hyperspectral images was performed using the software ENVI 4.6+IDL 7.0 (EXELIS Visual Information Solutions, Boulder, CO, USA). Reflectance was calculated relative to a white reference bar and to dark current measurement.
2.2. Supplemental Blue LED Lighting Array
The supplemental illumination board was configured as an array of 10 × 470 nm LEDs (Avago ASMT-JL31, Avago Technologies, San José, CA, USA). This array was mounted in parallel, next to the six ASD-Pro-Lamps of the hyperspectral system. The sample of interest was then illuminated with a constant intensity (Figure 1a, b). This was achieved by spacing the LEDs on a printed circuit board (PCB) in such a manner that the resulting intensity of illumination along the camera’s scan-line was uniform at the sample surface. The PCB also accommodated the constant current source for the LEDs (ON Semiconductor—CAT4101), screw terminals for power connections and mounting points for connecting it to the motorized scanning stage.
3. Results and Discussion
The applicability of a simple supplemental blue LED lighting array with an emission peak at 470 nm was developed and tested under controlled conditions for hyperspectral imaging of sugar beet leaves.
3.1. Noise Profile
To measure the noise profile of the hyperspectral system, the hyperspectral image profile of a white, barium sulphate, reference bar was recorded. The standard deviation of the measured reflectance values, as a function of wavelength, was then computed. With reference to the dotted black line in Figure 2a, the measured noise profile for the original ASD-Pro-Lamp illuminated system, without supplemental LED lighting, shows a high standard deviation in measured values at both extremes of the spectral range, i.e., in the 400–500 nm visible (blue colour) and 900–1000 nm near infrared regions. In these areas the measured standard deviation may represent greater than 10% of the measured signal for the white reference bar.
The noise profile for the system with the inclusion of the supplemental illumination, as depicted by the solid red line of Figure 2a, indicates an appreciable reduction in the standard deviation in the range 400–500 nm. Figure 2b illustrates a comparison of the reflectance spectrum recorded for the same region of a healthy sugar beet leaf for the system with and without supplemental LED lighting array. The data without the use of the supplemental lighting array shows significantly greater noise in the 400–500 nm region of the spectrum versus the equivalent readings with the dual lighting configuration. This effect could potentially be improved still further with the use of a data pre-processing step, such as the application of a Savitzky-Golay filter [13]. Figure 2c visualizes the standard deviation of the reflectance data measured across the same region (15,000 pixels in area) of the surface of a healthy sugar beet leaf. A noticeable reduction in the standard deviation is observed in the blue region (400–500 nm) and can be as much as 75% at 430 nm.
3.2. Improved Sensitivity of Spectral Vegetation Indices
The use of the supplemental illumination results in a significant reduction in noise in the images, potentially enabling structures within the leaf surface to be more easily characterized or identified at an earlier stage. Figure 3a,b, show greyscale images of the reflectance of a sugar beet leaf at 450 nm, false colour SIPI images with and without the use of the supplemental LED illumination, Figure 3c an RGB image of the sample and Figure 3d a transect of the SIPI through one of the leaf spots, respectively. Transects trough a Cercospora leaf spot reveal a higher sensitivity and detail rich information using the supplemental LED illumination. As a consequence of further developments in commercial LED and imaging detector components this research indicates that in combination they will enable the delivery of cost-effective hyperspectral sensors systems, for plant science and agriculture that provide greater spectral and spatial sensitivity than it is currently achievable [14].
4. Conclusions
This study indicates that the inclusion of a supplemental 400–500 nm (blue light) LED lighting array can significantly improve the sensitivity of hyperspectral plant images, under controlled conditions. The standard deviation of the measured data from a white barium sulphate reference object in this region was observed to decrease by a factor of 4. Tests of this system on healthy and diseased sugar beet leaves showed that both the recorded reflectance spectra and the recorded images in the 400–500 nm region of the spectrum show significantly less signal noise and a significantly lower standard deviation with the proposed additional illumination. The inexpensive and minor—but effective—modification to a hyperspectral imagining system could be applied in future agronomic research to improve the study of abiotic and biotic plant stress symptoms. There are indications that especially wavelength from 400–500 nm are sensitive to early reactions of plants to plant diseases, even before visible symptoms appear. Furthermore the use of the blue LED illumination system will provide more reliable results if vegetation indices with wavelength from 400–500 nm are calculated. This approach can be transferred to different imaging and non-imaging system and is not limited to the camera setup presented. Such modified hyperspectral imaging systems may assist with the detection and identification of plant stress in phenotyping studies.
Acknowledgments
This work could be carried out due to the financial support by the UK Engineering and Physical Sciences Research Council (EPSRC) under the “Manchester Image Reconstruction and Analysis (MIRAN) grant” (reference: EP/K00428X/1), by the German Federal Ministry of Education and Research (BMBF) within the scope of the competitive grants program “Networks of excellence in agricultural and nutrition research—CROP.SENSe.net” (funding code: 0315529) and due to financial support of the Daimler and Benz foundation.
Author Contributions
Anne-Katrin Mahlein, Simon Hammersley, Erich-Christian Oerke, Heinz-Wilhelm Dehne, Heiner Goldbach and Bruce Grieve conceived the study idea and designed the experiments. Anne-Katrin Mahlein and Simon Hammersley developed the blue LED illumination system, performed the experiments and drafted the manuscript. All authors read and approved the manuscript.
Conflicts of Interest
The authors declare no conflict of interest.
References
- 1.Carter G.A., Knapp A.K. Leaf optical properties in higher plants: Linking spectral characteristics to stress and chlorophyll concentration. Am. J. Bot. 2001;88:677–684. doi: 10.2307/2657068. [DOI] [PubMed] [Google Scholar]
- 2.Mahlein A.-K., Steiner U., Oerke E.-C., Dehne H.-W. Recent advances in sensing plant diseases for precision crop protection. Eur. J. Plant Pathol. 2012;133:197–209. doi: 10.1007/s10658-011-9878-z. [DOI] [Google Scholar]
- 3.Gitelson A.A., Merzlyak M.N. Signature analysis of leaf reflectance spectra: Algorithm development for remote sensing of chlorophyll. J. Plant Physiol. 1996;148:494–500. doi: 10.1016/S0176-1617(96)80284-7. [DOI] [Google Scholar]
- 4.Sims D.A., Gamon J.A. Relationships between leaf pigment content and spectral reflectance across a wide range of species, leaf structures and developmental stages. Remote Sens. Environ. 2002;81:337–354. doi: 10.1016/S0034-4257(02)00010-X. [DOI] [Google Scholar]
- 5.Penuelas J., Filella I. Visible and near-infrared reflectance techniques for diagnosing plant physiological status. Trends Plant Sci. 1998;3:151–156. doi: 10.1016/S1360-1385(98)01213-8. [DOI] [Google Scholar]
- 6.Penuelas J., Filella I., Lloret P., Munoz F., Vilajeliu M. Reflectance assessment of mite effects on apple trees. Int. J. Remote Sens. 1995;16:2727–2733. doi: 10.1080/01431169508954588. [DOI] [Google Scholar]
- 7.Mahlein A.-K., Rumpf T., Welke P., Dehne H.-W., Plümer L., Steiner U., Oerke E.-C. Development of spectral indices for detecting and identifying plant diseases. Remote Sens. Environ. 2013;128:21–30. doi: 10.1016/j.rse.2012.09.019. [DOI] [Google Scholar]
- 8.Bousquet L., Lachérade S., Jacquemoud S., Moya I. Leaf BRDF measurements and model for specular and diffuse components differentiation. Remote Sens. Environ. 2005;98:201–211. doi: 10.1016/j.rse.2005.07.005. [DOI] [Google Scholar]
- 9.Mahlein A.-K., Steiner U., Hillnhütter C., Dehne H.-W., Oerke E.-C. Hyperspectral imaging for small-scale analysis of symptoms caused by different sugar beet diseases. Plant Methods. 2012;8:3. doi: 10.1186/1746-4811-8-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Feilhauer H., Oerke E.C., Schmidtlein S. Quantifying empirical relations between planted species mixtures and canopy reflectance with PROTEST. Remote Sens. Environ. 2010;114:1513–1521. doi: 10.1016/j.rse.2010.02.006. [DOI] [Google Scholar]
- 11.Carvalho S., Macel M., Schlerf M., Skidmore A.K., van der Putten W.H. Soil biotic impact on plant species shoot chemistry and hyperspectral reflectance patterns. New Phytol. 2012;196:1133–1144. doi: 10.1111/j.1469-8137.2012.04338.x. [DOI] [PubMed] [Google Scholar]
- 12.Delalieux S., Somers B., Verstaeten W.W., van Aardt J.A.N., Keulemans W., Coppin P. Hyperspectral indices to diagnose leaf biotic stress of apple plants, considering leaf phenology. Int. J. Remote Sens. 2009;30:1887–1912. doi: 10.1080/01431160802541556. [DOI] [Google Scholar]
- 13.Savitzky A., Golay J.M.E. Smoothing and differentiation of data by simplified least squares procedures. Anal. Chem. 1964;36:1627–1639. doi: 10.1021/ac60214a047. [DOI] [Google Scholar]
- 14.Grieve B.D, Hammersley S., Mahlein A.K., Oerke E.C., Goldbach H. Localized multispectral crop imaging sensors: Engineering & validation of a cost effective plant stress and disease sensor. In: Gurkan D., Baglio S., editors. Proceedings of the IEEE 2015 Sensors Applications Symposium; Zadar, Croatia. 11–15 April 2015; Piscataway, NJ, USA: IEEE Instrument & Measurement Society; 2015. [Google Scholar]