1. Introduction
Modern advanced greenhouses are increasingly equipped with control functionalities. The temperature, humidity, CO
2-concentration, and light intensity can be controlled to optimal values, and irrigation and fertilization can be automated [
1]. An interesting development for automated and efficient precision agriculture is the detection and diagnosis of plant stress. Standard methods for stress detection are often destructive or disruptive [
2] and, hence, not an option for on-line detection.
However, much research has been carried out in the area of optical sensors [
3] for measuring the reflected and fluorescent light from the canopy as a mean for non-distruptive remote sensing of stress. Even though many methods have been suggested, sensor-based phenotyping is still at an early stage of development and not yet commonly applied in the field [
3,
4]. Thus, there is still a need for more research to develop reliable and cost-effective sensors for stress detection [
2].
The light energy absorbed by the plants is used for photosynthesis, reemitted as heat, or reemitted as fluorescence. This has made fluorescence an indispensable tool for studying photosynthesis in a wide range of applications [
5,
6]. In particular, if stress factors influence the plants in a way such that the photosynthesis is affected, one would expect an influence on the fluorescence response as well.
Fluorescence is classically measured and analysed using a pulse amplitude modulation fluorometer (PAM) and requires measurements from both fully dark adapted plants and plants at fully saturating light [
7]. In practice, this restricts its use to mainly on-leaf measurements. Another, completely different, fluorescence based method is sensing of solar induced fluorescence (SIF) [
8,
9]. This is a passive method, done remotely on an airborne scale, measuring the fluorescence of a whole field, for example.
In between remotely sensed and on-leaf level sensed fluorescence, there is proximal sensing [
10]. One method using proximal sensing of fluorescence is the laser induced fluorescence transient (LIFT) technique [
11]. A blue laser projects a collimated beam onto the leaves, in flashlets of 1.6 μs and in excitation protocols with up to 7500 flashlets [
12]. The emitted fluorescence at 690 nm is collected and then used to determine the photosynthetic properties. The LIFT device can be used both in labs and in the field, at distances up to 50 m [
13]. Another innovation in the field of proximal sensing and fluorescence measurements, was presented by Urschel and Pocock [
14]. It uses a chlorophyll
a fluorometer, developed to capture canopy level red and far-red fluorescence (i.e., the peaks around 685 and 740 nm), induced by saturating light pulses. The instrument, however, was mainly developed to monitor growth.
There is a great deal of ongoing research on advanced optical sensors for stress detection (see review articles [
2,
4,
15]). A wide range of spectral and spatial resolutions on the sensors are used; fluorescence spectroscopy [
16,
17] and multicolour fluorescence imaging [
18] as well as hyperspectral imaging [
19,
20,
21,
22]. Such equipment generates large amounts of data, and one method of handling these data is to use machine learning algorithms for feature selection [
21] as well as for classification. For a review of classification of biotic stresses using machine learning, please see [
23].
Not only are different types of sensors under investigation but also many different types of light protocols are used when gathering data. In addition to referring to the reviews, we highlight a few recent and, from our point of view, particularly interesting studies: Sun et al. [
24] investigated three different mutants of
Arabidopsis and their resistance to drought stress. Kinetic chlorophyll fluorescence imaging data was collected at a distance between the sample and the lens of about 20 cm. The plants were subjected to dark adaption for 15 min, followed by a measurement sequence of 200 s, where the light protocol consisted of several saturating light pulses in a dark background or in a constant actinic background light.
Deep learning methods were applied to extract features, which were then used as inputs for a machine learning classification algorithm. Blumenthal et al. [
25] used video imaging data from a prototype set-up (GrowScanner, GrowTech Inc., Lexington, MA, USA). Their process starts with dark adaption, followed by light excitation and measurements of the fluorescence intensity on one point of the leaf during 15 s. The smoothed intensity signal, as well as its derivative, are used as inputs to an unsupervised machine learning algorithm (Hidden Markov Models), to cluster plants with respect to the type of stress and stress level.
Römer et al. [
17] used a compact fiber-optic fluorescence spectrometer with a laser as the excitation source, placed a few millimetres from the leaf and measuring the spectrum with a resolution of 2 nm in the range 370–800 nm. To reduce the numbers of features, piecewise polynomials were fitted to the data and a (Support Vector Machine) classifier could then, with a high accuracy, distinguish between healthy and unhealthy wheat leaves.
All though showing promising results, all the methods above rely on saturating light and/or dark adaption, which are difficult to accommodate in the field or in a greenhouse. The measurements used for stress detection in this study are based on the dynamic fluorescence response (DFR), i.e., dynamic characteristics of the fluorescence response to weak and long light excitation pulse, without prior dark adaption. A spectrometer was used to measure the fluorescence at the canopy level, i.e., through proximal sensing of fluorescence.
We have previously shown correlation with photosynthesis [
26,
27,
28] and used it for growth tracking [
29] and for light stress detection [
30,
31,
32]. In the latter work, the variations in the DFR originating from a weak excitation from a blue LED light were used for light stress detection. The dynamics in the response in the fluorescence signal on a minute-scale could be used to distinguish between different light stress levels.
We hypothesized that it is possible to distinguish between healthy and various kinds of abiotically or biotically stressed plants, by analysing the information in the fluorescence signal. We investigated this by using a method similar to the DFR-method and extracted features from the dynamic responses to be used in a machine learning classification context.
Several stress factors were scanned: drought (lettuce) and salt stress (lettuce and lemon balm), root infection with the fungal pathogen Pythium ultimum (basil, tomato, and lettuce), and infection with the fungal pathogen for Powdery mildew, Podosphaera aphanis (strawberries). The strengths of this method are that the measurements are done on-line, remotely on the canopy level, and that the plants neither need to be dark adapted nor exposed to saturating light.
Furthermore, market available LED lamps were used in the experiments, and the blue channel was used to construct the weak excitation signal in the form of a positive step change. For this study, a spectrometer was used but a simpler, cheaper type of photodiode with a bandpass optical filter could be applicable. In such a case, it could be economically justified to distribute sensors over entire greenhouses.
3. Results
3.1. Abiotic Stress
The fluorescence step response was measured on lettuce ‘a’ and ‘b’, on healthy, dry, and salt-stressed plants.
Figure 4 shows all the fluorescence responses (normalized according to Equation (
1)) for lettuce ‘a’ at the lowest background light level. Green dotted lines correspond to reference plants, solid orange lines are the salt-stressed plants, and the red dashed lines are the dry ones. As can be seen, the initial dynamics after the step excitation differed between the plants depending on their conditions.
For each of the four different background light levels (ranging from 55 to 200 μmol m
−2 s
−1), the peak time and the peak value (for definition see
Figure 2) of the responses were extracted. The results for lettuce ‘a’ are presented in
Figure 5 and for lettuce ‘b’ in
Figure 6. The stressed plants generally had a shorter peak time and a higher peak value. In
Appendix A (
Table A1), a summary of the data is presented, where the time axis is ignored, and the data is divided into groups of healthy, salt- and drought-stressed plants.
A two sampled t-test was used to evaluate whether the mean peak time and/or the mean peak value were significantly different between stressed and healthy plants. For all groups (lettuce ‘a’ and ‘b’, salt and drought stressed, and peak time and peak values), the differences were significant at a confidence level of at least 0.95 for the first and second background light level, and, for most combinations, also at the third and fourth background light level. Furthermore, one can notice a trend in the figures, that the higher the background light level is, the lower the mean peak time.
The peak time also decreased for the salt-stressed plants as time passed (
Figure 6a, Bkg 1), a result that could be seen as a sign that the plants were becoming increasingly stressed the longer they were watered with salty water. The moisture content in the soil was measured in 14 of the experiments.
Figure 7 shows how the peak time and peak value (for the lowest background light) vary with the moisture content. The results show that the measured moisture contents were indeed lower in the dried pots and that the moisture content was positively correlated with the peak time and negatively correlated with the peak value.
In an additional setup, lettuce ‘c’ and lemon balm were evaluated for salt stress. Higher background light levels were included in this setup (85–760 μmol m−2 s−1). For the two lower light levels (85 and 215 μmol m−2 s−1), the results were in line with the previous findings. The fluorescence step response can also be used to distinguish between healthy and stressed plants both for lettuce ‘c’ and for lemon balm, with a shorter peak time and higher peak value for stressed plants. The distinction was even more clear for the lemon balm.
In
Table 2, the peak times and peak values for the lowest background light level are summarized. This shows the mean value and the standard deviation of the mean for each group: healthy and salt stressed (for each measurement day). The differences of the mean values were significant (with a confidence of at least 95%), even when comparing the healthy group with only the “least” stressed group, i.e., salt treated (day 1).
For increasing background light levels, there were less but faster dynamics in the fluorescence step responses. As a consequence, the peak value occurred within the first or second sample for all measurements at the two highest background light levels (465 and 760 μmol m−2 s−1), and for the salt-stressed plants also at the 215 μmol m−2 s−1 light level. Furthermore, the steady-state level of the fluorescence was not reached within the 4 min that the light was held constant, in contrast to the two lower light levels, where either steady-state was reached or the remaining transients were very small. This also complicates the automation of the data treatment.
To conclude, these experiments shows that it is indeed possible to detect salt and drought stress with proximal measured fluorescence dynamics at the canopy level and that it is preferable to have a background light of 200 μmol m−2 s−1 or less.
3.2. Pythium Ultimum
The fluorescence step responses were measured once a week for three weeks, starting the week the pathogens were added (except for lettuce ‘b’, where only measurements from the last two weeks are available).
Figure 8 shows the peak time as well as the corresponding peak value of the responses of lettuce ‘b’ for the three different background light intensities.
For each week, the peak time was lower in the infected group compared to the reference group, at the lowest background light level (Bkg 1). The difference was significant at a confidence level of 0.95 for week 3 but not week 2 (but at a confidence level of 0.90, it was). At higher background light, the majority of the registered peak times are at the first sample, making comparisons meaningless. All values are available in
Appendix A (
Table A2). The peak value, on the other hand, showed no distinction between the healthy and infected groups. Note that the sample size was small (four measures for week 2 and six measures for week 3); therefore, more data is needed to confirm differences with a high level of significance.
For lettuce ‘a’, basil, and tomato, it was not possible to distinguish between healthy and infected plants when inspecting the fluorescence step responses (
Figure 9 and
Figure 10). However, the response parameters changed over time such that the peak time decreased and the peak value increased over the three weeks. Comparing the peak times from all measurements week 1 with week 2 or 3, they significantly (at a confidence level of 0.95) different for lettuce ‘a’, basil, and tomato, at all background light levels. The peak values significantly differed when comparing the measurements of week 1 with week 3, for all species and at all background light levels. Data are available in
Appendix A (
Table A3).
At the end of the experiment, the lettuce and basil had passed the appropriate harvest day, and the tomato would have required transplanting for optimal development. The measurements were made in a sunny period when it was warm in the greenhouse. On Day 1, the temperature varied from 19 °C at night up to 28.5 °C at noon. On day 4, the range had increased to 20–31 °C. Unfortunately, further temperature measurements were lost; however, the authors believe the increasing indication of stress (shorter peak time and higher peak value) with time is a heat stress response.
The reference measurements are summarized in
Table 3; dry weight (DW; of the leaves, stems, and roots), the amount of pathogen on the roots (per dry weight roots) and the maximal photosynthetic rate. Each set contains three measurements, and the mean values and the standard deviations (according to Equation (
2)) are presented in the table.
All plant species (except lettuce ‘a’) had a lower dry weight in the infected group. However, the differences were small and not significant, indicating that the infection did not have a large impact on the photosynthesis of the whole plant. The amount of pathogens on the roots differed significantly between the different plant species. The highest amount was found in lettuce ‘b’, whereas the lowest amount was found in basil.
This is in line with that it was only for lettuce ‘b’ where a statistically significant difference in the peak time was detected between healthy and Pythium infected plants. The maximal photosynthetic rate was measured on basil, tomato, and lettuce ‘a’ on day 11, and again on tomato and basil on day 19.
In line with the expectations that were concluded from the dry weight measurements, the photosynthetic rate measurements only indicated a slightly lower photosynthetic rate for the infected plants (and only in four out of five groups, where a group refers to one species and one measurement day), and the differences were not significant. However, there was a significant decrease in photosynthesis between day 11 and day 19. Hence, the maximal photosynthetic rate appeared to decrease more over time than as a consequence of the Pythium infection in this experiment.
3.3. Powdery Mildew, Podospaera Aphanis
In this setup, over 150 measurements were conducted in order to collect enough data to be used in a supervised machine learning classification algorithm. Unfortunately, the spread of powdery mildew was slower and more uneven than expected, thus, making it difficult to correctly label the data collected in the middle of the experiment.
For the first group of plants that were exposed to the infection—group w0—the infection started four days before the experiment started, i.e., week 0. They were placed in another (slightly warmer) room in the greenhouse, and, when the experiment started, all strawberries were moved to one out of two identical rooms in a closed environment. The intention was to infect more plants over the course of the experiment by moving them into the "infected room" after being subjected to fluorescence step response measurements.
In the same way, group w1 refers to the group that were infected during week 1, after being measured as reference. However, the infection did not evolve as anticipated.
Table 4 shows the number of plants that visually showed signs of infection during the experiment. Inf 1 corresponds to very light symptoms and Inf 2 to slightly more symptoms (
Figure 3). A few plants were harvested every week, hence, there were decreasing total numbers of plants (the harvested leaves were frozen as a backup for possible PCR-measurements to quantify the infection level). As a consequence of the low degree of infection, group w1 was excluded from the presentation of the data.
Figure 11 shows the peak value and peak time for the fluorescence step response after the first excitation at the lowest background light level (110 μmol m
−2 s
−1). The results are similar for the second excitation (same background light level). For the third and fourth excitations (both at light level 215 μmol m
−2 s
−1) the mean value of the peak time was slightly lower, and the mean value of the peak value was slightly higher.
Four groups are included in the presented figure: the reference group (green stars), infected week 0 (red triangles), and infected weeks 3/4 (blue circles/triangles). Hence, the plants of the blue marks had only been in the infected room for one week and had no visible symptoms, yet, in contrast to group w0 in these weeks, would be expected to behave more similar to the healthy group than the infected group. However, there was no clear distinction between the healthy and infected groups, as shown in
Figure 11.
The peak time for most of the measurements were around 10 s, which is relatively high, indicating that the plants appeared to be healthy. The only significant change was in week 5, when the peak time decreased to around 5 s. This could be an indication of higher stress than the previous weeks and this occurred for plants in both groups. Looking at the mean of the peak value, there was only a distinction between the two groups during week 1 and week 5 (
Table 5). The peak value was then higher for the infected plants.
During week 5, there were visible symptoms of powdery mildew in the infected group (and not in the reference group). Hence, it cannot be excluded that it was the powdery mildew infection that caused the differences in peak values. However, as the differences in peak values between the infected/healthy were not consistent throughout the whole experiment, it is unlikely that the difference in week 1 is due to the infection.
4. Discussion
The aim with this study was to test the hypothesis that it is possible to distinguish between healthy and stressed plants from variations in the dynamic fluorescence response (DFR). The DFR method applied here to detect stress is a modification of the method proposed in Carstensen et al. to analyse the level of light stress [
31]. In that work, transfer function responses were fitted to the step responses, and then the transfer functions were analysed in the frequency domain using Bode plots. When applying this to the data presented here, an automated fitting was difficult to achieve, and therefore the time responses were analysed instead—more specifically, the peak time and the normalized peak value.
These two features alone were sufficient to distinguish between healthy and abiotically stressed plants (drought and salt stress investigated), where faster dynamics (shorter peak time) and a higher normalized peak value were found to be indicators of stress. This stress response is also in agreement with the light stress experiments by Carstensen et al. [
30,
31]. Hence, we concluded that abiotic stress (salt and drought) could be distinguished from healthy plants using DFR.
The experiments with biotic stress unfortunately have certain deficiencies. In particular, this is the case in the set with Pythium ultimum infection; the sample size is small, a few reference measurements are lacking, and the plants were grown in a warm greenhouse, which likely led to heat stress. Generally, no significant difference could be detected between healthy and Pythium infected plants, with the applied DFR-method. Hence, we could not confirm the hypothesis for this stressor. It was only for lettuce ‘b’ that the mean value of the peak time varied as a function of plant status; however, due to the small sample size, it is difficult to confirm differences with a high level of significance.
However, the measurements of pathogens on the roots showed that these were the plants with the highest occurrence of pathogens. Therefore, and due to the nature of the infection, i.e., a root infection that is difficult to visually detect, we suggest more research to determine if there is a critical level of infection required, in order for the method to work for detection of Pythium infection. Furthermore, in a stress detection setting where several step responses are measured (for example, several step responses every night), it is easier to detect differences compared to only singular measurements as was done in this study.
The plants in the Pythium setup were grown in a warm greenhouse, and we detected a significantly higher stress the third week compared to the first week, for all species included. It was likely heat stress that was detected, even though it cannot be excluded that it could be something else, such as malnutrition. Unfortunately, there is no data to either confirm or reject this. It was warm in the greenhouse during the Pythium experiments: day one had a 28.5/19 °C day/night temperature, and day four was 31/20 °C. Unfortunately, subsequent temperature data was lost; however, the outdoor weather continued to be warm and sunny, and this was the case also in the greenhouse.
The measurements of the maximal photosynthetic rate (data for five out of eight plant species and days were available), indicated a slight decrease as a consequence of
Pythium infection in most of the measurements; however, the decrease was larger when comparing measurements from day 19 and with the ones from day 11 (
Table 3). The fact that the photosynthetic apparatus was only slightly affected by the infection but more affected over time can (at least partly) explain the fact that the proposed fluorescence detection method captured a difference over time (increased heat stress) but could not distinguish between healthy and infected samples.
For powdery mildew on strawberries, a pilot study with heavily infected plants indicated that the peak time and the peak value could be used to separate healthy and infected plants. However, in the main experiment, the plants were never infected to the same degree, and it was also not possible to distinguish between the two groups, except from the peak value measurements during week 1 and week 5 (
Table 5). Potentially, this was due to the infection in week 5; however, as the difference was not detected throughout the whole experiment, there is likely another explanation for the difference in week 1.
To start the infection, group w0 had to be moved to another room in the greenhouse (to ensure no infection of the reference group), in which the temperature was about 5 °C higher. This was done four days prior to the start of the experiment when all plants were moved to the controlled, indoor environment. The difference in the fluorescence step response in the two groups during week 1 may, therefore, be because they reacted differently to the movement from the greenhouse to the indoor environment, either due to the powdery mildew or due to the different temperatures that they were exposed to in the greenhouse.
The method proposed here only measures the mean value of the fluorescence response over the entire canopy (two plants for the powdery mildew setup). Consequently, to be detected, a considerable part of the canopy must be affected. This is beyond the limit of acceptance for a detection method for powdery mildew. As this infection starts with a local infection, it would likely be more efficient to use a sensor with higher spatial resolution, e.g., a fluorescence camera. Possibly one could then detect specific areas of the plant that have a deviating step response signatures due to the infection.
The intention of using a machine learning algorithm to extract the most important features for classification of healthy/infected strawberry plants was unfortunately not possible. The infection did not spread at the rate that we expected, which led to uncertain annotation of the plants. However, it may still work to use the dynamic fluorescence response to generate input features to a classification algorithm. In such an algorithm, additional features can be added to increase the performance and to solve the problem of finding a general threshold value of, for example, the peak time or peak value, to classify plants as healthy or not. Candidate features to investigate could be the ambient conditions (temperature, humidity, etc.), plant status (age, development state, species, etc.), or other features from the fluorescence dynamics.
In the presented method, we measured the transient behaviour of chlorophyll fluorescence. However, this is slightly different from standard methods, in the sense that we did not include dark adaption. A dark-adapted leaf that is illuminated with continuous (or modulated) excitation shows a characteristic change in chlorophyll
a fluorescence intensity over time [
36]. This is called the fluorescence transient, or the Kautsky effect, named after Hans Kautsky, who first reported this phenomenon in 1931 [
37].
The fast part of this transient occurs within the first second of illumination and is called the OJIP transient curve; the fluorescence level at origin (O), followed by two intermediates (I, J) and finally the peak (P). The following, slower dynamics, SMT (semi-steady state, maximum, and terminal steady-state), occurs on the time scale of minutes [
38].
Due to the current sample rate we used, normally 0.8 s, we could not capture the behaviour of the fast transient (OJIP). Instead, the peak that we follow is likely something that is similar to the second maximum, M. A previous study on bean leaves [
39] reported that the time of the M-peak decreased for an increased heat stress on the leaves. This is clearly in line with our results, in that a short peak time indicated plant stress.
Another finding from the conducted experiments, was that the distinction between healthy and stressed plants was easier to detect at low background light intensities. The higher the background light level, the faster the dynamics in the fluorescence step response for all plants, no matter the stress status, thus, making it difficult to distinguish between them, at least with the current sampling rate. This can be seen in
Figure 6,
Figure 8,
Figure 9, and
Figure 10, comparing the peak time at the first background light level with the latter ones.
Previous research on dark adapted pea leaves, showed that the shape of the fluorescence transient curve was very different depending on the excitation light level [
40]. The excitation light from a LED with peak wavelength at 650 nm, at approximately 30, 300, and 3000 μmol m
−2 s
−1 were investigated. For the highest light, the slope from P to T was smooth, whereas, in the case of the lowest light, the semi-steady state S and second maximum M were pronounced. In our setup, we did not elaborate on the excitation light (it was always within 30–70 μmol m
−2 s
−1); however, in addition to the excitation light, we also had different background light levels.
Our finding—that the dynamics became faster at higher background light levels—might actually be the transition from a fluorescence curve where the M-peak is pronounced (low light) to the case where there is a smooth decrease from the P-peak to the terminal steady state, T. Hence, at the higher background light, there was no “M-peak” to detect and, instead, the maximal value occurred in the “P-peak”, which is within our first measured sample.
5. Conclusions
A method for plant stress detection is presented where the measurements can be done on-line, remotely on the canopy level, and the plants neither need to be dark adapted nor exposed to saturating light. Furthermore, the equipment can be relatively simple. For this research, a spectrometer was used; however, a simpler, cheaper type of photodiode with a bandpass optical filter could be applicable, and, in such a case, could be distributed over a large greenhouse. Furthermore, ordinary (controllable) LED growth lights, already in place in many advanced greenhouses, were used to supply the (relatively weak) blue light used to excite a fluorescence response.
The results from this research show that the abiotic stress from drought and salt (and probably heat), can efficiently be detected by the suggested method. The examined biotic stress from powdery mildew Podosphaera aphanis (on strawberries) and the root infection Pythium ultimum (on two types of lettuce, basil, and tomato) could not be significantly distinguished from healthy plants.
However, the results indicate that, for a severe infection, the stress appeared to be detectable. For the root infection case, the disease is difficult to detect visually, and hence this is an interesting option. More experiments are then needed to determine if there is a critical level of infection for detection and, then, to decide whether it is an acceptable limitation or not.
Powdery mildew, on the other hand, does not affect the whole plant at the start—instead, it spreads point-wise. Due to that nature, it will likely be more efficient to have a sensor with higher spatial resolution as it is desired to detect the mildew already at a stage when it is only visible on very small spots on single leaves.