Next Article in Journal
Towards Global Volcano Monitoring Using Multisensor Sentinel Missions and Artificial Intelligence: The MOUNTS Monitoring System
Next Article in Special Issue
Winter Wheat Mapping Based on Sentinel-2 Data in Heterogeneous Planting Conditions
Previous Article in Journal
Modelling the Surface of Racing Vessel’s Hull by Laser Scanning and Digital Photogrammetry
Previous Article in Special Issue
Validation of Copernicus Sentinel-2 Cloud Masks Obtained from MAJA, Sen2Cor, and FMask Processors Using Reference Cloud Masks Generated with a Supervised Active Learning Procedure
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Letter

A Simple Similarity Index for the Comparison of Remotely Sensed Time Series with Scarce Simultaneous Acquisitions

1
European Commission, Joint Research Centre (JRC), Via E. Fermi 2749, I-21027 Ispra, Italy
2
Piksel S.r.l., Via Ernesto Breda 176, 20126 Milan, Italy
3
Slavko Lemajic, Obkirchergasse 5/14, 1190 Vienna, Austria
*
Author to whom correspondence should be addressed.
Remote Sens. 2019, 11(13), 1527; https://0-doi-org.brum.beds.ac.uk/10.3390/rs11131527
Submission received: 24 May 2019 / Revised: 19 June 2019 / Accepted: 25 June 2019 / Published: 27 June 2019
(This article belongs to the Collection Sentinel-2: Science and Applications)

Abstract

:
Emergence of new state-of-the-art technologies has enabled an unprecedented amount of high spatial resolution satellite data having great potential for exploitation of extracted time series for a vast range of applications. Despite the high temporal resolution of time series, the number of real observations of optical data that can be utilized is reduced due to meteorological conditions (such as cloud or haze) prevailing at the time of acquisition. This fact has an effect on the density of the retrieved time series and subsequently on a number of coincidental observations when comparing the similarity of time series from two different data sources for which the simultaneous acquisition date is already scarce. Classical tools for assessing the similarity of such time series can prove to be difficult or even impossible because of a lack of simultaneous observations. In this paper, we propose a simple method in order to circumvent this scarcity issue. In the first step, we rely on an interpolation in order to produce artificial time series on the union of the original acquisition dates. Then, we extend the theory of the correlation coefficient (CC) estimator to these interpolated time series. After validation on synthetic data, this simple approach proved to be extremely efficient on a real case study where Sentinel-2 and PlanetScope NDVI time series on parcels in The Netherlands are compared. Indeed, compared to other methods, it reduced the number of undecided cases while also improving the power of the statistical test on the similarity between both types of time series and the precision of the estimated CC.

1. Introduction

Time series consist of repeated observations of the same quantity of interest over time. Often, these quantities are sampled on a regular time step (e.g., every minute/hour/day/week/month/year) so that one can define the notion of “next observation” or “previous observation” within the time series. While classical time series analysis and time series model generally assume these particular and optimal conditions [1]; such conditions are not always encountered in real-world applications, e.g., in remote sensing. Remote sensing time series are generally built with images acquired at very specific dates that depend on the revisit time of the sensor. There is often a trade-off between spatial resolution and revisit time so the issue is particularly seen for high (HR) and very high resolution (VHR) images [2,3]. In addition, it is also quite common for some of the observations to be discarded because of the poor data quality (e.g., cloud cover, haze). Finally, as Earth Observation (EO) scientists generally rely on different sensors, multivariate time series analyses can rapidly become complicated because not only are the acquisition dates not equidistant within each time series, but it is also unlikely to have a match between the different sets of acquisition dates. In particular, this has important practical impacts when we want to measure the similarity between time series.
The classical tool for quantifying the similarity between time series is to estimate the temporal structure of the time series through their empirical autocorrelation function and their empirical cross-correlation function [4]. In both cases, the idea is to estimate the correlation coefficients (CC) between observations distant of a given time lag. For irregularly sampled time series, one can rely on slotting methods that consist of grouping pairs of observations in classes of time distance [5]. The same approach is used for the estimation of covariograms and semivariograms for spatial data [4]. Unfortunately, these approaches generally require at least 30 pairs of observations in each of the classes in order to obtain reliable estimations [6]. This is a major limitation for their application in the context of scarcely sampled time series. Alternatively, one would like to limit the similarity analysis on the estimated zero-lag CC (i.e., the classical CC). In any case, this is still sometimes beyond reach because of the lack of simultaneous observations. Another alternative that is inspired from speech recognition [7] is dynamic time warping (DTW). It consists in warping the time axis for an optimal alignment of the time series. It is possible to constrain the warping to consider only pairs of observations that are not too far from each other, e.g., the Sakoe–Chiba band [8]. The resulting time series share the same length but consist of padded sequences of the same values (when the time series are stretched) so the actual number of genuine observations is smaller. Recently, it has been applied to remote sensing applications as well, mainly in image classification (e.g., [8] or [9]). DTW does not directly provide an index of similarity. For that purpose, one can compute the CC between the aligned time series.
In this paper, we proposed to overcome the scarcity of the time series with a simple linear interpolation approach. The motivation is to obtain two time series with identical acquisition dates, so that the classical estimation of the CC is possible. We rely here on the CC because we are interested in the similarity between the time series (i.e., exhibiting the same patterns) compared to the more specific objectives of other existing indexes such as the index of agreement [10,11,12] where the values between the time series must be comparable in absolute terms (e.g., same average, same standard deviation,…). While the resulting time series are a mix of genuine observations and synthetic values, we think that an interpolation between two consecutive dates is a valid and natural approach at least for continuous processes (e.g., vegetation/crop monitoring). Indeed, it directly translates the cognitive mechanisms that the analyst uses when one visually compares the two time series on the same graph. We opted for linear interpolations in order to keep the method as simple as possible. However, experimental results showed that using a shape-preserving piecewise cubic interpolation did not bring significant changes (results not shown here). Alternatively, choosing more advanced interpolation methods (e.g., splines) might also be an option but there is a risk of adding artifacts in the interpolated time series [13].
After a short reminder of the theoretical characteristics of the CC estimator, the proposed approach is first tested on simulated time series with limited simultaneous observations. The results confirmed that our method provides accurate estimations of the CCs while overcoming the scarcity of the time series. The method is further illustrated on the comparison of real NDVI time series from Sentinel-2 and PlanetScope in The Netherlands, with the same results as found in the synthetic examples. Indeed, the two sets of time series were found to be very correlated, as expected (the average estimated CC was found to be equal to 0.93), while drastically reducing the number of undecided cases due to the lack of simultaneous observations (from 385 to 14 out of 1670).

2. Methodology

2.1. The Correlation Coefficient

The correlation coefficient (or Pearson’s correlation coefficient) can be used for assessing the similarity between the two time series [10]. For paired observations (i.e., each observation is a pair of both quantities), the CC is generally estimated using the following estimator
ρ ^ = i = 1 n ( x i x ¯ ) ( y i y ¯ ) i = 1 n ( x i x ¯ ) 2 i = 1 n ( y i y ¯ ) 2 ,
where ( x i , y i ) are the paired observations, x ¯ and y ¯ are the observed averages of the time series and n is the number of observed pairs.
The precision of this estimator is generally evaluated using Fisher’s transformation [14]
λ ^ = 0.5 ln ( 1 + ρ ^ 1 ρ ^ ) ,
and its inverse transformation
ρ ^ = e 2 λ ^ 1 e 2 λ ^ + 1 .
The main advantage of this transformation is that λ ^ is approximately following a normal distribution with a mean equal to λ = 0.5 ln ( 1 + ρ 1 ρ ) (where ρ the true unknown CC) and a variance approximately equal to
σ λ 2 = ( n 3 ) 1 .
One can thus build the ( 1 α ) confidence interval for λ with λ ^ ± z 1 α / 2 n 3 and use the inverse transformation in order to get the confidence interval for ρ
C I ρ = [ e 2 λ ^ L 1 e 2 λ ^ L + 1 ; e 2 λ ^ U 1 e 2 λ ^ U + 1 ] ,
where λ ^ L = λ ^ z 1 α / 2 n 3 , λ ^ U = λ ^ + z 1 α / 2 n 3 and where z 1 α / 2 is the quantile of level ( 1 α 2 ) of the standard normal distribution. Figure 1 shows how the estimated confidence intervals change with different values of ρ ^ (namely –0.99, –0.9, –0.75, –0.5, 0, 0.5, 0.75, 0.9 and 0.99) and n (namely 5 and 10). One can see that the confidence intervals are not centered around ρ ^ (except for ρ ^ = 0 ) and that they are bounded to the [ 1 ; 1 ] interval.
More generally, any quantile of level p can be estimated through Fisher’s transformations of Equations (2) and (3) with
ρ ^ p = e 2 λ ^ p 1 e 2 λ ^ p + 1 ,
where λ ^ p = λ ^ + z p n 3 and z p is the quantile of level p of the standard normal distribution.
Using Equation (6), one can build any test on the true CC or estimate the probability that the CC exceeds a given threshold.

2.2. Generalization to Scarcely Sampled Time Series

When comparing two time series, one needs to have both time series sampled at the same dates. Unfortunately, this is a rare case. Most of the time, the time series come from different sources (e.g., two different satellite sensors) so that actual pairs of observations (i.e., on the same dates) are exceptions.
The general situation is thus two time series with n 1 and n 2 observations with n I simultaneous observations where n I min ( n 1 , n 2 ) . Figure 2 shows a synthetic example of two time series from two different sources (e.g., two different satellite sensors observed on the same agricultural parcel). In this example, each of the time series has 20 observations out of which only two dates coincide.
As could be seen from the synthetic example of Figure 2, one would typically conclude that the two time series are similar. However, as only two dates coincide, it is not even possible to compute the CC (Figure 2a). In order to circumvent this data issue, we propose to fill the gaps by interpolating each of the time series at the observed dates of the other time series (i.e., the union of the observed dates; Figure 2b). This simple approach has many advantages:
  • It is a straightforward generalization of the particular case where all the dates coincide;
  • It is simple to implement (a linear interpolation is the simplest solution but others exist, e.g., cubic interpolation or splines);
  • It preserves the time dimension of the observations (i.e., values interpolated at new dates directly depend on the proximity to the observed dates);
  • It somewhat translates the intuitive visual comparison of the time series (as can be seen in the example of Figure 2).
At this point, it is worth mentioning that the resulting time series do not constitute a genuine sample as some of the values are computed with the interpolation. Consequently, the general formula for the estimation of the variance of the estimation is not valid (i.e., we cannot take the union of the dates as n in the variance formula). There is an equivalent effective size n for the interpolated time series. Several different options were considered for the value of n . In the next section, we show, using simulations, that taking
n = min ( n 1 , n 2 ) ,
(i.e., the number of dates in the shortest time series) is a good empirical rule-of-thumb for substituting the value of n in Equations (4)–(6).

2.3. Comparison of the Methods

For the comparison of the two methods of estimation (i.e., with the simultaneous observations only or with the interpolation), we rely on the observed bias
B i a s ρ ^ = 1 N i = 1 N ( ρ ^ i ρ ) ,
the observed root mean square error (RMSE)
R M S E ρ ^ = 1 N i = 1 N ( ρ ^ i ρ ) 2 ,
the observed percentage of missing estimation and the observed 95% central interval (i.e., estimated with the empirical quantiles), where ρ is the true CC.
In a second step, we want to verify that the variability is correctly estimated using the definition of n in Equation (7) as a substitute of n in Equations (2)–(6). In particular, we would like to compare this option against two alternatives:
  • n 1 n 2 (i.e., the geometric mean of the observed sample sizes)
  • ( n 1 + n 2 ) / 2 (i.e., the arithmetic mean)
For this purpose, we compute the success rate of the different estimated 95% confidence intervals, i.e., the percentage of times that the true CC is contained in the estimated 95% confidence intervals (see Equation (5)).
In order to have a basis of reference, we also defined a control method that corresponds to the situation where both time series are observed on the union of both extracted sets of dates. As this control method is supposed to be the optimal situation (since the set of observed dates is the largest and there is no interpolation needed), we can build a confusion matrix between the estimated confidence intervals of the control method and the interpolation method with different criteria for n . The overall accuracy (OA) can be computed using the number of agreement cases.

3. Results

3.1. Validation using Simulations

The proposed methodology is tested here using simulated time series. The main advantage of simulations is that all the information is known (in our case, the target CC between the two time series) and repeated simulations allow us to derive observed bias and variability of the estimators.
In this test, we relied on a three-step simulation algorithm. First, we simulate two time series over a year (i.e., their length is equal to N = 365 ) with two sinusoidal functions and superposed them with white noise. Then, in order to simulate two scarce time series, we randomly select two numbers in the interval [10;20] and assign the values to variables n 1 and n 2 (i.e., the respective number of observations of the two time series). Finally, both time series are randomly subsampled for variables n 1 and n 2 , which represent a number of observation dates, thus a known sample size for each time series. As the actual observed dates are completely accidental, the number of simultaneous observations varies. We repeat this simulation algorithm 500,000 times. One can prove that this number of simultaneous observations is a random variable following a hypergeometric distribution with n 1 draws from N objects with n 2 success states. Using the conventions above, there is between 91% and 99% chance that the number of simultaneous observations is strictly smaller than three, which is the worst condition for the estimation of a CC based only on simultaneous dates.
Among the multitude of potential curves, here we show two example cases: (i) with a small negative CC and (ii) with a strong positive CC. For each of the simulated pairs of time series, we estimate five CCs: (i) using the proposed methodology, (ii) using a slotting method with three different bin size (three, seven and 14 days), (iii) DTW with a Sakoe–Chiba band of 45 days (following [8]) and, when possible, using the simultaneous observations only. Figure 3 shows the observed distributions of these estimators. One clearly sees that the proposed method provides better estimations. All the statistics (e.g., the observed bias, the root mean square errors, the estimated quantiles) point in favor of our proposed method (see Table 1 for the details). Finally, as anticipated, the coefficients could be estimated for only 3% of the simulations when using the simultaneous observations only, contrary to the proposed method where a 100% success rate was observed. The success rate of the slotting method lies between those of the simultaneous and our proposed method. Providing a reliable estimation even in extreme cases where the simultaneous observations are scarce is clearly the main advantage of our method.
Besides the estimation of the CCs, we also introduced a method for estimating the precision of the estimator (see Equations (4)–(6) for details). For that purpose, we proposed to substitute n (i.e., the number of paired observations) with n , which is the effective sample size. Three alternatives are tested: (i) the minimum of the sample sizes, (ii) the geometric mean of the sample sizes, and (iii) the arithmetic mean of the sample sizes.
As described in Section 2.3, we computed the success rates of the estimated 95% confidence interval for each of the three criteria above (see Table 2). For each of the three criteria, the success rate was larger than the objective 95%. This indicates that the confidence intervals are larger than expected, hence that each of them overestimate the variability. Such overestimated success rates were also observed for the control method (i.e., where no interpolation was needed). Thus, it does not invalidate the proposed method and the tested criteria for n .
As a second metric of comparison, the observed overall accuracy with the control method was slightly larger for the “minimum of the sample sizes” criterion.

3.2. Case Study: NDVI Time Series from Sentinel-2 and PlanetScope on Arable Cropland in The Netherlands

In this section, we show how the proposed method performs on real data.
For the definition of geometric boundaries of agriculture parcels, we used the Geospatial Aid Application (GSAA) dataset information publicly available through The Netherlands open geo-data infrastructure (http://www.nationaalgeoregister.nl). NDVI time series were retrieved from two different image data sources; Sentinel-2 MultiSpectral Instrument (MSI) and PlanetScope imagery. The signal extraction from the Copernicus Sentinel-2 MSI was performed using the product type Level-2A (i.e., bottom atmosphere reflectance) acquired by both twin satellites, Sentinel-2A and Sentinel-2B. As far as the PlanetScope image data is concerned, a comparable product was selected as the analytic ortho scene SR (surface reflectance). In this particular application, we expect a large majority of similarity between pairs of time series since (i) pairs of time series are extracted for the same parcel, (ii) they are extracted over the same period of time, and (iii) Sentinel-2 and PlanetScope products have similar spectral bands.
The time series of the 1670 parcels were processed by applying the same estimation methods as for the simulated examples. For the majority of the cases, all the methods performed correctly, having similar results (see Figure 4). However, as expected, the estimation when using the simultaneous observations only could not be computed for 23% of the parcels (see Table 3). For comparison, this occurred for only 0.8% when using the interpolation method. For each of the 14 cases, there were less than three Sentinel-2 images available, thus the CCs could not be computed. On average, when using the interpolation method, the estimated CCs were higher (0.93 against 0.87) and the observed range of the estimations is narrower (minimums are -0.32 versus -0.97). In addition, the statistical test on the hypothesis “ H 0 : ρ 0.5 ” with the alternative hypothesis “ H 1 : ρ > 0.5 ” based on Equation (6) was accepted for only 78 cases when using the interpolation method against 432 when using the simultaneous observations. This shows again that the proposed method circumvents most of the limitations of the classical estimation of the CC.

4. Discussion

The results presented in the previous section show that the proposed method brings significant improvements when comparing severely scarcely sampled time series (i.e., less than 20 acquisition dates). It is based on the idea that gaps between observed dates can be interpolated in order to artificially increase the number of observations. Even though this is a very simple idea, it proved to be both valid and a natural translation of a visual interpretation of the time series. The CCs that were computed using this interpolation method were coherent with their visual interpretation counterparts.
As noted in the synthetic case study, we observed that the constructed 95% confidence intervals actually contained more than 99% of the true simulated CC even when no interpolation was performed (i.e., what we called the control method). However, we also validated in parallel (results not shown here) that Equation (4) is correct for uncorrelated series (i.e., X i and Y i are correlated but the X i and the Y i are not correlated together). This is a clear indication that the presence of trends in the series tends to decrease the actual variability of the estimated CCs compared to Equation (4). Nevertheless, if this is a limitation, it is related to the use of the CC itself, not on the use of the interpolation strategy. While this brings doubts of the validity of Equation (4) in the context of time series, it does not invalidate our proposed approach. Moreover, since the variability is overestimated, the constructed confidence intervals and equivalent statistical tests are more conservative (i.e., if the null hypothesis “ H 0 : ρ 0.5 ” is rejected, it is very likely that it is a true rejection). In other words, the type I error is smaller than expected. The opposite case of an underestimated variability is riskier because the alternative hypothesis “ H 1 : ρ > 0.5 ” would then be accepted too easily (i.e., we believe that the test is at 95% but it is actually at a smaller percentage).
On the real data example, the estimations were consistently high for the large majority of the parcels. The only cases where the CCs were estimated as small corresponded to obvious lack of data in a crucial period of the crop season, such that no trend could actually be seen in the Sentinel-2 time series. On the contrary, in such conditions, we may expect a lower similarity between the time series because of this lack of information. For instance, in Figure 4, one could argue that the slotting method is actually overestimating the similarity.
The precision of the estimations was also significantly improved. The number of accepted “ H 0 : ρ 0.5 ” hypotheses significantly decreased when using the interpolation method. Indeed, more information were taken into account than merely using the simultaneous observations. The interpolation step translates the temporal evolution of the time series more adequately. The slotting method also showed some advantages, but it requires at least 20 observations in order to perform correctly. The DTW was able to bring some improvements but not as much as the slotting or interpolation methods.
Finally, the proposed interpolation method proved to be very efficient against the lack of simultaneous observations between the two time series. In the Dutch example, we observed a quasi disappearance of the cases where the CCs could not be computed (from 385 to only 14). This is a clear benefit of the proposed method since it drastically reduces the number of undecided cases (i.e., where there is not enough information for a conclusion). The slotting method proved to be an alternative but the results highly depend on the density and spread of the acquisition dates and on the bin size. Comparatively, the interpolation approach correctly brings added temporal information and helps fill the sampling gaps without requiring any parameters. Clearly, this benefit is less obvious for long time series observed on a regular time step with few missing data.

5. Conclusions

In this paper, we presented a simple method to quantify the similarity between scarce remotely sensed time series. The index is based on the Pearson’s correlation coefficient (CC) between the two time series. As we are interested in the similarity between the time series, the CC is computed on the raw time series (i.e., without removing the trends). The use of an interpolation step enables us to circumvent the issue of the scarcity of the time series. The theory of CC estimation was also extended to the estimation based on a mix between genuine observations and interpolated values.
The proposed method was tested both on simulated and real application data. It proved to be very efficient and specifically useful when the number of simultaneous observations is limited. Indeed, in such conditions, neither the cross- and autocorrelation functions nor a simple CC between the true pairs of observations can be accurately estimated. In many cases, the estimator cannot be computed at all. Limiting the computation to the zero-lag bin of the cross-correlation function is a possible alternative but at the cost of larger bin sizes, which might risk diluting the actual similarity with dissimilar pairs of observations. On the contrary, the interpolation step adequately brought the temporal information in order to cope with both the temporal gaps and the lack of simultaneous observations.
In our context, the objective was to evaluate the similarity between two time series for which the CC is a sufficient quantitative index. However, one could also extend the analysis to more complex indexes. After the same interpolation step, one can generalize the approach by replacing the CC with other types of indexes such as Spearman’s rho or Kendall’s tau [15], an index of agreement [10], or mutual information [16]. This approach thus opens interesting avenues for the analysis of scarce remotely sensed time series.

Author Contributions

Conceptualization, D.F. and B.V.; methodology, D.F.; software, D.F. and C.W.; formal analysis, D.F.; investigation, D.F.; data curation, S.L. and C.W.; writing—original draft preparation, D.F.; writing—review and editing, D.F., B.V., C.W. and S.L.

Funding

This research received no external funding.

Acknowledgments

Authors would like to thank the Planet Labs Company for providing necessary image dataset and technical support regarding PlanetScope imagery and Planet’s platform. We are also very grateful to Davide De Marchi for sharing scripts and technical support for JEODPP platform and the two anonymous reviewers that helped improving this letter with their constructive comments and suggestions.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Box, G.E.P.; Jenkins, G.M. Time Series Analysis: Forecasting and Control, 2nd ed.; Holden-Day: San Francisco, CA, USA, 1970. [Google Scholar]
  2. Löw, F.; Duveiller, G. Defining the spatial resolution requirements for crop identification using optimal remote sensing. Remote Sens. 2014, 6, 9034–9063. [Google Scholar] [CrossRef]
  3. Di Salvo, A.; Faggioli, L.; Morelli, B. Orbit selection criteria for optical dual-use earth observation satellites. In Proceedings of the 63rd International Astronautical Congress. IAC 2012, Naples, Italy, 1–5 October 2012; pp. 5651–5661. [Google Scholar]
  4. Cressie, N. Statistics for Spatial Data, Revised ed.; John Wiley and Sons, Inc.: New York, NY, USA, 1993. [Google Scholar]
  5. Broersen, P.M.T.; Bos, R. Estimating time-series models from irregularly spaced data. IEEE Trans. Instrum. Meas. 2006, 55, 1124–1131. [Google Scholar] [CrossRef]
  6. Journel, A.G.; Huijbregts, C.J. Mining Geostatistics; Academic Press: London, UK, 1978; p. 194. [Google Scholar]
  7. Sakoe, H.; Chiba, S. Dynamic Programming Algorithm Optimization for Spoken Word Recognition. IEEE Trans. Acoust. 1978, 26, 43–49. [Google Scholar] [CrossRef]
  8. Csillik, O.; Belgiu, M.; Asner, G.P.; Kelly, M. Object-based time-constrained dynamic time warping classification of crops using Sentinel-2. Remote Sens. 2019, 11, 1257. [Google Scholar] [CrossRef]
  9. Maus, V.; Câmara, G.; Cartaxo, R.; Sanchez, A.; Ramos, F.M.; de Queiroz, G.R. A time-weighted dynamic time warping method for land-use and land-cover mapping. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2016, 9, 3729–3739. [Google Scholar] [CrossRef]
  10. Duveiller, G.; Fasbender, D.; Meroni, M. Revisiting the concept of a symmetric index of agreement for continuous datasets. Sci. Rep. 2016, 6, 19401. [Google Scholar] [CrossRef] [PubMed]
  11. Willmott, C.J. On the validation of models. Phys. Geogr. 1981, 2, 184–194. [Google Scholar] [CrossRef]
  12. Mielke, P. Meteorological applications of permutation techniques based on distance functions. In Handbook of Statistics; Krishnaiah, P., Sen, P., Eds.; Elsevier Science Publishers: New York, NY, USA, 1984; Volume 6, pp. 813–830. [Google Scholar]
  13. Trauth, M.H. MATLAB® Recipes for Earth Sciences, 4th ed.; Springer-Verlag: Berlin/Heidelberg, Germany, 2005; p. 172. [Google Scholar]
  14. Fisher, R.A. Statistical Methods for Research Workers, 9th ed.; Oliver and Boyd Ltd.: Edinburgh, UK, 1944; pp. 192–193. [Google Scholar]
  15. Liu, C.; Frazier, P.; Kumar, L. Comparative assessment of the measures of thematic classification accuracy. Remote Sens. Environ. 2007, 107, 606–616. [Google Scholar] [CrossRef]
  16. Hong, T.; Hart, K.; Soh, L.-K.; Samal, A. Using spatial data support for reducing uncertainty in geospatial applications. GeoInformatica 2014, 18, 63–92. [Google Scholar] [CrossRef]
Figure 1. Comparison of the estimated confidence intervals for different correlation coefficients (CCs, horizontal lines) around the estimated CCs (plain dots) and for different values of the sample size: (a) n = 5; (b) n = 10.
Figure 1. Comparison of the estimated confidence intervals for different correlation coefficients (CCs, horizontal lines) around the estimated CCs (plain dots) and for different values of the sample size: (a) n = 5; (b) n = 10.
Remotesensing 11 01527 g001
Figure 2. (a) Typical example of two time series observed by two different satellite sensors on the same area. The vertical dashed lines represent the two simultaneous observations. (b) The same curves after interpolation on the union of the dates (hollow circles and squares). The number of pairs increased to 38.
Figure 2. (a) Typical example of two time series observed by two different satellite sensors on the same area. The vertical dashed lines represent the two simultaneous observations. (b) The same curves after interpolation on the union of the dates (hollow circles and squares). The number of pairs increased to 38.
Remotesensing 11 01527 g002
Figure 3. Observed distribution of estimated CCs for the three methods: the proposed method based on interpolation (plain purple line), the method based on the simultaneous observations only (dashed blue line), dynamic time warping (DTW) with a Sakoe–Chiba band of 45 days (dotted-dashed red line), and the slotting method with a bin size of ±7 days (dotted yellow line). The vertical dotted line represents the true CC. (a) The small negative correlation and (b) the strong positive correlation.
Figure 3. Observed distribution of estimated CCs for the three methods: the proposed method based on interpolation (plain purple line), the method based on the simultaneous observations only (dashed blue line), dynamic time warping (DTW) with a Sakoe–Chiba band of 45 days (dotted-dashed red line), and the slotting method with a bin size of ±7 days (dotted yellow line). The vertical dotted line represents the true CC. (a) The small negative correlation and (b) the strong positive correlation.
Remotesensing 11 01527 g003
Figure 4. Illustration of four different cases when comparing Sentinel-2 (squares) and PlanetScope (circles) time series: (a) Excellent match for all the tested methods; (b) excellent match for the interpolation and the slotted methods only; (c) estimation not possible for the simultaneous method; (d) poor results for all of the methods because of a lack of repeated observations. The slotting method with the different bin sizes produced similar results, thus only the seven-day bin size is shown here. The filled circles and squares represent the observations while the hollow circles and squares are the interpolated values. The dashed lines represent the simultaneous observations.
Figure 4. Illustration of four different cases when comparing Sentinel-2 (squares) and PlanetScope (circles) time series: (a) Excellent match for all the tested methods; (b) excellent match for the interpolation and the slotted methods only; (c) estimation not possible for the simultaneous method; (d) poor results for all of the methods because of a lack of repeated observations. The slotting method with the different bin sizes produced similar results, thus only the seven-day bin size is shown here. The filled circles and squares represent the observations while the hollow circles and squares are the interpolated values. The dashed lines represent the simultaneous observations.
Remotesensing 11 01527 g004aRemotesensing 11 01527 g004b
Table 1. Descriptive statistics of the CC estimators for the simultaneous observations, the slotting method with three different bin sizes, DTW with a Sakoe–Chiba band of 45 days, and the interpolation method and for both examples.
Table 1. Descriptive statistics of the CC estimators for the simultaneous observations, the slotting method with three different bin sizes, DTW with a Sakoe–Chiba band of 45 days, and the interpolation method and for both examples.
MethodTrue CorrelationBiasRMSE% Missing Number95% Central Interval
Simultaneous–0.290.050.6897%[–0.99;0.99]
Slotting 3d–0.290.040.5919%[–0.99;0.99]
Slotting 7d–0.290.020.421%[–0.94;0.75]
Slotting 14d–0.290.000.310%[–0.80;0.41]
DTW 45d–0.290.190.372%[–0.57;0.86]
Interpolation–0.29–0.090.180%[–0.67; –0.04]
Simultaneous0.85–0.090.4397%[–0.73;1.00]
Slotting 3d0.85–0.070.3720%[–0.59;0.99]
Slotting 7d0.85–0.040.231%[0.22;0.99]
Slotting 14d0.85–0.030.140%[0.47;0.97]
DTW 45d0.85–0.040.272%[–0.28;0.96]
Interpolation0.850.000.070%[0.68;0.94]
Table 2. Comparison of the success rates of the estimated 95% confidence interval for the correlation coefficient and overall accuracy with the control method for the three different criteria of effective sample size n .
Table 2. Comparison of the success rates of the estimated 95% confidence interval for the correlation coefficient and overall accuracy with the control method for the three different criteria of effective sample size n .
Criteria for the Value of n True CorrelationSuccess Rate of Control MethodObserved Success RateOverall Accuracy with Control Method
min ( n 1 , n 2 ) –0.2999.48%98.95%98.72%
n 1 n 2 –0.2999.48%98.45%98.33%
( n 1 + n 2 ) / 2 –0.2999.48%98.40%98.28%
min ( n 1 , n 2 ) 0.8599.39%98.56%98.35%
n 1 n 2 0.8599.39%97.95% 97.86%
( n 1 + n 2 ) / 2 0.8599.39%97.89% 97.80%
Table 3. Comparison of the occurrences of missed estimations, of the average and standard deviation of the CCs, and occurrences of accepted hypothesis “ H 0 : ρ 0.5 ” against the alternative hypothesis “ H 1 : ρ > 0.5 ” for the 1670 parcels.
Table 3. Comparison of the occurrences of missed estimations, of the average and standard deviation of the CCs, and occurrences of accepted hypothesis “ H 0 : ρ 0.5 ” against the alternative hypothesis “ H 1 : ρ > 0.5 ” for the 1670 parcels.
MethodsNot ComputedAverage of Correlation CoefficientsObserved Range of Correlation CoefficientsAccepted Tests H 0 : ρ 0.5 against H 1 : ρ > 0.5
Simultaneous385 (23%)0.87[–0.91;0.99]432 (25.9%)
Slotting 3d 16 (0.8%)0.94[–0.82;0.99]83 (5.0%)
Slotting 7d14 (0.8%)0.92[–0.34;0.99]61 (3.7%)
Slotting 14d14 (0.8%)0.87[–0.48;0.99]73 (4.4%)
DTW 45d14 (0.8%)0.86[–0.26;0.99]259 (15.5%)
Interpolation14 (0.8%)0.93[–0.32;0.99]78 (4.7%)

Share and Cite

MDPI and ACS Style

Fasbender, D.; Vajsová, B.; Wirnhardt, C.; Lemajic, S. A Simple Similarity Index for the Comparison of Remotely Sensed Time Series with Scarce Simultaneous Acquisitions. Remote Sens. 2019, 11, 1527. https://0-doi-org.brum.beds.ac.uk/10.3390/rs11131527

AMA Style

Fasbender D, Vajsová B, Wirnhardt C, Lemajic S. A Simple Similarity Index for the Comparison of Remotely Sensed Time Series with Scarce Simultaneous Acquisitions. Remote Sensing. 2019; 11(13):1527. https://0-doi-org.brum.beds.ac.uk/10.3390/rs11131527

Chicago/Turabian Style

Fasbender, Dominique, Blanka Vajsová, Csaba Wirnhardt, and Slavko Lemajic. 2019. "A Simple Similarity Index for the Comparison of Remotely Sensed Time Series with Scarce Simultaneous Acquisitions" Remote Sensing 11, no. 13: 1527. https://0-doi-org.brum.beds.ac.uk/10.3390/rs11131527

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop