Next Article in Journal
Detail Preserving Low Illumination Image and Video Enhancement Algorithm Based on Dark Channel Prior
Previous Article in Journal
Optimizing Calibration Procedure to Train a Regression-Based Prediction Model of Actively Generated Lumbar Muscle Moments for Exoskeleton Control
Previous Article in Special Issue
Radio-Frequency Biosensors for Real-Time and Continuous Glucose Detection
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Accurate Heart Rate and Respiration Rate Detection Based on a Higher-Order Harmonics Peak Selection Method Using Radar Non-Contact Sensors

1
Department of Electrical and Computer Systems Engineering, Monash University, Clayton, VIC 3800, Australia
2
Planet Innovation, Box Hill, VIC 3128, Australia
*
Author to whom correspondence should be addressed.
Submission received: 9 July 2021 / Revised: 11 August 2021 / Accepted: 12 August 2021 / Published: 23 December 2021
(This article belongs to the Special Issue Microwave Sensors: From Sensing Principle to Application)

Abstract

:
Vital signs such as heart rate and respiration rate are among the most important physiological signals for health monitoring and medical applications. Impulse radio (IR) ultra-wideband (UWB) radar becomes one of the essential sensors in non-contact vital signs detection. The heart pulse wave is easily corrupted by noise and respiration activity since the heartbeat signal has less power compared with the breathing signal and its harmonics. In this paper, a signal processing technique for a UWB radar system was developed to detect the heart rate and respiration rate. There are four main stages of signal processing: (1) clutter removal to reduce the static random noise from the environment; (2) independent component analysis (ICA) to do dimension reduction and remove noise; (3) using low-pass and high-pass filters to eliminate the out of band noise; (4) modified covariance method for spectrum estimation. Furthermore, higher harmonics of heart rate were used to estimate heart rate and minimize respiration interference. The experiments in this article contain different scenarios including bed angle, body position, as well as interference from the visitor near the bed and away from the bed. The results were compared with the ECG sensor and respiration belt. The average mean absolute error (MAE) of heart rate results is 1.32 for the proposed algorithm.

1. Introduction

Heart rate and respiration rate are two important factors of human’s body health. Resting heart rate can be a prognostic factor for coronary heart disease [1], and it highly relates to stroke, sudden death, and other non-cardiovascular diseases [2]. The traditional method to monitor heart rate is performed by using electrocardiography (ECG). However, it is not appropriate for long-time monitoring due to its limit of mobility and inconvenience. In addition, some people develop dermatitis after using ECG electrodes [3]. There is a demand for non-contact heart rate and respiration rate monitoring systems in hospitals. Camera-based heart rate monitoring technology is one of the popular research areas. L. Shan and M. Yu proposed an independent component analysis (ICA) and head tracking method to obtain the heart rate of subjects [4]. They used a face detector to determine a region of interest on the head. Then, applied band-pass filter (BPF) for both the x-axis and the y-axis. The heart rate result was displayed in fast Fourier transform (FFT) form after signal extraction through ICA. Patients may feel uncomfortable with the video-based monitoring systems because of the privacy problem. In [5], the authors used a light source and photodetector to obtain the chest movement and heartbeat signals. However, the results were affected by ambient light. A vibration-sensor-based monitoring system has been developed in [6,7] for sleep monitoring. In [7], they obtain the heart rate by using the autocorrelation function since the heart rate is a period signal, compared with the motion artifact. Researchers achieve multi-people heartbeat and respiration rate detection using the amplitude demodulation technique[7].
There is also another non-contact vital signs monitoring technique using radar sensors [8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26]. The advantage of radar-based heart rate monitoring is that patients do not need to take off clothes and put on electrodes, which is convenient, and patients do not need to worry about privacy issues. Moreover, it can be used for both on-bed and off-bed situations, which is suitable for hospital application and 24 h monitoring. Figure 1 shows an overview of a radar-based heart rate monitoring system. Heart rate detection using a non-contact radar sensor is challenging because of the lower signal-to-noise ratio (SNR), compared with a contact-based heart rate monitor devices, especially when the range increases. Because radio frequency (RF) wave will experience path loss when it travels in the air, and it will lose power when RF wave penetrates through the body. This will cause low received signal power and low SNR. Moreover, the energy of the heart rate signal is lower, compared with energy in the respiration signal, and the respiration harmonics will cause interference to the heartbeat signal. Thus, it is a fundamental problem to detect signals in low SNR scenarios [27,28]. Self-motion and random body motion are other challenges in vital sign radar detection. Researchers in [29] use autocorrelation for phase and cross correlation for range bin to distinguish between stationary objects and a human to extract respiration rate. A phase average method for multiple frequencies is proposed in [30] to track the body motion of the test subject. In [11], Mostafanezhad et al. applied empirical mode decomposition (EMD) to remove the motion from a continuous wave (CW) radar signal and increase the accuracy of heart rate measurement. A least mean squares (LMS) adaptive filter was applied to the CW radar signal to do the respiration harmonics cancellation in [12]. Researchers in [13] used an artificial neural network (ANN) to extract a heart rate signal and detect heartbeat events with low latency and low computational complexity.
CW doppler radars are commonly used in vital signs detection [9,10]. Frequency modulated continuous wave (FMCW) radar is also employed in heart rate and respiration rate monitoring [14]. Moreover, biomedical multiple-input–multiple-output (MIMO) radars have been used for vital signs detection and human localization [26]. Compared with CW radar, FMCW radar can provide more information such as range, velocity, and even angle estimation [31]. Since FMCW radar has a range profile, detection of multiple subjects or people is possible [15,16]. Another common radar for vital sign monitoring is IR-UWB. It can also provide a range of information. The study in [18] used IR-UWB radar to monitor the respiration of people with dementia. IR-UWB radar has also been used in car applications [19]. Study [17] has shown that IR-UWB radar has higher SNR, simpler hardware structure, and better accuracy ratio for most scenarios, compared with FMCW radar. IR-UWB radar was used in this research as it provides higher SNR and accuracy.
There are different signal processing algorithms in radar-based heart rate detection. The blind source separation (BSS) method can extract and recover the signals from a mixture of noise and wanted signals. It has been used as a dimension reduction and signals separation technique in a vital signs radar system. In [20], M. Le proposed an eigenvalue-based method to extract and reconstruct respiration and heartbeat signals. Principal component analysis (PCA) was applied in [21] to remove the static noise and recover vital signals [22]. Two CW radars systems in [23] apply ICA to attenuate the breathing effect for heartbeat signal recovering. In [32] ICA-JADE and direction of arrival techniques were used to obtain the respiration rate of multiple people. The main signal processing techniques in the literature such as PCA, ICA, and eigenvalue-based methods belong to the BSS method.
Considering the advantages of IR-UWB radar in providing range information and higher SNR, compared with FMCW or CW radars, this study developed a signal processing approach for heart rate and respiration rate detection based on IR-UWB technology. ICA was applied as a BSS method in signal processing for dimension reduction, noise cancellation, and signal separation. In addition, a new method of signal processing based on higher-order harmonics peak selection was applied to successfully achieve a highly accurate heart rate. Comparing with the existing studies, this work provides a less complicated computation for signal separation, accurate heart rate detection, and it avoids the respiration harmonics interference from heart rate detection. The structure of this paper is as follows: Section 2 derives vital signal modelling. Section 3 discusses the signal processing algorithm in this paper. Section 4 presents the results of the experiments. Section 5 presents the conclusions.

2. Radar Signal Modelling

The content of this section is about modelling the IR-UWB radar signal for vital signs detection. In [8,24], the authors derived mathematical equations for the IR-UWB radar signal in detail. To model the equation of vital signs in IR-UWB radar, the authors assumed that the chest movement and heartbeat are periodic sinusoidal. The UWB radar transmits pulses in a short time. The received pulses represent signals in different distances according to the time of arrival (TOA). Then, the received signal for one channel can be written as
d ( t ) = d 0 + d r s i n ( 2 π f r t ) + d h s i n ( 2 π f h t ) ,
where t is slow time along the measurement interval; d 0 is the distance from the radar to the person; d h and d r are the amplitudes of heartbeat and respiration, respectively. The f h and f r parameters are the frequencies of heartbeat and respiration, respectively, [24].
The received pulse signal can be expressed as multipath components plus the reflected signal from the body as follows:
r ( t , τ ) = i A i p ( τ τ i ) + A p ( τ τ d ( t ) ) ,
where A p is the amplitude of pulse at the target distance, τ is the time of arrival related to d ( t ) , p ( t ) is received pulse in pass-band frequency, A i is the amplitude of multipath components and τ i is the delay of a multipath signal. The time τ along to the range is fast time, and the time between each sample frame for all ranges is slow time. Since TOA is the time that a pulse transmits and receives, TOA from the person can be written as (3) [24]
τ d ( t ) = 2 d ( t ) c = τ 0 + τ r s i n ( 2 π f r t ) + τ h s i n ( 2 π f h t ) ,
where τ 0 is the delay from the person, and τ r and τ h are the displacement of chest movement and heartbeat, respectively [24].
In (3), two terms of the radar signal model are corresponding to multipath components and vital signals. The multipath components derive from a static environment, which causes DC to offset in the received signal. To extract heartbeat and respiration signals and compensate DC offset, the received signal is subtracted by the average of fast–time channels, as (4) [8]
y ( t , τ ) = A p ( τ τ d ( t ) ) .

3. Signal Processing

Figure 2 shows the block diagram of the suggested signal processing approach in this study for heart rate and respiration rate detection using the IR-UWB radar. The input signal in the algorithm is a fast-time–slow-time matrix, which is the raw signal from the IR-UWB radar.

3.1. Clutter Reduction

A clutter reduction technique was applied to the raw signal to remove background noise [33]. Assuming a person is keeping still, clutter would be a stationary noise; therefore, it could be removed by the background subtraction method. Suppose that r ( n ) is the received signal of one range index; then, the clutter removal method can be written as (5) [33]:
y ( n ) = r ( n ) b ( n 1 ) ,
where b ( n 1 ) is the background clutter estimator. The stationary background clutter is defined as the average of previous samples (6) [33]
b ( n 1 ) = 1 M j n M n 1 r ( j ) .

3.2. Range Selection

The next step was to select the distance range in which the target is located. Assume that there is only one person in the radar detection range, and the person keeps still. Hence, the respiratory motion will have the largest energy in the received signals. The range selection can be conducted by choosing the maximum variance along with the slow-time of the range samplers, which contains a respiration signal. It is important to keep the nearby range samplers to cover cardiac activity since the breathing signal may not contain a heartbeat signal. In this experiment, the range bin of interest for the radar sensor was set to 60 cm to cover from the chest to the back of the body.

3.3. Independent Component Analysis

The purpose of this step was to recover the heart rate and respiration signals from a mixed signal and reduce the noise using the BSS method. The observation (received signal) for each range can be considered as the linear combination of various signals, e.g., cardiac signal, chest motion, and noise signal. Thus, the observation for each range can be written as follows:    
x 1 ( t ) = a 11 s 1 ( t ) + a 12 s 2 ( t ) + + a 1 n s n ( t ) , x 2 ( t ) = a 21 s 1 ( t ) + a 22 s 2 ( t ) + + a 2 n s n ( t ) , x 3 ( t ) = a 31 s 1 ( t ) + a 32 s 2 ( t ) + + a 3 n s n ( t ) , b = x n ( t ) = a n 1 s 1 ( t ) + a n 2 s 2 ( t ) + + a n n s n ( t ) ,
where x 1 , x 2 x n are the observation signals in each range sampler index; s 1 , s 2 s n are the original unknown signals, and a i j are the constant coefficients (weights) of each unknown signals. Equation (7) can be written in a matrix form as (8), [34].
x = A s ,
where
A = a 11 a 12 a 1 n a 21 a 22 a 2 n a n 1 a n 2 a n n , x = x 1 ( t ) x 2 ( t ) x n ( t ) s = s 1 ( t ) s 2 ( t ) s n ( t ) .
It is assumed that the signals s i are statistically independent and have non-Gaussian distributions, and the observation is a random vector x . To recover vital signals s i , matrix A should be estimated first. If W is defined as the inverse matrix of A , then the independent components (IC) s can be computed as (10) [35].
s = W x .
Defining y as an IC, where column vector w is a row of the inverse of A , y can be calculated as (11) [34].
y = w T x = i w i x i .
Denote z = A T w , then (11) can be written as (12) [34],
y = w T x = z T s .
From (12), it is clear that y is the linear transformation of s i , where the weights are vector z. Since the central limit theorem tells that the summation of independent random variables will become more Gaussian than any one of the original variables, the least Gaussianity will happen when z T s is equal to the one of IC s i , and there is only one nonzero in weight z. Hence, w can be estimated by maximizing the non-Gaussianity of w T x [34].
There are different algorithms for ICA. The algorithm used in this paper was FastICA since it has low computation and uses a nonlinear algorithm that is robust [35]. The first step of ICA is centring data, which is x subtract the mean of itself. This can simplify the further process in the ICA algorithm.
x ^ = x E { x } .
After centring data, the next step is the whitening process, which reduces the computational complexity of FastICA. This process is to uncorrelate signals and normalise variance. The covariance matrix will become an identity matrix after whitening. The whitening process is performed through eigenvalue decomposition (EVD). EVD of the covariance matrix of x ^ is calculated as
E x ^ x ^ T = EDE T ,
where E is the matrix of eigenvector, and D is eigenvalues in a diagonal matrix. The data after whitening becomes
x ˜ = ED 1 / 2 E T x ^ = ED 1 / 2 E T As = A ˜ s ,
where A ˜ is the whitening transformation matrix.
The FastICA algorithm is using fixed-point arithmetic to solve the multi-dimension signals problem. The process of FastICA is described as Algorithm 1 [34].
Algorithm 1 FastICA
1:
Choose the initial value of w.
2:
w + = E { x g ( w T x ) } E { g ( w T x ) } w
3:
w = w + / w +
4:
ifw is not converged then
5:
    go to 2
6:
end if
where function g is
g 1 = t a n h ( a 1 y ) , g 2 = y e x p ( y T 2 ) , g 3 = y 3 .
a 1 is a constant 1 < a 1 < 2

3.4. Modified Covariance Method

All ICs have the same energy because the variances of ICs are unit. To obtain the respiration rate, ICs were filtered using a low-pass filter (LPF). Since the respiration rate at rest for healthy people is between 12 bpm to 20 bpm [36], the cutoff frequency of the LPF was chosen as 0.8 Hz (48 bpm). Considering that the respiration signal has less zero-crossing, compared to the heart rate signal, the ICs after LPF were compared, and the one with the least zero-crossing was chosen for respiration detection. The FFT was applied to the selected IC, and the frequency component with the maximum power was considered as respiration rate.
For the heart rate estimation, the ICs were passed through a high-pass filter (HPF) separately, as shown in Figure 2. The cutoff frequency of the HPF was chosen as 1.66 Hz to eliminate the frequency components related to respiration and its strongest harmonics. The energy of heart rate harmonics is more than the energy of respiration harmonics in the heart rate harmonics related frequency ranges [8]; therefore, a comparison was made between the energy of ICs after HPF, and the maximum energy IC was selected as the heart rate signal.
The measured breathing rate was used as a parameter for a notched comb filter to reduce the respiration harmonics’ effect on heart rate estimation. After notched filter, the modified covariance method was used as the spectrum estimation. The modified covariance is an autoregressive (AR) spectrum estimation method. The benefit of the modified covariance method is that it results in stable spectrum estimation with minimised forward and backward prediction errors. The AR coefficients can be calculated by solving (17) [37].
r x ( 1 , 1 ) r x ( 2 , 1 ) r x ( p , 1 ) r x ( 1 , 2 ) r x ( 2 , 2 ) r x ( n , 2 ) r x ( 1 , p ) r x ( 2 , p ) r x ( p , p ) a p ( 1 ) a p ( 2 ) a p ( p ) = r x ( 0 , 1 ) r x ( 0 , 2 ) r x ( 0 , p ) ,
where
r x ( k , l ) = n = p N 1 [ x ( n l ) x * ( n k ) + x ( n p + l ) x * ( n p + k ) ] .
In (17) and (18), r x is autocorrelation sequence of x and a p is coefficient of the poles. The power spectrum density (PSD) estimation of the AR process is as (19) [37].
P ^ A R ( e j ω ) = | b ^ ( 0 ) | 2 | 1 + k = 1 p a ^ p ( k ) e j ω k | 2 ,
where
| b ( 0 ) | 2 = r x ( 0 , 0 ) + k = 1 p a p ( k ) r x * ( 0 , k ) .
In (19), b is the coefficient of zero in AR model.

3.5. Peak Selection Algorithm

Because the heart rate in the frequency domain is easily contaminated by respiration and its harmonics, it is hard to obtain an accurate heart rate using the modified covariance method. Therefore, this study proposed a peak selection method based on high harmonics of heart rate.
First, denote that array P has the elements p 1 , p 2 p n , which are all peaks above 100 bpm.
Then, the algorithm finds all peaks p i between 100 bpm and 400 bpm, and puts all their related frequencies in a vector, as (21).
P = p 1 p 2 p n .
The next step is finding two initial values for heart rate, as (22).
H R g u e s s = h r g u e s s 1 h r g u e s s 2 .
If the difference between p 1 and p 2 is less than 100 bpm, p 1 and p 2 are considered as the first two harmonics of the heart rate and divided by 2 and 3, respectively, as the heart rate initial assumptions h r g u e s s 1 and h r g u e s s 2 . If the difference between p 1 and p 2 is greater than or equal to 100 bpm, p 1 is considered as the initial fundamental value for the heart rate h r g u e s s 1 , and p 2 is assumed as the second harmonic and divided by 2 to obtain the h r g u e s s 2 .
Next, vector P is divided by h r g u e s s 1 and h r g u e s s 2 separately and rounded to obtain the integer multiple arrays I n t 1 m u l and I n t 2 m u l , as (23) and (24).
I n t m u l = r o u n d [ P T P T ] × 1 h r g u e s s 1 0 0 1 h r g u e s s 2 = i n t 1 m u l i n t 2 m u l ,
where
i n t 1 m u l = i n t 1 m u l 1 i n t 1 m u l 2 i n t 1 m u l n T , i n t 2 m u l = i n t 2 m u l 1 i n t 2 m u l 2 i n t 2 m u l n T .
After that, P is element-wise divided by I n t 1 m u l and I n t 2 m u l separately to obtain the heart rate estimation array h r 1 e s t and h r 2 e s t , as (25) and (26).
h r e s t = P T P T . / i n t 1 m u l i n t 2 m u l = h r 1 e s t h r 2 e s t ,
where
h r 1 e s t = h r 1 e s t 1 h r 1 e s t 2 h r 1 e s t n , h r 2 e s t = h r 2 e s t 1 h r 2 e s t 2 h r 2 e s t n .
Later, the error arrays e r r o r 1 and e r r o r 2 are calculated by subtracting h r g u e s s 1 and h r g u e s s 2 from h r 1 e s t and h r 2 e s t , respectively, as (27) and (28).
E r r o r = a b s ( h r 1 e s t h r 2 e s t h r g u e s s 1 h r g u e s s 2 ) = e r r o r 1 e r r o r 2 ,
where
e r r o r 1 = e r r o r 1 1 e r r o r 1 2 e r r o r 1 n , e r r o r 2 = e r r o r 2 1 e r r o r 2 2 e r r o r 2 n .
If the calculated errors are above a threshold (6 bpm), consider the corresponding high-frequency peak as a noise. Remove estimated heart rates and errors according to its index in the heart rate estimation array.
Finally, the averages of the remaining errors for e r r o r 1 and e r r o r 2 are calculated, and the corresponding estimated heart rate array to the minimum average value is selected, h r s l t . The final heart rate h r e s t will be calculated as the average of the h r s l t , as (29).
h r e s t = m e a n ( h r s l t ) ,
where
h r s l t = h r 1 e s t , if m e a n ( e r r o r 1 ) m e a n ( e r r o r 2 ) h r 2 e s t , otherwise .

3.6. Outliers Removal in Real-Time Measurement

The proposed algorithm can be implemented for a real-time application. The window length for each reading is considered 35 s, and the readings are repeated every 5 s. Hence, the program waits for 35 s after the sensor starts for the first reading. Algorithm 2 shows the process of outliers removal. The first five estimations for heart rate are stored in a first-in-first-out (FIFO) buffer. Starting from the sixth measurement, the program compares the new heart rate estimation with the FIFO buffer’s median value.
Algorithm 2Outliers removal
1:
Put the first five results into FIFO buffer
2:
if h r e s t —median(FIFO) < threshold then
3:
    go to line 17
4:
     e r r o r _ c o u n t = 0;
5:
else
6:
    if is last IC then
7:
         e r r o r _ c o u n t = e r r o r _ c o u n t + 1;
8:
        discard result
9:
    else
10:
        select another IC to do peak selection
11:
        go to line 2
12:
    end if
13:
end if
14:
if e r r o r _ c o u n t = 5 then
15:
      reset FIFO and go to 1
16:
end if
17:
returns result.
Suppose the difference between the FIFO buffer’s median value and the latest reading is less than the threshold (10% of median value). In that case, the new result will be considered as the estimated heart rate and updated to the FIFO buffer. Otherwise, the program takes another IC to repeat the peak selection algorithm and achieve the results. It will continue changing the IC until the last estimated heart rate is within the threshold. If none of the ICs gives the correct estimation, the program discards the estimated value.

4. Experiment Results and Discussion

4.1. Experiment Setup

The UWB radar used in this paper was Xethru X4M200 [38,39]. It can operate in the low-frequency band and high-frequency band. The detection range is also configurable from 0.4 m to 5 m with a resolution of 0.0514 m [38,39]. Table 1 illustrates the configuration of the Xethru radar set for this study. The radar sensor was connected to the laptop with a MATLAB API interface to collect raw data. Meanwhile, an ECG sensor and a respiration belt were connected to another laptop as reference signals.
To evaluate the reliability of the algorithm for heart rate and respiration rate detection, a data collection was performed which covers different scenarios of a person on a bed. The details of the suggested protocols for the experiments are explained in Table 2. The data from five healthy participants were collected. None of them reported any cardiovascular or respiratory system disorders. Figure 3 shows the setup of devices during the experiment. Xethru was mounted 1 m above the bed pointing to the chest of the subject.

4.2. Results and Discussion

Figure 4a shows the fast time and slow time of the raw signal, and Figure 4b illustrates the result after clutter reduction based on the background subtraction method. In Figure 4b, the maximum energy is around 80 cm.
Figure 5 indicates a fast-time–slow-time matrix after ICA and reference signals. It is clear that after vital signals extraction, IC1 is the heartbeat signal, whereas IC2 is the chest cavity motion during breathing. Figure 6 illustrates the FFT result of IC2 in Figure 5 for respiration rate detection. The peak of FFT is represented as the respiration rate value with high accuracy.
Figure 7 clearly shows that after heartbeat signal extraction by ICA, the peak of PSD is closer to the reference heart rate, compared with the derived heart rate after high-pass filtering. Using ICA and a simple peak detection algorithm to find the accurate peak of a signal corresponding to the correct heart rate is not practical most of the time. Figure 8 illustrates an example of a situation where the fundamental heart rate is corrupted by respiration harmonics. It shows that all ICs have the highest peak around 60 bpm, whilst the reference heart rate value is around 79 bpm. Moreover, the harmonics of heart rate are almost aligned with the integer multiple of reference. This is the reason the proposed peak selection algorithm always works with the higher harmonics for heart rate extraction.
Figure 9 indicates the extracted heart rate using different algorithms and the reference heart rate values from ECG. The window length for each radar and ECG signals’ reading is 35 s, and the readings are repeated every 5 s. The figure shows that the FFT and modified covariance method are affected by respiration harmonics and can not achieve an accurate result. The proposed peak detection algorithm has higher accuracy and stability, compared with other methods.
Table 3 presents the estimated heart rates and respiration rates of one subject’s data for the previously mentioned scenarios. The error in this table is calculated using the absolute value of the difference between the reference ground truth and the measurement. It shows that the average error is 0.82 bpm for the respiration signal, and the maximum error is 2 bpm. In contrast, for heart rate estimation, the average error is 1.45 bpm. The maximum error is 4 bpm for Fowler’s position 2 and the visitor sitting near the head of the subject. Table 3 also indicates that different body positions and a visitor away 0.5 m or 1 m from the subject will give more accurate results for both heart rate and respiration rate estimation.
The results of the heart rates and respiration rates are displayed in Table 4. The mean absolute error (MAE) and root mean square error (RMSE) for all five subjects who participated in the experiments are compared with their related reference signals. It is clear that the average MAE is 0.65 for respiration rate and 1.32 for heart rate estimation in Table 4. The maximum MAE for heart rate happens in the scenarios of left lateral recumbent and the visitor sitting and talking near the leg of the subject. It is because the received signal will be weak when the radar signal penetrates from the right arm to the heart of the subject, and the visitor talking interferes with the heartbeat signal received from the radar sensor. Moreover, the heart rate detection will be accurate when a visitor is 0.5 m and 1 m away from the subject on the bed. Table 5 shows a comparison between the devices and signal processing approaches from different studies and the proposed method in this work.
M A E = i = 1 n | y i x i | n = i = 1 n e i n ,
R M S E = 1 n i = 1 n ( y i x i ) 2 .
In the Equations y i is the measurement and x i is the ground truth of reference signals.

5. Conclusions

In this paper, we proposed a novel signal processing algorithm for heart rate and respiration rate estimation based on the ICA and harmonics peak selection method for an IR-UWB radar sensor. The suggested algorithm used ICA to extract clear pulse waves and respiratory signals. Then, the modified covariance method was used to obtain the frequency domain PSD after filtering. Since the fundamental heartbeat signal is easily corrupted by the respiratory signal and its harmonics, a peak selection based on higher harmonics of the heart waveform was introduced to estimate the heart rate. The outliers detection algorithm was applied to improve the accuracy of the results further in the real-time application because of its capability to consider other ICs if there is an outlier in the detected heart rates. The results were measured with five subjects with different situations in this experiment. The result gives an MAE of 0.65 in respiration and 1.32 in heart rate detection.
There are some limitations to the proposed algorithm. The signal is easily interfered with by vibration noise from the environment with a frequency close to the heart rate because the energy of heart rate harmonics is low. In the future, our work will focus on multiple people detection, localization, heart rate, respiration rate detection in noisy environments such as body movement, talking, and walking scenarios.

Author Contributions

H.X. developed the algorithm to analyze the results. M.R.Y. and P.H. initiated the project. M.P.E. lead the project. H.X., M.R.Y., M.P.E., K.H., F.H., P.H. and M.R.Y. organized the experimental protocols. H.X. and K.H. conducted the trial. M.P.E. and F.H. helped in validating the algorithm and data. All authors have read and agreed to the published version of the manuscript.

Funding

This research is supported by the industry partner Planet Innovation.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Acknowledgments

We would like to thank Planet Innovation Australia for providing supports for the development of this system. The content within this paper is being protected through the IP process. The content should not be distributed until written confirmation is received.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Dyer, A.R.; Persky, V.; Stamler, J.; Paul, O.; Shekelle, R.B.; Berkson, D.M.; Lepper, M.; Schoenberger, J.A.; Lindberg, H.A. Heart rate as a prognostic factor for coronary heart disease and mortality: Findings in three Chicago epidemiologic studies. Am. J. Epidemiol. 1980, 112, 736–749. [Google Scholar] [CrossRef] [PubMed]
  2. Zhang, D.; Wang, W.; Li, F. Association between resting heart rate and coronary artery disease, stroke, sudden death and noncardiovascular diseases: A meta-analysis. CMAJ 2016, 188, E384–E392. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  3. Rühlemann, D.; Kügler, K.; Mydlach, B.; Frosch, P.J. Contact dermatitis to self-adhesive ECG electrodes. Contact Dermat. 2010, 62, 314–315. [Google Scholar] [CrossRef]
  4. Shan, L.; Yu, M. Video-based heart rate measurement using head motion tracking and ICA. In Proceedings of the 2013 6th International Congress on Image and Signal Processing (CISP), Hangzhou, China, 16–18 December 2013; Volume 1, pp. 160–164. [Google Scholar]
  5. Abuella, H.; Ekin, S. Non-contact vital signs monitoring through visible light sensing. IEEE Sens. J. 2019, 20, 3859–3870. [Google Scholar] [CrossRef] [Green Version]
  6. Jia, Z.; Bonde, A.; Li, S.; Xu, C.; Wang, J.; Zhang, Y.; Howard, R.E.; Zhang, P. Monitoring a person’s heart rate and respiratory rate on a shared bed using geophones. In Proceedings of the 15th ACM Conference on Embedded Network Sensor Systems, Delft, The Netherlands, 6–8 November 2017; pp. 1–14. [Google Scholar]
  7. Jia, Z.; Alaziz, M.; Chi, X.; Howard, R.E.; Zhang, Y.; Zhang, P.; Trappe, W.; Sivasubramaniam, A.; An, N. HB-phone: A bed-mounted geophone-based heartbeat monitoring system. In Proceedings of the 2016 15th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN), Vienna, Austria, 11–14 April 2016; pp. 1–12. [Google Scholar]
  8. Rong, Y.; Bliss, D.W. Remote Sensing for Vital Information Based on Spectral-Domain Harmonic Signatures. IEEE Trans. Aerosp. Electron. Syst. 2019, 55, 3454–3465. [Google Scholar] [CrossRef]
  9. Petrović, V.L.; Janković, M.M.; Lupšić, A.V.; Mihajlović, V.R.; Popović-Božović, J.S. High-accuracy real-time monitoring of heart rate variability using 24 GHz continuous-wave Doppler radar. IEEE Access 2019, 7, 74721–74733. [Google Scholar] [CrossRef]
  10. Nguyen, N.T.P.; Lyu, P.Y.; Lin, M.H.; Chang, C.C.; Chang, S.F. A short-time autocorrelation method for noncontact detection of heart rate variability using CW doppler radar. In Proceedings of the 2019 IEEE MTT-S International Microwave Biomedical Conference (IMBioC), Nanjing, China, 6–8 May 2019; Volume 1, pp. 1–4. [Google Scholar]
  11. Mostafanezhad, I.; Yavari, E.; Boric-Lubecke, O.; Lubecke, V.M.; Mandic, D.P. Cancellation of unwanted Doppler radar sensor motion using empirical mode decomposition. IEEE Sens. J. 2013, 13, 1897–1904. [Google Scholar] [CrossRef]
  12. Zhang, H.; Li, S.; Jing, X.; Zhang, P.; Zhang, Y.; Jiao, T.; Lu, G.; Wang, J. The separation of the heartbeat and respiratory signal of a doppler radar based on the lms adaptive harmonic cancellation algorithm. In Proceedings of the 2013 Sixth International Symposium on Computational Intelligence and Design, Hangzhou, China, 28–29 October 2013; Volume 1, pp. 362–364. [Google Scholar]
  13. Malešević, N.; Petrović, V.; Belić, M.; Antfolk, C.; Mihajlović, V.; Janković, M. Contactless real-time heartbeat detection via 24 GHz continuous-wave Doppler radar using artificial neural networks. Sensors 2020, 20, 2351. [Google Scholar] [CrossRef] [Green Version]
  14. Adib, F.; Mao, H.; Kabelac, Z.; Katabi, D.; Miller, R.C. Smart homes that monitor breathing and heart rate. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, Seoul, Korea, 18–23 April 2015; pp. 837–846. [Google Scholar]
  15. Ahmad, A.; Roh, J.C.; Wang, D.; Dubey, A. Vital signs monitoring of multiple people using a FMCW millimeter-wave sensor. In Proceedings of the 2018 IEEE Radar Conference (RadarConf18), Oklahoma City, OK, USA, 23–27 April 2018; pp. 1450–1455. [Google Scholar]
  16. Lee, H.; Kim, B.H.; Park, J.K.; Yook, J.G. A novel vital-sign sensing algorithm for multiple subjects based on 24-GHz FMCW Doppler radar. Remote Sens. 2019, 11, 1237. [Google Scholar] [CrossRef] [Green Version]
  17. Wang, D.; Yoo, S.; Cho, S.H. Experimental Comparison of IR-UWB Radar and FMCW Radar for Vital Signs. Sensors 2020, 20, 6695. [Google Scholar] [CrossRef]
  18. Chen, Z.; Bannon, A.; Rapeaux, A.; Constandinou, T.G. Towards robust, unobtrusive sensing of respiration using ultra-wideband impulse radar for the care of people living with dementia. In Proceedings of the 2021 10th International IEEE/EMBS Conference on Neural Engineering (NER), Virtual Event, Italy, 4–6 May 2021. [Google Scholar]
  19. Leem, S.K.; Khan, F.; Cho, S.H. Vital sign monitoring and mobile phone usage detection using IR-UWB radar for intended use in car crash prevention. Sensors 2017, 17, 1240. [Google Scholar] [CrossRef] [Green Version]
  20. Le, M. Heart rate extraction based on eigenvalues using UWB impulse radar remote sensing. Sens. Actuators A Phys. 2020, 303, 111689. [Google Scholar] [CrossRef]
  21. Pittella, E.; Bottiglieri, A.; Pisa, S.; Cavagnaro, M. Cardiorespiratory frequency monitoring using the principal component analysis technique on UWB Radar Signal. Int. J. Antennas Propag. 2017, 2017. [Google Scholar] [CrossRef] [Green Version]
  22. Cho, H.S.; Park, Y.J. Detection of heart rate through a wall using UWB impulse radar. J. Healthc. Eng. 2018, 2018. [Google Scholar] [CrossRef] [PubMed]
  23. Zakrzewski, M.; Vanhala, J. Separating respiration artifact in microwave Doppler radar heart monitoring by independent component analysis. In Proceedings of the SENSORS, 2010 IEEE, Waikoloa, HI, USA, 1–4 November 2010; pp. 1368–1371. [Google Scholar]
  24. Lazaro, A.; Girbau, D.; Villarino, R. Analysis of vital signs monitoring using an IR-UWB radar. Prog. Electromagn. Res. 2010, 100, 265–284. [Google Scholar] [CrossRef] [Green Version]
  25. Sakamoto, T.; Imasaka, R.; Taki, H.; Sato, T.; Yoshioka, M.; Inoue, K.; Fukuda, T.; Sakai, H. Accurate heartbeat monitoring using ultra-wideband radar. IEICE Electron. Express 2015, 12–20141197. [Google Scholar] [CrossRef] [Green Version]
  26. Cardillo, E.; Caddemi, A. A review on biomedical MIMO radars for vital sign detection and human localization. Electronics 2020, 9, 1497. [Google Scholar] [CrossRef]
  27. Romeo, K.; Bar-Shalom, Y.; Willett, P. Detecting low SNR tracks with OTHR using a refraction model. IEEE Trans. Aerosp. Electron. Syst. 2017, 53, 3070–3078. [Google Scholar] [CrossRef]
  28. Hua, X.; Ono, Y.; Peng, L.; Cheng, Y.; Wang, H. Target Detection within Nonhomogeneous Clutter via Total Bregman Divergence-Based Matrix Information Geometry Detectors. IEEE Trans. Signal Process. 2021, 69, 4326–4340. [Google Scholar] [CrossRef]
  29. Cardillo, E.; Li, C.; Caddemi, A. Vital sign detection and radar self-motion cancellation through clutter identification. IEEE Trans. Microw. Theory Tech. 2021, 69, 1932–1942. [Google Scholar] [CrossRef]
  30. Han, K.; Hong, S. Phase-Extraction Method With Multiple Frequencies of FMCW Radar for Human Body Motion Tracking. IEEE Microw. Wirel. Components Lett. 2020, 30, 927–930. [Google Scholar] [CrossRef]
  31. Rao, S. Introduction to mmWave Sensing: FMCW Radars. Available online: https://training.ti.com/sites/default/files/docs/mmwaveSensing-FMCW-offlineviewing_0.pdf (accessed on 16 April 2021).
  32. Islam, S.M.; Boric-Lubecke, O.; Lubekce, V.M. Concurrent respiration monitoring of multiple subjects by phase-comparison monopulse radar using independent component analysis (ICA) with JADE algorithm and direction of arrival (DOA). IEEE Access 2020, 8, 73558–73569. [Google Scholar] [CrossRef]
  33. Lazaro, A.; Girbau, D.; Villarino, R. Techniques for clutter suppression in the presence of body movements during the detection of respiratory activity through UWB radars. Sensors 2014, 14, 2595–2618. [Google Scholar] [CrossRef]
  34. Hyvärinen, A.; Oja, E. Independent component analysis: Algorithms and applications. Neural Netw. 2000, 13, 411–430. [Google Scholar] [CrossRef] [Green Version]
  35. Hyvärinen, A.; Karhunen, J.; Oja, E. Independent Component Analysis, 1st ed.; John Wiley & Sons: New York, NY, USA, 2008. [Google Scholar]
  36. Chourpiliadis, C.; Bhardwaj, A. Physiology, Respiratory Rate. StatPearls. Treasure Island (FL): StatPearls Publishing. [Updated 20 September 2021]. Available online: https://0-www-ncbi-nlm-nih-gov.brum.beds.ac.uk/books/NBK537306/ (accessed on 20 September 2021).
  37. Hayes, M.H. Statistical Digital Signal Processing and Modeling; John Wiley & Sons: New York, NY, USA, 2009. [Google Scholar]
  38. Novelda, AS. X4—Datasheet. Available online: https://www.radartutorial.eu/19.kartei/13.labs/pubs/x4_datasheet_revE_restricted.pdf (accessed on 16 April 2021).
  39. Novelda, AS. Xethru X4M200 Datasheet. Available online: http://laonuri.techyneeti.com/wp-content/uploads/2019/02/X4M200_DATASHEET.pdf (accessed on 16 April 2021).
Figure 1. An overview of heart rate radar monitoring system.
Figure 1. An overview of heart rate radar monitoring system.
Sensors 22 00083 g001
Figure 2. The block diagram of the signal processing algorithm.
Figure 2. The block diagram of the signal processing algorithm.
Sensors 22 00083 g002
Figure 3. The setup of devices: the radar is mounted 1 m above the bed. Two laptops are used for radar sensor data and reference signals recording.
Figure 3. The setup of devices: the radar is mounted 1 m above the bed. Two laptops are used for radar sensor data and reference signals recording.
Sensors 22 00083 g003
Figure 4. Fast–time–slow–time matrix.
Figure 4. Fast–time–slow–time matrix.
Sensors 22 00083 g004
Figure 5. ECG, respiration signals, and ICs.
Figure 5. ECG, respiration signals, and ICs.
Sensors 22 00083 g005
Figure 6. Result of FFT on extracted breathing signal.
Figure 6. Result of FFT on extracted breathing signal.
Sensors 22 00083 g006
Figure 7. Results of modified covariance method before ICA vital signs extraction and after vital signs extraction.
Figure 7. Results of modified covariance method before ICA vital signs extraction and after vital signs extraction.
Sensors 22 00083 g007
Figure 8. Results of modified covariance method for all ICs. The reference heart rate is 79 bpm. The red dash lines are the integer multiple of reference heart rate.
Figure 8. Results of modified covariance method for all ICs. The reference heart rate is 79 bpm. The red dash lines are the integer multiple of reference heart rate.
Sensors 22 00083 g008
Figure 9. Heart rate estimation with different methods with a window length of 35 s. The red star is the reference heart rate, the pink cross is FFT after the high-pass filter, the black triangle is the modified covariance method after the high-pass filter, and the blue circle is the proposed method.
Figure 9. Heart rate estimation with different methods with a window length of 35 s. The red star is the reference heart rate, the pink cross is FFT after the high-pass filter, the black triangle is the modified covariance method after the high-pass filter, and the blue circle is the proposed method.
Sensors 22 00083 g009
Table 1. UWB radar parameters.
Table 1. UWB radar parameters.
ParametersValues
Centre frequency7.29 GHz
Bandwidth1.4 GHz
ADC sampling rate23.328 GS/s
Frame rate24 fps
Detection range0.4–5 m
Range resolution0.0514 m
Table 2. Data collection protocol.
Table 2. Data collection protocol.
ScenariosTime
body positionSupine3 min
Right lateral recumbent3 min
Left lateral recumbent3 min
Prone3 min
Baby position (curled up) right3 min
Baby position (curled up) left3 min
Different bed angleFowler’s position 1 (20 degree)3 min
Fowler’s position 2 (40 degree)3 min
Fowler’s position 3 (55 degree)3 min
Sitting on the bed (90 degree)3 min
Visitor near bedVisitor standing near head3 min
Visitor sitting near head3 min
Visitor sitting and talking near head3 min
Visitor standing near leg3 min
Visitor sitting near leg3 min
Visitor sitting and talking near leg3 min
Visitor far from bedVisitor 0.5 m near head of bed3 min
Visitor 1 m near head of bed3 min
Visitor 0.5 m near leg3 min
Visitor 1 m near leg3 min
Visitor 0.5 m near tail of bed3 min
Visitor 1 m near tail of bed3 min
Table 3. Results of heart rate and respiration rate in different scenarios. The data length is 35 s in this table for each experiment.
Table 3. Results of heart rate and respiration rate in different scenarios. The data length is 35 s in this table for each experiment.
ScenariosRespiration RateHeart Rate
ReferenceRadarErrorReferenceRadarError
Supine2120174751
Right lateral recumbent1818076760
Left lateral recumbent1919071721
Prone1818071701
Baby position right1819168671
Baby position left1819168671
Fowler’s position 12120171701
Fowler’s position 21820270664
Fowler’s position 32020072753
Sitting on the bed1918178771
Visitor standing near head1819170682
Visitor sitting near head1921269654
Visitor sitting and talking near head2221172720
Visitor standing near leg1617167661
Visitor sitting near leg1718165632
Visitor sitting and talking near leg1820265652
Visitor 0.5 m near head of bed2020077781
Visitor 1 m near head of bed1819171743
Visitor 0.5 m near leg1919068680
Visitor 1 m near leg1818067661
Visitor 0.5 m near tail of bed1920167661
Visitor 1 m near tail of bed1918167661
Average error 0.82 1.45
Table 4. Results of different errors.
Table 4. Results of different errors.
ScenariosRespiration RateHeart Rate
MAERMSEMAERMSE
Supine11.1812.1
Right lateral recumbent0.20.451.41.95
Left lateral recumbent002.64.171
Prone0.20.4522.61
Baby position right0.81.11.41.95
Baby position left0.6122.61
Fowler’s position 111.1811
Fowler’s position 20.81.12.22.49
Fowler’s position 30.40.6321.21.67
Sitting on the bed0.60.771.41.48
Visitor standing near head0.40.631.61.79
Visitor sitting near head0.60.770.81.1
Visitor sitting and talking near head0.81.10.60.77
Visitor standing near leg11.6111.34
Visitor sitting near leg1.21.260.81.1
Visitor sitting and talking near leg11.342.62.93
Visitor 0.5 m near head of bed0.60.7722.68
Visitor 1 m near head of bed0.40.890.60.77
Visitor 0.5 m near leg1.41.480.61
Visitor 1 m near leg0.60.770.81.41
Visitor 0.5 m near tail of bed000.81.1
Visitor 1 m near tail of bed0.81.10.60.77
Average error0.650.891.321.76
Table 5. Comparison related work with the proposed method.
Table 5. Comparison related work with the proposed method.
Radar SystemRadar Frequency (GHz)Distance (m)PositionMethod
[9]CW radar240.75SittingEstimate the coarse HR first, then use narrow BPF according to coarse HR.
[17]UWB radar, FMCW radar8.70.5–2.5Front, left, right, backMTI and FFT
[20]UWB radar4.60.5–3Front, 45 degree, lateral side, backsideSVD and CZT
[23]Two CW radars10.587 and 10.5250.5SittingICA and HPF
[25]CW radar26.40.6SittingFilter only
Proposed methodUWB radar7.291Different bed angle and different body positionICA, modified covariance method and peak selection
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Xu, H.; Ebrahim, M.P.; Hasan, K.; Heydari, F.; Howley, P.; Yuce, M.R. Accurate Heart Rate and Respiration Rate Detection Based on a Higher-Order Harmonics Peak Selection Method Using Radar Non-Contact Sensors. Sensors 2022, 22, 83. https://0-doi-org.brum.beds.ac.uk/10.3390/s22010083

AMA Style

Xu H, Ebrahim MP, Hasan K, Heydari F, Howley P, Yuce MR. Accurate Heart Rate and Respiration Rate Detection Based on a Higher-Order Harmonics Peak Selection Method Using Radar Non-Contact Sensors. Sensors. 2022; 22(1):83. https://0-doi-org.brum.beds.ac.uk/10.3390/s22010083

Chicago/Turabian Style

Xu, Hongqiang, Malikeh P. Ebrahim, Kareeb Hasan, Fatemeh Heydari, Paul Howley, and Mehmet Rasit Yuce. 2022. "Accurate Heart Rate and Respiration Rate Detection Based on a Higher-Order Harmonics Peak Selection Method Using Radar Non-Contact Sensors" Sensors 22, no. 1: 83. https://0-doi-org.brum.beds.ac.uk/10.3390/s22010083

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop