Skip to main content

REVIEW article

Front. Med., 07 December 2020
Sec. Intensive Care Medicine and Anesthesiology
Volume 7 - 2020 | https://doi.org/10.3389/fmed.2020.614326

Advances in the Approaches Using Peripheral Perfusion for Monitoring Hemodynamic Status

Julianne M. Falotico1 Koichiro Shinozaki1,2* Kota Saeki2,3 Lance B. Becker1,2
  • 1Department of Emergency Medicine, North Shore University Hospital, Northwell Health, Manhasset, NY, United States
  • 2The Feinstein Institutes for Medical Research, Northwell Health, Manhasset, NY, United States
  • 3Nihon Kohden Innovation Center, Cambridge, MA, United States

Measures of peripheral perfusion can be used to assess the hemodynamic status of critically ill patients. By monitoring peripheral perfusion status, clinicians can promptly initiate life-saving therapy and reduce the likelihood of shock-associated death. Historically, abnormal perfusion has been indicated by the observation of pale, cold, and clammy skin with increased capillary refill time. The utility of these assessments has been debated given that clinicians may vary in their clinical interpretation of body temperature and refill time. Considering these constraints, current sepsis bundles suggest the need to revise resuscitation guidelines. New technologies have been developed to calculate capillary refill time in the hopes of identifying a new gold standard for clinical care. These devices measure either light reflected at the surface of the fingertip (reflected light), or light transmitted through the inside of the fingertip (transmitted light). These new technologies may enable clinicians to monitor peripheral perfusion status more accurately and may increase the potential for ubiquitous hemodynamic monitoring across different clinical settings. This review will summarize the different methods available for peripheral perfusion monitoring and will discuss the advantages and disadvantages of each approach.

Introduction

Hemodynamic instability creates an imbalance between oxygen delivery and consumption and is an important contributor to organ failure (1). Hemodynamic monitoring is crucial to identify inadequate tissue perfusion in order to prevent organ dysfunction and death (2). Both global and peripheral biomarkers of tissue perfusion are used clinically as proxies for hemodynamic status. Global measurements often require invasive techniques, and the extent to which they reflect tissue oxygenation has been questioned (3).

Blood is diverted from less vital to more vital organs in response to circulatory failure (35). Compared to central organs, the peripheral, non-vital organs are the first to reflect hypoperfusion during shock and the last to reperfuse during resuscitation (6). As a result, clinicians shift from global to peripheral perfusion monitoring to promptly recognize deteriorating clinical status and to assess the effectiveness of resuscitation therapy (7). Measures of peripheral tissue perfusion have emerged as important tools to monitor the hemodynamic status of critically ill patients. Efforts have been made to determine the ideal method for assessing peripheral perfusion status, which should be non-invasive, rapid, reproducible, and easily measured.

Shock is the clinical manifestation of acute circulatory failure. It is characterized by signs of tissue hypoperfusion (8) and leads to impairments in cellular oxygen delivery (9, 10). Septic shock is a form of distributive shock that results from dysregulations in the host inflammatory response to infection (11). As a leading healthcare burden, septic shock accounts for one-third to one-half of all deaths occurring in hospital settings (12), with roughly 32 million sepsis cases per year (13). Given that peripheral perfusion status can be used to quickly assess shock severity (14), hemodynamic monitoring can allow clinicians to promptly initiate therapy, evaluate the effectiveness of interventions, and assess the patient throughout their recovery.

The monitoring of peripheral perfusion status is a central element to patient care. Methods to perform this measurement are of interest and can be complicated. Major modalities that are used to measure peripheral perfusion status include capillary refill time (CRT) and temperature. New technologies have been developed to calculate CRT. These devices measure either light reflected at the surface of the fingertip (reflected light), or light transmitted through the inside of the fingertip (transmitted light). These new approaches can enable clinicians to non-invasively monitor hemodynamic status with more accuracy than traditional measurements and may become a very valuable aspect of clinical medicine. This review will discuss the pros and cons of the available methods to monitor peripheral perfusion in critically ill patients. The available techniques will be grouped according to their mechanism of monitoring perfusion status, including reflected light, transmitted light, and temperature. Within these categories, the techniques will be further delineated as either subjective or objective methods of monitoring. This review therefore provides a novel schema for classifying the available methods of monitoring peripheral perfusion (Table 1).

TABLE 1
www.frontiersin.org

Table 1. Summary of the available methods used to monitor peripheral perfusion.

Methods to Monitor Peripheral Perfusion

Capillary Refill Methods

Capillary refill time is the time it takes for the color of a distal capillary bed to return to baseline after applying enough pressure to cause blanching. Delayed CRT is defined as >2 s (46) and indicates abnormal circulatory status (47). CRT is used clinically to assess peripheral circulation for signs of shock and dehydration (21).

Reflected Light and Surface Color Changes

Subjective Measures

Clinicians routinely measure CRT using the naked eye. The value of these measurements in hemodynamic monitoring has been widely studied. Ait-Oufella et al. (15) examined septic shock patients 6 h after resuscitation. The investigators found that prolonged CRT was a strong predictive factor of 14-day mortality. Hernandez et al. (4) studied a mixed severe sepsis/septic shock population 6 h after resuscitation. The authors found that CRT <4 s was associated with correction of hyperlactatemia at 24 h. van Genderen et al. (16) examined the diagnostic accuracy of different peripheral perfusion measures in identifying surgical patients at high risk of developing post-operative complications. The investigators reported that CRT displayed the highest diagnostic accuracy [area under the curve (AUC) 0.91] and was independent of systemic hemodynamics. Hernandez et al. (17) compared organ dysfunction in septic shock patients 72 h after different methods of resuscitation. The authors reported that peripheral perfusion–targeted resuscitation was associated with less organ dysfunction compared to lactate-targeted resuscitation [mean sequential organ failure assessment (SOFA) score 5.6 vs. 6.6]. Peripheral perfusion–targeted resuscitation also trended toward reduced 28-day mortality, but did not reach the proposed statistical significance threshold (p = 0.06). Zampieri et al. (48) reassessed the results of this trial using both a post-hoc Bayesian analysis and a mixed logistic regression analysis. The authors reported a very high probability that peripheral perfusion–targeted resuscitation results in lower mortality and faster resolution of organ dysfunction than lactate-targeted resuscitation strategies. These findings highlight the prognostic value and therapeutic potential of the manual CRT-test.

Subjective CRT measurements are quick, convenient, non-invasive, and inexpensive methods of measuring hemodynamic status. However, there are important limitations. Measurements can be confounded by ambient (4951), skin (49, 52, 53), and core temperature (50), ambient lighting (54), gender and age (5052). Clinicians may interpret surface color changes differently, which raises concerns about the reliability of the CRT-test. Ait-Oufella et al. (15) found that CRT is very reproducible with an excellent inter-rater concordance (80%: index finger; 95%: knee). van Genderen et al. (16) reported a good overall agreement for inter-rater reliability of CRT between different examiners on different post-operative days (κ = 0.74–0.91). However, Alsma et al. (55) reported that inter-observer agreement on CRT is moderate at best, and higher for the distal phalanx (κ = 0.40) than for the sternum (κ = 0.30). Brabrand et al. (56) found only moderate inter-observer reliability (κ = 0.56) when observers categorized CRT as normal or abnormal. When CRT was measured in seconds, the investigators found an acceptable interclass correlation (ICC) of 0.62. Quantitative measures of CRT with clearly defined cut-offs appear to reduce discrepancies between observers (57).

It is possible that training may improve the reproducibility of the CRT-test. In our laboratory, we analyzed CRT measurements made by observers with varying training levels (58). We found that the mean intra-observer reliability was higher in clinicians than non-clinicians (0.46 vs. 0.25). It was also the highest in attending physicians and physician assistants, followed by residents, nurses, and non-clinicians. Standardization of compression strength may also improve reproducibility. Ait-Oufella et al. (15) reported excellent inter-rater concordance using 15 s of firm pressure. Alsma et al. (55) found only slightly higher inter-observer correlation using 15 s of pressure compared to 5 s. Considering practicality in emergent settings, investigators recommend the use of 5 s of moderate, firm pressure to perform CRT measurements (55, 57). Standardization of the protocol may help overcome the shortcomings in routinely measuring CRT.

Objective Measures

Technology has been developed to objectively calculate CRT. These devices also measure reflected light, but eliminate the variability that exists when clinicians manually measure CRT. Shavit et al. (18) introduced the concept of digitally measured CRT (DCRT). DCRT is calculated as the time between the release of fingertip compression and the recovery frame. In children with gastroenteritis, DCRT was more accurate at assessing the presence of significant dehydration than overall clinical assessment by experienced pediatric ED physicians (AUC 0.99 vs. 0.88). Kawaguchi et al. (20) developed a device that adjusts for pressing strength and time to determine the characteristics of the optimal fingernail compression. The authors reported that fingernail compressions <2 s resulted in unreliable CRT measurements. They found significant differences in CRT at pressing strengths of 1 newton (N) and 3 N, but no significant differences between 3, 5, and 7 N. The investigators therefore recommended compressions using 3–7 N of pressure for 2 s. Development of devices that uniformly apply these compression settings may improve the precision of hemodynamic monitoring in clinical settings. Using an automated, pneumatic device, Blaxter et al. (21) reported a statistically significant increase in CRT in the majority of patients who underwent forearm cooling. As the device provides continuous measurements, it can repeatedly monitor hemodynamic status while reducing clinician burden and inter-observer variability. John et al. (19) used video mode polarization spectroscopy to quantify changes in red blood cell (RBC) concentration. The authors found that tRtB1 (rapid return of RBC concentration to baseline after release of fingertip pressure) corresponds best with the clinical definition of visually inspected CRT. However, clinicians may actually measure tpk (onset of hyperemia after resolution of blanching) when they perform the test. The naked eye alone may therefore be incapable of capturing the fundamentals of the CRT test. Implementation of this software into clinical care may allow clinicians to monitor perfusion status and guide clinical decision-making with more accuracy. However, this technology is limited in chaotic clinical settings, where recorded video data can be shaky and unfocused (36). In contrast to fingertip assessments, certain technologies evaluate perfusion status via analysis of reflected light at different areas of the peripheral surface. Investigators have used sidestream dark-field (SDF) imaging (22, 23) to assess peripheral perfusion via evaluation of the sublingual microcirculation. In critically ill patients, Klijn et al. (24) reported that SDF assessed tissue perfusion and oxygenation was not inferior to invasive hemodynamic measurements in monitoring fluid responsiveness. SDF provides clear capillary imaging and can evaluate deep sublingual arterioles (22, 25). However, a large amount of data is discarded due to image quality artifacts and manual tracing of the vessels is too time consuming to be practical for clinical use. The development of automated devices would increase the clinical utility of SDF measurements (26).

Objective CRT measurements provide detailed data, improve reproducibility, and minimize observer bias. There are also disadvantages. Technology that assesses skin color changes (18, 20) is limited in populations with darker skin. The current design of these devices is impractical for routine use in clinical settings (18) and the procedures are time-consuming (19). Future research should focus on making adjustments that reduce procedural time and allow these devices to be easily implemented into patient care.

Transmitted Light and Spectrophotometric Methods

New technologies measure peripheral perfusion by analyzing light transmitted through the inside of the fingertip. Since visual assessments cannot be performed, there are no subjective measures of peripheral perfusion using this methodology.

Near infrared spectroscopy (NIRS) analyzes spectra in the near-infrared range to quantify oxyhemoglobin and deoxyhemoglobin levels in order to assess peripheral tissue oxygen saturation (StO2) (27, 28). The utility of NIRS for monitoring critically ill patients remains uncertain (28). Lima et al. (29) investigated the relationship between thenar StO2 during a vascular occlusion test (VOT) to the peripheral perfusion status and clinical outcome of critically ill patients. The authors reported a significantly lower baseline StO2 and StO2 recovery rate in patients with abnormal peripheral perfusion compared to patients with normal peripheral perfusion (72 vs. 81 and 1.9 vs. 3.2, respectively). These findings were independent of disease condition and hemodynamic status. In a follow-up study, Lima et al. (28) investigated the effect of peripheral vasoconstriction on thenar StO2. After body surface cooling, the authors reported a significant decrease in StO2 (82–72%) and StO2 recovery rate (3.0–1.7%/s). Together, these findings suggest that peripheral tissue oxygenation varies according to peripheral circulation status. StO2 measurements should therefore be interpreted in the context of other markers of peripheral circulation, such as skin temperature. Given that perfusion status continually changes in critically ill patients, clinicians must carefully consider peripheral circulatory status when using NIRS for hemodynamic monitoring. Although NIRS can non-invasively evaluate perfusion, it is limited by the fact that the measurements are time consuming and expensive (30).

Peripheral perfusion index (PPI) has been investigated for its use in hemodynamic monitoring. Using pulse oximetry, PPI is calculated from the ratio between the pulsatile and non-pulsatile signals of absorbed light (31) and provides insight on the circulatory status of vital organs during shock (32). In a study on healthy newborn infants, Zaramella et al. (32) compared the relationship between foot PPI and variables of peripheral perfusion measured by NIRS on the calf. The authors reported a significant correlation between foot PPI and both calf blood flow (r = 0.32) and oxygen delivery (r = 0.32). In a study on 100 children undergoing hemodynamic monitoring, Sivaprasath et al. (33) reported that PPI had a good correlation with pulse pressure and systolic blood pressure in all age groups, and a weak correlation with mean arterial blood pressure and diastolic blood pressure. The authors concluded that a 57% reduction in PPI from baseline may predict impending shock in children. He at al. (34) explored the prognostic value of PPI in septic patients. The authors reported that PPI was significantly correlated with baseline transcutaneous carbon dioxide tensions (PtcO2), 10 min-oxygen challenge test (OCT) and oxygen challenge index (OCI). The authors also found significantly lower PPI, 10 min-OCT, and OCI values in non-survivors compared to survivors. These variables predicted ICU mortality with similar accuracy to arterial lactate level. PPI therefore appears to be a simple yet powerful predictor of mortality in septic patients status post-resuscitation. The results of these studies support the use of PPI for unambiguous, non-invasive, and continuous evaluations of global resuscitation status and outcome. However, PPI is limited in patients with hypothermia, embolism, or local vasospasm (35). Additional studies are necessary to support the routine monitoring of PPI as a parameter to detect impending shock and improve clinical outcomes.

Recent research has focused on the development of new technology that quantifies CRT using a pulse oximeter, which investigators have called quantified CRT (Q-CRT). Morimura et al. (14) first introduced this method. The authors analyzed the infrared transmitted light intensity (TLI) emitted from a pulse oximeter senor. They defined Q-CRT as the time in seconds from the release of fingertip compression to TLI reaching 90% of baseline. The authors reported that Q-CRT was significantly correlated with blood lactate levels in ICU patients (rs = 0.681). Q-CRT has also been correlated with venous blood lactate levels in ED patients (37). Together, these results suggest that Q-CRT might be an effective measure of insufficient global tissue perfusion and shock in both the ICU and ED. In ED patients with suspected infection, Yasufumi et al. (38) investigated the ability of Q-CRT to predict sepsis compared with quick sequential organ failure assessment (qSOFA) and systemic inflammatory response syndrome (SIRS) scores. The authors reported that the accuracy of Q-CRT in predicting sepsis was comparable to qSOFA scores, SIRS scores, and lactate level. Q-CRT may therefore be a quicker and non-invasive alternative to evaluate patients with suspected sepsis.

In our laboratory, we modified the TLI calculation used to measure Q-CRT. We modeled the curve fitting the recovery phase of the TLI waveform as an exponential decay using the least squares method, and measured the time at which the fitting curve returned to 90% (Figure 1). This improved measurement was named blood refill time (BRT) (39, 40) and later referred to as capillary refill index (CRI) (36). In a healthy volunteer (39), we found that our device successfully detected prolonged BRT (5.8 s) after fingertip cooling to 22.8°C. In 30 healthy volunteers (40), we measured BRT at room temperature, after immersion in cold water, and after re-warming by warm water. We reported that the “cold” group had significantly longer BRT (4.67 s) than the “room temperature” (1.96 s) and “re-warm” groups (1.96 s). Our data suggests a causal relationship between temperature and peripheral blood perfusion. Healthcare providers routinely encounter patients with cool fingertips when performing bedside evaluations of CRT. Our results suggest that clinicians should interpret these measurements with caution when performed in the setting of unknown fingertip temperature.

FIGURE 1
www.frontiersin.org

Figure 1. Mechanism of the CRI monitoring device. The curve fitting the recovery phase of the TLI waveform is modeled as an exponential decay using the least squares method. CRI is measured as the time at which the fitting curve returns to 90% of baseline.

We compared the accuracy of CRI to CRT calculated via software analysis of recorded fingertip compression videos (36). We measured CRT and CRI at room temperature, after immersion in cold water, and after re-warming by warm water. To avoid procedural variability in compression, the fingertips were compressed pneumatically for both CRI and CRT at the same pressure and duration. We found that there was a strong correlation between CRI and CRT (r = 0.89). We performed a validation study in the ED to clinically evaluate the accuracy of our device (36). We reported a strong correlation between CRI and CRT (r = 0.76). Given the use of software analysis, we believe our study provides reliable evidence that the CRI algorithm is representative of the CRT measurements performed in clinical practice. We also reported higher CRI and CRT in ED patients compared to healthy volunteers at room temperature. Using a Bland-Altman analysis, we found that CRI was consistently higher than CRT (difference = +1.01). Although CRI and CRT measurements both represent peripheral perfusion status, this data suggests that the absolute value of the measurements may not be equal. Because CRI was associated with a systematic bias rather than random errors, we recommend it as a reliable and objective alternative to the manual CRT-test.

Q-CRT/CRI minimizes observer variability and provides immediate and reproducible data regarding the circulatory status of critically ill patients. Given that resuscitation strategies rooted in peripheral perfusion monitoring result in lower mortality, faster resolution of organ dysfunction, and decreased fluid requirements (17, 48), Q-CRT/CRI may have tremendous clinical potential. However, future research is necessary in populations of critically ill patients in order to evaluate the efficacy of Q-CRT/CRI in lowering mortality and reducing individual requirements (i.e., vasopressor, mechanical ventilation, and renal replacement therapies). With further clinical support, this technology may be a promising alternative for continuous monitoring and spot check measurements of peripheral perfusion.

Temperature

Body temperature is distributed both centrally (body core) and peripherally (body shell and environment) (59). Thermoregulatory status provides insight about the clinical condition of patients in intensive/critical care units. In response to shock, blood flow is restricted to central/vital organs at the expense of peripheral organs. Peripheral temperature is therefore used as an indicator of hemodynamic status (16, 60). Septic shock is divided into two categories: “cold” and “warm” shock (41, 61). Some authors believe that this distinction might confuse the interpretation of perfusion state (62). Regardless, studies show that peripheral temperature is still useful in differentiating well-perfused from hypo-perfused patients (63).

Subjective Measures (Clinical Estimates)

Healthcare providers use clinical judgment to estimate peripheral body temperature in order to quickly evaluate hemodynamic status. In ICU patients, Kaplan et al. (42) compared clinician assessment of distal extremity skin temperature (warm or cool) to objective markers of hypoperfusion. The authors found that patients with cool extremities had significantly higher serum lactate levels and lower cardiac index compared to patients with warm skin temperature. Hasdai et al. (43) reported that the presence of cold and clammy skin was an independent predictor of 30-day mortality in cardiogenic shock patients. 48 h after resuscitation, Lima et al. (41) found that ICU patients with cool extremities had significantly higher rates of organ failure compared to patients with normal skin temperature (SOFA score 9 vs. 7).

Peripheral temperature measurements can be performed quickly and easily while providing valuable insight on perfusion status. However, there is a large degree of variability, since what is considered “cool” to one clinician may not always be consistent. Changes in ambient temperature may also affect clinical estimates of skin temperature (41).

Objective Measures (Temperature Gradients)

Body temperature gradients provide objective measures of peripheral perfusion status. The gradients are created by calculating the temperature difference between two points, such as central-to-toe (Tc-toe), forearm-to-fingertip (Tskin-diff), and peripheral-to-ambient. Skin temperature can be measured using infrared thermometer (59), thermocouple disposable probes (64), or infrared thermography (65). Regardless of the modality used, these gradients provide non-invasive, accurate measures of thermoregulatory peripheral vasoconstriction (66). In response to shock, there is a reduction in fingertip blood flow in order to maintain perfusion of vital organs. This causes Tskin-diff and Tc-toe gradients to increase in the presence of constant environmental conditions (60). Peripheral-to-ambient gradients decrease during shock (3), despite some limitations that exist from this interpretation and from using ambient temperature as a marker.

In critically ill patients, Joly et al. (44) reported a significantly lower toe-to-ambient gradient in non-survivors (0.9°C) than in survivors (3.4°C). In septic patients, Hernandez et al. (4) found that return of Tc-toe to normal within the first 6 h of resuscitation was independently associated with successful resuscitation. It was also predictive of hyperlactatemia normalization at 24 h. In septic patients, Bourcier et al. (45) reported significant decreases in toe-to-room temperature gradients in patients who died from multiple organ failure (−0.2°C) compared to survivors (+3.9°C). Toe-to-room temperature gradient was also significantly correlated with other measures of tissue perfusion, including urine output, arterial lactate level, knee CRT, and mottling score.

Body temperature gradients provide better reproducibility than clinical estimates of cool hands/feet (67) and are more accurate reflections of peripheral blood flow than skin temperature alone (3, 68, 69). Abnormal gradients can be used as early indicators of abnormal perfusion, while therapeutic efficacy can be monitored by normalization of the gradient (70). As most critically ill adult patients undergo invasive monitoring, the use of body temperature gradients provides a non-invasive, economic, and effective alternative to monitor circulatory status (59). However, body temperature gradients are limited in certain populations, including anesthetized (71) and cardiac surgical patients (72). Differences in ambient temperature between the two measurement sites may also influence Tc-toe and Tskin-diff gradients. However, any fluctuations in ambient temperature should affect both sites similarly and minimize any potential confounds (41).

Recommendations and Conclusions

In order to promptly initiate life-saving clinical interventions and improve outcomes, an early recognition of shock is key. Many authors therefore recommend peripheral perfusion measures to continuously assess the hemodynamic status of critically ill patients. However, current sepsis bundles suggest the need for the reassessment of resuscitation guidelines. It appears that the use of therapies guided by peripheral perfusion measurements result in favorable clinical outcomes. It is important to acknowledge that our review does not discuss all of the available technologies that may be used to evaluate peripheral perfusion status, such as laser doppler flowmetry (LDF), infrared thermography (73), and PulseCam technology (74). Nevertheless, clinicians should choose among the available techniques with an understanding of the pros and cons of each approach (Table 1). Newer technologies that measure CRT, such as the objective CRI device used in our laboratory, meet many of the important criteria of assessing peripheral perfusion and are promising tools to monitor shock status at the bedside. Future studies focused on peripheral perfusion should further define the clinical implications of these devices, including their utility in modulating response to treatment. Adjustments should also be made to make the devices more practical for routine clinical use. The ability of these technologies to provide uniform/reproducible measurements across different clinical settings, decrease the use of hospital resources, and improve clinical outcomes would strengthen the role of peripheral perfusion monitoring in the bedside evaluation of hemodynamic status.

Author Contributions

KSh and JF designed the conception of the work. JF drafted. KSh and KSa edited the manuscript. LB supervised and enabled the work. All authors added intellectual content, interpretations of the work, critically revised the paper, and gave final approval of the version to be published.

Conflict of Interest

KSa is an employee of Nihon Kohden Corporation and Nihon Kohden Innovation Center, Inc. A pulse oximeter with the CRI function is marketed in Japan. This does not alter the authors' adherence to all the journal's policies on sharing data and materials. KSh and LB had a patent right of metabolic measurements in critically ill patients. KSh had a grant/research support from Nihon Kohden Corp. LB had a grant/research support from Philips Healthcare, the NIH, Nihon Kohden Corp., Zoll Medical Corp., PCORI, BrainCool, and United Therapeutics and owes patents including seven issued patents and several pending patents involving the use of medical slurries as human coolant devices to create slurries, reperfusion cocktails, and measurement of respiratory quotient.

The remaining author declares that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Abbreviations

CRT, Capillary refill time; AUC, area under the curve; SOFA, sequential organ failure assessment; ICC, interclass correlation; RBC, red blood cell; DCRT, digitally measured capillary refill time; N, newton; SDF, sidestream dark field; NIRS, near infrared spectroscopy; PPI, peripheral perfusion index; PtcO2, transcutaneous carbon dioxide tensions; OCT, 10 min-oxygen challenge test; OCI, oxygen challenge index; Q-CRT, quantified CRT; qSOFA, quick sequential organ failure assessment; SIRS, systemic inflammatory response syndrome; BRT, blood refill time; CRI, capillary refill index; StO2, peripheral tissue oxygen saturation; VOT, vascular occlusion test; TLI, total light intensity; Tc-toe, central-to-toe; Tskin-diff, forearm-to-fingertip; LDF, laser doppler flowmetry.

References

1. Huygh J, Peeters Y, Bernards J, Malbrain MLNG. Hemodynamic monitoring in the critically ill: an overview of current cardiac output monitoring methods. F1000Res. (2016) 5:F1000. doi: 10.12688/f1000research.8991.1

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Rhodes A, Evans LE, Alhazzani W, Levy MM, Antonelli M, Ferrer R, et al. Surviving sepsis campaign: international guidelines for management of sepsis and septic shock: 2016. Intensive Care Med. (2017) 43:304–77. doi: 10.1007/s00134-017-4683-6

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Lima A, Bakker J. Noninvasive monitoring of peripheral perfusion. Intensive Care Med. (2005) 31:1316–26. doi: 10.1007/s00134-005-2790-2

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Hernandez G, Pedreros C, Veas E, Bruhn A, Romero C, Rovegno M, et al. Evolution of peripheral vs metabolic perfusion parameters during septic shock resuscitation. A clinical-physiologic study. J Crit Care. (2012) 27:283–8. doi: 10.1016/j.jcrc.2011.05.024

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Lima A, Bakker J. Clinical assessment of peripheral circulation. Curr Opin Crit Care. (2015) 21:226–31. doi: 10.1097/MCC.0000000000000194

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Hasanin A, Mukhtar A, Nassar H. Perfusion indices revisited. J Intensive Care. (2017) 5:24. doi: 10.1186/s40560-017-0220-5

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Lima A, Bakker J. Clinical monitoring of peripheral perfusion: there is more to learn. Crit Care. (2014) 18:113. doi: 10.1186/cc13738

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Cecconi M, De Backer D, Antonelli M, Beale R, Bakker J, Hofer C, et al. Consensus on circulatory shock and hemodynamic monitoring. Task force of the European Society of Intensive Care Medicine. Intensive Care Med. (2014) 40:1795–815. doi: 10.1007/s00134-014-3525-z

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Vincent J-L, De Backer D. Circulatory shock. N Engl J Med. (2013) 369:1726–34. doi: 10.1056/NEJMra1208943

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Cannon JW. Hemorrhagic shock. N Engl J Med. (2018). 378:370–9. doi: 10.1056/NEJMra1705649

CrossRef Full Text | Google Scholar

11. Singer M, Deutschman CS, Seymour CW, Shankar-Hari M, Annane D, Bauer M, et al. The third international consensus definitions for sepsis and septic shock (sepsis-3) consensus definitions for sepsis and septic shockconsensus definitions for sepsis and septic shock. JAMA. (2016) 315:801–10. doi: 10.1001/jama.2016.0287

CrossRef Full Text | Google Scholar

12. Liu V, Escobar GJ, Greene JD, Soule J, Whippy A, Angus DC, et al. Hospital deaths in patients with sepsis from 2 independent cohorts. JAMA. (2014) 312:90–2. doi: 10.1001/jama.2014.5804

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Fleischmann C, Scherag A, Adhikari NK, Hartog CS, Tsaganos T, Schlattmann P, et al. Assessment of global incidence and mortality of hospital-treated sepsis. Current estimates and limitations. Am J Respir Crit Care Med. (2016) 193:259–72. doi: 10.1164/rccm.201504-0781OC

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Morimura N, Takahashi K, Doi T, Ohnuki T, Sakamoto T, Uchida Y, et al. A pilot study of quantitative capillary refill time to identify high blood lactate levels in critically ill patients. Emerg Med J. (2015) 32:444–8. doi: 10.1136/emermed-2013-203180

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Ait-Oufella H, Bige N, Boelle PY, Pichereau C, Alves M, Bertinchamp R, et al. Capillary refill time exploration during septic shock. Intensive Care Med. (2014) 40:958–64. doi: 10.1007/s00134-014-3326-4

PubMed Abstract | CrossRef Full Text | Google Scholar

16. van Genderen ME, Paauwe J, de Jonge J, van der Valk RJ, Lima A, Bakker J, et al. Clinical assessment of peripheral perfusion to predict postoperative complications after major abdominal surgery early: a prospective observational study in adults. Crit Care. (2014) 18:R114. doi: 10.1186/cc13905

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Hernandez G, Ospina-Tascon GA, Damiani LP, Estenssoro E, Dubin A, Hurtado J, et al. Effect of a resuscitation strategy targeting peripheral perfusion status vs serum lactate levels on 28-day mortality among patients with septic shock: the ANDROMEDA-SHOCK randomized clinical trial. JAMA. (2019) 321:654–64. doi: 10.1001/jama.2019.0071

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Shavit I, Brant R, Nijssen-Jordan C, Galbraith R, Johnson DW. A novel imaging technique to measure capillary-refill time: improving diagnostic accuracy for dehydration in young children with gastroenteritis. Pediatrics. (2006) 118:2402–8. doi: 10.1542/peds.2006-1108

PubMed Abstract | CrossRef Full Text | Google Scholar

19. John RT, Henricson J, Nilsson GE, Wilhelms D, Anderson CD. Reflectance spectroscopy: to shed new light on the capillary refill test. J Biophotonics. (2018) 11:e201700043. doi: 10.1002/jbio.201700043

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Kawaguchi R, Nakada TA, Oshima T, Shinozaki M, Nakaguchi T, Haneishi H, et al. Optimal pressing strength and time for capillary refilling time. Crit Care. (2019) 23:4. doi: 10.1186/s13054-018-2295-3

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Blaxter LL, Morris DE, Crowe JA, Henry C, Hill S, Sharkey D, et al. An automated quasi-continuous capillary refill timing device. Physiol Meas. (2016) 37:83–99. doi: 10.1088/0967-3334/37/1/83

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Ince C. Sidestream dark field imaging: an improved technique to observe sublingual microcirculation. Crit Care. (2005) 9(Suppl. 1):P72. doi: 10.1186/cc3135

CrossRef Full Text | Google Scholar

23. Ince C, Boerma EC, Cecconi M, De Backer D, Shapiro NI, Duranteau J, et al. Second consensus on the assessment of sublingual microcirculation in critically ill patients: results from a task force of the European Society of Intensive Care Medicine. Intensive Care Med. (2018) 44:281–99. doi: 10.1007/s00134-018-5070-7

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Klijn E, van Velzen MH, Lima AP, Bakker J, van Bommel J, Groeneveld AB. Tissue perfusion and oxygenation to monitor fluid responsiveness in critically ill, septic patients after initial resuscitation: a prospective observational study. J Clin Monit Comput. (2015) 29:707–12. doi: 10.1007/s10877-014-9653-8

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Treu CM, Lupi O, Bottino DA, Bouskela E. Sidestream dark field imaging: the evolution of real-time visualization of cutaneous microcirculation and its potential application in dermatology. Arch Dermatol Res. (2011) 303:69–78. doi: 10.1007/s00403-010-1087-7

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Massey MJ, Shapiro NI. A guide to human in vivo microcirculatory flow image analysis. Crit Care. (2016) 20:5. doi: 10.1186/s13054-016-1213-9

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Myers DE, Anderson LD, Seifert RP, Ortner JP, Cooper CE, Beilman GJ, et al. Noninvasive method for measuring local hemoglobin oxygen saturation in tissue using wide gap second derivative near-infrared spectroscopy. J Biomed Opt. (2005) 10:034017. doi: 10.1117/1.1925250

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Lima A, van Genderen ME, Klijn E, Bakker J, van Bommel J. Peripheral vasoconstriction influences thenar oxygen saturation as measured by near-infrared spectroscopy. Intensive Care Med. (2012) 38:606–11. doi: 10.1007/s00134-012-2486-3

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Lima A, van Bommel J, Sikorska K, van Genderen M, Klijn E, Lesaffre E, et al. The relation of near-infrared spectroscopy with changes in peripheral circulation in critically ill patients. Crit Care Med. (2011) 39:1649–54. doi: 10.1097/CCM.0b013e3182186675

PubMed Abstract | CrossRef Full Text | Google Scholar

30. Nicklin SE, Hassan IA, Wickramasinghe YA, Spencer SA. The light still shines, but not that brightly? The current status of perinatal near infrared spectroscopy. Arch Dis Child Fetal Neonatal Ed. (2003) 88:F263–8. doi: 10.1136/fn.88.4.F263

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Espinoza ED, Welsh S, Dubin A. Lack of agreement between different observers and methods in the measurement of capillary refill time in healthy volunteers: an observational study. Rev Bras Ter Intensiva. (2014) 26:269–76. doi: 10.5935/0103-507X.20140038

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Zaramella P, Freato F, Quaresima V, Ferrari M, Vianello A, Giongo D, et al. Foot pulse oximeter perfusion index correlates with calf muscle perfusion measured by near-infrared spectroscopy in healthy neonates. J Perinatol. (2005) 25:417–22. doi: 10.1038/sj.jp.7211328

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Sivaprasath P, Mookka Gounder R, Mythili B. Prediction of shock by peripheral perfusion index. Indian J Pediatr. (2019) 86:903–8. doi: 10.1007/s12098-019-02993-6

PubMed Abstract | CrossRef Full Text | Google Scholar

34. He H-w, Liu D-w, Long Y, Wang X-t. The peripheral perfusion index and transcutaneous oxygen challenge test are predictive of mortality in septic patients after resuscitation. Crit Care. (2013) 17:R116. doi: 10.1186/cc12788

PubMed Abstract | CrossRef Full Text | Google Scholar

35. De Felice C, Latini G, Vacca P, Kopotic RJ. The pulse oximeter perfusion index as a predictor for high illness severity in neonates. Eur J Pediatr. (2002) 161:561–2. doi: 10.1007/s00431-002-1042-5

PubMed Abstract | CrossRef Full Text | Google Scholar

36. Shinozaki K, Saeki K, Jacobson LS, Falotico JM, Li T, Hirahara H, et al. Evaluation of accuracy of capillary refill index with pneumatic fingertip compression. J Clin Monit Comput. (2020) doi: 10.1007/s10877-019-00454-1. [Epub ahead of print].

PubMed Abstract | CrossRef Full Text | Google Scholar

37. Oi Y, Sato K, Nogaki A, Shinohara M, Matsumoto J, Abe T, et al. Association between venous blood lactate levels and differences in quantitative capillary refill time. Acute Med Surg. (2018) 5:321–8. doi: 10.1002/ams2.348

PubMed Abstract | CrossRef Full Text | Google Scholar

38. Yasufumi O, Morimura N, Shirasawa A, Honzawa H, Oyama Y, Niida S, et al. Quantitative capillary refill time predicts sepsis in patients with suspected infection in the emergency department: an observational study. J Intensive Care. (2019) 7:29. doi: 10.1186/s40560-019-0382-4

PubMed Abstract | CrossRef Full Text | Google Scholar

39. Shinozaki K, Capilupi MJ, Saeki K, Hirahara H, Horie K, Kobayashi N, et al. Blood refill time: clinical bedside monitoring of peripheral blood perfusion using pulse oximetry sensor and mechanical compression. Am J Emerg Med. (2018) 36:2310–2. doi: 10.1016/j.ajem.2018.04.006

PubMed Abstract | CrossRef Full Text | Google Scholar

40. Shinozaki K, Capilupi MJ, Saeki K, Hirahara H, Horie K, Kobayashi N, et al. Low temperature increases capillary blood refill time following mechanical fingertip compression of healthy volunteers: prospective cohort study. J Clin Monit Comput. (2019) 33:259–67. doi: 10.1007/s10877-018-0159-7

PubMed Abstract | CrossRef Full Text | Google Scholar

41. Lima A, Jansen TC, van Bommel J, Ince C, Bakker J. The prognostic value of the subjective assessment of peripheral perfusion in critically ill patients. Crit Care Med. (2009) 37:934–8. doi: 10.1097/CCM.0b013e31819869db

PubMed Abstract | CrossRef Full Text | Google Scholar

42. Kaplan LJ, McPartland K, Santora TA, Trooskin SZ. Start with a subjective assessment of skin temperature to identify hypoperfusion in intensive care unit patients. J Trauma. (2001) 50:620–7; discussion 627–8. doi: 10.1097/00005373-200104000-00005

PubMed Abstract | CrossRef Full Text | Google Scholar

43. Hasdai D, Holmes DR Jr, Califf RM, Thompson TD, Hochman JS, Pfisterer M, et al. Cardiogenic shock complicating acute myocardial infarction: predictors of death. GUSTO Investigators. Global utilization of streptokinase and tissue-plasminogen activator for occluded coronary arteries. Am Heart J. (1999) 138:21–31. doi: 10.1016/S0002-8703(99)70241-3

PubMed Abstract | CrossRef Full Text | Google Scholar

44. Joly HR, Weil MH. Temperature of the great toe as an indication of the severity of shock. Circulation. (1969) 39:131–8. doi: 10.1161/01.CIR.39.1.131

PubMed Abstract | CrossRef Full Text | Google Scholar

45. Bourcier S, Pichereau C, Boelle P-Y, Nemlaghi S, Dubée V, Lejour G, et al. Toe-to-room temperature gradient correlates with tissue perfusion and predicts outcome in selected critically ill patients with severe infections. Ann Intensive Care. (2016) 6:63. doi: 10.1186/s13613-016-0164-2

PubMed Abstract | CrossRef Full Text | Google Scholar

46. Baraff LJ. Capillary refill: is it a useful clinical sign? Pediatrics. (1993) 92:723–4.

PubMed Abstract | Google Scholar

47. Pickard A, Karlen W, Ansermino JM. Capillary refill time: is it still a useful clinical sign? Anesth Analg. (2011) 113:20–123. doi: 10.1213/ANE.0b013e31821569f9

PubMed Abstract | CrossRef Full Text | Google Scholar

48. Zampieri FG, Damiani LP, Bakker J, Ospina-Tascón GA, Castro R, Cavalcanti AB, et al. Effects of a resuscitation strategy targeting peripheral perfusion status versus serum lactate levels among patients with septic shock. A Bayesian reanalysis of the ANDROMEDA-SHOCK Trial. Am J Respir Crit Care Med. (2020) 201:423–9. doi: 10.1164/rccm.201905-0968OC

PubMed Abstract | CrossRef Full Text | Google Scholar

49. Gorelick MH, Shaw KN, Baker MD. Effect of ambient temperature on capillary refill in healthy children. Pediatrics. (1993) 92:699–702.

PubMed Abstract | Google Scholar

50. Anderson B, Kelly AM, Kerr D, Clooney M, Jolley D. Impact of patient and environmental factors on capillary refill time in adults. Am J Emerg Med. (2008) 26:62–5. doi: 10.1016/j.ajem.2007.06.026

PubMed Abstract | CrossRef Full Text | Google Scholar

51. Strozik KS, Pieper CH, Roller J. Capillary refilling time in newborn babies: normal values. Arch Dis Child Fetal Neonatal Ed. (1997) 76:F193–6. doi: 10.1136/fn.76.3.F193

PubMed Abstract | CrossRef Full Text | Google Scholar

52. Schriger DL, Baraff L. Defining normal capillary refill: variation with age, sex, and temperature. Ann Emerg Med. (1988) 17:932–5. doi: 10.1016/S0196-0644(88)80675-9

PubMed Abstract | CrossRef Full Text | Google Scholar

53. Raju NV, Maisels MJ, Kring E, Schwarz-Warner L. Capillary refill time in the hands and feet of normal newborn infants. Clin Pediatr (Phila). (1999) 38:139–44. doi: 10.1177/000992289903800303

PubMed Abstract | CrossRef Full Text | Google Scholar

54. Brown LH, Prasad NH, Whitley TW. Adverse lighting condition effects on the assessment of capillary refill. Am J Emerg Med. (1994) 12:46–7. doi: 10.1016/0735-6757(94)90196-1

PubMed Abstract | CrossRef Full Text | Google Scholar

55. Alsma J, van Saase J, Nanayakkara PWB, Schouten W, Baten A, Bauer MP, et al. The power of flash mob research: conducting a nationwide observational clinical study on capillary refill time in a single day. Chest. (2017) 151:1106–13. doi: 10.1016/j.chest.2016.11.035

PubMed Abstract | CrossRef Full Text | Google Scholar

56. Brabrand M, Hosbond S, Folkestad L. Capillary refill time: a study of interobserver reliability among nurses and nurse assistants. Eur J Emerg Med. (2011) 18:46–9. doi: 10.1097/MEJ.0b013e32833b4fba

PubMed Abstract | CrossRef Full Text | Google Scholar

57. Fleming S, Gill P, Jones C, Taylor JA, Van den Bruel A, Heneghan C, et al. Validity and reliability of measurement of capillary refill time in children: a systematic review. Arch Dis Child. (2015). 100:239–49. doi: 10.1136/archdischild-2014-307079

PubMed Abstract | CrossRef Full Text | Google Scholar

58. Shinozaki K, Jacobson LS, Saeki K, Kobayashi N, Weisner S, Falotico JM, et al. Does training level affect the accuracy of visual assessment of capillary refill time? Crit Care. (2019) 23:157. doi: 10.1186/s13054-019-2444-3

PubMed Abstract | CrossRef Full Text | Google Scholar

59. Matsukawa T, Ozaki M, Nishiyama T, Imamura M, Kumazawa T. Comparison of infrared thermometer with thermocouple for monitoring skin temperature. Crit Care Med. (2000) 28:532–6. doi: 10.1097/00003246-200002000-00041

PubMed Abstract | CrossRef Full Text | Google Scholar

60. van Genderen ME, van Bommel J, Lima A. Monitoring peripheral perfusion in critically ill patients at the bedside. Curr Opin Crit Care. (2012) 18:273–9. doi: 10.1097/MCC.0b013e3283533924

PubMed Abstract | CrossRef Full Text | Google Scholar

61. Rabuel C, Mebazaa A. Septic shock: a heart story since the 1960s. Intensive Care Med. (2006) 32:799–807. doi: 10.1007/s00134-006-0142-5

PubMed Abstract | CrossRef Full Text | Google Scholar

62. Dubin A, Henriquez E, Hernandez G. Monitoring peripheral perfusion and microcirculation. Curr Opin Crit Care. (2018) 24:173–80. doi: 10.1097/MCC.0000000000000495

PubMed Abstract | CrossRef Full Text | Google Scholar

63. Schey BM, Williams DY, Bucknall T. Skin temperature and core-peripheral temperature gradient as markers of hemodynamic status in critically ill patients: a review. Heart Lung. (2010) 39:27–40. doi: 10.1016/j.hrtlng.2009.04.002

PubMed Abstract | CrossRef Full Text | Google Scholar

64. Matsukawa T, Ozaki M, Hanagata K, Iwashita H, Miyaji T, Kumazawa T. A comparison of four infrared tympanic thermometers with tympanic membrane temperatures measured by thermocouples. Can J Anaesth. (1996) 43:1224–8. doi: 10.1007/BF03013429

PubMed Abstract | CrossRef Full Text | Google Scholar

65. Pereira CB, Czaplik M, Blanik N, Rossaint R, Blazek V, Leonhardt S. Contact-free monitoring of circulation and perfusion dynamics based on the analysis of thermal imagery. Biomed Opt Expr. (2014) 5:1075–89. doi: 10.1364/BOE.5.001075

PubMed Abstract | CrossRef Full Text | Google Scholar

66. Rubinstein EH, Sessler DI. Skin-surface temperature gradients correlate with fingertip blood flow in humans. Anesthesiology. (1990) 73:541–5. doi: 10.1097/00000542-199009000-00027

PubMed Abstract | CrossRef Full Text | Google Scholar

67. Hariri G, Joffre J, Leblanc G, Bonsey M, Lavillegrand JR, Urbina T, et al. Narrative review: clinical assessment of peripheral tissue perfusion in septic shock. Ann Intensive Care. (2019) 9:7. doi: 10.1186/s13613-019-0511-1

PubMed Abstract | CrossRef Full Text | Google Scholar

68. Akata T, Kanna T, Yoshino J, Higashi M, Fukui K, Takahashi S. Reliability of fingertip skin-surface temperature and its related thermal measures as indices of peripheral perfusion in the clinical setting of the operating theatre. Anaesth Intensive Care. (2004) 32:519–29. doi: 10.1177/0310057X0403200409

PubMed Abstract | CrossRef Full Text | Google Scholar

69. Pezawas T, Rajek A, Plochl W. Core and skin surface temperature course after normothermic and hypothermic cardiopulmonary bypass and its impact on extubation time. Eur J Anaesthesiol. (2007) 24:20–5. doi: 10.1097/00003643-200701000-00004

PubMed Abstract | CrossRef Full Text | Google Scholar

70. Kholoussy AM, Sufian S, Pavlides C, Matsumoto T. Central peripheral temperature gradient. Its value and limitations in the management of critically iii surgical patients. Am J Surg. (1980) 140:609–12. doi: 10.1016/0002-9610(80)90041-0

PubMed Abstract | CrossRef Full Text | Google Scholar

71. Sessler DI. Perioperative thermoregulation and heat balance. Lancet. (2016) 387:2655–64. doi: 10.1016/S0140-6736(15)00981-2

PubMed Abstract | CrossRef Full Text | Google Scholar

72. Vincent JL, Moraine JJ, van der Linden P. Toe temperature versus transcutaneous oxygen tension monitoring during acute circulatory failure. Intensive Care Med. (1988) 14:64–8. doi: 10.1007/BF00254125

PubMed Abstract | CrossRef Full Text | Google Scholar

73. Lahiri BB, Bagavathiappan S, Jayakumar T, Philip J. Medical applications of infrared thermography: a review. Infrared Phys Technol. (2012) 55:221–35. doi: 10.1016/j.infrared.2012.03.007

PubMed Abstract | CrossRef Full Text | Google Scholar

74. Kumar M, Suliburk JW, Veeraraghavan A, Sabharwal A. PulseCam: a camera-based, motion-robust and highly sensitive blood perfusion imaging modality. Sci Rep. (2020) 10:4825. doi: 10.1038/s41598-020-61576-0

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: capillary refill time, shock, sepsis, medical device, peripheral perfusion, optics, monitoring, hemodynamic status

Citation: Falotico JM, Shinozaki K, Saeki K and Becker LB (2020) Advances in the Approaches Using Peripheral Perfusion for Monitoring Hemodynamic Status. Front. Med. 7:614326. doi: 10.3389/fmed.2020.614326

Received: 05 October 2020; Accepted: 16 November 2020;
Published: 07 December 2020.

Edited by:

Zhongheng Zhang, Sir Run Run Shaw Hospital, China

Reviewed by:

Tasuku Matsuyama, Kyoto Prefectural University of Medicine, Japan
Hao Wang, Shandong University, China

Copyright © 2020 Falotico, Shinozaki, Saeki and Becker. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Koichiro Shinozaki, shino@gk9.so-net.ne.jp; kshinozaki@northwell.edu

Download