Next Article in Journal
Dogs as Sentinels for Flavivirus Exposure in Urban, Peri-Urban and Rural Hanoi, Vietnam
Next Article in Special Issue
Detection and Typing of Human Enteroviruses from Clinical Samples by Entire-Capsid Next Generation Sequencing
Previous Article in Journal
A Roadmap for Genome-Based Phage Taxonomy
Previous Article in Special Issue
Method Development for Enteric Virus Recovery from Primary Sludge
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Environmental Surveillance for Polioviruses in Haïti (2017–2019): The Dynamic Process for the Establishment and Monitoring of Sampling Sites

1
Polio Eradication Branch, Centers for Disease Control and Prevention, Global Immunization Division, Atlanta, GA 30329, USA
2
Polio and Picornavirus Laboratory Branch, Centers for Disease Control and Prevention, Division of Viral Diseases, Atlanta, GA 30329, USA
3
United States Public Health Service, Rockville, MD 20852, USA
4
Laboratory and Research, Division of Epidemiology, Ministère de la Santé Publique et de la Population (Ministry of Public Health and Population (MSPP)), Port au Prince HT6110, Haiti
5
IHRC, Inc., Atlanta, GA 30346, USA
6
Cherokee Nation Assurance, Catoosa, OK 74015, USA
7
Pan American Health Organization, World Health Organization, Region of the Americas, Port au Prince HT6110, Haiti
8
Pan American Health Organization, World Health Organization, Washington, DC 20037, USA
*
Author to whom correspondence should be addressed.
Submission received: 18 February 2021 / Revised: 3 March 2021 / Accepted: 5 March 2021 / Published: 18 March 2021
(This article belongs to the Special Issue Surveillance for Polio and Non-polio Enteroviruses)

Abstract

:
Haïti is at risk for wild poliovirus (WPV) importation and circulation, as well as vaccine-derived poliovirus (VDPV) emergence. Environmental surveillance (ES) for polioviruses was established in Port au Prince and Gonaïves in 2016. During 2017–2019, initial ES sites were re-evaluated, and ES was expanded into Cap Haïtien and Saint Marc. Wastewater samples and data on weather, hour of collection, and sample temperature and pH were collected every 4 weeks during March 2017–December 2019 (272 sampling events) from 21 sites in Cap Haïtien, Gonaïves, Port au Prince, and Saint Marc. Samples were processed for the detection of polio and non-polio enteroviruses using the two-phase and “Concentration and Filter Elution” methodologies. Polioviruses were serotyped and underwent intra-typic characterization. No WPV or VDPVs were isolated. Sabin-like polioviruses (oral vaccine strain) of serotypes 1 and 3 were sporadically detected. Five of six (83%), one of six (17%), five of six (83%), and two of three (67%) sites evaluated in Cap Haïtien, Gonaïves, Port au Prince, and Saint Marc, respectively, had enterovirus isolation from >50% of sampling events; these results and considerations, such as watershed population size and overlap, influence of sea water, and excessive particulates in samples, were factors in site retention or termination. The evaluation of 21 ES sampling sites in four Haïtian cities led to the termination of 11 sites. Every-four-weekly sampling continues at the remaining 10 sites across the four cities as a core Global Polio Eradication Initiative activity.

1. Introduction

In 1988, the World Health Assembly passed a resolution to eradicate poliomyelitis (polio, caused by wild poliovirus (WPV) infection), a viral disease with an oral–fecal route of transmission [1,2,3,4]. Surveillance for cases of acute flaccid paralysis (AFP) in children and virologic testing is one of the four strategic pillars for eradication used by the Global Polio Eradication Initiative (GPEI); however, surveillance for AFP has low sensitivity for poliovirus infection, as paralysis occurs in <1% of poliovirus infections, which may limit the detection of poliovirus circulation in areas of low transmission [1,2,3]. Sensitivity of AFP surveillance may be diminished further if poorly implemented (i.e., the non-polio AFP rate is below the expected baseline of one per 100,000 population in people less than 15 years of age) [2,5]. Environmental surveillance (ES) for polioviruses, including the collection and analyses of wastewater/sewage for polioviruses, is increasingly being used to complement AFP surveillance [2,3,6,7,8,9,10,11,12,13,14,15,16,17]. The expansion of ES is a principal activity proposed in the GPEI’s Polio Endgame Strategy 2019–2023 [14]. ES has detected WPV and vaccine-derived poliovirus (VDPV) transmission in both the presence and absence of virus detection through AFP surveillance [2,6,7,8,9,10,11,12,13,18].
The ongoing efforts to characterize ES sampling sites, to optimize sensitivity for detecting poliovirus transmission, are critical, especially in the late stages of eradication [7,8,15,17]. In non-WPV-endemic countries, the consistent isolation of enteroviruses (e.g., Sabin-like (SL) vaccine strain polioviruses and non-polio enteroviruses (NPEVs)) in wastewater samples has been used as a working criterion that an ES system for polioviruses is sufficiently sensitive to detect WPVs and VDPVs [2,7,17].
In 2014, the Pan American Health Organization (PAHO) began to consider implementing ES in selected settings in the Americas to rapidly detect WPV circulation in the event of the importation and the emergence of VDPVs [17]. Haïti was considered a priority country for the establishment of ES, due to its (a) long history of sub-optimal polio vaccination coverage (estimated national coverage of the third dose of oral polio vaccine (OPV; Pol3) never exceeded 70% from 1980–2013), (b) poor hygienic and sanitary conditions, (c) high levels of population movement and high numbers of international visitors, and (d) history of a circulating VDPV type 1 (cVDPV1) outbreak in 2000–2001 [3,17,18,19,20,21]. In 2016, ES for polioviruses was established in two densely populated Haïtian cities: Port au Prince and Gonaïves [17,22,23]. The results of the first year of sampling (March 2016–February 2017) have been reported [17]. After that feasibility assessment, certain initial ES sites were re-evaluated, and ES was expanded into Cap Haïtien and Saint Marc, two additional densely populated cities [22,23]. Here we report the processes and methodologies used for the evaluation, expansion, and optimization of ES sampling sites during March 2017–December 2019.

2. Materials and Methods

2.1. Review of Estimated Annual National Pol3 Coverage

A review of Haïti’s estimated annual national-level Pol3 coverage was conducted with data available from 1980–2019 [20]. With the exception of 2019, when coverage was estimated at 74%, coverage for all years was ≤67%.

2.2. Environmental Surveillance Site Selection

A total of 21 sampling sites in four coastal cities—Cap Haïtien, Gonaïves, Port au Prince, and Saint Marc (Table 1, Figure 1A–F)—were selected and evaluated, considering GPEI environmental surveillance guidelines [2]. These four cities were chosen because they are among the most populated in the country with road accessibility throughout the rainy and dry seasons, are in regions involved in the 2000–2001 cVDPV1 outbreak, and have open canals that make sample collection feasible [17,18,19,22,23]. Maps for each city, where the catchment area and hydrology dynamics were derived from a 30m terrain model (digital elevation model), were used to localize the open canals and assist in the site selection process [24]. Geographic coordinates for each site were measured by a handheld GPS device (Montana 600; Garmin International, Olathe, KS, United States), and watershed populations were estimated from a WorldPop spatial demographic dataset (Department of Geography and Environment, University of Southampton, Southampton, United Kingdom) [24]. The watershed populations, corresponding to certain sampling sites, were smaller than recommended in the GPEI guidelines (>100,000 persons); however, these sites were evaluated for feasibility, due to limited options for safely accessible collection sites in the chosen cities [2].

2.3. Sample Collection and Frequency

The Haïtian Ministère de la Santé Publique et de la Population (Ministry of Public Health and Population (MSPP)) project coordinator and sample collectors were trained on sample collection and personal protection procedures through classroom and field training [17]. Staff from the Centers for Disease Control and Prevention in Atlanta (CDC-Atlanta, GA, USA) and PAHO conducted twice-yearly field supervision visits during the surveillance period.
Two wastewater samples (1 L each) were collected from the 21 different sampling sites during 272 sampling events in Cap Haïtien (six sites, 60 sampling events), Gonaïves (six sites, 61 sampling events), Port au Prince (six sites, 110 sampling events), and Saint Marc (three sites, 41 sampling events), approximately every 4 weeks during March 2017–December 2019, except for September and October 2019, when sampling was not possible in Gonaïves and Saint Marc due to civil insecurity (Table 1, Figure 1A–F). Collection was conducted using the grab method, with a swing sampler (NASCO, Fort Atkinson, WI, USA) using 1 L Nalgene® bottles. Time and date of collection, sample temperature, and weather conditions on collection day and the previous day were recorded.
All samples were maintained in a 2–8 °C cold chain from collection until arrival at the Laboratoire National de Santé Publique (LNSP) in Port au Prince, where they were stored at −20 °C until shipment on dry ice to CDC-Atlanta. Upon arrival, samples were maintained at −20 °C until processing for virologic analyses.

2.4. Environmental Sample Processing

All samples were processed by the Polio and Picornavirus Laboratory Branch at CDC-Atlanta. Before processing, both 1 L environmental water samples from each sampling site were thawed at room temperature for 24 h, combined into a sterile glass beaker with a stir bar to mix for 15 min, and split into duplicate aliquots when parallel virus concentration methods were used. Samples collected during March 2017–November 2017 and July–August 2019 were processed using only the two-phase separation method, and those from September 2019–December 2019 were processed using only the “concentration and filter elution” (CaFÉ) methodology (described below) [2,17]. Samples collected during December 2017–June 2019 and samples collected in August 2019 at the Route National Bridge (RNB), Impasse Petion (IMP), and Rivière Commerce Bridge (CMB) sites in Cap Haïtien were processed in parallel with the two-phase separation method (500 mL) and the CaFÉ (500 mL) method. The remaining volume from each sampling site was refrozen at −20 °C in case re-testing was necessary. Enterovirus isolation results from the two methods are combined in the Results section; however, results from each method are provided separately in Supplementary Figure S1.

2.5. Two-Phase Separation Method

A volume of 500 mL was concentrated using the two-phase separation method, as described previously [17]. Antibiotics were added to the concentrate at 100 IU/mL penicillin, 100 µg/mL streptomycin, and 50 µg/mL gentamycin. The resulting concentrates were inoculated into cell culture for enterovirus isolation on the same day, as described below.

2.6. Concentration and Filter Elution Filtration Method

A volume of 500 mL was processed using the CaFÉ procedure, which utilizes a 1 L, stainless steel coffee press (VonShef, London, UK) using an 8 µm filter (85 mm, grade 1, Cytiva Life Sciences, Hillerød, Iceland). Briefly, wastewater was added to the carafe and then pressed to separate the sediment from liquid. Virus was extracted from the sediment by adding beef extract (3% w/v; Criterion, Hardy Diagnostics, Santa Maria, CA, USA) and chloroform–dithizone (0.001% w/v; Sigma-Aldrich, St. Louis, MO, USA) to a 50 mL conical tube containing the sediment and the filter. Samples were agitated for 5 min using a Heidolph (Schwabach, Germany) shaker and subsequently centrifuged at 1500× g for 10 min. The supernatant was transferred to the liquid from the original sample. Magnesium chloride hexahydrate (2.5% w/v; EMD Millipore Corp, Burlington, MA, USA) was added to the sample, and the pH was adjusted to 3.5.
The pressed filtrate was passed through a series of two additional filters. The first stage used a 5 µm filter with a diameter of 47 mm, made of mixed cellulose ester, and the second stage used a 0.45 µm filter with a diameter of 47 mm made of mixed cellulose ester (both from Advantec, Toyo Roshi Kaisha, Ltd., Uchisaiwaicho, Chiyoda City, Japan). Both filters were subsequently cut into four pieces and placed in a 50 mL conical tube containing beef extract (3% w/v) and agitated for 20 min.
The resulting concentrate was treated with chloroform (20% v/v), agitated for 20 min, and the phases were separated by centrifugation (1500× g, 20 min). Antibiotics (100 IU/mL penicillin, 100 µg/mL streptomycin, and 50 µg/mL gentamycin) were added to the supernatant. The resulting concentrates were inoculated into cells for enterovirus isolation on the same day, as described below.

2.7. Virus Isolation

Polioviruses, including SL, and NPEVs were isolated according to the recommended World Health Organization poliovirus isolation protocol, using cell cultures of L20B cells (recombinant murine cells that express human poliovirus receptor) and human rhabdomyosarcoma (RD) cells, followed by detection and intratypic characterization of polioviruses by real-time (RT)-PCR. [2,25].

3. Results

3.1. Sample Collection and Water Quality Analyses

For all sites in Cap Haïtien and Saint Marc; the Bois de Neuf (BNF), Bois de Chêne (BDC), and Route Rails Diquini (RRD) sites in Port au Prince; and the Boulevard de l’Avenir (BRA) and Key Soleil Health Facility (KHF) sites in Gonaïves, the median collection hour was before 10:00 a.m. (Table S1). For the remaining sites in Gonaïves and Port au Prince, the median collection hour was between approximately 10:00 a.m.–2:00 p.m. By site, the percentage of sample collection events with rain on the prior day and on the day of collection ranged from 0–50% and 0–8%, respectively. By site, median sample temperatures ranged between approximately 26–33 °C, and median pH values ranged between 6.6–7.4.

3.2. Enterovirus Detection

No WPVs or VDPVs were isolated from any sample (Figure 2 and Figure S1).

3.2.1. Port Au Prince

No SL polioviruses were isolated from any sample collected during March 2017–February 2018 (Figure 2 and Figure S1). SL polioviruses of serotypes 1 and 3 were isolated from samples collected at the BNF, BDC, and RRD sites in various months between March 2018–November 2019; each site had four instances of SL poliovirus detection, with serotype 3 being the most frequently isolated (9 of 12 collections). NPEV and/or SL polioviruses were isolated from collections during 91–100% of sampling events at the BNF (32/34), BDC (32/34), Morne à Cabri (MAC) (1/1), RRD (30/33), and Cite au Cayes (CAC) (4/4) sites, and during 50% of sampling events at the Carrefour (CAR) site (2/4) (Figure 2, Table 2, and Figure S1).

3.2.2. Gonaïves

No SL polioviruses were isolated from any sample collected between March 2017–May 2018 (Figure 2 and Figure S1). SL poliovirus of serotype 3 was isolated from samples collected from the BRA site in June 2018 and March 2019. NPEV and SL polioviruses were isolated from collections during 50–84% of sampling events at the KHF (8/16), Avenue Leon Legros (ALL) (2/4), and BRA (26/31) sites and during 0% of sampling events at the Key Soleil Bridge (KSB) (0/5), Autorité Portuaire (ATP) (0/1), and Key Soleil School (KHS) (0/4) sites (Figure 2, Table 2, and Figure S1).

3.2.3. Saint Marc

SL poliovirus of serotype 3 was isolated from four samples collected from the Avenue Maurepas (AMA) site between November 2018–December 2019 (Figure 2 and Figure S1). NPEV and SL polioviruses were isolated from collections during 17/19 (90%), 8/16 (50%), and 4/6 (67%) sampling events at the AMA, Impasse Hucar (HUC), and Rue Petion (PET) sites, respectively (Figure 2, Table 2, and Figure S1).

3.2.4. Cap Haïtien

SL poliovirus of serotype 3 was isolated from a sample collected from the CRC site in January 2019, and an SL poliovirus of serotype 1 was isolated from a sample collected from the Ruelle Patience (RPA) site in August 2019 (Figure 2 and Figure S1). NPEV and SL polioviruses were isolated from collections during 67–100% of sampling events at the Ruelle Caporis (CRC) (17/21), RPA (14/21), Grand Rue Champin (GRC) (3/3), IMP (5/5), and CMB (4/5) sites, and during 20% (1/5) of sampling events at the RNB site (Figure 2, Table 2, and Figure S1).

4. Discussion

ES for polioviruses was established in Haïti for the timely detection of WPV circulation after importation and the emergence of VDPVs [17]. During the surveillance period reported here (March 2017–December 2019), no WPVs or VDPVs were detected in any environmental sample collected in four of the country’s most populated cities (Cap Haïtien, Gonaïves, Port au Prince, and Saint Marc) [22,23]. Moreover, neither had been detected in Port au Prince or Gonaïves during the previous surveillance period, March 2016–February 2017 [17].
Because OPV replicates in the intestines of recipients and is excreted in feces, SL polioviruses can be detected through ES [2,7,15,16,17,18]. Haïti’s routine immunization schedule for polio provides bivalent OPV (bOPV1,3, serotype 1- and 3-containing) at birth, 10 and 14 weeks, and nine months of age [26]. Between May 2016–February 2018, no SL polioviruses were isolated from any ES site [17]. Subsequently, between March 2018 and December 2019, there was sporadic isolation of SL polioviruses of serotypes 1 and 3 in each of the four cities, with the isolation of serotype 3 being more common; of the 20 total occurrences of SL poliovirus isolation, 16 (80%) were serotype 3 and 12 (60%) were from sites in Port au Prince. The more frequent isolation of SL polioviruses in Port au Prince over time, compared to the other cities, could be due to the greater estimated watershed populations associated with the ES sites, or to greater access to vaccination services, as it is the capital city. A temporal pattern of SL poliovirus isolation was not obvious; however, isolations could be related to instances of intensified vaccination activities, when large numbers of primary vaccinees and their close contacts are shedding SL polioviruses simultaneously. During the surveillance period, there was a nationwide bOPV1,3 supplemental immunization activity from 15 July–5 September 2019, targeting children 2–59 months of age [27]. Moreover, from March–April and October–November 2018 and May 2019, there were tetanus–diphtheria outbreak response campaigns in certain Haïtian regions that provided opportunities for all-antigen vaccination of under-vaccinated and un-vaccinated children [27]. During 2017–2019, there were 31 AFP cases notified in Haïti; only one case, in 2019, had SL poliovirus (of serotype 3) isolated from stool. Infrequent isolation of SL polioviruses from ES sites, with consistent NPEV isolation, and from AFP cases was also noted in Haïti during March 2016–February 2017 [17]. Similar infrequent SL isolations through ES have been observed in other OPV-using countries; the reasons are not well-characterized [6,28,29]. Haïti’s national-level Pol3 coverage delivered through routine services was estimated at 64-74% annually during 2016–2019 [20]; actual coverage among the ES site watershed populations might be significantly lower than these estimates. Alternatively, the fecal matter of children in the target age for routine immunization services may not be well-represented in the open canals from which samples are collected.
SL poliovirus of serotype 2 was last isolated in Haïti through ES in Port au Prince in March 2016 [17]; none was isolated from any ES sample during the current surveillance period. In April 2016, Haïti participated in the global switch, during which the use of trivalent OPV (tOPV, serotype 1-, 2-, and 3-containing) ceased and was replaced with bOPV1,3 [12,16]. The absence of SL poliovirus of serotype 2 in Haïti’s ES samples collected during this surveillance period provides support for a successful switch and an absence of the post-switch, type 2 circulating VDPV outbreaks that have been observed in other countries [11,12,13,16].
Most ES sample collection during the surveillance period was conducted before 10:00 a.m.; exceptions were collection events at certain sites in Port au Prince and Gonaïves where the median collection times were much later than the typical peak time frame for the flushing of human sewage [2,3]. Later-than-recommended collection times might have been irrelevant for the MAC site, a Port au Prince wastewater treatment facility, but could have negatively impacted the presence of enteroviruses at the other sites. Field-measured sample temperatures and laboratory-measured sample pH did not suggest conditions that would adversely affect enterovirus survival. Median laboratory-measured pH values for samples from all Haïti’s ES sites have been in the neutral range over time [17]. An attempt was made to measure physico-chemical properties (i.e., pH, total dissolved solids, conductivity, and salinity) of samples at the sampling sites using a hand-held device; however, values were erratic, making interpretation difficult (data not shown). Other investigators have succeeded with such field-measured parameters and found that pH ≥8.5 and concentrations of total dissolved solids ≥1.77 mg/L were independently associated with higher rates of enterovirus isolation [7].
The consistent isolation of enteroviruses over time, in conjunction with other considerations and estimated watershed populations, was used to determine the retention or termination of the 21 ES sites assessed in Haïti during March 2016–December 2019 (Table 2) [17]. The primary reason for terminating collection at eight sites in the four cities (CAR in Port au Prince; KHF, KSB, ATP, ALL, and KHS in Gonaïves; HUC in Saint Marc; and RNB in Cap Haïtien) was an enterovirus isolation rate of ≤54% during the combined periods assessed, between March 2016–December 2019 (Table 2) [17]. Sampling from the MAC site in Port au Prince was discontinued after March 2017 due to the difficulty of processing the samples because of their high levels of particulate matter and to inability to identify the geographic origins of the populations contributing to the waste [17]. The CAC site in Port au Prince, upstream from BNF, provided promising results; however, BNF is preferred, due to its downstream location capturing a greater watershed and its performance over time [17]. After three months of collection with satisfactory enterovirus isolation at GRC, it was nonetheless terminated due to a very low estimated watershed population size (5445 persons).
A total of ten sites in the four cities were retained (Table 2). The major population areas of Port au Prince are covered by ongoing collection at three sites—BNF, BDC, and RRD—that span the coast of the city from east to west, respectively (Figure 1B). The four sites retained in Cap Haïtien represent watersheds from populations in the western (CRC and IMP) and eastern (CMB and RPA) areas of the city (Figure 1F). The PET and AMA sites in Saint Marc span the coast from north to south (Figure 1D).

5. Conclusions

This report describes the dynamic process of establishing and monitoring ES sites for polioviruses. The analyses of data from many months of sample collection are often necessary to make evidence-based judgements of site performance and to inform decisions for terminating or retaining sites and exploring new ones [7,17]. The experience with ES in Haïti continues to inform the GPEI as it expands ES implementation [14]. Because of longstanding suboptimal poliovirus vaccination in Haïti, the country remains at high risk for the circulation of any imported WPV and the emergence and circulation of VDPVs [20]. Attention is needed towards strengthening the performance of Haïti’s AFP surveillance system; non-polio AFP rates (0.22, 0.25, and 0.39 for 2017, 2018, and 2019, respectively) did not attain the standard of one per 100,000 population less than 15 years of age during the surveillance period [5,27]. Continuation of the every-four-week ES sampling from multiple watersheds in four of Haïti’s large population centers, with ongoing site evaluation, is necessary for the foreseeable future, at least for several years after the cessation of OPV use [3].

Supplementary Materials

The following are available online at https://0-www-mdpi-com.brum.beds.ac.uk/1999-4915/13/3/505/s1, Table S1: Selected water quality measurements, time of day of collection, and general weather conditions at sites for samples collected through Haïti poliovirus environmental surveillance during March 2017–December 2019. Figure S1: Enteroviruses isolated through Haïti poliovirus environmental surveillance during March 2017–December 2019 by year, epidemiological week, sampling site, and processing method.

Author Contributions

M.M.A., A.D.C.-S., P.W., E.G., R.B., G.R.-B., C.C.B., and E.V. advised on collection protocol and site selection. P.W., R.B., E.G., and G.R.-B. managed the every-four-weekly wastewater collection. P.W. conducted the water quality analyses. H.B.-W., K.W., L.S., and E.V. conducted the virologic analyses. M.M.A., A.D.C.-S., H.B.-W., K.W., L.S., C.C.B., and E.V. analyzed all laboratory data. All authors were involved in interpreting the data and in drafting the manuscript; moreover, all authors approved the manuscript’s final version. All authors have read and agreed to the published version of the manuscript.

Funding

The work presented in this report was supported by federal appropriations to the Centers for Disease Control and Prevention in Atlanta (CDC-Atlanta) through the polio eradication line item.

Institutional Review Board Statement

Environmental surveillance for polioviruses is a surveillance activity conducted by the Haïtian Ministère de la Santé Publique et de la Population (Ministry of Public Health and Population (MSPP)) with support from CDC-Atlanta and the Pan American Health Organization (PAHO). The human subjects research coordinator of the Center for Global Health, CDC-Atlanta, reviewed the standard operating procedures and deemed the work to be exempt from institutional review board approval because it was not human-subject research (i.e., no specimens from human subjects were collected).

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Acknowledgments

The authors would like to express their appreciation to the staff of Novel-t for preparing the maps included in this report, and for their technical assistance with satellite images and watershed population estimates, and to CDC-Atlanta colleagues, M. Steven Oberste and Steven Wassilak, for their thoughtful review of several versions of the manuscript. Appreciation is given to Amelus Hebrelienne and Marie Jose Laraque, Ministère de la Santé Publique et de la Population Haïti (MSPP-Haïti), for assistance with shipping samples to CDC-Atlanta and to the staff of CDC-Haïti, U.S. Embassy-Port au Prince, and PAHO-Haïti for facilitating administrative processes, supervisory visits, and receipt of supply shipments. Finally, the utmost appreciation to the MSPP-Haïti for a productive and ongoing collaboration and to MSPP field staff who have diligently collected the wastewater samples described in this report. Last, a special commemoration for Fausnel Anna-Marie Pierre, one of the sample collectors in Cap Haïtien, who lost his life during the surveillance period.

Conflicts of Interest

The authors declare no conflict of interest. The findings and conclusions in this report are those of the authors and do not necessarily represent the official position of the Centers for Disease Control and Prevention, nor that of the Pan American Health Organization.

References

  1. Wassilak, S.; Orenstein, W. Challenges faced by the global polio eradication initiative. Expert Rev. Vaccines 2010, 9, 447–449. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  2. World Health Organization. Global Polio Eradication Initiative, Guidelines on Environmental Surveillance for Detection of Polioviruses. Available online: http://polioeradication.org/wp-content/uploads/2016/07/GPLN_GuidelinesES_April2015.pdf (accessed on 28 December 2020).
  3. Asghar, H.; Diop, O.M.; Weldegebriel, G.; Malik, F.; Shetty, S.; El Bassioni, L.; Akande, A.O.; Al Maamoun, E.; Zaidi, S.; Adeniji, A.J.; et al. Environmental Surveillance for Polioviruses in the Global Polio Eradication Initiative. J. Infect. Dis. 2014, 210, S294–S303. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Nathanson, N.; Kew, O.M. From Emergence to Eradication: The Epidemiology of Poliomyelitis Deconstructed. Am. J. Epidemiol. 2010, 172, 1213–1229. [Google Scholar] [CrossRef] [PubMed]
  5. Surveillance Indicators. Available online: https://polioeradication.org/polio-today/polio-now/surveillance-indicators/ (accessed on 28 December 2020).
  6. Muluh, T.J.; Hamisu, A.W.; Craig, K.; Mkanda, P.; Andrew, E.; Adeniji, J.; Akande, A.; Musa, A.; Ayodeji, I.; Nicksy, G.; et al. Contribution of Environmental Surveillance Toward Interruption of Poliovirus Transmission in Nigeria, 2012–2015. J. Infect. Dis. 2016, 213, S131–S135. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  7. Hamisu, A.W.; Blake, I.M.; Sume, G.; Braka, F.; Jimoh, A.; Dahiru, H.; Bonos, M.; Dankoli, R.; Bello, A.M.; Yusuf, K.M.; et al. Characterizing Environmental Surveillance Sites in Nigeria and Their Sensitivity to Detect Poliovirus and Other Enteroviruses. J. Infect. Dis. 2020, 20, 1–10. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  8. O’Reilly, K.M.; Verity, R.; Durry, E.; Asghar, H.; Sharif, S.; Zaidi, S.Z.; Wadood, M.Z.M.; Diop, O.M.; Okayasu, H.; Safdar, R.M.; et al. Population sensitivity of acute flaccid paralysis and environmental surveillance for serotype 1 poliovirus in Pakistan: An observational study. BMC Infect. Dis. 2018, 18, 176. [Google Scholar] [CrossRef] [PubMed]
  9. Cowger, T.L.; Burns, C.C.; Sharif, S.; Iber, J.; Henderson, E.; Malik, F.; Zaidi, S.S.Z.; Shaukat, S.; Rehman, L.; Pallansch, M.A.; et al. The role of supplementary environmental surveillance to complement acute flaccid paralysis surveillance for wild poliovirus in Pakistan—2011–2013. PLoS ONE 2017, 12, e0180608. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  10. Lickness, J.S.; Gardner, T.; Diop, O.M.; Chavan, S.; Jorba, J.; Ahmed, J.; Gumede, N.; Johnson, T.; Butt, O.; Asghar, H.; et al. Surveillance to Track Progress Toward Polio Eradication—Worldwide, 2018–2019. MMWR. Morb. Mortal. Wkly. Rep. 2020, 69, 623–629. [Google Scholar] [CrossRef] [PubMed]
  11. Mbaeyi, C.; Alleman, M.M.; Ehrhardt, D.; Wiesen, E.; Burns, C.C.; Liu, H.; Ewetola, R.; Seakamela, L.; Mdodo, R.; Ndoutabe, M.; et al. Update on Vaccine-Derived Poliovirus Outbreaks—Democratic Republic of the Congo and Horn of Africa, 2017–2018. MMWR. Morb. Mortal. Wkly. Rep. 2019, 68, 225–230. [Google Scholar] [CrossRef] [PubMed]
  12. Jorba, J.; Diop, O.M.; Iber, J.; Henderson, E.; Zhao, K.; Quddus, A.; Sutter, R.; Vertefeuille, J.F.; Wenger, J.; Wassilak, S.G.; et al. Update on Vaccine-Derived Poliovirus Outbreaks—Worldwide, January 2018–June 2019. MMWR. Morb. Mortal. Wkly. Rep. 2019, 68, 1024–1028. [Google Scholar] [CrossRef] [PubMed]
  13. Alleman, M.M.; Jorba, J.; Greene, S.A.; Diop, O.M.; Iber, J.; Tallis, G.; Goel, A.; Wiesen, E.; Wassilak, S.G.; Burns, C.C. Update on Vaccine-Derived Poliovirus Outbreaks—Worldwide, July 2019–February 2020. MMWR. Morb. Mortal. Wkly. Rep. 2020, 69, 489–495. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  14. World Health Organization. Polio Endgame Strategy, 2019–2023. Available online: Polioeradica-tion.org/wp-content/uploads/2019/06/english-polio-endgame-strategy.pdf (accessed on 26 December 2020).
  15. Kroiss, S.J.; Ahmadzai, M.; Ahmed, J.; Alam, M.M.; Chabot-Couture, G.; Famulare, M.; Mahamud, A.; McCarthy, K.A.; Mercer, L.D.; Muhammad, S.; et al. Assessing the sensitivity of the polio environmental surveillance system. PLoS ONE 2018, 13, e0208336. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  16. Blake, I.M.; Pons-Salort, M.; Molodecky, N.A.; Diop, O.M.; Chenoweth, P.; Bandyopadhyay, A.S.; Zaffran, M.; Sutter, R.W.; Grassly, N.C. Type 2 Poliovirus Detection after Global Withdrawal of Trivalent Oral Vaccine. N. Engl. J. Med. 2018, 379, 834–845. [Google Scholar] [CrossRef] [PubMed]
  17. Coulliette-Salmond, A.D.; Alleman, M.M.; Wilnique, P.; Rey-Benito, G.; Wright, H.B.; Hecker, J.W.; Miles, S.; Penaranda, S.; Lafontant, D.; Corvil, S.; et al. Haiti Poliovirus Environmental Surveillance. Am. J. Trop. Med. Hyg. 2019, 101, 1240–1248. [Google Scholar] [CrossRef] [PubMed]
  18. Vinjé, J.; Gregoricus, N.; Martin, J.; Gary, J.H.E.; Cáceres, V.M.; Venczel, L.; Macadam, A.; Dobbins, J.G.; Burns, C.; Wait, D.; et al. Isolation and Characterization of Circulating Type 1 Vaccine-Derived Poliovirus from Sewage and Stream Waters in Hispaniola. J. Infect. Dis. 2004, 189, 1168–1175. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  19. Kew, O.; Morris-Glasgow, V.; Landaverde, M.; Burns, C.; Shaw, J.; Garib, Z.; André, J.; Blackman, E.; Freeman, C.J.; Jorba, J.; et al. Outbreak of Poliomyelitis in Hispaniola Associated with Circulating Type 1 Vaccine-Derived Poliovirus. Science 2002, 296, 356–359. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  20. World Health Organization and UNICEF. Haïti: WHO and UNICEF Estimates of Immunization Coverage: 2019 Revision. Available online: https://www.who.int/immunization/monitoring_surveillance/data/hti.pdf (accessed on 28 December 2020).
  21. Pan American Health Organization. Regional Plan for Expansion of Environmental Surveillance of Poliovirus. In Proceedings of the Meeting of Ad hoc Small Working Group of Polio, Gloria Rey-Benito, PAHO, FGL/IM, Amman, Jordan, 29–30 January 2015. [Google Scholar]
  22. List of Cities in Haïti. Available online: https://en.wikipedia.org/wiki/List_of_cities_in_Haïti (accessed on 28 December 2020).
  23. Population of Cities in Haïti. 2020. Available online: https://worldpopulationreview.com/countries/cities/Haïti (accessed on 28 December 2020).
  24. Novel-t, PATH, Environmental Surveillance, Supporting Polio Eradication. Available online: https://www.es.world/#!/catalog (accessed on 28 December 2020).
  25. Gerloff, N.; Sun, H.; Mandelbaum, M.; Maher, C.; Nix, W.A.; Zaidi, S.; Shaukat, S.; Seakamela, L.; Nalavade, U.P.; Sharma, D.K.; et al. Diagnostic Assay Development for Poliovirus Eradication. J. Clin. Microbiol. 2017, 56, 1–10. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  26. World Health Organization. WHO Vaccine-Preventable Diseases: Monitoring System. 2020 Global Summary. Available online: https://apps.who.int/immunization_monitoring/globalsummary/schedules?sc%5Br%5D%5B%5D=AMRO&sc%5Bc%5D%5B%5D=HTI&sc%5Bd%5D=&sc%5Bv%5D%5B%5D=OPV&sc%5BOK%5D=OK (accessed on 28 December 2020).
  27. Rey-Benito, G.; (Pan American Health Organization). Personal communication, 2020.
  28. Njile, D.K.; Sadeuh-Mba, S.A.; Endegue-Zanga, M.-C.; Mengouo, M.N.; Djoumetio, M.D.; Pouth, F.B.B.; Diop, O.M.; Njouom, R. Detection and characterization of polioviruses originating from urban sewage in Yaounde and Douala, Cameroon 2016–2017. BMC Res. Notes 2019, 12, 248. [Google Scholar] [CrossRef] [PubMed]
  29. Intercountry Support Team for Central Africa; World Health Organization Regional Office for Africa Libreville, Gabon. Mise à Jour Hebdomadaire sur l’Initiative d’Eradication de la Polio en Afrique Centrale (Weekly Update for the Polio Eradication Initiative in Central Africa). 2020. Available online: https://www.afro.who.int/ (accessed on 18 February 2021).
Figure 1. Haïti poliovirus environmental surveillance sites during March 2017–December 2019, site locations. (A) Location of the cities of Cap Haïtien, Gonaïves, Port au Prince, and Saint Marc. Poliovirus environmental surveillance sampling sites in (B) Port au Prince (BDC = Bois de Chêne, BNF = Bois de Neuf, CAC = Cite au Cayes, CAR = Carrefour, and RRD = Route Rails Diquini; the MAC site is not shown [17]); (C) Gonaïves: (ALL = Avenue Leon Legros, ATP = Autorité Portuaire, BRA = Boulevard de l’Avenir, KHF = Key Soleil Health Facility, KHS = Key Soleil School, and KSB = Key Soleil Bridge); (D) Saint Marc (AMA = Avenue Maurepas, HUC = Impasse Hucar, and PET = Rue Petion); (E) Cap Haïtien (RNB = Route National Bridge); and (F) Cap Haïtien (CRC = Ruelle Caporis, GRC = Grand Rue Champin, IMP = Impasse Petion, CMB = Rivière Commerce Bridge, and RPA = Ruelle Patience). Watershed boundaries for each sampling site are indicated in green shading, except for ATP, where the boundaries could not be determined [17,24].
Figure 1. Haïti poliovirus environmental surveillance sites during March 2017–December 2019, site locations. (A) Location of the cities of Cap Haïtien, Gonaïves, Port au Prince, and Saint Marc. Poliovirus environmental surveillance sampling sites in (B) Port au Prince (BDC = Bois de Chêne, BNF = Bois de Neuf, CAC = Cite au Cayes, CAR = Carrefour, and RRD = Route Rails Diquini; the MAC site is not shown [17]); (C) Gonaïves: (ALL = Avenue Leon Legros, ATP = Autorité Portuaire, BRA = Boulevard de l’Avenir, KHF = Key Soleil Health Facility, KHS = Key Soleil School, and KSB = Key Soleil Bridge); (D) Saint Marc (AMA = Avenue Maurepas, HUC = Impasse Hucar, and PET = Rue Petion); (E) Cap Haïtien (RNB = Route National Bridge); and (F) Cap Haïtien (CRC = Ruelle Caporis, GRC = Grand Rue Champin, IMP = Impasse Petion, CMB = Rivière Commerce Bridge, and RPA = Ruelle Patience). Watershed boundaries for each sampling site are indicated in green shading, except for ATP, where the boundaries could not be determined [17,24].
Viruses 13 00505 g001
Figure 2. Enteroviruses isolated through Haïti poliovirus environmental surveillance during March 2017–December 2019 by year, epidemiological week, and sampling site. Orange shading for months in 2018 and May 2019 indicates periods of tetanus–diphtheria outbreak response campaigns in certain regions, which provided an opportunity for intensified all-antigen vaccination, and for July–September 2019 indicates the approximate time period of a nationwide supplementary immunization activity targeting children 2–59 months of age with bivalent oral polio vaccine (bOPV, containing Sabin strain serotypes 1 and 3). NPEV = non-polio enterovirus; SL1 = Sabin-like poliovirus of serotype 1; SL3 = Sabin-like poliovirus of serotype 3.
Figure 2. Enteroviruses isolated through Haïti poliovirus environmental surveillance during March 2017–December 2019 by year, epidemiological week, and sampling site. Orange shading for months in 2018 and May 2019 indicates periods of tetanus–diphtheria outbreak response campaigns in certain regions, which provided an opportunity for intensified all-antigen vaccination, and for July–September 2019 indicates the approximate time period of a nationwide supplementary immunization activity targeting children 2–59 months of age with bivalent oral polio vaccine (bOPV, containing Sabin strain serotypes 1 and 3). NPEV = non-polio enterovirus; SL1 = Sabin-like poliovirus of serotype 1; SL3 = Sabin-like poliovirus of serotype 3.
Viruses 13 00505 g002
Table 1. Haïti poliovirus environmental surveillance sites evaluated during March 2017–December 2019; site details, including estimated watershed populations. Port au Prince: BNF = Bois de Neuf, BDC = Bois de Chêne, MAC = Morne à Cabri, RRD = Route Rails Diquini, CAC = Cite au Cayes, CAR = Carrefour; Gonaïves: KHF = Key Soleil Health Facility, KSB = Key Soleil Bridge, ATP = Autorité Portuaire, ALL = Avenue Leon Legros, BRA = Boulevard de l’Avenir, KHS = Key Soleil School; Saint Marc: AMA = Avenue Maurepas, HUC = Impasse Hucar, and PET = Rue Petion; Cap Haïtien: CRC = Ruelle Caporis, RPA = Ruelle Patience, GRC = Grand Rue Champin, IMP = Impasse Petion, RNB = Route National Bridge, and CMB = Rivière Commerce Bridge.
Table 1. Haïti poliovirus environmental surveillance sites evaluated during March 2017–December 2019; site details, including estimated watershed populations. Port au Prince: BNF = Bois de Neuf, BDC = Bois de Chêne, MAC = Morne à Cabri, RRD = Route Rails Diquini, CAC = Cite au Cayes, CAR = Carrefour; Gonaïves: KHF = Key Soleil Health Facility, KSB = Key Soleil Bridge, ATP = Autorité Portuaire, ALL = Avenue Leon Legros, BRA = Boulevard de l’Avenir, KHS = Key Soleil School; Saint Marc: AMA = Avenue Maurepas, HUC = Impasse Hucar, and PET = Rue Petion; Cap Haïtien: CRC = Ruelle Caporis, RPA = Ruelle Patience, GRC = Grand Rue Champin, IMP = Impasse Petion, RNB = Route National Bridge, and CMB = Rivière Commerce Bridge.
CitySite CodeTotal Sampling EventsGeographic CoordinatesEstimated Watershed PopulationAdditional Site Details
Port au PrinceBNF3418.5815, −72.3291347,237 *Downstream from CAC [17]
BDC3418.5383, −72.3539339,624 *[17]
MAC118.6611, −72.1870Unknown †[17]
RRD3318.5345, −72.384367,320Open canal near intersection Rue du Dr Dehoux and Harry Truman Blvd
CAC418.5658, −72.3105139,987Upstream from BNF, open canal Saint George
CAR418.5500, −72.41669361Open canal Rivière Froide on Route de Rails
GonaïvesKHF1619.4534, −72.690020,749 *[17]
KSB519.4575, −72.696082,123 *[17]
ATP119.4483, −72.6963Unknown †[17]
ALL419.4422, −72.684510,034Upstream from BRA, open canal near intersection of Ave Leon Legros and Ruelle Patience
BRA3119.4383, −72.689620,241Downstream from ALL, open canal near intersection Blvd de l’Avenir and Bas Mavignole
KHS419.4532, −72.684917,878Upstream from KHF, open canal near intersection Avenue Roland 1 and Rue Polkos
Saint MarcAMA1919.1059, −72.702250,744Open canal at intersection Rivière Saint Marc and Avenue Maurepas ‡
HUC1619.1224, −72.69785655Open canal near intersection Impasse Hucar and Rue les Boutin
PET619.1102, −72.698449,372Open canal at intersection Rivière Saint Marc and Rue Petion ‡
Cap HaïtienCRC2119.7336, −72.21788810Open canal along Ruelle Caporis, drains into Rivière du Haut du Cap
RPA2119.7383, −72.184422,468Open canal along Ruelle Patience
GRC319.7367, −72.21555455Open canal along Grand Rue (Ruelle) Champin, drains into Rivière du Haut du Cap
IMP519.7405, −72.20889626Open canal along footpath south of Impasse Petion, drains into Rivière du Haut du Cap
RNB519.7504, −72.2046225,762Site is Rivière du Haut du Cap under the Route National 3 bridge
CMB519.7336, −72.177221,580Open canal adjacent to the Voix Evangélique d’Haïti (4VEH) radio transmission station
* Updated from previously published figures [17]; † unknown [17]; ‡ based on satellite imagery, there is no overlap between these two tributaries of the Rivière Saint Marc that flow through the city of Saint Marc [24].
Table 2. Summary of enterovirus isolation for samples collected through Haïti poliovirus environmental surveillance during March 2016–December 2019 and considerations for retaining or terminating sampling sites. Port au Prince: BNF = Bois de Neuf, BDC = Bois de Chêne, MAC = Morne à Cabri, RRD = Route Rails Diquini, CAC = Cite au Cayes, CAR = Carrefour. Gonaïves: KHF = Key Soleil Health Facility, KSB = Key Soleil Bridge, ATP = Autorité Portuaire, ALL = Avenue Leon Legros, BRA = Boulevard de l’Avenir, KHS = Key Soleil School. Saint Marc: AMA = Avenue Maurepas, HUC = Impasse Hucar, and PET = Rue Petion. Cap Haïtien: CRC = Ruelle Caporis, RPA = Ruelle Patience, GRC = Grand Rue Champin, IMP = Impasse Petion, RNB = Route National Bridge, and CMB = Rivière Commerce Bridge. SL = Sabin-like poliovirus.
Table 2. Summary of enterovirus isolation for samples collected through Haïti poliovirus environmental surveillance during March 2016–December 2019 and considerations for retaining or terminating sampling sites. Port au Prince: BNF = Bois de Neuf, BDC = Bois de Chêne, MAC = Morne à Cabri, RRD = Route Rails Diquini, CAC = Cite au Cayes, CAR = Carrefour. Gonaïves: KHF = Key Soleil Health Facility, KSB = Key Soleil Bridge, ATP = Autorité Portuaire, ALL = Avenue Leon Legros, BRA = Boulevard de l’Avenir, KHS = Key Soleil School. Saint Marc: AMA = Avenue Maurepas, HUC = Impasse Hucar, and PET = Rue Petion. Cap Haïtien: CRC = Ruelle Caporis, RPA = Ruelle Patience, GRC = Grand Rue Champin, IMP = Impasse Petion, RNB = Route National Bridge, and CMB = Rivière Commerce Bridge. SL = Sabin-like poliovirus.
CitySite CodeTotal Sampling Events (% enterovirus Isolation)
Mar 2017–Dec 2019
Total Sampling Events (% enterovirus Isolation)
Mar 2016–
Feb 2017 [17]
Estimated Watershed PopulationAdditional ConsiderationsStatus
Port au PrinceBNF34 (94)12 (100)347,237 †Periodic SL poliovirus isolation; represents a watershed of northern Port au PrinceRetained
BDC34 (94)12 (92)339,624 †Periodic SL poliovirus isolation; represents a watershed between BNF and RRDRetained
MAC1 (100)12 (75)Unknown ‡High levels of particulate matter in samples; population represented was unknownTerminated
RRD33 (91)N/A67,321Periodic SL poliovirus isolation; represents a watershed of southern Port au PrinceRetained
CAC4 (100)N/A139,987Upstream from BNF; smaller watershed population than BNFTerminated
CAR4 (50)N/A9361Very small estimated watershed populationTerminated
GonaïvesKHF16 (50)12 (58)20,749 †§Terminated
KSB5 (0)12 (25)82,123 †§Terminated
ATP1 (0)12 (0)Unknown ‡§Terminated
ALL4 (50)N/A10,034Upstream from BRA; smaller watershed population than BRATerminated
BRA31 (84)N/A20,241Periodic SL poliovirus isolation; downstream from ALL; larger watershed population than ALLRetained
KHS4 (0)N/A17,878§Terminated
Saint MarcAMA19 (90)N/A50,744Periodic SL poliovirus isolation; represents a watershed of southern Saint MarcRetained
HUC16 (50)N/A5655Canal was periodically dryTerminated
PET6 (67)N/A49,372Wide canal with large volume of water; represents a watershed between AMA and HUCRetained
Cap HaïtienCRC21 (81)N/A8810Periodic SL poliovirus isolation, represents a watershed of western Cap HaïtienRetained
RPA21 (67)N/A22,468Periodic SL poliovirus isolation, represents a watershed of eastern Cap HaïtienRetained
GRC3 (100)N/A5455Very small estimated watershed populationTerminated
IMP5 (100)N/A9626Represents a watershed of western Cap HaïtienRetained
RNB5 (20)N/A225,762Possible influence of high salinity due to proximity to seaTerminated
CMB5 (80)N/A21,580Represents a watershed of eastern Cap HaïtienRetained
N/A = not applicable, site did not exist during surveillance period; † updated from previously published figures [17]; ‡ unknown [17]; § no additional considerations beyond enterovirus isolation.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Alleman, M.M.; Coulliette-Salmond, A.D.; Wilnique, P.; Belgasmi-Wright, H.; Sayyad, L.; Wong, K.; Gue, E.; Barrais, R.; Rey-Benito, G.; Burns, C.C.; et al. Environmental Surveillance for Polioviruses in Haïti (2017–2019): The Dynamic Process for the Establishment and Monitoring of Sampling Sites. Viruses 2021, 13, 505. https://0-doi-org.brum.beds.ac.uk/10.3390/v13030505

AMA Style

Alleman MM, Coulliette-Salmond AD, Wilnique P, Belgasmi-Wright H, Sayyad L, Wong K, Gue E, Barrais R, Rey-Benito G, Burns CC, et al. Environmental Surveillance for Polioviruses in Haïti (2017–2019): The Dynamic Process for the Establishment and Monitoring of Sampling Sites. Viruses. 2021; 13(3):505. https://0-doi-org.brum.beds.ac.uk/10.3390/v13030505

Chicago/Turabian Style

Alleman, Mary M., Angela D. Coulliette-Salmond, Pierre Wilnique, Hanen Belgasmi-Wright, Leanna Sayyad, Kimberly Wong, Edmund Gue, Robert Barrais, Gloria Rey-Benito, Cara C. Burns, and et al. 2021. "Environmental Surveillance for Polioviruses in Haïti (2017–2019): The Dynamic Process for the Establishment and Monitoring of Sampling Sites" Viruses 13, no. 3: 505. https://0-doi-org.brum.beds.ac.uk/10.3390/v13030505

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop