Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Impact of the COVID-19 pandemic on skin cancer diagnosis: A population-based study

  • Yuka Asai,

    Roles Investigation, Methodology, Project administration, Writing – original draft, Writing – review & editing

    Affiliation Division of Dermatology, Department of Medicine, Queen’s University, Kingston, ON, Canada

  • Paul Nguyen,

    Roles Data curation, Formal analysis, Methodology, Software, Validation, Writing – review & editing

    Affiliation ICES at Queen’s University, Kingston, ON, Canada

  • Timothy P. Hanna

    Roles Conceptualization, Data curation, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Validation, Visualization, Writing – review & editing

    tim.hanna@kingstonhsc.ca

    Affiliations Division of Cancer Care and Epidemiology, Cancer Research Institute at Queen’s University, Kingston, ON, Canada, Department of Oncology, Queen’s University, Kingston, ON, Canada, Department of Public Health Sciences, Queen’s University, Kingston, ON, Canada

Abstract

Background

The COVID-19 pandemic has been unprecedented and has led to drastic reductions in non-urgent medical visits. Deferral of these visits may have critical health impact, including delayed diagnosis for melanoma and other skin cancers. We examined the influence of the pandemic on skin biopsy rates in a large population-based cohort.

Methods

Using a universal health care claims dataset from Ontario, we examined skin biopsies from January 6, 2020 to September 27, 2020, and compared these to the same period for 2019. Those diagnosed with anogenital cancers, younger than 20 years, residing out-of-province and with lapses in coverage were excluded. The sensitivity and specificity of claims diagnoses compared to a validated algorithm to identify keratinocyte carcinoma (KC), or to the cancer registry for melanoma was evaluated. Factors associated with biopsy during the early pandemic were investigated with modified Poisson regression.

Results

A precipitous drop in total skin biopsies (15% of expected), biopsies for KC (18%) and melanoma (27%) was seen with the onset of COVID-19 cases (p<0.01). Claims diagnoses were of high specificity for KC (99%), and for melanoma (98%), though sensitivity was less (61%, 28% respectively). In adjusted analysis, the elderly (80+ years), females and residents of certain regions were less likely to be biopsied during the pandemic. Subsequently, there were substantial improvements in biopsy rates over 10 weeks. However, compared to 2019, a large backlog of expected cases still remained 28 weeks after lockdown (45,710 all biopsy, 9,104 KC, 595 melanoma).

Interpretation

A drastic reduction in skin biopsies is noted early in the COVID-19 pandemic; this disproportionately affected the elderly, females and certain geographic regions. Though biopsies subsequently increased, a large backlog of cases remained after almost half a year. This will have implications for downstream care of skin cancer. Efforts should be made to limit diagnostic delay.

Introduction

Skin cancer incidence has been increasing in North America over the last decade, mirrored by the number of biopsies for skin cancer [1]. The COVID-19 pandemic has been unprecedented and has led to drastic reductions in non-urgent medical visits. Deferral of these visits may have critical health impact. The impact of the pandemic on skin cancer care has not been well described. There are no reports from Canada, and only two known reports from other countries describing the possible impact. A national report from the Netherlands suggested a drop in skin cancer diagnoses more than for other cancers, though results were not reported according to subtype (e.g. melanoma or squamous cell carcinoma) and data was incomplete [2]. One institutional series from Italy suggested diagnostic delay for melanoma, though generalizability is limited given the narrow population coverage [3]. We hypothesized that the impact on skin cancer care in a Canadian population-level sample would be substantial, with potential differences between skin cancer types and some patient groups. Therefore, we examined the influence of the COVID-19 pandemic on the diagnosis of skin cancer via biopsy in a large population-based cohort in a Canadian context, stratifying according melanoma and non-melanoma cancer types.

Methods

Study design

This was a retrospective population-based cohort study.

Study population

Using a universal health care claims dataset from Canada’s most populous province, Ontario (N = 14.7 million), we undertook a population-based study examining skin biopsies from January 6, 2020 to September 27, 2020, and compared these to the same period for 2019. Our primary analysis focused on the early lockdown, and covered January 6, 2020 to April 19, 2020. Those diagnosed with anogenital cancers, younger than 20 years, residing out-of-province, and those who had lapses with provincial medical coverage were excluded (Fig 1, S1 Appendix). This study followed the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) reporting guideline for cohort studies.

thumbnail
Fig 1. Flow diagram for selection of study cohort of skin biopsy claims from January 6, 2020 to April 19, 2020.

https://doi.org/10.1371/journal.pone.0248492.g001

Data sources

Claims data from the Ontario Health Insurance Plan (OHIP) were utilized for outcome measurement. OHIP records are updated monthly with claims validated and processed by the Ontario Ministry of Health and Long-Term Care (MOHLTC). As described below, data from the Ontario Cancer Registry (OCR) were used to evaluate the specificity of melanoma claims to melanoma diagnoses. The OCR is known for its high level of population coverage [4], with annual capture rates generally 94% or more for melanoma in a major validation study [5]. Age and sex were determined from the Registered Persons Database maintained by MOHLTC. Area-level income quintiles were determined based on quintile rankings of neighbourhood average income within each census metropolitan area or census agglomeration. Comorbidity was based on the Elixhauser comorbidity index using CIHI Discharge Abstract Database (DAD) and Same Day Surgery (SDS) data available up to March 31, 2020, with zero indicating no identified comorbidity and one point for each additional comorbidity in the index [6]. A five-year lookback window for admissions was utilized. Diagnostic codes for cancer metastasis or solid tumor without metastasis were not included in the comorbidity measure. Rurality was based on the 2008 Rurality Index for Ontario scale, ranging from 0 to 100, with 100 indicating the highest degree of rurality [7]. The biopsying physician main specialty was based on the ICES Physician Database.

Outcomes

Claims for first skin biopsy extracted on July 21, 2020 in each study interval (January 7 to April 21, 2019 and January 6 to April 19, 2020) for each of the following were considered: 1) any diagnosis (2019: N = 57,744; 2020: N = 42,848), 2) keratinocyte carcinoma (KC) [basal cell carcinoma (BCC) or squamous cell carcinoma (SCC); ICD-9: 173)] (2019: N = 13,734; 2020: N = 10,776) and 3) melanoma (ICD-9: 172) (2019: N = 910; 2020: N = 736). Claims diagnoses were investigated as they were available in a more timely fashion compared to OCR, and provided more complete information on non-melanoma skin cancers. Trends in biopsies beyond the early lockdown period (weeks 11 to 15 of 2020) were quantified up to week 38 of 2020 based on administrative data extracted on February 11, 2021.

Statistical analysis

Statistical analyses were conducted using the SAS software version 9.4 (SAS Institute Inc., Cary, NC). Two-sided statistical significance was a p-value<0.05. Descriptive statistics of the patient socio-demographics and general health characteristics were first generated for the study cohort of skin biopsy claims for the first 15 weeks (starting on Monday) of 2020, and for comparison, the first 15 weeks of 2019. Results were stratified by the pre-COVID-19 (Weeks 1–10) and COVID-19 (Weeks 11–15) periods defined by the Declaration of Emergency in Ontario enacted on March 17, 2020.

For comparing proportional change in biopsy rates between KC and melanoma outcomes in the COVID-19 era, Pearson’s chi-squared test was used to evaluate the difference between 2019 and 2020. To evaluate sensitivity and specificity of a KC claims diagnosis to a confirmed cancer diagnosis, we compared OHIP biopsy claims for July 2018-June 2019 to an algorithm validated in Ontario using pathology reports [8]. This algorithm was not directly used as an outcome for our study, as we lacked the required 6-month follow-up period. For melanoma, we compared claims diagnoses to the provincial cancer registry [5]. The period of selection for this analysis was based on the availability of complete registry data. Modified Poisson regression was then used to evaluate the patient characteristics between the COVID-19 and pre-COVID-19 eras for the first 15 weeks of 2020. The potential predictors that were modeled in the unadjusted analyses were included in the full adjusted model.

Ethics approval

This study was approved and overseen by the Queen’s University Health Sciences Research Ethics Board (Study ONGY-579-20), with a waiver of informed consent based on the Personal Health Information Protection Act, Section 44(1), which allows waivers of informed consent for research meeting criteria including whether the research can be accomplished without the requested personal health information, research that is in the public interest, safeguards for privacy, and impracticality of obtaining informed consent. Analyses were conducted using anonymized encoded data sources. Administrative records for the study population covered January 6, 2020 to September 27, 2020, and the same period for 2019, with a 5-year look back to measure the comorbidity index, while records for sensitivity and specificity evaluation covered July 1, 2018 to June 30, 2019.

Results

There were 42,848 with a first skin biopsy in weeks 1 to 15 of 2020 (Fig 1). In this cohort, the median age was 63 years (interquartile range (IQR): 50–74 years), and 51% were female. This was the same for the 57,744 people with a first skin biopsy in weeks 1 to 15 of 2019 (S1 Appendix). Many patient factors (e.g., age, income quintiles, rurality, Elixhauser comorbidity index) were similar between the pre-COVID-19 and COVID-19 periods in 2020 (Table 1).

thumbnail
Table 1. Patient characteristics for all biopsy claims for the first 15 weeks (starting on Monday) of 2019 and 2020.

https://doi.org/10.1371/journal.pone.0248492.t001

A precipitous drop in the number of skin biopsies was observed starting in mid-March 2020, coinciding with the report of COVID-19 in Ontario and announcement of emergency measures. Compared to 2019, only 15% of the expected numbers of all skin biopsies, and those undertaken in conjunction with a diagnostic code for KC (18%) and melanoma (27%) were observed (Fig 2). The drop in KC-associated biopsies was greater than for melanoma (p<0.01).

thumbnail
Fig 2.

A. Time trends of all skin biopsy claims for the first 38 weeks (starting on Monday) of 2019 and 2020 in Ontario in relation to COVID-19 cases in Ontario, Canada. B. Time trends of skin biopsy claims associated with a diagnosis of keratinocyte carcinoma for the first 38 weeks (starting on Monday) of 2019 and 2020 in relation to COVID-19 cases in Ontario, Canada. C. Time trends of skin biopsy claims associated with a diagnosis of melanoma for the first 38 weeks (starting on Monday) of 2019 and 2020 in Ontario in relation to COVID-19 cases in Ontario, Canada.

https://doi.org/10.1371/journal.pone.0248492.g002

We found our results of high specificity compared to a validated algorithm [8] to identify KC (87% accuracy, 61% sensitivity, 99% specificity). Similarly, ICD-9 claim codes are highly specific for melanoma, compared to the OCR (98% accuracy, 28% sensitivity, 98% specificity). Importantly, although claims-based diagnoses lacked pathological confirmation, regardless of claim diagnosis, biopsies dropped dramatically.

We investigated whether any group of patients were disproportionately affected during the early lockdown (weeks 11 to 15 of 2020). In the adjusted analysis, elderly patients (80+ years vs. 20–59 years, relative risk (RR) with 95% confidence interval (CI): 0.81 (0.73–0.90), p<0.01) and patients residing in Southwestern Ontario (01, 02) and the Greater Toronto Area (05, 07, 08, 09) compared to the South East LHIN (10) were less likely to have a skin biopsy in the COVID-19 era (Table 2). Furthermore, male patients (RR: 1.16 (1.09–1.23), p<0.01) and patients biopsied by plastic surgeons (plastic surgeon vs. other specialists, RR: 1.37 (1.13–1.66), p<0.01) were more likely to have a skin biopsy in the COVID-19 era.

thumbnail
Table 2. Relative risks for comparing all skin biopsy claims between COVID-19 (Weeks 11–15) and pre-COVID-19 (Weeks 1–10) periods for the first 15 weeks (starting on Monday) of 2020.

https://doi.org/10.1371/journal.pone.0248492.t002

Keratinocyte cancer-associated biopsies showed similar results between the COVID-19 and pre-COVID-19 periods: Elderly patients (70–79 years vs. 20–59 years, RR: 0.83 (0.70–0.99), p = 0.03; 80+ years vs. 20–59 years, RR: 0.69 (0.57–0.83), p<0.01) and patients residing in Southwestern Ontario (02) and the Greater Toronto Area (05, 08, 09) compared to the South East LHIN (10) were less likely to have a KC claims diagnosis in the COVID-19 era, while male patients (RR: 1.25 (1.11–1.41), p<0.01) were more likely to have KC-associated biopsies in the COVID-19 era compared with pre-COVID-19 era (S2 and S3 Appendices).

For melanoma-associated biopsies, there were similar trends for age (80+ years vs. 20–59 years, RR: 0.70 (0.36–1.36), p = 0.29) and male sex (RR: 1.15 (0.77–1.72), p = 0.49), though findings were not significant (S4 and S5 Appendices). Patients residing in higher income neighborhoods (5 vs. 1, RR: 2.59 (1.20–5.60), p = 0.02) and with higher comorbidities (3+ vs. 0, RR: 2.01 (1.09–3.71), p = 0.03) were more likely to have a biopsy in the COVID-19 era while patients residing in suburban areas were less likely (suburban vs. rural, RR: 0.54 (0.30–0.98), p = 0.04). Biopsies for melanoma in the COVID-19 era were proportionately less likely to be performed by dermatologists (dermatologist vs. otolaryngologist or other specialists, RR: 0.52 (0.30–0.92), p = 0.02) or GPs/FPs (GP/FP vs. otolaryngologist or other specialists, RR: 0.36 (0.17–0.73), p = 0.01) compared with the pre-COVID-19 period.

Following the precipitous drops in skin biopsies seen in the early lockdown (weeks 11–15), a slow increase in numbers of skin biopsies was observed over the following 10 weeks. However, following lockdown, skin biopsy rates in most weeks of 2020 did not meet those of the same week in 2019 (Fig 2A–2C). As skin cancer incidence is expected to increase from year to year, this deficit is noticeable, with 45,710 fewer cases for all skin biopsies, 9,104 for KC and 595 for melanoma between weeks 11–38 of 2020, compared to 2019 weeks 11–38.

Interpretation

Using a claims-based method in a Canadian population, large drops in observed rates were seen with the onset of COVID-19 cases in Ontario for the total number of skin biopsies (15% of expected), and skin biopsies specifically performed in conjunction with a diagnostic code for keratinocyte carcinoma (18% of expected) and melanoma (27% of expected) (p<0.01). A differential change between KC biopsies and melanoma biopsies suggests a triage effect, though changes in skin biopsy in all categories was large, and precipitous. As overall demographic characteristics of the 2020 and 2019 data for the same period were similar, it is evident some patient groups were disproportionately affected during the lockdown, with biopsies less likely among females, the elderly (80+ years), and residents of certain regions in the weeks after the shutdown than in the prior 10 weeks. Moreover, despite increases in biopsies following the early lockdown, a large backlog in expected skin biopsies persisted to the end of the study period, which was almost half a year beyond the early lockdown (45,710 all biopsy, 9,104 KC, 595 melanoma).

Our findings provide direct evidence of the impact of COVID-19 in skin cancer care in a Canadian setting, and augment the very limited data on impact of the pandemic in this setting. A report from the Netherlands suggests our findings may be part of a broader trend, with observed drops reported in diagnosis of non-basal cell carcinoma skin cancers, in a limited data set [2]. A triage effect is suggested by our more detailed population data; there was a significant difference in proportional drop in biopsy, which was greater for biopsies associated with KC diagnoses compared with melanoma. A single-institution report from Italy suggests that diagnostic delay in melanoma during the pandemic may be translating into greater thickness of melanoma at diagnosis, though this requires broader confirmation across jurisdictions [3].

Biopsy trends observed in our population-based sample may be explained by a number of factors, such as: 1) decreased early detection due to public health regulations limiting non-urgent health care provision and social distancing, 2) decreased access to primary health care and specialist care, 3) lack of transportation services, 4) childcare or eldercare responsibilities, 5) limitations of telehealth, and 6) patients refusing to seek care or refusing care due to perceived infection risk.

The variable impact of the early lockdown on skin biopsies may be explained by some of these factors. We observed females and the elderly (80+ years) were less likely to be biopsied during the pandemic, as were residents of certain regions in the province. We also observed a higher proportion of biopsies were performed by plastic surgeons during the initial months of the COVID-19 epidemic in Ontario than by general practitioners, dermatologists or other specialists. Limitations in non-urgent health care provision probably contributed to the proportionally greater decline in biopsies by general practitioners and dermatologists. As plastic surgeons may manage more advanced lesions, their biopsy rates may have stayed proportionately higher compared to other types of health practitioners. Reasons for fewer biopsies among female patients are unclear, but may be multifactorial. This may relate in part to differences in caregiver burden between male and female groups in the cohort. Behavioral differences in care seeking between males and females have also been described in other settings [9]. In a population-based study of melanoma in Ontario, we observed that males were more likely to present with advanced stage disease [10]. If males in our cohort had a higher burden of advanced skin cancer, proportionately more cases would have had concerning findings or symptoms, possibly leading to faster diagnostic biopsy.

We observed that for melanoma, the presence of multiple comorbidities and residence in higher income quintile neighbourhoods were associated with a much greater likelihood for biopsy during the early lockdown. The association with comorbidity may relate to diagnoses captured during admissions for management of advanced melanoma (e.g. for biopsy of lymph node metastasis or symptomatic metastatic disease). Some biopsies for melanoma among the high-comorbidity group may have been for incidental findings during admissions for comorbid conditions, though the same pattern was not seen for keratinocyte carcinoma. The association with income quintile may relate to greater availability of services for skin biopsy in higher income quintile regions [11] or greater self-advocacy or melanoma awareness for those living in these regions. Notably, we previously observed a lower risk of advanced melanoma in less deprived regions in Ontario [10].

The decreased likelihood for biopsy in certain LHINs may be related to the incidence rate of COVID-19 in those regions. Both the Greater Toronto Area and the Southwestern region had higher overall rates of cases of COVID-19 compared to the Southeast LHIN, and decreased likelihood of biopsy.

In the absence of a diagnostic biopsy, it is difficult to ascertain the risk posed by a suspicious skin lesion; a lesion thought to be BCC could be melanoma. The impact of pandemic-related delay on skin cancer outcomes is yet unknown but is a cause for concern given the strong relationship between early detection and skin cancer outcomes. Evidence suggests a possible association of delay in melanoma diagnosis with stage progression and survival [12], and between delay in SCC excision and tumour size, which is known to correlate with metastasis [13]. Moreover, the observed impact on skin cancer diagnosis is expected to be compounded by waiting times required for backlog management in the post-lockdown period, given that our results suggest a large number of cases with deferred biopsies, which will be added to the normal influx of new cases arising on a daily basis. Of great concern, we found that almost half a year after lockdown measures started, there were still large deficits in expected numbers of skin biopsies, with 45,710 fewer cases for all skin biopsies, 9,104 for KC and 595 for melanoma between weeks 11–38 of 2020, compared to 2019 weeks 11–38. This comparison does not take into account the normal expected annual increases in cancer incidence.

Disparities in access to timely diagnosis of melanoma in Ontario are suggested by a recent population based study [10], and Ontario is facing a dermatologist shortage that will likely increase with attrition of the work force [14], compounded by a longstanding deficiency in primary care providers. Canada as a whole and other countries face similar human resource issues [1517]. Health systems should ensure the timely diagnosis of skin cancer; this should be reflected by public health messages encouraging individuals with suspicious skin lesions to seek evaluation within an appropriate timeline.

There are limitations to our study. We were not able to directly measure changes in pathologic diagnoses of skin cancer or stage as complete data is not available. However, we were able to measure changes in skin biopsies, which ultimately will lead to changes in pathologic cancer diagnoses. Moreover, we found our claims algorithm highly specific compared to a validated algorithm identifying pathologically proven keratinocyte cancer diagnoses, and melanoma diagnoses in the Ontario cancer registry. Our data on comorbidity was limited to an administrative data algorithm without chart data abstraction, and CIHI data defining comorbidity was incomplete, notably for the last two and a half weeks of our study period. Given the use of a five-year lookback for comorbid diagnoses in CIHI, the impact on overall findings is expected to be small. Our results could under-estimate the magnitude of delayed cancer diagnosis as shown by the moderate sensitivity of our approach for KC and low sensitivity for melanoma. Melanoma may be more difficult to correctly identify clinically, especially for generalists. Moreover, some melanoma claims are for recurrences, or in-situ melanoma that is not captured in OCR.

Conclusion

A drastic reduction in number of skin biopsies is noted early in the COVID-19 pandemic; this disproportionately affected females, the elderly and residents of certain regions. A large backlog of skin biopsies was observed during the pandemic, persisting well after initial lockdown measures were instated. This will have implications for downstream care of skin cancer. We recommend that public health messages encourage individuals with suspicious skin lesions to seek evaluation in a timely fashion, and that this is welcome and encouraged. Groups at greater risk of delay should receive special attention. Moreover, health systems should increase the priority of unbiopsied skin lesions, and ensure sufficient resources for management of the expected backlog in cases.

Supporting information

S1 Appendix. Flow diagram for selection of study cohort of skin biopsy claims from January 7, 2019 to April 21, 2019.

https://doi.org/10.1371/journal.pone.0248492.s001

(DOCX)

S2 Appendix. Patient characteristics for skin biopsy claims associated with a diagnosis of keratinocyte carcinoma for the first 15 weeks (starting on Monday) of 2019 and 2020.

https://doi.org/10.1371/journal.pone.0248492.s002

(DOCX)

S3 Appendix. Relative risks for comparing skin biopsy claims associated with a diagnosis of keratinocyte carcinoma between COVID-19 (Weeks 11–15) and pre-COVID-19 (Weeks 1–10) periods for first 15 weeks (starting on Monday) of 2020.

https://doi.org/10.1371/journal.pone.0248492.s003

(DOCX)

S4 Appendix. Patient characteristics for skin biopsy claims associated with a diagnosis of melanoma for the first 15 weeks (starting on Monday) of 2019 and 2020.

https://doi.org/10.1371/journal.pone.0248492.s004

(DOCX)

S5 Appendix. Relative risks for comparing skin biopsy claims associated with a diagnosis of melanoma between COVID-19 (Weeks 11–15) and pre-COVID-19 (Weeks 1–10) periods for first 15 weeks (starting on Monday) of 2020.

https://doi.org/10.1371/journal.pone.0248492.s005

(DOCX)

Acknowledgments

The opinions, results and conclusions reported in this paper are those of the authors and are independent from the funding sources. No endorsement by ICES or the Ontario Ministry of Health and Long-Term Care (MOHLTC) is intended or should be inferred. Parts of this material are based on data and/or information compiled and provided by CIHI. However, the analyses, conclusions, opinions and statements expressed in the material are those of the author(s), and not necessarily those of CIHI. Parts of this material are based on data and information provided by Cancer Care Ontario (CCO). The opinions, results, view, and conclusions reported in this paper are those of the authors and do not necessarily reflect those of CCO. No endorsement by CCO is intended or should be inferred. These data were linked using unique encoded identifiers and analyzed at ICES.

The Ontario dataset for confirmed positive cases of COVID-19 was obtained from the Ontario Open Catalogue. All materials are licensed under the Open Government Licence–Ontario.

We also acknowledge Chao Xue for her administrative support.

References

  1. 1. Wang DM, Morgan FC, Besaw RJ, Schmults CD. An ecological study of skin biopsies and skin cancer treatment procedures in the United States Medicare population, 2000 to 2015. Journal of the American Academy of Dermatology. 2018;78(1):47–53. Epub 2017/09/28. pmid:28947293.
  2. 2. Dinmohamed AG, Visser O, Verhoeven RHA, Louwman MWJ, van Nederveen FH, Willems SM, et al. Fewer cancer diagnoses during the COVID-19 epidemic in the Netherlands. The Lancet Oncology. 2020. Epub 2020/05/04. pmid:32359403; PubMed Central PMCID: PMC7252180.
  3. 3. Ricci F, Fania L, Paradisi A, Di Lella G, Pallotta S, Sobrino L, et al. Delayed melanoma diagnosis in the COVID-19 era: Increased breslow thickness in primary melanomas seen after the COVID-19 lockdown. Journal of the European Academy of Dermatology and Venereology: JEADV. 2020. pmid:32780876; PubMed Central PMCID: PMC7436601.
  4. 4. Robles SC, Marrett LD, Clarke EA, Risch HA. An Application of Capture Recapture Methods to the Estimation of Completeness of Cancer Registration. J Clin Epidemiol. 1988;41(5):495–501. WOS:A1988N334600011. pmid:3367181
  5. 5. Tran JM, Schwartz R, Fung K, Rochon P, Chan AW. Comprehensive capture of cutaneous melanoma by the Ontario Cancer Registry: validation study using community pathology reports. Cancer Causes Control. 2016;27(1):137–42. pmid:26537120.
  6. 6. Elixhauser A, Steiner C, Harris DR, Coffey RM. Comorbidity measures for use with administrative data. Medical care. 1998;36(1):8–27. pmid:9431328.
  7. 7. Kralj B. Measuring rurality—RIO 2008_BASIC: methodology and results. Ontario Medical Association Economics Department; 2009. Accessed May 12, 2017.http://www.eriestclairlhin.on.ca/Page.aspx?id=11606. 2009.
  8. 8. Chan AW, Fung K, Tran JM, Kitchen J, Austin PC, Weinstock MA, et al. Application of Recursive Partitioning to Derive and Validate a Claims-Based Algorithm for Identifying Keratinocyte Carcinoma (Nonmelanoma Skin Cancer). JAMA Dermatol. 2016;152(10):1122–7. Epub 2016/08/18. pmid:27533718.
  9. 9. Thompson AE, Anisimowicz Y, Miedema B, Hogg W, Wodchis WP, Aubrey-Bassler K. The influence of gender and other patient characteristics on health care-seeking behaviour: a QUALICOPC study. BMC Fam Pract. 2016;17:38. pmid:27036116; PubMed Central PMCID: PMC4815064.
  10. 10. Mavor ME, Richardson H, Miao Q, Asai Y, Hanna TP. Disparities in diagnosis of advanced melanoma: a population-based cohort study. CMAJ Open. 2018;6(4):E502–E12. pmid:30381323; PubMed Central PMCID: PMC6208113.
  11. 11. Yadav G, Goldberg HR, Barense MD, Bell CM. A Cross-Sectional Survey of Population-Wide Wait Times for Patients Seeking Medical vs. Cosmetic Dermatologic Care. PLoS ONE. 2016;11(9):e0162767. pmid:27632206; PubMed Central PMCID: PMC5025036.
  12. 12. Neal RD, Tharmanathan P, France B, Din NU, Cotton S, Fallon-Ferguson J, et al. Is increased time to diagnosis and treatment in symptomatic cancer associated with poorer outcomes? Systematic review. Br J Cancer. 2015;112 Suppl 1:S92–107. pmid:25734382; PubMed Central PMCID: PMC4385982.
  13. 13. Renzi C, Mastroeni S, Passarelli F, Mannooranparampil TJ, Caggiati A, Potenza C, et al. Factors associated with large cutaneous squamous cell carcinomas. Journal of the American Academy of Dermatology. 2010;63(3):404–11. Epub 2010/07/06. pmid:20598396.
  14. 14. Heughan C, Kanigsberg N, Amdemichael E, Fergusson D, Ammerman D. Canaries in the mineshaft: the dermatology workforce shortage in Eastern Ontario. Journal of cutaneous medicine and surgery. 2008;12(5):217–22. Epub 2008/10/11. pmid:18845090.
  15. 15. Chow EY, Searles GE. The amazing vanishing Canadian dermatologist: results from the 2006 Canadian Dermatology Association member survey. Journal of cutaneous medicine and surgery. 2010;14(2):71–9. pmid:20338122.
  16. 16. Kimball AB, Resneck JS Jr. The US dermatology workforce: a specialty remains in shortage. Journal of the American Academy of Dermatology. 2008;59(5):741–5. pmid:18723242.
  17. 17. Eedy D. Dermatology: a specialty in crisis. Clinical medicine. 2015;15(6):509–10. pmid:26621935; PubMed Central PMCID: PMC4953248.