Skip to main content
Download PDF
  • Research article
  • Open access
  • Published:

Development of nomograms to predict axillary lymph node status in breast cancer patients

BMC Cancer volume 17, Article number: 561 (2017) Cite this article

Abstract

Background

Prediction of axillary lymph node (ALN) status preoperatively is critical in the management of breast cancer patients. This study aims to develop a new set of nomograms to accurately predict ALN status.

Methods

We searched the National Cancer Database to identify eligible female breast cancer patients with profiles containing critical information. Patients diagnosed in 2010–2011 and 2012–2013 were designated the training (n = 99,618) and validation (n = 101,834) cohorts, respectively. We used binary logistic regression to investigate risk factors for ALN status and to develop a new set of nomograms to determine the probability of having any positive ALNs and N2–3 disease. We used ROC analysis and calibration plots to assess the discriminative ability and accuracy of the nomograms, respectively.

Results

In the training cohort, we identified age, quadrant of the tumor, tumor size, histology, ER, PR, HER2, tumor grade and lymphovascular invasion as significant predictors of ALNs status. Nomogram-A was developed to predict the probability of having any positive ALNs (P_any) in the full population with a C-index of 0.788 and 0.786 in the training and validation cohorts, respectively. In patients with positive ALNs, Nomogram-B was developed to predict the conditional probability of having N2–3 disease (P_con) with a C-index of 0.680 and 0.677 in the training and validation cohorts, respectively. The absolute probability of having N2–3 disease can be estimated by P_any*P_con. Both of the nomograms were well-calibrated.

Conclusions

We developed a set of nomograms to predict the ALN status in breast cancer patients.

Peer Review reports

Background

Treatment for early-stage breast cancer is focused on minimizing axillary surgery. The IBCSG 23–01 trial [1] demonstrated that patients with micrometastases in sentinel lymph nodes (SLNs) can be spared from axillary lymph node dissection (ALND). Furthermore, ALND does not provide any additional benefit in patients who received breast-conserving surgery (BCS) with 1–2 positive SLNs, as demonstrated in the Z11 trial [2]. Ongoing studies [3,4,5] are attempting to extend the results reported in the Z11 trial to mastectomy patients. The SOUND trial and the recent NCT01821768 trial [6] have been designed to explore the possibility of abandoning SLNB in a select group of patients [7]. However, the safety of the selection criteria used in these studies is unconfirmed. Predictive models for axillary lymph node (ALN) status would help to identify patients who are more likely to have negative ALNs to spare SLNB. These models, presented as nomograms, were reported and validated in different populations [8,9,10,11]. However, none has been widely accepted in clinical practice, possibly due to the lack of external validation in a large population.

In addition, most of the reported models were designed to predict the probability of having any positive ALNs (≥ 1 positive ALNs). It is also important to predict the probability of having N2–3 disease (>/=4 positive ALNs) for clinical decision making. For example, in patients who fit the Z11 criteria and did not receive ALND, successful prediction of the axillary tumor burden may be informative for radiation oncologists in the determination of radiation fields.

The National Cancer Database (NCDB) is a joint program of the American College of Surgeons and the American Cancer Society. The database includes more than 1500 cancer programs in the United States with detailed tumor pathology information and overall survival data. Since 2010, data concerning HER2 status and lymphovascular invasion (LVI) have been available in the NCDB. In this study, we used data from the NCDB to develop novel and accurate nomograms that can predict the probability of having any positive ALNs and N2–3 disease. The wide range of patients represented in the NCDB may help to improve the robustness and generalizability of the novel nomograms.

Methods

Patient selection

We searched the NCDB registry dataset between 2010 and 2013 and identified female breast cancer patients using the following criteria:

Inclusion criteria

  1. 1)

    Year of diagnosis ≥2010 (LVI and HER2 status have been available since 2010)

  2. 2)

    Female gender

  3. 3)

    A known number of lymph nodes was examined, and a known number of positive ALNs was reported

  4. 4)

    The location of the tumor was known (PRIMARY_SITE coding: C501;C502;C503; C504;C505)

Exclusion criteria

  1. 1)

    T-stage unknown, DCIS or T4 patients, or tumor size larger than 10 cm.

  2. 2)

    Phyllodes tumor

  3. 3)

    Presence of metastatic disease at the time of diagnosis

  4. 4)

    Neoadjuvant chemotherapy

  5. 5)

    Patients with a prior tumor diagnosis

  6. 6)

    Patients with radical mastectomy, extended radical mastectomy or unknown surgery type

  7. 7)

    Bilateral breast cancer

  8. 8)

    Patients with overlapping lesions of the breast, multicentric lesions, or lesions that involved the entire breast (PRIMARY_SITE coding: C508;C509)

  9. 9)

    Tumor grade unknown, except for lobular carcinoma

  10. 10)

    ER, PR, and HER2 status unknown; HER2 borderline patients were also excluded

  11. 11)

    Unknown LVI status.

This was a retrospective study using anonymous and de-identified data from the NCDB. The authors cannot assess the information that could identify individual participants; therefore, this study was exempt from the Johns Hopkins Medicine Institutional Review Board and the Sun Yat-sen Memorial Hospital ethical committee review, and no consent was required.

Statistical analysis

Patients diagnosed from 2010 to 2011 and from 2012 to 2013 with ≥1 nodes examined were defined as the training cohort and validation cohort, respectively, for predictive model development and validation.

We used the Chi-square test to identify risk factors for positive ALNs. The statistically significant (P < 0.001) risk factors were considered to be potential predictors of ALNs status and were all included in the full model. We used a binary logistic regression model to develop a predictive model for ALN status. We used Akaike information criterion (AIC) and ROC analysis to identify the optimal model. We used the full population to develop a prediction model (Model-A) of the risk of having any ALNs(+). Next, we developed a model (Model-B) that could estimate the conditional probability of having pN2–3, given the conditions that the patients had ALNs(+), that patients were ALN-positive, and that patients with <10 ALNs examined and > = 1 positive ALNs (N = 23,106) were excluded.

We used the “rms” package of the R software to develop nomograms to visualize our predictive model graphically. Nomogram-A estimated the probability of having any positive ALNs (P_any). Nomogram-B estimated the conditional probability of having pN2–3 disease (P_con). The probability of having pN2–3 disease can be calculated as P_any*P_con.

We used the ROC analysis and calibration plots to evaluate the discriminative ability and accuracy of the models, respectively. The performance of the models were evaluated and validated internally in the training cohort and externally in the validation cohort, respectively.

For sensitivity analysis, we randomly selected 500, 5000 and 50,000 patients from the study population and calculated the AUC values of the model in these sub-populations. We repeated the sampling for N = 200 times and calculated the mean and standard deviations of the AUC values to determine the stability of AUC values.

All of the statistical analyses were performed using STATA 13.0MP and R.

Results

Clinicopathological features

This study included 201,452 breast cancer patients cataloged in the NCDB with a median age of 61 years old. The clinicopathological features are listed in Table 1. There were 99,618 and 101,834 patients in the training and the validation cohort, respectively. Patient features were similar between the training cohort and the standard validation cohort.

Table 1 Clincopathological features of the study populations
Full size table

Nomogram for predicting risk of any positive ALNs

We used Chi-square analysis and logistic regression as univariate and multivariate analysis to evaluate the risk factors for any positive ALNs in the training cohort. Age, location of lesions, T-stage, histology, ER, PR, HER2, tumor grade and LVI were independent predictors for any positive ALNs by univariate analysis (Table 2). These variables were further confirmed as independent factors in the multivariate analysis, and variables were incorporated in the full model. We also tested some variant models with different variables included. The full model had similar AIC and C-index with the variant model 2 (Additional file 1 : Table S1) and the latter consisted of fewer variables. Therefore, we selected variant model 2 (with age, quadrant, size, histology, grade and LVI as predictors) for development of nomogram A to predict the risk of any positive ALNs (Fig. 1).

Table 2 Analysis of risk factors for any positive ALNs
Full size table
Fig. 1
figure 1

a Nomogram to predict the probability of having any positive ALNs (P_any); b Nomogram to predict the conditional probability of having N2–3 disease (P_con), when the patients have any positive ALNs. The absolute probability of having N2–3 can be estimated by P_any*P_con

Full size image

Nomogram for predicting pN2–3 disease in patients with any positive ALNs

We excluded patients with negative ALNs to predict the pN2–3 disease in patients with any positive ALNs. Patients had <10 ALNs nodes examined, and ≥1 positive ALNs were also excluded (N = 23,106). Univariate analysis suggested that age, location of lesions, T-stage, histology, ER, PR, HER2, tumor grade and LVI were risk factors for pN2–3 disease in patients with any positive ALNs (Table 3). These variables, except for ER and PR status, were confirmed as independent risk factors in the multivariate analysis. The full model was selected based on its lowest AIC and the highest C-index (Additional file 1 : Table S1). Nomogram-B (Fig. 1) was developed to predict the conditional probability of having pN2–3 patients, given that patients have ≥1 positive ALNs.

Table 3 Analysis of risk factors for pN2–3a
Full size table

Distribution of the predicted probability

The training cohort and the validation cohort exhibited a similar distribution of predicted risks by the new model (Additional file 2 : Fig. S1). Most of the predicted risk of any ALNs ranged between 0 and 20%. Most of the predicted risks of pN2–3 disease ranged between 10% and 50% and between 0% and 10% in patients with any positive ALNs and in all populations, respectively.

Validation of the nomograms

The AUC values of the nomograms (Additional file 1 : Table S1) for predicting any positive ALNs and pN2–3 disease were 0.788 and 0.680 in the training cohort and 0.786 and 0.677 in the validation cohort, respectively. The calibration plot (Fig. 2) suggested that the nomograms were well-calibrated. The average estimation errors of predicting any positive ALNs and pN2–3 disease were 0.78% and 0.85% in the training cohort and 1.14% and 2.79% in the validation cohort, respectively.

Fig. 2
figure 2

Calibration plots of nomogram-A to predict the probability of having any positive ALNs in the a) training and b) validation cohort, and nomogram-B to predict the conditional probability of having N2–3 disease in the c) training and d) validation cohort

Full size image

Sensitivity analysis

For sensitivity analysis, we randomly selected 500, 5000 and 50,000 patients from the training and validation cohorts and performed the ROC analysis and calibration plot analysis. We repeated the re-sampling 200 times to obtain a reliable estimation of the AUC values and average prediction error between the actual and predicted risks. As shown in Additional file 3 : Table S2, the estimated AUC values and average prediction error were similar among sub-populations with varied sample sizes.

Discussion

Accuracy of the nomograms

The first predictive model for ALN status was developed a decade ago by Bevilacqua et al. [8]. The authors retrospectively reviewed the database of MSKCC and identified 3786 and 1545 breast cancer patients as training and validation sets, respectively. A nomogram was developed using age, tumor size, special pathology type, location, LVI, multifocal status, nuclear grade, and ER and PR status as predictors of ALN status. Chen et al. [10] validated the MSKCC model in a Chinese population (n = 1545) and reported a new nomogram (the Shanghai model) using data from Chinese breast cancer patients. However, the MSKCC model did not incorporate HER2 status. Reyal et al. [11] reported that molecular subtype approximation, including ER, PR and HER2, is also a determinant of ALN status, and another nomogram was later developed (the Paris model). Additionally, several more models [9, 12,13,14,15] have been developed to predict ALN status. However, none of these models has been widely accepted by treatment guidelines, and clinical practice has not significantly changed. A lack of sufficient evidence to support external validity is one of the major underlying reasons. In addition, these models can only predict the risk of having ≥1 positive ALN. In the current study, we used a large multi-institutional NCDB population to develop and validate a set of nomograms that can predict the risk of having any positive ALNs and N2–3 disease.

Benefit of the new nomograms in the post-Z0011 era

The Z11 study [2] demonstrated that patients with 1–2 positive SLNs receiving BCS and standardized adjuvant therapies could be spared from ALND [16]. However, it is impossible to know whether a patient fits the Z11 criteria or not before surgery, as the number of positive SLNs can only be identified during or after surgery. Our nomograms may be able to identify patients who may not fit the Z11 criteria by predicting the risk of having N2–3 disease preoperatively. If a patient had a high risk of having N2–3 disease, she may be unlikely to fit the Z11 criteria.

Because mastectomy patients were not included in the Z11 study, ALND is still a routine procedure for SLN-positive patients. However, several retrospective studies suggested the feasibility to omit ALND in selected mastectomy patients with positive [4, 17, 18]. A prospective randomized trial was also initiated to test this hypothesis (NCT02112682). Therefore, the trend that Z11 conclusions could be extended to mastectomy patients is very clear, and with the help of these nomograms, surgeons may feel safer in omitting the ALND in selected mastectomy patients with positive SLNs.

One concern related to omitting the ALND in mastectomy patients is whether RT should be given. The NCCN guidelines [19] clearly recommend RT to the infraclavicular region, supraclavicular area, and internal mammary nodes for patients with N2–3 disease (≥4 positive ALNs). For patients with 1–3 positive nodes (N1 disease) after mastectomy, radiotherapy coverage of these areas was considered controversial by NCCN panel members [19] because high-level contradictory evidence was apparent [20,21,22,23]. With our nomograms, omitting ALND in selected mastectomy patients after positive SLNs may not be a major problem, as the radiation oncologist can estimate the risk of having N2–3 disease and determine the treatment plans. Additionally, these nomograms would be more helpful to the radiation oncologists, in that 1) they may help reassure them that patients who met Z11 criteria do not need additional radiation therapy, in terms of increasing the tangents/fields for radiation; 2) For patients who received neoadjuvant chemotherapy, RT decisions should be based on pre-chemotherapy tumor features regardless of the tumor response [18]. Our nomograms may be useful in the estimation of axillary tumor burden prior to the initiation of neoadjuvant chemotherapy to provide more information.

Benefit of the new nomograms in the “SLNB-sparing” era

In the post-Z11 era when “the days are numbered for axillary surgery” [24], it is likely that SLNB could be omitted in selected patients. The SOUND trial [7], proposed in 2012, was designed to test this hypothesis. In the SOUND trial, T1 breast cancer patients with clinically negative axilla were randomized into groups receiving either observation or SLNB. There were only 12.8% of patients with positive ALNs in the SLNB group, suggesting the high probability that SLNB could be spared in the future. The development of the nomograms is consistent with the trend towards the “SLNB-sparing” era. If we could identify node negative patients preoperatively, the omission of SLNB would be much safer, without the need to wait for the results of the SOUND trial. Sparing SLNB would improve the quality of life and reduce the medical cost and all possible surgical complications. The authors recently reported that the physical function of the upper limb in the no-SLNB group was significantly better than in the SLNB-group, suggesting the benefit of minimizing axillary surgery when appropriate [25].

In the “SLNB-sparing” era, if the SOUND trial demonstrated that not performing SLNB in selected patients is safe, there will be concerns regarding the absence of axillary staging on the decision to use adjuvant therapies. For example, post-mastectomy radiotherapy (PMRT) is not necessary in T1–2 patients with negative ALNs, whereas in patients with positive ALNs, PMRT is strongly recommended by the NCCN guidelines [19]. The need for radiotherapy has also influenced the optimal timing of breast reconstruction (e.g., immediate vs. delayed). Additionally, a T1a patient with HER2 positive disease may be spared from chemotherapy if ALNs were negative, and adjuvant chemotherapy is recommended for patients with positive ALNs [19]. Taken together, the ability to predict the probability of having any positive ALNs (or N0 disease) would be helpful in the “SLNB-sparing” era in the future.

Limitations

There are several limitations to this study.

First, several of the predictors of these models, such as LVI and multifocal lesions, may not always be available prior to surgery. Core needle biopsy may not provide an adequate volume of tissue for the identification of LVI. These issues may limit the utility of the models developed in the current study. However, ultrasound-guided vacuum-assisted biopsy [26, 27] has been used by many institutions and may provide a larger volume of tissue for the identification of LVI. Current imaging modalities can provide an accurate estimate of tumor size and multifocality [28,29,30,31].

Second, several important variables are not available in the NCDB, such as whether the tumor was palpable or ki-67 status. More importantly, the clinical axillary status was also not available in this study. In patients with clinically negative axilla, the probability of having N2–3 disease is very low. The performance of the model in these patients needs to be validated.

Third, the NSABP B-32 trial suggested a 10% false-negative rate of SLNs. In our study, patients with SLNB only, without any positive SLNs, were classified as having no positive ALNs. This limitation cannot be avoided when using data from the modern era when SLNB is the routine practice. However, we believe that the 10% false-negative rate may not significantly affect the performance of our model.

Fourth, when developing nomogram-B for predicting the conditional probability of having N2–3 disease, we excluded 23,106 patients (11.5%, 23,106/201,452) with ≥1 positive ALNs but with less than 10 ALNs evaluated. We may have skewed the data by excluding these patients. However, we considered that the benefit of excluding these patients might outweigh the harm of including them. As demonstrated in the Z11 study, patients with 1–2 SLN+ without further ALND may theoretically have a 27% risk of additional positive ALNs. Therefore, the exact amount of positive ALNs in these patients was unknown, leading to the inaccuracy of model development and validation.

Fifth, these nomograms can only be used in patients with a single focus of disease and only in patients with unilateral disease.

Conclusions

In this study, we used a large multi-institutional NCDB population to develop a set of nomograms to predict nodal status in breast cancer patients. Future validation studies are needed to confirm our findings.

Abbreviations

AIC:

Akaike information criterion

ALN:

Axillary lymph node

ALND:

Axillary lymph node dissection

AUC:

Area under the curve

BCS:

Breast conserving surgery

ER:

Estrogen receptor

HER2:

Human epidermal growth receptor 2

LVI:

lymphovascular invasion

NCDB:

National Cancer Database

PMRT:

Post-mastectomy radiotherapy

PR:

Progesterone receptor

ROC:

Receiver-operator-curve

SLN:

Sentinel lymph node

References

  1. Galimberti V, Cole BF, Zurrida S, Viale G, Luini A, Veronesi P, Baratella P, Chifu C, Sargenti M, Intra M, et al. Axillary dissection versus no axillary dissection in patients with sentinel-node micrometastases (IBCSG 23-01): a phase 3 randomised controlled trial. Lancet Oncol. 2013;14(4):297–305.

    Article  PubMed  PubMed Central  Google Scholar 

  2. Giuliano AE, Hunt KK, Ballman KV, Beitsch PD, Whitworth PW, Blumencranz PW, Leitch AM, Saha S, McCall LM, Morrow M. Axillary dissection vs no axillary dissection in women with invasive breast cancer and sentinel node metastasis: a randomized clinical trial. JAMA. 2011;305(6):569–75.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  3. Crawford JD, Ansteth M, Barnett J, Glissmeyer M, Johnson NG. Routine completion axillary lymph node dissection for positive sentinel nodes in patients undergoing mastectomy is not associated with improved local control. Am J Surg. 2013;205(5):581–4. discussion 584

    Article  PubMed  Google Scholar 

  4. Fu Y, Chung D, Cao MA, Apple S, Chang H. Is axillary lymph node dissection necessary after sentinel lymph node biopsy in patients with mastectomy and pathological N1 breast cancer? Ann Surg Oncol. 2014;21(13):4109–23.

    Article  PubMed  Google Scholar 

  5. Omitting Completion Axillary Treatment in Sentinel Node Positive Breast Cancer Patients Undergoing a Mastectomy. https://clinicaltrials.gov/ct2/show/NCT02112682

  6. Axillary Ultrasound With or Without Sentinel Lymph Node Biopsy in Detecting the Spread of Breast Cancer in Patients Receiving Breast Conservation Therapy. https://clinicaltrials.gov/ct2/show/NCT01821768

  7. Gentilini O, Veronesi U. Abandoning sentinel lymph node biopsy in early breast cancer? A new trial in progress at the European Institute of Oncology of Milan (SOUND: Sentinel node vs Observation after axillary UltraSouND). Breast. 2012;21(5):678–81.

    Article  PubMed  Google Scholar 

  8. Bevilacqua JL, Kattan MW, Fey JV, Cody HS 3rd, Borgen PI, Van Zee KJ. Doctor, what are my chances of having a positive sentinel node? A validated nomogram for risk estimation. J Clin Oncol. 2007;25(24):3670–9.

    Article  PubMed  Google Scholar 

  9. Carmichael AR, Aparanji K, Nightingale P, Boparai R, Stonelake PS. A clinicopathological scoring system to select breast cancer patients for sentinel node biopsy. Eur J Surg Oncol. 2006;32(10):1170–4.

    Article  CAS  PubMed  Google Scholar 

  10. Chen JY, Chen JJ, Yang BL, Liu ZB, Huang XY, Liu GY, Han QX, Yang WT, Shen ZZ, Shao ZM, et al. Predicting sentinel lymph node metastasis in a Chinese breast cancer population: assessment of an existing nomogram and a new predictive nomogram. Breast Cancer Res Treat. 2012;135(3):839–48.

    Article  PubMed  Google Scholar 

  11. Reyal F, Rouzier R, Depont-Hazelzet B, Bollet MA, Pierga JY, Alran S, Salmon RJ, Fourchotte V, Vincent-Salomon A, Sastre-Garau X, et al. The molecular subtype classification is a determinant of sentinel node positivity in early breast carcinoma. PLoS One. 2011;6(5):e20297.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  12. Kolarik D, Pecha V, Skovajsova M, Zahumensky J, Trnkova M, Petruzelka L, Halaska M, Sottner O, Otcenasek M, Kolarova H. Predicting axillary sentinel node status in patients with primary breast cancer. Neoplasma. 2013;60(3):334–42.

    Article  CAS  PubMed  Google Scholar 

  13. Qiu SQ, Zeng HC, Zhang F, Chen C, Huang WH, Pleijhuis RG, Wu JD, van Dam GM, Zhang GJ. A nomogram to predict the probability of axillary lymph node metastasis in early breast cancer patients with positive axillary ultrasound. Sci Rep. 2016;6:21196.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  14. Xie F, Yang H, Wang S, Zhou B, Tong F, Yang D, Zhang J. A logistic regression model for predicting axillary lymph node metastases in early breast carcinoma patients. Sensors. 2012;12(7):9936–50.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  15. Fehm T, Maul H, Gebauer S, Scharf A, Baier P, Sohn C, Jager W, Gebauer G. Prediction of axillary lymph node status of breast cancer patients by tumorbiological factors of the primary tumor. Strahlenther Onkol. 2005;181(9):580–6.

    Article  PubMed  Google Scholar 

  16. Wright GP, Mater ME, Sobel HL, Knoll GM, Oostendorp LD, Melnik MK, Chung MH. Measuring the impact of the American College of Surgeons Oncology Group Z0011 trial on breast cancer surgery in a community health system. Am J Surg. 2015;209(2):240–5.

    Article  PubMed  Google Scholar 

  17. Milgrom S, Cody H, Tan L, Morrow M, Pesce C, Setton J, Rogers K, Arnold B, Eaton A, Catalano J, et al. Characteristics and outcomes of sentinel node-positive breast cancer patients after total mastectomy without axillary-specific treatment. Ann Surg Oncol. 2012;19(12):3762–70.

    Article  PubMed  Google Scholar 

  18. Cowher MS, Grobmyer SR, Lyons J, O'Rourke C, Baynes D, Crowe JP. Conservative axillary surgery in breast cancer patients undergoing mastectomy: long-term results. J Am Coll Surg. 2014;218(4):819–24.

    Article  PubMed  Google Scholar 

  19. NCCN Clinical Practice Guidelines in Oncology. Breast Cancer. Version I. 2017. www.nccn.org

  20. Clarke M, Collins R, Darby S, Davies C, Elphinstone P, Evans V, Godwin J, Gray R, Hicks C, James S, et al. Effects of radiotherapy and of differences in the extent of surgery for early breast cancer on local recurrence and 15-year survival: an overview of the randomised trials. Lancet. 2005;366(9503):2087–106.

    Article  CAS  PubMed  Google Scholar 

  21. Ragaz J, Olivotto IA, Spinelli JJ, Phillips N, Jackson SM, Wilson KS, Knowling MA, Coppin CM, Weir L, Gelmon K, et al. Locoregional radiation therapy in patients with high-risk breast cancer receiving adjuvant chemotherapy: 20-year results of the British Columbia randomized trial. J Natl Cancer Inst. 2005;97(2):116–26.

    Article  PubMed  Google Scholar 

  22. Recht A, Edge SB, Solin LJ, Robinson DS, Estabrook A, Fine RE, Fleming GF, Formenti S, Hudis C, Kirshner JJ, et al. Postmastectomy radiotherapy: clinical practice guidelines of the American Society of Clinical Oncology. J Clin Oncol. 2001;19(5):1539–69.

    Article  CAS  PubMed  Google Scholar 

  23. Overgaard M, Jensen MB, Overgaard J, Hansen PS, Rose C, Andersson M, Kamby C, Kjaer M, Gadeberg CC, Rasmussen BB, et al. Postoperative radiotherapy in high-risk postmenopausal breast-cancer patients given adjuvant tamoxifen: Danish Breast Cancer Cooperative Group DBCG 82c randomised trial. Lancet. 1999;353(9165):1641–8.

    Article  CAS  PubMed  Google Scholar 

  24. Gentilini O, Veronesi U. Staging the Axilla in Early Breast Cancer: Will Imaging Replace Surgery? JAMA Oncol. 2015;1(8):1031–2.

    Article  PubMed  Google Scholar 

  25. Gentilini O, Botteri E, Dadda P, Sangalli C, Boccardo C, Peradze N, Ghisini R, Galimberti V, Veronesi P, Luini A, et al. Physical function of the upper limb after breast cancer surgery. Results from the SOUND (Sentinel node vs. Observation after axillary Ultra-souND) trial. Eur J Surg Oncol. 2016;42(5):685–9.

    Article  CAS  PubMed  Google Scholar 

  26. Meyer JE, Smith DN, Lester SC, Kaelin C, PJ DP, Denison CM, Christian RL, Harvey SC, Selland DL, Durfee SM. Large-core needle biopsy of nonpalpable breast lesions. JAMA. 1999;281(17):1638–41.

    Article  CAS  PubMed  Google Scholar 

  27. Preibsch H, Baur A, Wietek BM, Kramer B, Staebler A, Claussen CD, Siegmann-Luz KC. Vacuum-assisted breast biopsy with 7-gauge, 8-gauge, 9-gauge, 10-gauge, and 11-gauge needles: how many specimens are necessary? Acta Radiol. 2015;56(9):1078–84.

    Article  PubMed  Google Scholar 

  28. Fiorentino C, Berruti A, Bottini A, Bodini M, Brizzi MP, Brunelli A, Marini U, Allevi G, Aguggini S, Tira A, et al. Accuracy of mammography and echography versus clinical palpation in the assessment of response to primary chemotherapy in breast cancer patients with operable disease. Breast Cancer Res Treat. 2001;69(2):143–51.

    Article  CAS  PubMed  Google Scholar 

  29. Luparia A, Mariscotti G, Durando M, Ciatto S, Bosco D, Campanino PP, Castellano I, Sapino A, Gandini G. Accuracy of tumour size assessment in the preoperative staging of breast cancer: comparison of digital mammography, tomosynthesis, ultrasound and MRI. Radiol Med. 2013;118(7):1119–36.

    Article  PubMed  Google Scholar 

  30. Davis PL, Staiger MJ, Harris KB, Ganott MA, Klementaviciene J, KS MC Jr, Tobon H. Breast cancer measurements with magnetic resonance imaging, ultrasonography, and mammography. Breast Cancer Res Treat. 1996;37(1):1–9.

    Article  CAS  PubMed  Google Scholar 

  31. Leddy R, Irshad A, Metcalfe A, Mabalam P, Abid A, Ackerman S, Lewis M. Comparative accuracy of preoperative tumor size assessment on mammography, sonography, and MRI: Is the accuracy affected by breast density or cancer subtype? J Clin Ultrasound. 2016;44(1):17–25.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

The data used in the study was derived from a de-identified NCDB. The American College of Surgeons and the Commission on Cancer have not verified and are not responsible for the analytic or statistical methodology used or the conclusions drawn from these data by the investigator. This study was supported by the National Natural Science Foundation of China (Grant # 81402201, Grant # 81602673), and Grant [2013] 163 from the Key Laboratory of Malignant Tumor Molecular Mechanism and Translational Medicine of Guangzhou Bureau of Science and Information Technology.

Funding

This study was supported by the National Natural Science Foundation of China (Grant # 81402201/81372817) and Grant [2013] 163 from Key Laboratory of Malignant Tumor Molecular Mechanism and Translational Medicine of Guangzhou Bureau of Science and Information Technology. All of the funding bodies did not have a role in the design of the study and data collection or analysis. Also they did not have a role in the interpretation of the data. The funding bodies supported the travel of the author (Kai Chen) to US to meet with Lisa Jacobs for discussion over this manuscript. Also, the funding bodies support the expense of the language editting of this manuscript, and the working allowance for the authors (Kai Chen, Jieqiong Liu and Shunrong Li).

Availability of data and materials

We used the NCDB data and selected appropriate patients for this study. We only retrieved relevant variables for the included patients, and we cleaned the data, stored it as the dta. File, which can be loaded using the STATA 13. As the author had signed an agreement with the NCDB and promise not to share the data with others, we cannot upload the “clean” data online. However, for scientific purpose, the “clean” data are freely available upon request. Anyone who wants to request the data can contact the corresponding author Kai Chen (chenkai23@mail.sysu.edu.cn) and need to sign a Data Transfer Agreement with Kai Chen, Lisa Jacobs, and possibly the NCDB.

Ethics approval and consent to participate.

This is a study using a publicly available database (NCDB) with signed agreement between the authors and the NCDB. All of the data are anonymous. Therefore, the ethical approval can be waived, based on our institutional policy and consent to participate and is not needed.

Author information

Author notes

    Authors and Affiliations

    1. Guangdong Provincial Key Laboratory of Malignant Tumor Epigenetics and Gene Regulation, Sun Yat-Sen Memorial Hospital, Sun Yat-Sen University, Guangzhou, China

      Kai Chen, Jieqiong Liu & Shunrong Li

    2. Breast Tumor Center, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, Guangdong, 510120, China

      Kai Chen, Jieqiong Liu & Shunrong Li

    3. Departments of Surgery and Oncology, Johns Hopkins Medical Institutions, Blalock #607, 600 N. Wolfe St, Baltimore, Maryland, 21287, USA

      Lisa Jacobs

    Authors
    1. Kai Chen
      View author publications

      You can also search for this author in PubMed Google Scholar

    2. Jieqiong Liu
      View author publications

      You can also search for this author in PubMed Google Scholar

    3. Shunrong Li
      View author publications

      You can also search for this author in PubMed Google Scholar

    4. Lisa Jacobs
      View author publications

      You can also search for this author in PubMed Google Scholar

    Contributions

    K.C. made substantial contribution to conception and design, analysis and interpretation of data, wrote and revised the manuscript, gave final approval for publications and agreed to be accountable for all aspects of the work. J.L. collected and analyzed the data, wrote and revised the manuscript, gave final approval for publications and agreed to be accountable for all aspects of the work. S.L. designed the study and analyzed the data, and also took part in the drafting of the manuscript, gave final approval for publications and agreed to be accountable for all aspects of the work. L.J. helped to collect the data, and get invovled in analyzing the data, gave critical and important opinions in the revision of the manusript, gave final approval for publications and agreed to be accountable for all aspects of the work.

    Corresponding authors

    Correspondence to Kai Chen or Lisa Jacobs.

    Ethics declarations

    Consent for publication

    Not applicable.

    Competing interests

    The authors declare that they have no competing interests in this section.

    Publisher’s Note

    Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

    Additional files

    Additional file 1: Table S1.

    Model performance of the full models and the variants. This table showed the performance of the full models and their variants. (XLSX 42 kb)

    Additional file 2: Figure S1.

    Kernel density plots of the a) predicted probability of having any positive ALNs by nomogram-A, b) predicted conditional probability of having N2–3 disease in patients with positive ALNs by nomogram-B, and c) the predicted absolute probability of having N2–3 disease in all populations, by nomogram-A and B. (PDF 54 kb)

    Additional file 3: Table S2.

    Sensitivity analysis of the model performance in population with different sample sizes. We used different populations with different sample size to assess the performance and the robustness of the models. (XLSX 41 kb)

    Rights and permissions

    Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

    Reprints and permissions

    About this article

    Check for updates. Verify currency and authenticity via CrossMark

    Cite this article

    Chen, K., Liu, J., Li, S. et al. Development of nomograms to predict axillary lymph node status in breast cancer patients. BMC Cancer 17, 561 (2017). https://0-doi-org.brum.beds.ac.uk/10.1186/s12885-017-3535-7

    Download citation

    • Received:

    • Accepted:

    • Published:

    • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s12885-017-3535-7

    Keywords

    BMC Cancer

    ISSN: 1471-2407

    Contact us