Next Article in Journal
Immune Landscape and an RBM38-Associated Immune Prognostic Model with Laboratory Verification in Malignant Melanoma
Previous Article in Journal
Considerations and Challenges in the Management of the Older Patients with Gastric Cancer
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

The Barcelona Predictive Model of Clinically Significant Prostate Cancer

1
Department of Urology, Vall d’Hebron Hospital, 08035 Barcelona, Spain
2
Department of Surgery, Universitat Autònoma de Barcelona, 08193 Barcelona, Spain
3
Department of Urology, Hospital Universitario Miguel Servet, IIS-Aragon, 50009 Zaragoza, Spain
4
Department of Radiology, Vall d´Hebron Hospital, 08035 Barcelona, Spain
5
Department of Pathology, Vall d´Hebron Hospital, 08035 Barcelona, Spain
6
Department of Morphological Sciences, Universitat Autònoma de Barcelona, 08193 Barcelona, Spain
7
Department of Urology, Parc de Salut Mar, 08003 Barcelona, Spain
8
Department of Urology, Hospital Germans Trias I Pujol, 08916 Badalona, Spain
9
Urology Research Group, Vall d´ Hebron Research Institute, 08035 Barcelona, Spain
10
Department of Applied Mathematics, Escuela Universitaria Politécnica La Almunia, Universidad de Zaragoza, 50100 Zaragoza, Spain
*
Author to whom correspondence should be addressed.
These authors contribute equally as co-first authors.
These authors contribute equally as co-last authors.
Submission received: 24 February 2022 / Revised: 15 March 2022 / Accepted: 16 March 2022 / Published: 21 March 2022
(This article belongs to the Topic Prostate Cancer: Symptoms, Diagnosis & Treatment)

Abstract

:

Simple Summary

Magnetic-resonance-imaging-based predictive models (MRI-PMs) improve the MRI prediction of clinically significant prostate cancer (csPCa) in prostate biopsies. Risk calculators (RC) provide easy individual assessment of csPCa likelihood. MRI-PMs have been analysed in overall populations of men suspected to have PCa, but they have never been analysed according to the prostate imaging-report and data system (PI-RADS) categories. Therefore, the true clinical usefulness of MRI-PMs regarding the specific PI-RADS categories is unknown.

Abstract

A new and externally validated MRI-PM for csPCa was developed in the metropolitan area of Barcelona, and a web-RC designed with the new option of selecting the csPCa probability threshold. The development cohort comprised 1486 men scheduled to undergo a 3-tesla multiparametric MRI (mpMRI) and guided and/or systematic biopsies in one academic institution of Barcelona. The external validation cohort comprised 946 men in whom the same diagnostic approach was carried out as in the development cohort, in two other academic institutions of the same metropolitan area. CsPCa was detected in 36.9% of men in the development cohort and 40.8% in the external validation cohort (p = 0.054). The area under the curve of mpMRI increased from 0.842 to 0.897 in the developed MRI-PM (p < 0.001), and from 0.743 to 0.858 in the external validation cohort (p < 0.001). A selected 15% threshold avoided 40.1% of prostate biopsies and missed 5.4% of the 36.9% csPCa detected in the development cohort. In men with PI-RADS <3, 4.3% would be biopsied and 32.3% of all existing 4.2% of csPCa would be detected. In men with PI-RADS 3, 62% of prostate biopsies would be avoided and 28% of all existing 12.4% of csPCa would be undetected. In men with PI-RADS 4, 4% of prostate biopsies would be avoided and 0.6% of all existing 43.1% of csPCa would be undetected. In men with PI-RADS 5, 0.6% of prostate biopsies would be avoided and none of the existing 42.0% of csPCa would be undetected. The Barcelona MRI-PM presented good performance on the overall population; however, its clinical usefulness varied regarding the PI-RADS category. The selection of csPCa probability thresholds in the designed RC may facilitate external validation and outperformance of MRI-PMs in specific PI-RADS categories.

1. Introduction

Prostate cancer (PCa) suspicion is established from prostate-specific antigen (PSA) serum elevation and/or abnormal digital rectal examination (DRE), while its diagnosis is confirmed with a prostate biopsy [1]. The classic approach based on systematic biopsies results in high rates of unnecessary biopsies and overdetection of insignificant PCa (iPCa) [2]. The detection of clinically significant prostate cancer (csPCa) has improved with the use of magnetic resonance imaging (MRI) and guided biopsies [3,4]. However, that approach can improve by emploting the proper selection of prostate biopsy candidates after MRI [5,6]. For this purpose, PSA density (PSAD) [7], MRI-based predictive models (MRI-PMs) [8], and modern markers [9] have been recommended. MRI-PMs share Prostate Imaging-Report and Data System (PI-RADS) scores and additional independent predictors as PSAD [8,9,10]. External validation is always required before implementing any predictive model in new population [11,12]. To date, at least fifteen MRI-PMs have been developed [11,12,13,14,15,16,17,18,19,20,21,22,23,24,25]. In 10 of them, MRI results were reported using the latest PI-RADS versions 2.0–2.1 [11,13,19,20,21,22,23,24,25]; 5 of them had any external validation [20,21,22,24,25]; and none had any associated web or smartphone risk calculator (RC). In addition, the performance of MRI-PMs regarding the PI-RADS categories has never been analysed.
Our main objective was to design a new web-RC for csPCa likelihood, derived from a developed MRI-PM in the metropolitan area of Barcelona, Spain. The RC calculator will provide the novel option of selecting the csPCa probability threshold to facilitate future external validations and outperformances in specific PI-RADS categories. The specific objectives were: i. to develop the Barcelona MRI-PM; ii. to externally validate the developed model in a representative cohort of the Barcelona metropolitan area; iii. to design a friendly and free available web-RC with the PCa probability threshold selection allowed; and iv. to analyse the MRI-PM performance regarding PI-RADS categories in the development and external validation cohorts.

2. Materials and Methods

2.1. Development Cohort

The development cohort was formed of 1987 men with suspected PCa who had serum PSA > 3 ng/mL and/or abnormal DRE and were referred to our early PCa detection program from the primary care system. All men were scheduled for pre-biopsy multipa-rametric MRI (mpMRI), and thereafter, underwent guided and/or systematic biopsies from 1 to 4 weeks later, between 1 January 2016 and 31 December 2019, in one academic institution (VHH) of the metropolitan area of Barcelona, Spain. Data were collected in a prospective database according to the standards of reporting for MRI-targeted biopsy studies (START) [26]. Written consent was provided by all participants, and the institutional review board approved the project (PR/AG-317/2017). Men excluded from the study were: those undergoing 5-alpha reductase inhibitors for symptomatic benign prostatic hyperplasia; those with a previous PCa diagnosis; those with previous findings of atypical small acinar proliferation or prostate-intraepithelial neoplasia with atypia; and those with an incomplete data set. Additionally, 183 men were also excluded because mpMRI was not carried out due to technical reasons (56 due to claustrophobia, 32 due to a heart pacemaker, and 95 due to any metal prosthesis). The final development cohort comprised 1486 men (Figure 1).

2.2. External Validation Cohort

The external validation cohort comprised 946 men with suspected PCa who were retrospectively selected in two other academic institutions (PSM and GTIPH) and were representative of the metropolitan area of Barcelona, Spain. The criteria of PCa suspicion, the period of recruitment, and the diagnostic approach were the same as in the development cohort.

2.3. MRI Technique and Evaluation

MRI scans were acquired using a 3-tesla scanner with a standard surface phased-array coil. Magneto Trio (Siemens Corp., Erlangen, Germany) equipment was used for the development cohort and Diamond Select Achieva 3.0-TX (Phillips Corp., Eindoven, The Netherlands) and Nova Dual (Phillips Corp., Eindoven, The Netherlands) were used for the external validation cohorts. The acquisition protocol included T2-weighted imaging (T2W), diffusion-weighted imaging (DWI) and dynamic contrast-enhanced (DCE) imaging, according to the guidelines of the European Society of Urogenital Radiology. Two expert radiologists in each institution analysed images using the PI-RADSv.2.0, and in cases with multiple PI-RADS category lesions, the highest PI-RADS was selected for the model [27]. Prostate volume was assessed using MRI in all three institutions.

2.4. Prostate Biopsy Procedure

All men underwent a 2- to 4-core transrectal ultrasound (TRUS), cognitive-fusion guided biopsies for all PI-RADS > 3 lesions, and a 12-core TRUS systematic biopsy. Men with PI-RADS < 3 underwent a 12-core TRUS systematic biopsy. All biopsies were performed by one experienced urologist in each institution using the BK Focus 400 ultrasound scanner (BK Medical Inc., Herlev, Denmark) for the development cohort, and the Siemens Acuson 150 (Siemens Inc., Erlangen, Germany) and the Sonolite Antares (Siemens Inc., Erlangen, Germany) for the external validation cohort.

2.5. Pathologic Analysis and csPCa Definition

Biopsy samples were sent separately to local pathology departments, where two expert uro-pathologists analysed them, assigning them an International Society of Uro-Pathology (ISUP) grade group when PCa was detected. csPCa was defined when ISUP grade > 2 was founded [28].

2.6. Development of MRI-PM

The independent ability to predict csPCa of PI-RADSv.2.0 (1–5), age (years), ethnicity (Caucasian vs. others), serum PSA level (ng/mL), prostate volume (mL), DRE (normal vs. abnormal), PCa family history (no vs. first-degree relatives), and biopsy type (initial vs. repeat) was explored. PSAD was not directly included as a predictor because of the need for previous calculation, and due to having an area under the curve for csPCa detection of 0.892 and 0.897 when serum PSA and prostate volume were the predictors (data not shown).

2.7. Endpoint Measurements for the Performance Analysis of MRIPM

CsPCa detection rates and avoidable prostate biopsy rates.

2.8. Statistical Analysis

Descriptive statistics for the development and external validation cohorts were analysed and compared with the Chi-square and Mann–Whitney U tests. Binary logistic stepwise regression analysis of csPCa candidate predictors was performed for the model development. Continuous variables were modelled as linear or nonlinear predictors using restricted cubic splines. Calibration of the predictive model was assessed in both cohorts. Discrimination power was determined using the receiver operating characteristic (ROC) curve and the area under the curve (AUC), and clinical utility was determined using the clinical utility curve (CUC), which explored the potential rates of missed csPCa detection and avoidable prostate biopsies. The net benefit of the mpMRI- and MRI-based predictive model over biopsying all men was evaluated with a decision curve analysis (DCA). AUCs and specificities for 90% sensitivity to csPCa of the MRI and MRI-based predictive model in the development and external validation cohorts were compared with the DeLong and Chi-square tests, respectively. After selecting the threshold with 95% sensitivity to csPCa, the overall performances of the MRI and MRI-based predictive model were compared, and a sub-analysis—after stratifying by PI-RADS < 3, 3, 4 and 5—was performed. Sensitivity, specificity, positive and negative predictive values, and accuracy of rates of avoidable biopsies and potentially undetected csPCa were analysed. For the external validation, transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD) statements were followed. Statistical analyses were computed using R programming language v.4.0.3 (The R Foundation for Statistical Computing, Vienna, Austria) and SPSS v.24 (IBM, statistical package for the social sciences, San Francisco, CA, USA).

3. Results

3.1. Characteristics of Development and External Validation Cohorts

The characteristics of development and external validation cohorts are summarised in Table 1. We noted a lower significant age and higher serum PSA in the development cohort than in the external validation cohort (p < 0.001). We also noted higher abnormal DRE, PCa family history, and repeat prostate biopsy rates in the external validation cohort (p < 0.001). The prostate volume was similar in both cohorts (p = 0.559). The Caucasian race was predominant in both cohorts (p = 0.738). Different case-mixes of PI-RADS categories existed between both cohorts (p < 0.001). We noted no significant increase in csPCa in the external validation cohort (p = 0.054), and a significant increase in iPCa (p < 0.001). The overall detection rate of csPCa was 36.9% in the development cohort, and regarding PI-RADS categories, 4.1% of men had PI-RADS < 3, 15.3% of men had PI-RADS 3, 52.4% of men had PI-RADS 4, and 83.4% of men had PI-RADS 5. The overall detection rate of csPCa was 40.8% in the external validation cohort, and regarding PI-RADS categories, 10.9% of men had PI-RADS < 3, 20.4% of men had PI-RADS 3, 51.9% of men had PI-RADS 4, and 84.0% of men had PI-RADS 5.

3.2. MRI-Based Predictive Model Development and Performance

Logistic regression analysis showed age, serum PSA, DRE, prostate volume, PCa family history, type of biopsy, and PI-RADSv2.0 as independent predictors of csPCa (Table 2), and a forest plot ranking the odds ratios is presented in Figure S1.
The ROC curves of mpMRI and MRI-PM in the development cohort are presented in Figure 2A. MRI-PM exhibited a net benefit of mpMRI over biopsying all men within the threshold, with a csPCa probability of 2%. MpMRI also exhibited a net benefit over biopsying all men (Figure 2B).
The AUC of the mpMRI increased from 0.842 (95% CI: 0.822–0.861) to 0.902 (95% CI: 0.880–0.914) of MRI-PM in the development cohort (p = 0.011). The efficacies of the mpMRI-PM were higher than those of mpMRI (p < 0.001) at 85%, 90%, and 95% sensitivities. At 90% sensitivity, the specificity of mpMRI was 56.8% (95% CI: 53.6–60.0) and that of MRI-PM was 69.5% (95% CI: 66.4–72.4; p < 0.001) (Table 3 (A)).
The MRI-PM derived nomogram is presented in Figure 3, and its calibration curve is presented in Figure S2A.
CUCs showing the rate of avoidable biopsies and the corresponding rate of potentially missed csPCa, regarding the continuous csPCa probability threshold, are presented in Figure 4.
Details of avoidable biopsies and the corresponding risk of missing csPCa detection, regarding the probability threshold for a development cohort of 1000 men with suspected PCa, are displayed with absolute values in Table S1 (A), and relative values in Table S2 (A). The 15% threshold was selected due to its 95% csPCa sensitivity, which corresponded with a 40% rate of avoidable biopsies. In PI-RADS 5, all csPCas would be correctly classified, and 0.5% of biopsies would be avoided. In PI-RADS 4, 0.6% of csPCas would be missed, and 4% of biopsies would be avoided. In PI-RADS 3, 28.2% of csPCa would be missed, and 61.9% of biopsies would be avoided. Finally, in PI-RADS < 3, an MRI-based predictive model would suggest biopsy in 4.3% of cases, and 33.3% of extremely infrequent csPCa in this scenario (4.2%) would be detected (Table 4 (A)). The discrimination ability of the MRI-based predictive model regarding PI-RADS categories is shown in Figure S3A, and its net benefits over biopsying all men regarding PI-RADS are presented in Figure S4A.

3.3. External Validation of MRI-PM and Its Performance

The calibration curve of the MRI-PM shows how the nomogram slightly underestimated csPCa occurrence in the external validation cohort. For instance, for a 20% csPCa probability provided by the model (X axis), the real incidence is approximately 25%; thus, the model underestimates real csPCa occurrence. The intercept (0.261) and slope (0.815) show this disagreement, which is probably due to a 4% higher csPCa incidence (40.8 vs. 36.9%) in the cohort (Figure S2B).
The ROC curves of MRI-PM in the external validation cohort and development cohort are presented in Figure 5A and DCA, showing the net benefit of MRI-PM in both the external validation cohort and the development cohort (presented in Figure 5B, respectively). The AUC of mpMRI in the external validation cohort was 0.743 (95% CI: 0.711–0.776) compared to 0.842 (95% CI: 0.822–0.861) in the development cohort (p < 0.001). The AUC of MRI-PM in the external validation cohort was 0.858 (95% CI: 0.833–0.883) while it was 0.897 (95% CI: 0.880–0.914) in the development cohort (p = 0.009) (Table 3 (A) and (B)). At 90% sensitivity for csPCa, the specificity of MRI-PM decreased from 52.3% to 41.3% in the external validation cohort (p < 0.001) (Table 3 (B)).
The CUCs of MRI-PMs in the external validation cohort are presented in Figure 4, where those in the development cohort are also presented. Details of avoided prostate biopsies regarding the csPCa probability thresholds, and the corresponding risk of non-detected csPCa for an external validation cohort of 1000 men, are displayed with absolute and relative values in Tables S1 (B) and S2 (B). At the 15% threshold, MRI-PM avoided 39.9% of prostate biopsies and missed 11.5% of csPCas. In PI-RADS 5, 2.4% of prostate biopsies would be avoided and 0.9% of csPCa would be missed. In PI-RADS 4, 7.3% of prostate biopsies would be avoided and 18.6% of csPCa would be missed. In PI-RADS 3, 63.2% of prostate biopsies would be avoided and 14% of csPCas would be missed. Finally, in men with PI-RADS < 3, MRI-PM would suggest biopsying 6.5% of them, detecting 18.2% of existing csPCa (Table 4 (B)). The discrimination ability of MRI-PM regarding PI-RADS categories is shown in the ROC curves in Figure S4A, and the net benefits over biopsying all men regarding PI-RADS categories are presented in the DCA in Figure S4B.

3.4. Web-RC Design

The validated nomogram was implemented in a web-diagnostic tool using RStudio v.1.2.5001 (RStudio Team, 2015; RStudio: Integrated Development for RStudio, Inc., Boston, MA, USA; URL: http://www.rstudio.com/; accessed on 12 April 2020) and the shiny library. The designed RC incorporates the novel option of selecting the csPCa probability threshold, and it is freely available at https://mripcaprediction.shinyapps.io/MRIPCaPrediction/ (accessed on 23 November 2020).

4. Discussion

Early detection of csPCa can improve even after the spread of MRI and guided biopsies. The proper individualised selection of candidates for prostate biopsy is the current challenge [6]. The most recent MRI-PMs include the latest versions of PI-RADS as well as the prostate volume derived from MRI [11,19,20,24]. Our model was developed from PI-RADS v2.0, which was always reported from 3-tesla mpMRI. The clinical independent predictors finally included in the developed MRI-PM, without a limited range, were the age, serum PSA, and prostate volume. We aimed to design an RC covering real clinical practice in contrast with others that limit the range of these predictors [12]. Ethnicity was not part of our developed model, since it was not an independent predictor of csPCa, perhaps because only one race was prevalent in both the development and external validation cohorts, in contrast to others [16]. PSAD, which is the most powerful predictor of csPCa after PI-RADS, has undergone increased use following the spread of MRI, providing the most accurate measurement of prostate volume without the additional cost [5,6,10]. Furthermore, PSAD appears to be an ideal predictor of csPCa for MRI-PM sharing due to its dynamic behavior across PI-RADS categories [7]. PSAD can be directly incorporated into models as a ratio [11,16,17,19,23,24], or indirectly through the serum PSA and the prostate volume, which also are independent predictors of csPCa [12,13,15,18,21,25]. Due to the observation of similar odds ratios of the two ways of expressing PSAD, we used serum PSA and prostate volume to avoid any calculation before the introduction of data into the RC. PSAD has been compared with some MRI-PMs, showing good performances compared to those MRI-PMs with inadequate calibration in the external validation cohorts [29]. We also included in our MRI-PM the type of biopsy (initial or repeat), since it was also an independent predictor and it provided greater clinical applicability than MRI-PM developed exclusively in biopsy-naïve men [20,21] or in men with previous negative biopsies [13,19,23,24].
External validation of developed model is a key point. It was carried out in a cohort selected in two representative institutions of the same metropolitan area where the MRI-PM was developed, using the same criteria of suspected PCa and the same diagnostic approach to csPCa. Even so, a non-significant 4-percentage-point difference in csPCa incidence of 36.9% vs. 40.8% was observed. This was stressful for the developed model, although its ability to discriminate csPCa remained accurate in the external validation cohort only, with minimal underestimation. We selected the 15% probability threshold of csPCa from development cohort due to its 95% sensitivity and avoidance of 40% of prostate biopsies. The same threshold provided a chance of avoiding 39.9% of biopsies with an 11.5% lack of csPCa detection in the external validation cohort. The clinical utility and net benefit of developed MRI-PMs over biopsying all men with PI-RADS > 3 was low in both the development and external validation cohorts. The avoidable biopsies would be 4% in PI-RADS 4 and 0.5% in PI-RADS 5 in the development cohort, and 7.3% and 2.4%, respectively, in the external validation cohort. CsPCa would be undetected in 0.6% and 0%, and 1.9% and 0.9%, respectively, in the development and external validation cohorts. The performance and net benefit in men with PI-RADS < 3 was better. In men with PI-RADS 3, 61.9% and 62.3% of prostate biopsies would be avoided in the development and external validation cohorts, respectively, while 28.2% and 14% of the few existing csPCas would be undetected. Finally, in men with normal mpMRIs (PI-RADS < 3), 4.3% and 6.5% would be biopsied, respectively, in the developed and external validation cohorts, detecting 33.3% and 18.2% of existing csPCa, respectively. In these low and intermediate PI-RADS categories, the absolute number of undetected csPCa is low due to the limited number of existing csPCa that did not reach rates higher than 5–10% of all detected csPCa.
External validations in populations where predictive models are going to be used are essential, and accessible and friendly RC are needed to avoid the cumbersome and time-consuming use of nomograms [11,12]. A novelty of our designed RC is the option to select the csPCa probability threshold for the overall population or according to the PI-RADS categories. The threshold can be adapted to the overall csPCa incidence of external validation populations [30]. In addition, the threshold selection can also improve the usefulness of the model in specific PI-RADS categories. For example, if we find it unacceptable that 28% of existing csPCa in men with PI-RADS 3 are not detected, we can select the csPCa probability threshold of 7%, which results in 11% of csPCa missing; however, it will result in 26% avoided prostate biopsies instead of 62%. This is the first time that the behavior of any MRI-PM for csPCa has been analysed according to the PI-RADS categories. This analysis shows that the usefulness of MRI-PM is limited in men with PI-RADS >3, and especially in men with PI-RADS 5, in whom the biopsy must be always. High PI-RADS categories exhibit high rates of csPCa; therefore, loosing small rates of csPCa, in addition to their greater aggressiveness, is dangerous [27,31,32,33,34,35].
We developed a new MRI-PM for csPCa and externally validated it, initially in the same metropolitan area. An accessible and friendly RC was designed for its easy and widespread use. The novelty of selecting the csPCa probability threshold may be helpful in new external validations and to modulate the desired sensitivity to csPCa in each PI-RADS category. Rather than limitations, we believe that local reporting by experienced radiologists following PI-RADS v.2 [27]; local experienced pathologists reporting ISUP grades [28]; and local experienced urologist performing biopsies according to the recommended EAU scheme [1] are strengths, because they represent real-life early detection of csPCa. We believe a true limitation of our MRI-PM is the prediction of csPCa made in prostate biopsies, which do not represent the true pathology in whole prostate gland [36]. Our model cannot be implemented in populations where ethnicity predicts different risk of csPCa. The applicability of our developed predictive model in other contemporary populations is unknown and should be evaluated in future studies; these include non-academic populations or in referred populations for prostate biopsy centers with a different case-mix of PI-RADS and csPCa incidence. Performing guided biopsies using a cognitive-fusion technique does not seem to be a limitation, since all men in the development and validation cohorts underwent the same technique, and no difference with the software fusion-guided technique has been found [37]. Further validations in cohorts in which other biopsy schemes and fusion techniques are used are needed. Finally, genomics must report a deeper understanding of PCa aggressiveness, and will help to improve the current csPCa definition. Thus, in the near future, radiomics will be able to predict the newly redefined csPCa [38].

5. Conclusions

A new MRI-PM for csPCa was developed to improve and individualise the selection of candidates for prostate biopsy in the metropolitan area of Barcelona, Spain. An associated web-RC incorporates the option to select the csPCa probability threshold, which may improve further external validations and outperformances in specific PI-RADS categories. The developed MRI-PM was able to detect 95% of existing csPCa, avoiding 40% of prostate biopsies in our overall population. However, the analysis regarding PI-RADS categories shows that the developed MRI-PM outperforms in PI-RADS < 3.

Supplementary Materials

The following supporting information can be downloaded at: https://0-www-mdpi-com.brum.beds.ac.uk/article/10.3390/cancers14061589/s1, Figure S1: Forest plot of the odds ratios of independent predictors of csPCa in the development cohort; Figure S2: Calibration curve of MRI-PM in development cohort (A) and external validation cohort (B); Table S1: Estimation, in a 1000-case development cohort (A) and external validation cohort (B), of absolute missed csPCa and avoided biopsies for different thresholds and PI-RADS v.2.0 categories; Table S2: Estimation, in a 1000-case development cohort (A) and validation cohort (B), of relative values of missed csPCa and avoided biopsies for different thresholds and PI-RADS categories; Figure S3: Boxplots of the likelihoods of csPCa in men overall and regarding PI-RADS categories in development cohort (A) and external validation cohort (B); Figure S4: DCAs showing the net benefit of generated mpMRI-based predictive model over biopsying all men, according to the PI-RADS categories <3 (upper left), 3 (upper right), 4 (lower left), and 5 (lower right) in the development cohort (A), and the validation cohort (B).

Author Contributions

Conceptualization, J.M., A.B.-F. and L.M.E.; methodology, J.M., A.B.-F. and L.M.E.; software, L.M.E.; validation, L.M.E.; formal analysis, L.M.E.; investigation, J.M., A.B.-F., L.M.E.; resources, J.M.; data curation, M.T., A.C., L.R., M.E., R.M., I.M.d.T., M.E.S., J.M.A., C.S., P.S., D.S., A.S., J.P.; writing—original draft preparation, J.M.; writing—review and editing, J.M., A.B.-F., L.M.E.; supervision, E.T.; project administration, J.M.; funding acquisition, J.M. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Instituto de Salud Carlos III (ESP), grant number PI20/01666.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki and approved by the Institutional Review of the Vall d´Hebron Hospital Campus (PR/AG-317/2017, approved on 28 August 2017).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are available on request from the corresponding author.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Mottet, N.; van den Bergh, R.C.N.; Briesrs, E.; Briers, E.; Van den Broeck, T.; Cumberbatch, M.G.; De Santis, M.; Fanti, S.; Fossati, N.; Gandaglia, G.; et al. EAU-EANM-ESTRO-ESUR-SIOG Guidelines on Prostate Cancer-2020 Update. Part 1: Screening, Diagnosis, and Local Treatment with Curative Intent. Eur. Urol. 2021, 79, 243–262. [Google Scholar] [CrossRef] [PubMed]
  2. Drazer, M.W.; Huo, D.; Eggener, S.E. National Prostate Cancer Screening Rates After the 2012 US Preventive Services Task Force Recommendation Discouraging Prostate-Specific Antigen-Based Screening. J. Clin. Oncol. 2015, 33, 2416–2423. [Google Scholar] [CrossRef] [PubMed]
  3. Ahmed, H.U.; El-Shater Bosaily, A.; Brown, L.C.; Gabe, R.; Kaplan, R.; Parmar, M.K.; Collaco-Moraes, Y.; Ward, K.; Hindley, R.G.; Freeman, A.; et al. Diagnostic accuracy of multi-parametric MRI and TRUSbiopsy in prostate cancer (PROMIS): A paired validating confirmatory study. Lancet 2017, 389, 815–822. [Google Scholar] [CrossRef] [Green Version]
  4. Schoots, I.G.; Padhani, A.R.; Rouvière, O.; Barentsz, J.O.; Richenberg, J. Analysis of Magnetic Resonance Imaging-directed Biopsy Strategies for Changing the Paradigm of Prostate Cancer Diagnosis. Eur. Urol. Oncol. 2020, 3, 32–41. [Google Scholar] [CrossRef]
  5. Van Poppel, H.; Roobol, M.J.; Chapple, C.R.; Catto, J.W.F.; N’Dow, J.; Sønksen, J.; Stenzl, A.; Wirth, M. Prostate-specific Antigen Testing as Part of a Risk-Adapted Early Detection Strategy for Prostate Cancer: European Association of Urology Position and Recommendations for 2021. Eur. Urol. 2021, 80, 703–711. [Google Scholar] [CrossRef]
  6. Van Poppel, H.; Hogenhout, R.; Albers, P.; van den Bergh, R.C.N.; Barentsz, J.O.; Roobol, M.J. A European Model for an Organised Risk-stratified Early Detection Programme for Prostate Cancer. Eur. Urol. Oncol. 2021, 4, 731–739. [Google Scholar] [CrossRef]
  7. Morote, J.; Celma, A.; Diaz, F.; Regis, L.; Roche, S.; Mast, R.; Semidey, M.E.; de Torres, I.M.; Planas, J.; Trilla, E. Prostatic-specific antigen density behavior according to multiparametric magnetic resonance imaging result. Urol. Oncol. 2020, 38, 410–417. [Google Scholar] [CrossRef]
  8. Schoots, I.G.; Roobol, M.J. Multivariate risk prediction tools including MRI for individualized biopsy decision in prostate cancer diagnosis: Current status and future directions. World J. Urol. 2020, 38, 517–529. [Google Scholar] [CrossRef] [Green Version]
  9. Becerra, M.F.; Atluri, V.S.; Bhattu, A.S.; Punnen, S. Serum and urine biomarkers for detecting clinically significant prostate cancer. Urol. Oncol. 2021, 39, 686–690. [Google Scholar] [CrossRef]
  10. Dianat, S.S.; Rancier Ruiz, R.M.; Bonekamp, D.; Carter, H.B.; Macura, K.J. Prostate volumetric assessment by magnetic resonance imaging and transrectal ultrasound: Impact of variation in calculated prostate-specific antigen density on patient eligibility for active surveillance program. J. Comput. Assist. Tomogr. 2013, 37, 589–595. [Google Scholar] [CrossRef]
  11. Borque-Fernando, A.; Esteban, L.M.; Celma, A.; Regis, L.; de Torres, I.M.; Semidey, M.E.; Trilla, E.; Morote, J. How to implement magnetic resonance imaging before prostate biopsy in clinical practice: Nomograms for saving biopsies. World J. Urol. 2019, 38, 1481–1491. [Google Scholar] [CrossRef] [PubMed]
  12. Alberts, A.R.; Roobol, M.J.; Verbeek, J.F.M.; Schoots, I.G.; Chiu, P.K.; Osses, D.F.; Tijsterman, J.D.; Beerlage, H.P.; Mannaerts, C.K.; Schimmöller, L.; et al. Prediction of High-grade Prostate Cancer Following Multiparametric Magnetic Resonance Imaging: Improving the Rotterdam European Randomized Study of Screening for Prostate Cancer Risk Calculators. Eur. Urol. 2019, 75, 310–318. [Google Scholar] [CrossRef] [PubMed]
  13. Fang, D.; Zhao, C.; Ren, D.; Yu, W.; Wang, R.; Wang, H.; Li, X.; Yin, W.; Yu, X.; Yang, K.; et al. Could Magnetic Resonance Imaging Help to Identify the Presence of Prostate Cancer Before Initial Biopsy? The Development of Nomogram Predicting the Outcomes of Prostate Biopsy in the Chinese Population. Ann. Surg. Oncol. 2016, 23, 4284–4292. [Google Scholar] [CrossRef] [PubMed]
  14. Kim, E.H.; Weaver, J.K.; Shetty, A.S.; Vetter, J.M.; Andriole, G.L.; Strope, S.A. Magnetic Resonance Imaging Provides Added Value to the Prostate Cancer Prevention Trial Risk Calculator for Patients With Estimated Risk of High-grade Prostate Cancer Less Than or Equal to 10. Urology 2017, 102, 183–189. [Google Scholar] [CrossRef]
  15. Radtke, J.P.; Wiesenfarth, M.; Kesch, C.; Freitag, M.T.; Alt, C.D.; Celik, K.; Distler, F.; Roth, W.; Wieczorek, K.; Stock, C.; et al. Combined Clinical Parameters and Multiparametric Magnetic Resonance Imaging for Advanced Risk Modeling of Prostate Cancer-Patient-tailored Risk Stratification Can Reduce Unnecessary Biopsies. Eur. Urol. 2017, 72, 888–896. [Google Scholar] [CrossRef]
  16. Bjurlin, M.A.; Rosenkrantz, A.B.; Sarkar, S.; Lepor, H.; Huang, W.C.; Huang, R.; Venkataraman, R.; Taneja, S. Prediction of Prostate Cancer Risk Among Men Undergoing Combined MRI-targeted and Systematic Biopsy Using Novel Pre-biopsy Nomograms That Incorporate MRI Findings. Urology 2018, 112, 112–120. [Google Scholar] [CrossRef]
  17. Lee, S.M.; Liyanage, S.H.; Wulaningsih, W.; Wolfe, K.; Carr, T.; Younis, C.; Van Hemelrijck, M.; Popert, R.; Acher, P. Toward an MRI-based nomogram for the prediction of transperineal prostate biopsy outcome: A physician and patient decision tool. Urol. Oncol. 2017, 35, 66411–66418. [Google Scholar] [CrossRef] [Green Version]
  18. Van Leeuwen, P.J.; Hayen, A.; Thompson, J.E.; James, E.; Moses, D.; Shnier, R.; Böhm, M.; Abuodha, M.; Haynes, A.M.; Ting, F.; et al. Multiparametric magnetic resonance imaging-based risk model to determine the risk of significant prostate cancer prior to biopsy. BJU Int. 2017, 120, 774–781. [Google Scholar] [CrossRef] [Green Version]
  19. Niu, X.K.; Li, J.; Das, S.K.; Yang, C.B.; Peng, T. Developing a nomogram based on multiparametric magnetic resonance imaging for forecasting high-grade prostate cancer to reduce unnecessary biopsies within the prostate-specific antigen gray zone. BMC Med. Imaging 2017, 17, 11. [Google Scholar] [CrossRef] [Green Version]
  20. Truong, M.; Wang, B.; Gordetsky, J.B.; Nix, J.W.; Frye, T.P.; Messing, E.M.; Thomas, J.V.; Feng, C.; Rais-Bahrami, S. Multi-institutional nomogram predicting benign prostate pathology on magnetic resonance/ultrasound fusion biopsy in men with a prior negative 12-core systematic biopsy. Cancer 2018, 124, 278–285. [Google Scholar] [CrossRef] [Green Version]
  21. Huang, C.; Song, G.; Wang, H.; Li, J.; Chen, Y.; Fan, Y.; Fang, D.; Xiong, G.; Xin, Z.; Zhou, L. Multiparametric Magnetic Resonance Imaging-Based Nomogram for Predicting Prostate Cancer and Clinically Significant Prostate Cancer in Men Undergoing Repeat Prostate Biopsy. Biomed. Res. Int. 2018, 6368309. [Google Scholar] [CrossRef] [Green Version]
  22. Mehralivand, S.; Shih, J.H.; Rais-Bahrami, S.; Oto, A.; Bednarova, S.; Nix, J.W.; Thomas, J.V.; Gordetsky, J.B.; Gaur, S.; Harmon, S.A.; et al. A Magnetic Resonance Imaging-Based Prediction Model for Prosate Biopsy Risk Stratification. JAMA Oncol. 2018, 4, 678–685. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  23. Boesen, L.; Thomsen, F.B.; Nørgaard, N.; Løgager, V.; Balslev, I.; Bisbjerg, R.; Thomsen, H.S.; Jakobsen, H. A predictive model based on biparametric magnetic resonance imaging and clinical parameters for improved risk assessment and selection of biopsy-naïve men for prostate biopsies. Prostate Cancer Prostatic Dis. 2019, 2, 311–319. [Google Scholar] [CrossRef] [PubMed]
  24. Noh, T.I.; Hyun, C.W.; Kang, H.E.; Jin, H.J.; Tae, J.H.; Shim, J.S.; Kang, S.G.; Sung, D.J.; Cheon, J.; Lee, J.G.; et al. A Predictive Model Based on Bi-parametric Magnetic Resonance Imaging and Clinical Parameters for Clinically Significant Prostate Cancer in the Korean Population. Cancer Res. Treat. 2021, 53, 1148–1155. [Google Scholar] [CrossRef]
  25. Chen, I.A.; Chu, C.H.; Lin, J.T.; Tsai, J.Y.; Yu, C.C.; Sridhar, A.N.; Sooriakumaran, P.; Loureiro, R.C.V.; Chand, M. Prostate Cancer Risk Calculator Apps in a Taiwanese Population Cohort: Validation Study. J. Med. Internet Res. 2020, 22, e16322. [Google Scholar] [CrossRef]
  26. Bossuyt, P.M.; Reitsma, J.B.; Bruns, D.E.; Korevaar, D.A.; STARD Group. STARD 2015: An updated list of essential items for reporting diagnostic accuracy studies. BMJ 2015, 351, h5527. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  27. Weinreb, J.C.; Barentsz, J.O.; Choyke, P.L.; Choyke, P.L.; Cornud, F.; Haider, M.A.; Macura, K.J.; Margolis, D.; Schnall, M.D.; Shtern, F.; et al. PI-RADS Prostate Imaging—Reporting and Data System: 2015, Version 2. Eur. Urol. 2016, 69, 16–40. [Google Scholar] [CrossRef]
  28. Epstein, J.I.; Egevad, L.; Amin, M.B.; Delahunt, B.; Srigley, J.R.; Humphrey, P.A.; Grading Committee. The 2014 International Society of Urological Pathology (ISUP) Consensus Conference on Gleason Grading of Prostatic Carcinoma: Definition of Grading Patterns and Proposal for a New Grading System. Am. J. Surg. Pathol. 2016, 40, 244–252. [Google Scholar] [CrossRef]
  29. Deniffel, D.; Healy, G.M.; Dong, X.; Ghai, S.; Salinas-Miranda, E.; Fleshner, N.; Hamilton, R.; Kulkarni, G.; Toi, A.; van der Kwast, T.; et al. Avoiding Unnecessary Biopsy: MRI-based Risk Models versus a PI-RADS and PSA Density Strategy for Clinically Significant Prostate Cancer. Radiology 2021, 300, 369–379. [Google Scholar] [CrossRef]
  30. Remmers, A.; Kasivisvanathan, V.; Verbeek, J.; Moore, C.M.; Roobol, M.J.; ERSPC Rotterdam Study Group and PRECISION Investigators Group. Reducing Biopsies and Magnetic Resonance Imaging Scans During the Diagnostic Pathway of Prostate Cancer: Applying the Rotterdam Prostate Cancer Risk Calculator to the PRECISION Trial Data. Eur. Urol. Open Sci. 2022, 36, 1–8. [Google Scholar] [CrossRef]
  31. Mazzone, E.; Stabile, A.; Pellegrino, F.; Basile, G.; Cignoli, D.; Cirulli, G.O.; Sorce, G.; Barletta, F.; Scuderi, S.; Bravi, C.A.; et al. Positive Predictive Value of Prostate Imaging Reporting and DataSystem Version 2 for the Detection of Clinically Significant Prostate Cancer: A Systematic Review and Meta-analysis. Eur. Urol. Oncol. 2020, 4, 697–713. [Google Scholar] [CrossRef] [PubMed]
  32. Schoots, I.G. MRI in early prostate cancer detection: How to manage indeterminate or equivocal PI-RADS 3lesions. Transl. Urol. 2018, 7, 70–82. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  33. Osses, D.F.; Roobol, M.J.; Schoots, I.G. Prediction Medicine: Biomarkers, Risk Calculators and Magnetic Resonance Imaging as Risk Stratification Tools in Prostate Cancer Diagnosis. Int. J. Mol. Sci. 2019, 20, 1637. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  34. Abreu-Gomez, J.; Wu, M.; McInnes, M.D.F.; Thornhill, R.E.; Flood, T.A.; Schieda, N. Shape Analysis of Peripheral Zone Observations on Prostate DWI: Correlation to Histopathology Outcomes After Radical Prostatectomy. AJR. Am. J. Roentgenol. 2020, 214, 1239–1247. [Google Scholar] [CrossRef]
  35. Boschheidgen, M.; Schimmöller, L.; Arsov, C.; Ziayee, F.; Morawitz, J.; Valentin, B.; Radke, K.L.; Giessing, M.; Esposito, I.; Albers, P.; et al. MRI grading for the prediction of prostate cancer aggressiveness. Eur. Radiol. 2021, 32, 2351–2359. [Google Scholar] [CrossRef] [PubMed]
  36. Rapisarda, S.; Bada, M.; Crocetto, F.; Barone, B.; Arcaniolo, D.; Polara, A.; Imbimbo, C.; Grosso, G. The role of multiparametric resonance and biopsy in prostate cancer detection: Comparison with definitive histological report after laparoscopic/robotic radical prostatectomy. Abdom. Radiol. 2020, 45, 4178–4184. [Google Scholar] [CrossRef] [PubMed]
  37. Khoo, C.; Eldred-Evans, D.; Peters, M.; van Son, M.; van Rossum, P.S.N.; Connor, M.J.; Hosking-Jervis, F.; Tanaka, M.B.; Reddy, D.; Bass, E.; et al. Comparison of Prostate Cancer Detection between Visual Estimation (Cognitive Registration) and Image Fusion (Software Registration) Targeted Transperineal Prostate Biopsy. J. Urol. 2021, 205, 1075–10781. [Google Scholar] [CrossRef] [PubMed]
  38. Ferro, M.; de Cobelli, O.; Vartolomei, M.D.; Lucarelli, G.; Crocetto, F.; Barone, B.; Sciarra, A.; Del Giudice, F.; Muto, M.; Maggi, M.; et al. Prostate Cancer Radiogenomics-From Imaging to Molecular Characterization. Int. J. Mol. Sci. 2021, 22, 9971. [Google Scholar] [CrossRef]
Figure 1. Flow chart of development cohort creation: inclusion and exclusion criteria.
Figure 1. Flow chart of development cohort creation: inclusion and exclusion criteria.
Cancers 14 01589 g001
Figure 2. ROC curves showing the efficiency of MRI and MRI-PM in the development cohort (A). DCAs evaluating the net benefit of MRI and MRI-PM over biopsying all men belonging to the development cohort (B).
Figure 2. ROC curves showing the efficiency of MRI and MRI-PM in the development cohort (A). DCAs evaluating the net benefit of MRI and MRI-PM over biopsying all men belonging to the development cohort (B).
Cancers 14 01589 g002
Figure 3. Nomogram derived from the developed MRI-PM model of csPCa in prostate biopsies.
Figure 3. Nomogram derived from the developed MRI-PM model of csPCa in prostate biopsies.
Cancers 14 01589 g003
Figure 4. CUCs showing the rates of avoided biopsies (red lines) and corresponding missed csPCa (blue lines) regarding the continuous threshold of csPCa probability using MRI-PMs in development cohort (continuous lines) and external validation cohorts (interrupted lines).
Figure 4. CUCs showing the rates of avoided biopsies (red lines) and corresponding missed csPCa (blue lines) regarding the continuous threshold of csPCa probability using MRI-PMs in development cohort (continuous lines) and external validation cohorts (interrupted lines).
Cancers 14 01589 g004
Figure 5. (A) ROC curves showing the efficacy of MRI-PM in development cohort and external validation cohort; (B) DCAs analysing the net benefit of MRI-PM in development (red interrupted line) and external validation (blue interrupted line) cohort over biopsying all men (continuous grey line).
Figure 5. (A) ROC curves showing the efficacy of MRI-PM in development cohort and external validation cohort; (B) DCAs analysing the net benefit of MRI-PM in development (red interrupted line) and external validation (blue interrupted line) cohort over biopsying all men (continuous grey line).
Cancers 14 01589 g005
Table 1. Characteristics of men suspected to have PCa in development and external validation cohorts and comparisons between them.
Table 1. Characteristics of men suspected to have PCa in development and external validation cohorts and comparisons between them.
CharacteristicDevelopment CohortExternal Validation Cohortp Value
Number of men1486946-
Caucasian race, n (%)1465 (98.6)931 (98.4)0.738
Median age at biopsy (IQR), years69 (62–74)67 (61–72)<0.001
Median serum PSA (IQR), ng/mL6.0 (4.4–9.2)7.4 (5.5–10.9)<0.001
Abnormal DRE, n (%)329 (22.1)283 (29.9)<0.001
PCa family history, n (%)127 (8.5)34 (3.6)<0.001
Median prostate volume (IQR), mL55 (40–76)55 (40–78)0.559
Prior negative prostate biopsy, n (%)388 (26.1)293 (31.0)0.010
PI-RADS v.2.0, n (%)
 1242 (16.3)185 (19.6)<0.001
 273 (4.9)50 (5.3)
 3444 (29.9)201 (21.2)
 4450 (30.3)391 (41.3)
 5277 (18.6)119 (12.6)
PCa detection, n (%)693 (46.6)521 (55.1)<0.001
csPCa detection, n (%)548 (36.9)386 (40.8)0.054
iPCa detection, n (%)145 (9.8)135 (14.3)<0.001
IQR = interquartile range; n = number; PSA = prostate-specific antigen; DRE = digital rectal examination; PI-RADS = Prostate Imaging-Reporting and Data System; PCa = prostate cancer; csPCa = clinically significant PCa; iPCa = insignificant PCa.
Table 2. Logistic regression analysis of independent significant predictors of csPCa in prostate biopsies.
Table 2. Logistic regression analysis of independent significant predictors of csPCa in prostate biopsies.
PredictorOdds Ratio (95% CI)p Value
Age at prostate biopsy, ref. prior year1.056 (1.036–1.077)<0.001
Serum PSA, ref. prior ng/mL1.085 (1.056–1.114)<0.001
DRE, ref. normal.1.730 (1.195–2.503)0.004
Prostate volume, ref. prior mL0.970 (0.964–0.977)<0.001
Family history of PCa, ref. no1.788 (1.066–3.002)0.028
Biopsy type, ref. initial0.668 (0.478–0.934)0.018
PI-RADS v.2.0 score, 2 to ref. 13.311 (1.008–10.879)0.048
3 to ref. 16.551 (2.740–15.661)<0.001
4 to ref. 132.088 (13.660–75.377)<0.001
5 to ref. 175.673 (30.738–186.311)<0.001
CI = confidence interval; PSA = prostate-specific antigen; DRE = digital rectal examination; PI-RADSv.2 = Prostate Imaging-Reporting and Data System v.2.; ref. = referenced to.
Table 3. Efficacy of mpMRI and MRI-based predictive model analysed from the AUCs and specificities corresponding to the 85%, 90% and 95% sensitivity thresholds for csPCa, in development cohort (A) and external validation cohort (B).
Table 3. Efficacy of mpMRI and MRI-based predictive model analysed from the AUCs and specificities corresponding to the 85%, 90% and 95% sensitivity thresholds for csPCa, in development cohort (A) and external validation cohort (B).
PredictorDevelopment Cohort (A)External Validation Cohort (B)
AUC (95% CI)Specificities According to SensitivityAUC (95% CI)Specificities According to Sensitivity
85%90%95%85%90%95%
mpMRI0.842 (0.822–0.861)72.4 (69.4–75.2%)56.8 (53.6–60.0)40.7 (37.5–43.9)0.743 (0.711–0.776)45.5 (41.3–49.7)41.3 (32.9–48.3)14.3 (11.6–17.5)
MRI-PM0.897 (0.880–0.914)78.1% (75.3–80.7)69.5 (66.4–72.4)55.7 (52.5–58.9)0.858 (0.833–0.883)67.7 (63.6–71.5)52.3 (48.1–56.5)32.3 (28.5–36.4)
p Value=0.011p = 0.005<0.001<0.001<0.001<0.001<0.001<0.001
mpMRI = multiparametric magnetic resonance imaging; MRI-PM = MRI-based predictive model; AUC = area under the curve; CI = confidence interval.
Table 4. Clinical utility of MRI-based predictive model in terms of avoidable prostate biopsies and potentially missed csPCa in a 1000-sample-size development cohort (A) and external validation cohort (B), using the 15% threshold and regarding PI-RADS categories.
Table 4. Clinical utility of MRI-based predictive model in terms of avoidable prostate biopsies and potentially missed csPCa in a 1000-sample-size development cohort (A) and external validation cohort (B), using the 15% threshold and regarding PI-RADS categories.
PI-RADSDevelopment Cohort (A)External Validation Cohort (B)
Missed csPCaAvoidable BiopsiesMissed csPCaAvoidable Biopsies
1–2, n (%)6/9 (66.7)203/212 (95.7)36/44 (81.8)232/248 (93.5)
3, n (%)13/46 (28.2)185/299 (61.9)6/43 (14.0)134/212 (63.2)
4, n (%)1/159 (0.6)12/303 (4.0)4/215 (1.9)30/413 (7.3%)
5, n (%)0/155 (0)1/186 (0.5)1/106 (0.9)3/126 (2.4)
All, n (%)20/369 (5.4)401/1000 (40.1)47/408 (11.5)399/1000 (39.9)
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Morote, J.; Borque-Fernando, A.; Triquell, M.; Celma, A.; Regis, L.; Escobar, M.; Mast, R.; de Torres, I.M.; Semidey, M.E.; Abascal, J.M.; et al. The Barcelona Predictive Model of Clinically Significant Prostate Cancer. Cancers 2022, 14, 1589. https://0-doi-org.brum.beds.ac.uk/10.3390/cancers14061589

AMA Style

Morote J, Borque-Fernando A, Triquell M, Celma A, Regis L, Escobar M, Mast R, de Torres IM, Semidey ME, Abascal JM, et al. The Barcelona Predictive Model of Clinically Significant Prostate Cancer. Cancers. 2022; 14(6):1589. https://0-doi-org.brum.beds.ac.uk/10.3390/cancers14061589

Chicago/Turabian Style

Morote, Juan, Angel Borque-Fernando, Marina Triquell, Anna Celma, Lucas Regis, Manel Escobar, Richard Mast, Inés M. de Torres, María E. Semidey, José M. Abascal, and et al. 2022. "The Barcelona Predictive Model of Clinically Significant Prostate Cancer" Cancers 14, no. 6: 1589. https://0-doi-org.brum.beds.ac.uk/10.3390/cancers14061589

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop