SYSTEMATIC REVIEW article

Front. Oncol., 08 February 2021

Sec. Surgical Oncology

Volume 10 - 2020 | https://doi.org/10.3389/fonc.2020.539592

Predictive Factors for Positive Surgical Margins in Patients With Prostate Cancer After Radical Prostatectomy: A Systematic Review and Meta-Analysis

  • Department of Urology, Affiliated Jiang-yin Hospital of the Southeast University Medical College, Jiang-yin, China

Abstract

Background and Objectives:

Previous studies have demonstrated that positive surgical margins (PSMs) were independent predictive factors for biochemical and oncologic outcomes in patients with prostate cancer (PCa). This study aimed to conduct a meta-analysis to identify the predictive factors for PSMs after radical prostatectomy (RP).

Methods:

We selected eligible studies via the electronic databases, such as PubMed, Web of Science, and EMBASE, from inception to December 2020. The risk factors for PSMs following RP were identified. The pooled estimates of standardized mean differences (SMDs)/odds ratios (ORs) and 95% confidence intervals (CIs) were calculated. A fixed effect or random effect was used to pool the estimates. Subgroup analyses were performed to explore the reasons for heterogeneity.

Results:

Twenty-seven studies including 50,014 patients with PCa were eligible for further analysis. The results showed that PSMs were significantly associated with preoperative prostate-specific antigen (PSA) (pooled SMD = 0.37; 95% CI: 0.31–0.43; P < 0.001), biopsy Gleason Score (<6/≥7) (pooled OR = 1.53; 95% CI:1.31–1.79; P < 0.001), pathological Gleason Score (<6/≥7) (pooled OR = 2.49; 95% CI: 2.19–2.83; P < 0.001), pathological stage (<T2/≥T3) (pooled OR = 3.90; 95% CI: 3.18–4.79; P < 0.001), positive lymph node (PLN) (pooled OR = 3.12; 95% CI: 2.28–4.27; P < 0.001), extraprostatic extension (EPE) (pooled OR = 4.44; 95% CI: 3.25–6.09; P < 0.001), and seminal vesicle invasion (SVI) (pooled OR = 4.19; 95% CI: 2,87–6.13; P < 0.001). However, we found that age (pooled SMD = 0.01; 95% CI: −0.07–0.10; P = 0.735), body mass index (BMI) (pooled SMD = 0.12; 95% CI: −0.05–0.30; P = 0.162), prostate volume (pooled SMD = −0.28; 95% CI: −0.62–0.05; P = 0.097), and nerve sparing (pooled OR = 0.90; 95% CI: 0.71–1.14; P = 0.388) had no effect on PSMs after RP. Besides, the findings in this study were found to be reliable by our sensitivity and subgroup analyses.

Conclusions:

Preoperative PSA, biopsy Gleason Score, pathological Gleason Score, pathological stage, positive lymph node, extraprostatic extension, and seminal vesicle invasion are independent predictors of PSMs after RP. These results may helpful for risk stratification and individualized therapy in PCa patients.

Introduction

Prostate cancer (PCa) is the most common type of newly diagnosed malignancy and a leading cause of cancer-related death in males worldwide (1). With the wide use of the prostate−specific antigen (PSA) screening test, the majority of PCa patients are diagnosed in the early stages (2). As a result, radical prostatectomy (RP) with bilateral pelvic lymph node dissection has been the gold standard for the treatment of patients with localized PCa (3). The goal of RP for PCa is complete prostate extirpation; despite favorable cancer control associated with RP, approximately 25% of all patients experience biochemical recurrence (BCR) (4). A number of factors have been found to be associated with BCR after RP, and one adverse risk factor is the presence of positive surgical margins (PSMs).

PSMs are defined as an extension of cancer cells to the inked cut surface of the RP specimen (5). Our previous findings have indicated that PSMs are significantly associated with BCR and poor survival outcome after RP (6, 7). However, none of the systematic research studies have reported about the factors that may affect the margin status of PCa after RP. Conventional parameters for risk estimation of PSMs are mainly based on factors, including preoperative PSA (p-PSA), pathological T stage, pathological Gleason Score (GS), and multiple positive biopsy cores (811). However, the prognostic value of these predictive factors is limited. Besides, PSMs may be affected by remnant normal tissue and inadequate surgical skill (12). Therefore, no consensus has been reported regarding the above results. Based on these considerations, a comprehensive meta-analysis and systematic review was necessary to evaluate the predictive factors for PSMs in PCa patients following RP.

Materials and Methods

Literature and Search Strategy

We carried out this meta-analysis in accordance with the guidelines of the Preferred Reporting Items for Systematic Review and Meta-Analyses statement (PRISMA) (13). A comprehensive literature search was conducted using the PubMed, Web of Science, Wanfang, and China National Knowledge Infrastructure (CNKI) databases. Search strategies were based on the combination of Medical Subject Headings (MeSH) and keywords as follows: “prostate cancer,” “radical prostatectomy,” “positive surgical margin,” “clinicopathological” and “risk factors.” The last search was conducted on December 2020. Meanwhile, to identify other eligible publications, reference lists were also screened manually. The language was restricted to English and Chinese. Because we did not perform clinical research in this study, no ethical approval was needed and all analyses were based on previously published literatures.

Selection Criteria and Data Extraction

Papers were included in this meta-analysis if they met the following criteria: (1) all patients with a diagnosis of PCa and PSMs were histopathologically confirmed; (2) treatment was limited to RP; (3) clinicopathological features were analyzed according to the surgical margins status, and all studies had a comparable study design; (4) standardized mean differences (SMDs)/odds ratios (ORs) and 95% confidence intervals (CIs) were reported in the paper or could be computed from the given data; (5) if more than one article was identified in the same cohort, the most comprehensive and largest dataset was adopted. Accordingly, studies with the following criteria were excluded: (1) case reports, review articles, editorials, and non-original articles; (2) papers not published in English and Chinese; (3) studies that did not analyze the PSMs and clinical features; (4) studies lacking sufficient data to acquire SMDs/ORs and 95% CIs. Literature search was independently performed by two investigators. Disagreement was resolved by discussion.

Data Extraction and Quality Assessment

Two researchers (BW and ZZ) assessed the titles and abstracts of the searched studies, respectively. Any disagreements were reconciled by a third researcher (JY). The following information was extracted from the included studies: publication information (first author’s last name, publication year, country of origin, and study design), patients’ characteristics (mean age, p-PSA, and follow-up time), and PCa outcomes (tumor stage, GS, and oncologic outcomes). According to the Newcastle–Ottawa quality assessment scale (NOS) (14), two researchers (HZ and YF) independently assessed the quality of each study. According to its criteria, the NOS estimates studies based on the following three parts: selection, comparability, and outcome assessment. For quality assessment, scores ranged from 0 to 9, and studies with scores of 6 or more were rated as being of high quality.

Statistical Analysis

For this meta-analysis, pooled SMDs/ORs with 95% CIs were used to describe the relationship between risk factors and PSMs. An OR >1 or SMD >0 suggested a close relationship of PSMs in patients with PCa. Heterogeneity among studies was evaluated by using Cochran’s Q test and Higgins I-squared statistic. If the I2 value was >50% or the Pheterogeneity was <0.1, it suggested a statistically significant heterogeneity in the included studies, and a random-effects (RE) model was adopted; otherwise, a fixed-effects (FE) model was used. To consider the potential reason for heterogeneity, subgroup analysis was conducted. To test the stability of the result, we performed a sensitivity analysis by excluding one study in turn. Visual inspection of asymmetry in funnel plots was carried out to assess the potential publication bias. Furthermore, we performed Egger’s tests to provide quantitative evidence of publication bias. These statistical analyses or data syntheses were calculated using STATA version 12.0 (Stata Corporation, College Station, TX, USA). All statistical tests were two sided, and P < 0.05 was considered statistically significant.

Results

Literature Search

A flowchart of the literature selection process is shown in Figure 1. The initial search of electronic databases identified 1,568 records according to the search criteria; after the duplicates were removed, 883 papers remained behind. A total of 588 papers were then excluded by screening the titles and abstracts. Then, 295 full-text articles were further examined and 268 articles were excluded because 27 articles included the same cohort of patients and 241 articles lacked enough data for further research. Finally, 27 articles (8, 1540) published between 2009 and 2020 were included in this meta-analysis.

Figure 1

Features of the Included Studies

Summary of the major characteristics of these studies is shown in Table 1 and Table 2. All studies had a retrospective study design. The sample size ranged from 144 to 12,515, and a total of 50,014 patients were included. A total of 12,093 PCa patients with PSMs were included in our study, which accounted for 24.2% of all patients. Geographically, eight studies were conducted in Asia, eight in North America, eight in Europe, two in Australia, and one in multi-center locations. All patients had received RP as primary treatment for PCa. According to the NOS quality assessment, all studies included in this study were categorized as being of high quality (Supplementary Table S1).

Table 1

AuthorYearCountryRecruitment periodNo. of patientsAge (years)Pre-PSAFollow-up (months)
PSMsNSMsPSMsNSMsPSMsNSMsPSMsNSMs
Celik et al. (15)2020Turkey2005–20208931,750Mean ± SD
63.2 ± 6.5
Mean ± SD
62.4 ± 6.7
Mean ± SD
13 ± 18.9
Mean ± SD
8.8 ± 9.5
NANA
Porcaro et al. (16)2020Italy2013–2017192540Median
(IQR)
65 (60–69)
Median
(IQR)
65 (60–69)
Median
(IQR)
6.9 (5.1–8.7)
Median
(IQR)
6.1 (4.8–8.3)
Median (IQR)
26 (14–40)
Median (IQR)
26 (14–40)
Tian et al. (17)2019China2010–2016142267Median
(IQR)
70 (62.8–75.0)
Median
(IQR)
71 (66.0–75.0)
Median
(IQR)
13.7 (9.3–25.0)
Median
(IQR)
10.2 (6.7–17.7)
NANA
Martini et al. (18)2019Italy2011–20172851,472Median
(IQR)
64.8 (58.9–70.0)
Median
(IQR)
64.6 (59.0–69.7)
Median
(IQR)
7.2 (5.5–10.6)
Median
(IQR)
6.3 (4.6–8.3)
Median
30
Median
30
Hou et al. (19)2019China2007–201794226Median
(IQR)
67.9 (45–80)
Median
(IQR)
67.9 (45–80)
Median
(IQR)
14.4 (1–123)
Median
(IQR)
14.4 (1–123)
NANA
Herforth et al. (20)2018USA1988–20151,9022,063Median
(IQR)
62 (58–66)
Median
(IQR)
63 (58–67)
Median (IQR)
7.5 (5.2–12)
Median (IQR)
5.9 (4.4–8.5)
Median (IQR)
93 (53–152)
Median (IQR)
105 (63–147)
Tatsugami et al. (21)2017Japan2009–20135941,794Mean ± SD
64.9 ± 6.2
Mean ± SD
65.3 ± 6.2
Median (range)
6.6 (1.8–57.1)
Median (range)
7.7 (3.0–69.8)
Median (range)
9 (1–83)
Median
(range)
9 (1–83)
Seo et al. (8)2017Korea2008–20145094Mean ± SD
64.6 ± 6.5
Mean ± SD
67.3 ± 6.7
Mean ± SD
16.3 ± 11.4
Mean ± SD
10.5 ± 6.7
Mean ± SD
55.4 ± 3.9
Mean ± SD
64.1 ± 2.0
Meyer et al. (22)2017USA1992–2005118785Median
(IQR)
63 (60–67)
Median
(IQR)
63 (58–66)
Median (IQR)
6 (4.3–9.0)
Median
(IQR)
6.4 (4.6–8.9)
Median
(IQR)
132 (86–145)
Median
(IQR)
133 (99–157)
Abdollah et al. (23)2016MC2002–20131,04511,470Median (IQR)
62 (56–67)
Median (IQR)
61 (55–56)
Median (IQR)
6.2 (4.7–9.6)
Median
(IQR)
5.2 (4.1–7.2)
Median
39
Median
39
Whalen et al. (24)2015USA2005–2011126453Mean ± SD
61.0 ± 7.7
Mean ± SD
61.3 ± 7.0
Mean ± SD
9.2 ± 8.6
Mean ± SD
6.1 ± 5.4
Median (range)
20.5 (1–80)
Median
(range)
20.5 (1–80)
Retèl et al. (25)2014Switzerland1990–2008479775Mean ± SD
63.4 ± 6.0
Mean ± SD
62.9 ± 6.5
NANAMedian (range)
73.2 (2–120)
Median
(range)
73.2 (2–120)
Rouanne et al. (26)2014France1988–2001108295Median (range)
66 (47–77)
Median (range)
66 (46–81)
Median (range)
10 (2–158)
Median (range)
10 (0.5–134)
Median (range)
139 (126–231)
Median
(range)
147 (134–251)
Sammon et al. (27)2013USA1993–2010162632Mean ± SD
63.1 ± 8.9
Mean ± SD
63.5 ± 7.8
Mean ± SD
6.9 ± 4.6
Mean ± SD
5.3 ± 3.3
Median (IQR)
54 (27–84)
Median (IQR)
54 (27–84)
Lee et al. (28)2013Korea2005–2011167200Mean ± SD
67.9 ± 5.7
Mean ± SD
67.8 ± 5.3
Mean ± SD
11.2 ± 10.4
Mean ± SD
8.4 ± 6.4
NANA
Hashimoto et al. (29)2013Japan2006–201154190Mean ± SD
64.8 ± 5.7
Mean ± SD
64.0 ± 6.8
Mean ± SD
12.5 ± 12.6
Mean ± SD
9.3 ± 7.3
NANA
Abdollah et al. (30)2013Italy1998–20103051,198Median (range)
64.6 (40.5–81.1)
Median
(range)
64.8 (42.3–82.2)
Median (range)
6.6 (1–74.1)
Median (range)
6.2 (0.2–47.8)
Mean
122.5
Mean
122.5
Savdie et al. (31)2012Australia1997–2003285655Median (range)
61.7 (46.4–81)
Median
(range)
61.2 (42.2–77.4)
Median (range)
8.7 (2–63)
Median (range)
7.5 (0.4–84)
Median (range)
82 (5–146)
Median
(range)
82 (5–146)
Lu et al. (32)2012China1993–1999250544Median
(IQR)
62 (57–66)
Median
(IQR)
62 (52–66)
Median (IQR)
6.2 (4.5–9.3)
Median
(IQR)
5.9 (4.5–8.0)
Median
(IQR)
115.2 (72–132)
Median
(IQR)
120 (78–135.6)
Karavitakis et al. (33)2012UK2007–20093164Mean
62.9
Mean
61.3
Mean
13.9
Mean
10.9
NANA
Corcoran et al. (34)2012Australia1995–20103701,144Median (range)
61.5 (40.2–79.8)
Median
(range)
61.5 (40.2–79.8)
Mean ± SD
7.8 ± 6.6
Mean ± SD
7.8 ± 6.6
Median (range)
22.2 (0.8–181)
Median
(range)
22.2 (0.8–181)
Li et al. (35)2011China2000–20095792Mean ± SD
70.2 ± 6.3
Mean ± SD
69.0 ± 6.0
Mean ± SD
13.4 ± 17.6
Mean ± SD
8.0 ± 5.8
Mean ± SD
46.8 ± 27.8
Mean ± SD
46.8 ± 27.8
Coelho et al. (36)2010USA2008–2009101775Median
(IQR)
62 (56–66)
Median
(IQR)
61 (56–66)
Median
(IQR)
5 (3.9–6.9)
Median
(IQR)
4.9 (3.8–6.6)
NANA
Boorjian et al. (37)2010USA1990–20063,6518,078Median
(IQR)
64 (59–69)
Median
(IQR)
63 (57–68)
Median
(IQR)
8.1 (5.4–14.1)
Median
(IQR)
5.9 (4.1–8.7)
Median
(IQR)
98.4 (52.8–145.2)
Median
(IQR)
98.4 (52.8–145.2)
Alkhateeb et al. (38)2010Canada1992–20082641,004Mean ± SD
62 ± 6.6
Mean ± SD
62 ± 6.6
Mean
(range)
7.7 (0.1–65.9)
Mean
(range)
7.7 (0.1–65.9)
Mean
(range)
78.1 (3–192)
Mean
(range)
78.1 (3–192)
Shikanov et al. (39)2009USA2003–20082431,155Median
(IQR)
59 (54–65)
Median
(IQR)
60 (55–65)
Median
(IQR)
5.6 (4.4–8.1)
Median
(IQR)
5.1 (4.1–7.1)
Median
(IQR)
12.3 (6.3–18.9)
Median
(IQR)
12.3 (6.3–20.1)
Ficarra et al. (40)2009Italy2005–200895227Mean
61.4
Mean
61.4
NANAMedian
14
Median
14

The basic characteristics of all studies included in this meta-analysis.

SD, standard deviation; NA, data not applicable; MC, Multi-centers; PSMs, positive surgical margins; NSMs, negative surgical margins.

Table 2

AuthorStagingsystemGradingsystemBiopsy GS <6/≥7Pathological GS <6/≥7Pathological stage 1–2/3–4
PSMsNSMsPSMsNSMsPSMsNSMs
Celik et al. (15)TNM2014 ISUPNANANANA427/4661,377/413
Porcaro et al. (16)2010 TNM2014 ISUP81/111262/27819/173107/433161/31453/87
Tian et al. (17)2012TNMGleason scoreNANANANA75/67212/64
Martini et al. (18)TNMGleason scoreNANA203/821,246/208108/177969/503
Hou et al. (19)TNMGleason score27/67101/12516/7884/14246/48174/52
Herforth et al. (20)TNMGleason scoreNANANANA1,249/6531,567/496
Tatsugami et al. (21)TNMGleason score172/4221,200/59446/548276/1,518539/5562/594
Seo et al. (8)TNMGleason score14/3640/54NANA34/1684/10
Meyer et al. (22)2002TNMGleason score98/20625/12069/49510/275NANA
Abdollah et al. (23)TNMGleason score436/8911,726/2,237138/1,1981,167/2,796373/9542,883/1,080
Whalen et al. (24)1997TNMGleason score30/96214/23930/96214/23951/75365/88
Retèl et al. (25)TNMGleason scoreNANA224/255502/273239/240629/146
Rouanne et al. (26)TNMGleason score81/27233/6249/59181/11435/73224/71
Sammon et al. (27)TNMGleason scoreNANA67/95525/10747/115298/334
Lee et al. (28)TNMGleason scoreNANA30/13669/13188/79169/31
Hashimoto et al. (29)NAGleason score18/3663/127NANANANA
Abdollah et al. (30)TNMGleason scoreNANA115/190635/563256/491,115/83
Savdie et al. (31)TNMGleason scoreNANA75/210241/414105/180438/217
Lu et al. (32)TNMGleason scoreNANA80/170293/251161/89468/76
Karavitakis et al. (33)TNMGleason score18/1343/217/2122/4314/1745/19
Corcoran et al. (34)TNMGleason scoreNANA47/323290/854182/188924/220
Li et al. (35)1992TNMGleason scoreNANANANANANA
Coelho et al. (36)TNMGleason score56/45453/32221/80310/46343/58669/106
Boorjian et al. (37)TNMGleason score1,905/1,1255,372/1,6211,806/1,8395,719/2,3282,072/1,5796,767/1,289
Alkhateeb et al. (38)TNMGleason scoreNANA42/222310/694116/148737/267
Shikanov et al. (39)TNMGleason score118/125727/42873/170592/563120/123980/175
Ficarra et al. (40)2002TNMGleason score67/28187/4026/69112/11521/74177/50

The main pathological characteristics of all studies included in this meta-analysis.

NA, data not applicable; PSMs, positive surgical margins; NSMs, negative surgical margins; GS, Gleason Score; ISUP, International Society of Urologic Pathology (ISUP) system.

Meta-Analysis

The pooled results from the included studies indicated that PSMs were associated with pathological GS (<6/≥7) (RE model, pooled OR = 2.49; 95% CI: 2.19–2.83; P < 0.001, Figure 2), pathological stage (<T2/≥T3) (RE model, pooled OR = 3.90; 95% CI: 3.18–4.79; P < 0.001, Figure 3), biopsy GS (<6/≥7) (RE model, pooled OR = 1.53; 95% CI: 1.31–1.79; P < 0.001, Figure 4), p-PSA (FE model, pooled SMD = 0.37; 95% CI: 0.31–0.43; P < 0.001, Figure 5A), positive lymph node (PLN) (RE model, pooled OR = 3.12; 95% CI: 2.28–4.27; P < 0.001, Figure 5B), extraprostatic extension (EPE) (RE model, pooled OR = 4.44; 95% CI: 3.25–6.09; P < 0.001, Figure 5C), and seminal vesicle invasion (SVI) (RE model, pooled OR = 4.19; 95% CI: 2.87–6.13; P < 0.001, Figure 5D).

Figure 2

Figure 3

Figure 4

Figure 5

The results of meta-analysis of PSMs showed that no significant associations were found between PSMs and age (RE model, pooled SMD = 0.01; 95% CI: −0.07–0.10; P = 0.735, Figure 6A), nerve sparing (RE model, pooled OR = 0.90; 95% CI: 0.71–1.14; P = 0.388, Figure 6B), body mass index (BMI) (RE model, pooled SMD = 0.12; 95% CI: −0.05–0.30; P = 0.162, Figure 6C), and prostate volume (RE model, pooled SMD = −0.28; 95% CI: −0.62–0.05; P = 0.097, Figure 6D).

Figure 6

Subgroup Analysis

Considering that there was no significant heterogeneity in p-PSA and the number of studies that evaluated BMI, SVI, and prostate volume was relatively small, we only conducted subgroup analysis for biopsy GS, pathological GS, pathological stage, PLN, EPE, age, and nerve sparing (Table 3). Subgroup analyses were conducted according to the geographical region (Asian vs. non-Asian), year of publication (≥2014 vs. <2014), number of patients (≥1,000 vs. <1,000), and median follow-up (≥70 months vs. <70 months). The results of subgroup analysis were roughly the same as overall results. Besides, the heterogeneity decreased significantly in some subgroup analyses, such as geographical region in Asian, year of publication <2014, and number of patients <1,000 cases.

Table 3

Analysis specificationNo. of studiesStudy heterogeneityEffects modelPooled OR/SMD (95% CI)P-Value
I2 (%)Pheterogeneity
BMI
Overall383.20.003Random0.12 (–0.05,0.30)0.162
p-PSA
Overall719.20.283Fixed0.37 (0.31,0.43)<0.001
SVI
Overall474.80.008Random4.19 (2.87,6.13)<0.001
Prostate volume
Overall376.30.015Random–0.28 (–0.62,0.05)0.097
Age
Overall9570.017Random0.01 (–0.07,0.10)0.735
Geographical region
 Asian549.60.094Random–0.03 (–0.17,0.12)0.724
 non-Asian436.40.193Fixed0.06 (–0.02,0.14)0.149
Year of publication
 ≥2014575.60.003Random–0.01 (–0.12,0.11)0.916
 <2014400.543Fixed0.02 (–0.09,0.14)0.675
No. of patients
 ≥1,000378.40.010Random0.05 (–0.07,0.16)0.442
 <1,000634.00.182Fixed–0.02 (–0.14,0.10)0.719
Biopsy GS (<6/≥7)
Overall1471.5<0.001Random1.53 (1.31,1.79)<0.001
Geographical region
 Asian428.20.243Fixed1.19 (0.90,1.58)0.227
 non-Asian1064.10.003Random1.65 (1.42,1.93)<0.001
Year of publication
 ≥2014964.80.004Random1.44 (1.17,1.76)<0.001
 <2014541.10.147Fixed1.75 (1.44,2.11)<0.001
No. of patients
 ≥1,000550.20.090Random1.84 (1.40,2.42)<0.001
 <1,0001078.5<0.001Random1.39 (1.13,1.70)0.001
Median follow-up
 ≥70 months329.90.240Fixed1.58 (1.32,1.90)<0.001
 <70 months668.10.008Random1.67 (1.13,2.46)0.010
P-GS (<6/≥7)
Overall2275.1<0.001Random2.49 (2.19,2.83)<0.001
Geographical region
 Asian400.489Fixed2.47 (2.04,2.99)<0.001
 non-Asian1879.2<0.001Random2.48 (2.14,2.89)<0.001
Year of publication
 ≥2014974.3<0.001Random2.37 (1.90,2.96)<0.001
 <20141273.5<0.001Random2.48 (2.08,2.95)<0.001
No. of patients
 ≥1,0001077.4<0.001Random2.49 (2.02,3.07)<0.001
 <1,0001273.5<0.001Random2.48 (2.08,2.95)<0.001
Median follow-up
 ≥70 months866.20.004Random2.04 (1.74,2.39)<0.001
 <70 months976.6<0.001Random2.87 (2.27,3.62)<0.001
Stage (<T2/≥T3)
Overall2391.4<0.001Random3.90 (3.18,4.79)<0.001
Geographical region
 Asian600.592Fixed3.32 (2.75,4.00)<0.001
 non-Asian1793.9<0.001Random4.08 (3.19,5.22)<0.001
Year of publication
 ≥20141194.8<0.001Random3.28 (2.20,4.89)<0.001
 <20141282.5<0.001Random4.53 (3.64,5.64)<0.001
No. of patients
 ≥1,0001094.3<0.001Random3.58 (2.74,4.69)<0.001
 <1,0001387.9<0.001Random4.24 (2.88,6.25)<0.001
Median follow-up
 ≥70 months775.8<0.001Random4.24 (3.42,5.26)<0.001
 <70 months1095.8<0.001Random3.58 (2.20,5.82)<0.001
Nerve sparing
Overall877.8<0.001Random0.90 (0.71,1.14)0.388
Geographical region
 Asian200.836Fixed1.04 (0.87,1.24)0.666
 non-Asian674.80.001Random0.86 (0.65,1.14)0.288
Year of publication
 ≥2014586.1<0.001Random0.91 (0.67,1.24)0.564
 <2014320.60.284Fixed0.87 (0.60,1.25)0.452
No. of patients
 ≥1,000483.10.001Random0.74 (0.56,1.00)0.06
 <1,000400.439Fixed1.23 (0.94,1.61)0.130
Median follow-up
 ≥70 months291.70.001Random1.05 (0.36,3.05)0.933
 <70 months422.00.279Fixed1.00 (0.81,1.23)0.990
EPE
Overall582.30.001Random4.44 (3.25,6.09)<0.001
Year of publication
 ≥2014285.60.008Random4.16 (3.02,5.74)<0.001
 <2014387.2<0.001Random4.80 (1.97,11.68)0.001
No. of patients
 ≥1,000285.60.008Random4.16 (3.02,5.74)<0.001
 <1,000387.2<0.001Random4.80 (1.97,11.68)0.001
PLN
Overall770.80.002Random3.12 (2.28,4.27)<0.001
No. of patients
 ≥1,000456.40.076Random3.43 (2.66,4.54)<0.001
 <1,000372.00.028Random2.52 (1.06,5.99)0.037
Median follow-up
 ≥70 months382.80.003Random2.49 (1.07,5.79)0.033
 <70 months353.70.115Random3.18 (2.24,4.52)<0.001

Summary and subgroup results for PSMs and clinicopathological features in PCa patients.

Sensitivity Analysis

To validate the reliability of our results, sensitivity analysis was performed. As shown in Supplementary Figure S1, the combined ORs for biopsy GS ranged from 1.47 (95% CI: 1.25 –1.72) to 1.58 (95% CI: 1.37–1.85) (Supplementary Figure S1A), the combined ORs for pathological GS ranged from 2.39 (95% CI: 2.14–2.67) to 2.56 (95% CI: 2.26–2.90) (Supplementary Figure S1B), the combined ORs for pathological stage ranged from 3.73 (95% CI: 3.04–4.58) to 4.15 (95% CI: 3.47–4.96) (Supplementary Figure S1C), the combined ORs for PLN ranged from 2.88 (95% CI: 2.08–4.00) to 3.51 (95% CI: 2.67–4.79) (Supplementary Figure S1D), the combined ORs for nerve sparing ranged from 0.83 (95% CI: 0.66–1.04) to 0.97 (95% CI: 0.74–1.27) (Supplementary Figure S1E), and the combined ORs for EPE ranged from 3.84 (95% CI: 3.05–4.85) to 4.68 (95% CI: 3.36–6.53) (Supplementary Figure S1F). The pooled SMD for p-PSA ranged from 0.36 (95% CI: 0.29–0.42) to 0.44 (95% CI: 0.35–0.54) (Supplementary Figure S2A), and the pooled SMD for age ranged from −0.01 (95% CI: −0.09–0.07) to 0.03 (95% CI: −0.05–0.12) (Supplementary Figure S2B). These data suggested that the results were statistically robust. Because the number of included studies for BMI, EPE, SVI, and prostate volume were small, the sensitivity analysis was not valuable.

Publication Bias

The shape of funnel plots did not reveal any evidence of asymmetry (Figure 7). The statistical results of Egger’s test still did not show any publication bias for biopsy GS (p- Egger = 0.277, Figure 7A), pathological GS (p- Egger = 0.945, Figure 7B), pathological stage (p- Egger = 0.830, Figure 7C), PLN (p- Egger = 0.605, Figure 7D), EPE (p- Egger = 0.513, Figure 7E), SVI (p- Egger = 0.797, Figure 7F), age (p- Egger = 0.431, Figure 7G), and nerve sparing (p- Egger = 0.197, Figure 7H). However, a minimal publication bias existed in p-PSA (p- Egger = 0.047). As the number of studies on prostate volume and BMI was limited, the publication bias was not assessed.

Figure 7

Discussion

PSMs are unfavorable pathological features, which suggest incomplete tumor resection and confer poorer cancer control after RP (38). It was reported that PSMs were present in 11–38% of patients treated by RP and patients with PSMs have a higher risk of BCR compared to those with negative surgical margins (NSMs) (41). A multi-institutional review in 2009 conducted by Yossepowitch et al. (42) concluded that PSMs in RP specimens may be considered as an adverse outcome following RP. Consistent with these findings, our recent studies (6, 7) demonstrated the adverse effect of PSMs on both BCR and cancer-specific survival through a systematic review and meta-analysis. However, not all patients with PSMs have poor tumor outcomes, and some patients with localized PCa will show tumor progression even in the no-PSMs cases.

PSMs are factors that may be modified by the surgical technique. It seems that surgeon’s experience plays an important role in the decrease in the incidence of PSMs (43). Considerable efforts have been devoted to identifying factors, such as p-PSA (44), positive biopsy cores (10), and clinical stage (36), which can predict PSMs and clinical outcome following RP. The conclusion of several published studies indicated that several unfavorable pathological features may be associated with PSMs. However, inconsistent results have also been demonstrated in the published studies. Besides, for patients with adverse features of PSMs, prediction parameters that are currently available for PSMs may not reliable.

A retrospective study conducted by Boorjian et al. (37) found that increased p-PSA and BMI, higher pathological stage/GS, and greater tumor volume were significantly associated with the risk of PSMs. Likewise, Ficarra et al. (40) found an association between PSMs and biopsy GS, pathologic stage and GS, and EPE; however, no correlation was found between PSMs and p-PSA. Hashimoto et al. (29) found that only PSA density and prostate volume were independent predictors of PSMs after robot-assisted RP based on the data from 244 Japanese patients. Moreover, Yuksel et al. (45) considered the number of positive biopsies, pathologic stage and GS, SVI, and EPE as predictive factors for PSMs after robot-assisted RP. Meanwhile, no correlation was found with p-PSA, biopsy GS, and PLN. The inconsistent results from the above studies may due to small sample size, single-center design, and inhomogeneous population.

To the best of our knowledge, none of the studies have systematically addressed the preoperative predictive factors for PSMs after RP. In the present study, we identified 27 studies involving 50,014 patients, and the rate of PSMs was 24.2%, which is comparable to that in previous reports. The meta-analysis showed that p-PSA, biopsy GS (<6/≥7), pathological GS (<6/≥7), pathological stage (<T2/≥T3), PLN, EPE, and SVI had a statistically significant association with PSMs. Moreover, the pooled OR/SMD of the results suggested that age, BMI, prostate volume, and nerve sparing were not independent prognostic factors for PSMs in patients after RP. Subgroup analyses revealed a similar result despite different geographical regions, publication years, sample sizes, and median follow-ups. Further, sensitivity analysis and publication bias test were also performed, and the overall results showed that our data were stable and reliable.

This is the first comprehensive study to investigate the pathological features of PSMs and predictive factors for PSMs in patients treated with RP, and the results of this analysis are meaningful. The two strengths of this study are as follows: First, a large sample size of PCa patients from different geographic areas was included, and the findings of our study were more robust than those of an individual study. Second, a summary OR/SMD was conducted to compare the difference between PSMs and NSMs in PCa patients categorized by several confounders. Therefore, our findings could provide solid evidence for prognostic factors in PCa patients with PSMs.

Nevertheless, the present study has some limitations that should be acknowledged. First, all the studies were retrospectively performed, which made our research more susceptible to recall or selection bias. Second, a substantial heterogeneity was detected, while sensitivity analysis and subgroup analysis failed to identify the potential heterogeneity. Third, this study was limited to articles published in English and Chinese, which might have contributed to selection bias. As known, articles with positive results are more likely to be published. Therefore, this article also had a certain publication bias. Fourth, the number of included studies was limited in terms of publication bias and subgroup and sensitivity analyses, which could have led to unpersuasive conclusions. Therefore, more studies are required, which can provide more detailed individual high-quality data.

Conclusion

The meta-analysis demonstrates that p-PSA, biopsy GS, pathological GS, pathological stage, PLN, EPE, and SVI were independent factors predicting PSMs after RP, and a combination of these factors might be useful for predicting PSMs in PCa patients undergoing RP. Considering the limitations of the present analysis, it is necessary to conduct more large-scale and well-designed studies to validate our results in the future.

Statements

Data availability statement

All datasets generated for this study are included in the article/Supplementary Material.

Author contributions

LZ conceptualized the study. BW, ZZ, and JY performed the literatue search. HZ and YF analyzed the data. HZ wrote the original draft. LZ wrote, reviewed, and edited the manuscript. All authors contributed to the article and approved the submitted version.

Acknowledgments

This manuscript has been released as a pre-print at research square, Lijin Zhang et al.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Supplementary material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fonc.2020.539592/full#supplementary-material

Supplementary Figure 1

Sensitivity analysis (pooled ORs) of the association between the predictive factors and PSMs risk. (A) biopsy GS; (B) pathological GS; (C) pathological stage; (D) PLN, and (E) nerve sparing.

Supplementary Figure 2

Sensitivity analysis (pooled SMDs) of the association between the predictive factors and PSMs risk. (A) p-PSA; (B) age.

Abbreviations

PCa, renal cell cancer; PSMs, positive surgical margins; NSMs, negative surgical margins; RP, radical prostatectomy; PRISMA, Preferred Reporting Items for Systematic Reviews and Meta-Analyses; NOS, Newcastle Ottawa scale; ORs, odds ratios; SMD, standard mean differences; CIs, corresponding confidence intervals; p-PSA, preoperative PSA; GS, Gleason Score; PLN, positive lymph node; EPE, extraprostatic extension; SVI, seminal vesicle invasion; BMI, body mass index; RE, random-effects; FE, fixed-effects.

References

  • 1

    SiegelRLMillerKDJemalA. Cancer Statistics, 2017. CA: Cancer J Clin (2017) 67(1):730. doi: 10.3322/caac.21387

  • 2

    IlicDDjulbegovicMJungJHHwangECZhouQClevesAet al. Prostate cancer screening with prostate-specific antigen (PSA) test: a systematic review and meta-analysis. BMJ (Clinical Res ed) (2018) 362:k3519. doi: 10.1136/bmj.k3519

  • 3

    MatulayJTDeCastroGJ. Radical Prostatectomy for High-risk Localized or Node-Positive Prostate Cancer: Removing the Primary. Curr Urol Rep (2017) 18(7):53. doi: 10.1007/s11934-017-0703-x

  • 4

    NovaraGFicarraVMocellinSAhleringTECarrollPRGraefenMet al. Systematic review and meta-analysis of studies reporting oncologic outcome after robot-assisted radical prostatectomy. Eur Urol (2012) 62(3):382404. doi: 10.1016/j.eururo.2012.05.047

  • 5

    KellerEXBachofnerJBritschgiAJSabaKMortezaviAKaufmannBet al. Prognostic value of unifocal and multifocal positive surgicalmargins in a large series of robot-assisted radical prostatectomy for prostatecancer. World J Urol (2019) 37(9):1837–44. doi: 10.1007/s00345-018-2578-y

  • 6

    ZhangLWuBZhaZZhaoHYuanJJiangYet al. Surgical margin status and its impact on prostate cancer prognosis after radical prostatectomy: a meta-analysis. World J Urol (2018) 36(11):1803–15. doi: 10.1007/s00345-018-2333-4

  • 7

    ZhangLWuBZhaZZhaoHJiangYYuanJ. Positive surgical margin is associated with biochemical recurrence risk following radical prostatectomy: a meta-analysis from high-quality retrospective cohort studies. World J Surg Oncol (2018) 16(1):124. doi: 10.1186/s12957-018-1433-3

  • 8

    SeoWIKangPMYoonJHKimWChungJI. Correlation between postoperative prostate-specific antigen and biochemical recurrence in positive surgical margin patients: Single surgeon series. Prostate Int (2017) 5(2):53–8. doi: 10.1016/j.prnil.2017.02.002

  • 9

    LallasCDFasholaYDenRBGelpi-HammerschmidtFCalvaresiAEMcCuePet al. Predictors of positive surgical margins after radical prostatectomy at a single institution: preoperative and pathologic factors, and the impact of surgeon variability and technique on incidence and location. Can J Urol (2014) 21(5):7479–86.

  • 10

    TuliaoPHKooKCKomninosCChangCHChoiYDChungBHet al. Number of positive preoperative biopsy cores is a predictor of positive surgical margins (PSM) in small prostates after robot-assisted radical prostatectomy (RARP). BJU Int (2015) 116(6):897904. doi: 10.1111/bju.12888

  • 11

    OuzzaneARozetFSalasRSGalianoMBarretEPrapotnichDet al. Positive surgical margins after minimally invasive radical prostatectomy in patients with pT2 and pT3a disease could be considered pathological upstaging. BJU Int (2014) 113(4):586–91. doi: 10.1111/bju.12249

  • 12

    EasthamJAKattanMWRiedelEBeggCBWheelerTMGerigkCet al. Variations among individual surgeons in the rate of positive surgical margins in radical prostatectomy specimens. J Urol (2003) 170(6 Pt 1):2292–5. doi: 10.1097/01.ju.0000091100.83725.51

  • 13

    LiberatiAAltmanDGTetzlaffJMulrowCGøtzschePCIoannidisJPet al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. PLoS Medicine (2009) 6(7):e1000100. doi: 10.1371/journal.pmed.1000100

  • 14

    StangA. Critical evaluation of the Newcastle-Ottawa scale for the assessment of the quality of nonrandomized studies in meta-analyses. Eur J Epidemiol (2010) 25(9):603–5. doi: 10.1007/s10654-010-9491-z

  • 15

    ÇelikSAslanGSözenSÖzenHAkdoğanBBaltaciSet al. Factors Affecting Surgical Margin Positivity after Radical Prostatectomy in the Turkish Population: A Multicenter Study of the Urooncology Association. Urologia Internationalis (2020) 104(9-10):724–30. doi: 10.1159/000507268

  • 16

    PorcaroABSebbenMCorsiPTafuriAProcessaliTPirozziMet al. Risk factors of positive surgical margins after robot-assisted radical prostatectomy in high-volume center: results in 732 cases. J Robotic Surgery (2020) 14(1):167–75. doi: 10.1007/s11701-019-00954-x

  • 17

    TianXJWangZLLiGCaoSJCuiHRLiZHet al. Development and validation of a preoperative nomogram for predicting positive surgical margins after laparoscopic radical prostatectomy. Chin Med J (2019) 132(8):928–34. doi: 10.1097/CM9.0000000000000161

  • 18

    MartiniAGandagliaGFossatiNScuderiSBraviCAMazzoneEet al. Defining Clinically Meaningful Positive Surgical Margins in PatientsUndergoing Radical Prostatectomy for Localised Prostate Cancer. Eur UrolOncol (2019) S2588-9311(19)30039-2. doi: 10.1016/j.euo.2019.03.006

  • 19

    HouHJiangXLiuMDiaoTWangJ. The characteristics and independent associated factors of positive surgical margin after radical prostatectomy. Chin J Urol (2018) 39(10):740–4. doi: 10.3760/cma.j.issn.1000-6702.2018.10.004

  • 20

    HerforthCStroupSP. Radical prostatectomy and the effect of close surgical margins: results from the Shared Equal Access Regional Cancer Hospital (SEARCH) database. BJU Int (2018) 122: (4):592–8. doi: 10.1111/bju.14178

  • 21

    TatsugamiKYoshiokaKShirokiREtoMYoshinoYTozawaKet al. Reality of nerve sparing and surgical margins in surgeons’ early experience with robot-assisted radical prostatectomy in Japan. Int J Urol (2017) 24(3):191–6. doi: 10.1111/iju.13281

  • 22

    MeyerCPHansenJBoehmKTilkiDAbdollahFTrinhQDet al. Tumor volume improves the long-term prediction of biochemical recurrence-free survival after radical prostatectomy for localized prostate cancer with positive surgical margins. World J Urol Feb (2017) 35(2):199206. doi: 10.1007/s00345-016-1861-z

  • 23

    AbdollahFMoschiniMSoodASammonJDalelaDHsuLet al. When Should a Positive Surgical Margin Ring a Bell? An Analysis of a Multi-Institutional Robot-Assisted Laparoscopic Radical Prostatectomy Database. J Endourol (2016) 30(2):201–7. doi: 10.1089/end.2015.0465

  • 24

    WhalenMJShapiroEYRothbergMBTurkATWolduSLRoy ChoudhuryAet al. Close surgical margins after radical prostatectomy mimic biochemical recurrence rates of positive margins. Urologic Oncol (2015) 33(11):494.e499e414. doi: 10.1016/j.urolonc.2015.07.005

  • 25

    RetelVPBouchardyCUselMNeyroud-CasparISchmidlinFWirthGet al. Determinants and effects of positive surgical margins after prostatectomy on prostate cancer mortality: a population-based study. BMC Urol (5) 201414:86. doi: 10.1186/1471-2490-14-86

  • 26

    RouanneMRodeJCampeggiAAlloryYVordosDHoznekAet al. Long-term impact of positive surgical margins on biochemical recurrence after radical prostatectomy: ten years of follow-up. Scand J Urol (2014) 48(2):131–7. doi: 10.3109/21681805.2013.813067

  • 27

    SammonJDTrinhQDSukumarSRaviPFriedmanASunMet al. Risk factors for biochemical recurrence following radical perineal prostatectomy in a large contemporary series: a detailed assessment of margin extent and location. Urologic Oncol (2013) 31(8):1470–6. doi: 10.1016/j.urolonc.2012.03.013

  • 28

    LeeJWRyuJHKimYBYangSOLeeJKJungTY. Do positive surgical margins predict biochemical recurrence in all patients without adjuvant therapy after radical prostatectomy? Korean J Urol (2013) 54(8):510–5. doi: 10.4111/kju.2013.54.8.510

  • 29

    HashimotoTYoshiokaKGondoTTakeuchiHNakagamiYNakashimaJet al. Predictors for positive surgical margins after robot-assisted radical prostatectomy: a single surgeon’s series in Japan. Int J Urol (2013) 20(9):873–8. doi: 10.1111/iju.12081

  • 30

    AbdollahFSunMSuardiNGallinaACapitanioUBianchiMet al. Presence of positive surgical margin in patients with organ-confined prostate cancer equals to extracapsular extension negative surgical margin. A plea for TNM staging system reclassification. Urologic Oncol (2013) 31(8):1497–503. doi: 10.1016/j.urolonc.2012.04.013

  • 31

    SavdieRHorvathLGBenitoRPRasiahKKHaynesAMChatfieldMet al. High Gleason grade carcinoma at a positive surgical margin predicts biochemical failure after radical prostatectomy and may guide adjuvant radiotherapy. BJU Int (2012) 109(12):1794–800. doi: 10.1111/j.1464-410X.2011.10572.x

  • 32

    LuJWirthGJWuSChenJDahlDMOlumiAFet al. A close surgical margin after radical prostatectomy is an independent predictor of recurrence. J Urol (2012) 188(1):91–7. doi: 10.1016/j.juro.2012.02.2565

  • 33

    KaravitakisMAhmedHUAbelPDHazellSWinklerMH. Margin status after laparoscopic radical prostatectomy and the index lesion: implications for preoperative evaluation of tumor focality in prostate cancer. J Endourol (2012) 26(5):503–8. doi: 10.1089/end.2011.0345

  • 34

    CorcoranNMHovensCMMetcalfeCHongMKPedersenJCaseyRGet al. Positive surgical margins are a risk factor for significant biochemical recurrence only in intermediate-risk disease. BJU Int (2012) 110(6):821–7. doi: 10.1111/j.1464-410X.2011.10868.x

  • 35

    LiKLiHYangYIanLHPunWHHoSF. Risk factors of positive surgical margin and biochemical recurrence of patients treated with radical prostatectomy: a single-center 10-year report. Chin Med J (2011) 124(7):1001–5.

  • 36

    CoelhoRFChauhanSOrvietoMAPalmerKJRoccoBPatelVR. Predictive factors for positive surgical margins and their locations after robot-assisted laparoscopic radical prostatectomy. Eur Urol (2010) 57(6):1022–9. doi: 10.1016/j.eururo.2010.01.040

  • 37

    BoorjianSAKarnesRJCrispenPLCarlsonRERangelLJBergstralhEJet al. The impact of positive surgical margins on mortality following radical prostatectomy during the prostate specific antigen era. J Urol (2010) 183(3):1003–9. doi: 10.1016/j.juro.2009.11.039

  • 38

    AlkhateebSAlibhaiSFleshnerNFinelliAJewettMZlottaAet al. Impact of positive surgical margins after radical prostatectomy differs by disease risk group. J Urol (2010) 183(1):145–50. doi: 10.1016/j.juro.2009.08.132

  • 39

    ShikanovSSongJRoyceCAl-AhmadieHZornKSteinbergGet al. Length of positive surgical margin after radical prostatectomy as a predictor of biochemical recurrence. J Urol (2009) 182(1):139–44. doi: 10.1016/j.juro.2009.02.139

  • 40

    FicarraVNovaraGSeccoSD'EliaCBoscolo-BertoRGardimanMet al. Predictors of positive surgical margins after laparoscopic robot assisted radical prostatectomy. J Urol (2009) 182(6):2682–8. doi: 10.1016/j.juro.2009.08.037

  • 41

    PreisserFMazzoneEKnipperSNazzaniSBandiniMShariatSFet al. Rates of Positive Surgical Margins and Their Effect on Cancer-specific Mortality at Radical Prostatectomy for Patients With Clinically Localized Prostate Cancer. Clin Genitourinary Cancer (2019) 17(1):e130–9. doi: 10.1016/j.clgc.2018.09.024

  • 42

    YossepowitchOBjartellAEasthamJAGraefenMGuillonneauBDKarakiewiczPIet al. Positive surgical margins in radical prostatectomy: outlining the problem and its long-term consequences. Eur Urol (2009) 55(1):8799. doi: 10.1016/j.eururo.2008.09.051

  • 43

    SooriakumaranPJohnMWiklundPLeeDNilssonATewariAK. Learning curve for robotic assisted laparoscopic prostatectomy: a multi-institutional study of 3794 patients. Minerva Urologica e Nefrologica = Ital J Urol Nephrol (2011) 63(3):191–8.

  • 44

    ChooMSChoSYJeongCWLeeSBKuJHHongSKet al. Predictors of positive surgical margins and their location in Korean men undergoing radical prostatectomy. Int J Urol (2014) 21(9):894–8. doi: 10.1111/iju.12465

  • 45

    YukselMKaramikKAnilHIslamogluEAtesMSavasM. Factors affecting surgical margin positivity in robotic assisted radical prostatectomy. Archivio Italiano di Urol Androl Organo Ufficiale [di] Societa Italiana di Ecografia Urologica e Nefrologica (2017) 89(1):71–4. doi: 10.4081/aiua.2017.1.71

Summary

Keywords

prostate cancer, radical prostatectomy, positive surgical margins, risk factors, meta-analysis

Citation

Zhang L, Zhao H, Wu B, Zha Z, Yuan J and Feng Y (2021) Predictive Factors for Positive Surgical Margins in Patients With Prostate Cancer After Radical Prostatectomy: A Systematic Review and Meta-Analysis. Front. Oncol. 10:539592. doi: 10.3389/fonc.2020.539592

Received

01 March 2020

Accepted

22 December 2020

Published

08 February 2021

Volume

10 - 2020

Edited by

Ian Pearce, Manchester University NHS Foundation Trust (MFT), United Kingdom

Reviewed by

Luca Mazzarella, European Institute of Oncology (IEO), Italy; Xiangming Cheng, Peking Union Medical College Hospital (CAMS), China

Updates

Copyright

*Correspondence: Lijin Zhang,

This article was submitted to Surgical Oncology, a section of the journal Frontiers in Oncology

Disclaimer

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.

Outline

Figures

Cite article

Copy to clipboard


Export citation file


Share article

Article metrics