Abstract
Simple Summary
Despite its varying sensitivity and decreased specificity, chromogranin A (CgA) is the most widely used biomarker for neuroendocrine tumors. The most common factor affecting its diagnostic accuracy is the use of proton pump inhibitors (PPIs). Our aim was to investigate circulating miRNA expression profiles in pancreatic neuroendocrine tumors (pNET) and pheochromocytomas/paragangliomas (PPGL) to find miRNAs which could be used as biomarkers along with CgA in these patients. MiRNA expression profiles were determined with next generation sequencing and validated by quantitative real time PCR in 74 samples obtained from patients and healthy volunteers treated with PPI. We observed a global downregulation of miRNAs in NET compared to controls. A set of miRNAs in combination with CgA resulted in the best discrimination of pNET irrespective of PPI treatment and a combination of miRNAs increased the diagnostic utility of CgA even in pNET patients with low CgA.
Abstract
Chromogranin A (CgA) is the most widely accepted biomarker for neuroendocrine tumors (NET) but its diagnostic accuracy is dependent on tumor type and the use of proton-pump inhibitors (PPI). We investigated the diagnostic value of circulating miRNAs along with CgA in pancreatic neuroendocrine tumors (pNET). 74 serum samples from patients with pNET (n = 25, nonfunctioning), pheochromocytoma/paraganglioma (PPGL, n = 20), healthy individuals with normal CgA (n = 29) including 10 samples from 5 healthy individuals with and without current PPI treatment were collected. MiRNA expression profiles were determined using next-generation sequencing, followed by validation with individual TaqMan assays. A global downregulation of miRNAs was observed in patients with NET compared to controls. MiRNA expression of 33 miRNAs was able to discriminate tumor samples from controls. No miRNA alone could be considered as an applicable biomarker for pNET or PPGL. However, using a logistic model, the combination of a set of miRNAs increased the discriminatory role of CgA irrespective of PPI treatment. In pNET patients with normal CgA level our regression model yielded high (89.4%) diagnostic accuracy (AUC: 0.904, sensitivity: 66.6%, specificity: 96.5%). A set of miRNAs increased the diagnostic utility of CgA in pNET even in patients with low CgA.
Keywords: circulating miRNA, biomarker, neuroendocrine tumor, pheochromocytoma, pancreas, pNET
1. Introduction
Chromogranins are polypeptide prohormones being the major constituents of dense-core secretory granules in neuroendocrine cells and they are co-secreted with peptide hormones and amines [1].
Neuroendocrine tumors (NETs) originate from neuroendocrine cells distributed widely throughout the body [2]. They are rare neoplasms but their incidence and prevalence are steadily rising [3]. Pancreatic NET (pNET) is the most common neuroendocrine tumor that can either be functioning or nonfunctioning according to hormone production [2]. Nonfunctioning (NF) pNETs comprising the largest group of pNETs being asymptomatic result in delayed diagnosis and often present as metastatic at diagnosis that significantly affect prognosis and survival [2,4].
An elevated level of circulating CgA has been associated with almost all tumor types of the neuroendocrine system [1,5], but its sensitivity varies between 47–100% depending on tumor type (100%, in gastrinomas, ~89% in pheochromocytomas, and ~69% in nonfunctioning pNETs) [1,6,7,8]. In addition, many oncological and non-oncological conditions, including renal failure, non-endocrine tumors (e.g., prostate, breast, thymus, uterus, colon), chronic gastritis, and current proton pump inhibitor therapy (PPIs) decrease the specificity CgA [6,9], but CgA is the only routinely measured circulating marker in pNET. Previous studies, including one from our research group, showed that both short- and long-term applications of PPIs and other acid-suppressive medications result in a significant increase of CgA in blood, thus decreasing its clinical utility in the management of NETs [10,11].
Neuron-specific enolase (NSE) is a cytosolic enzyme of neurons and neuroendocrine cells, that is predominantly expressed in small-cell lung cancer and poorly differentiated NETs [12,13]. Its diagnostic value, particularly its specificity for neuroendocrine tumors is rather poor [8,14,15]. 5-Hydroxyindoleacitic acid (5-HIAA), as the main metabolite of serotonin, is a useful biomarker of NETs in patients with carcinoid syndrome [12]. Other biomarkers, such as insulin, glucagon, or gastrin are specific for subtypes of neuroendocrine cells [12].
Pheochromocytomas/paragangliomas (PPGLs) are rare neuroendocrine tumors of chromaffin cell origin. These are found in the adrenal medulla (pheochromocytomas, PCC) and the paravertebral ganglia of the nervous system (paragangliomas, PGL) [16]. They can produce catecholamines, but PGLs located above the diaphragm are often non-secretory [16]. In PPGL, as CgA is co-secreted with catecholamines, besides the determination of catecholamines and their metabolites, elevated CgA may indicate tumor mass and malignancy; therefore, it may be used to monitor clinical response and tumor relapse especially when the measurement of plasma metanephrines is not accessible [16].
Similarly to gene expression, miRNA expression is also cell type-specific and due to their presence in circulation and their stability, they are considered as promising biomarker candidates in several tumor types [17,18]. Their previously described expression alterations in pNET and PPGL raise their potential usefulness as circulating biomarkers [19,20]. A multianalyte biomarker (NETest) encompassing 51 different NET-related transcripts showed a significantly more sensitive and efficient method in NET diagnosis compared to single biomarkers [21], however, its availability and costs may limit its usefulness [12].
We aimed to investigate the serum miRNA expression profile in patients with pNET to identify potentially useful miRNA biomarkers. PPGL and healthy individuals with and without PPI treatment were also studied to challenge the diagnostic utility of identified miRNAs along with CgA.
2. Results
2.1. Evaluation of Cell Contamination Based on miRNA Signature
As intracellular miRNA concentration is much higher compared to those measured in a cell-free environment, cellular contamination is an important factor to avoid. Therefore, first, we assessed whether cellular contamination in our serum samples was present. In the collected samples visually, no sign of hemolysis could be seen. The ratio of red blood cell-enriched miR-451a to the reference miR-23a-3p was revealed as the most sensitive method for the detection of hemolysis compared to hemoglobin measurement techniques (Coulter® AcT diff Analyzer and spectrophotometric method) [22]. Assessing miR-451a to miR-23a-3p ratio no red blood cell (RBC) contamination was detected in any of our samples.MiRNAs which are considered indicating red-blood-cell or platelet cellular contamination [23,24,25] also showed low variance (0.4 for miR-142-3p and 0.3 for miR451a/miR-23a-3p, respectively). Only samples without cellular contamination were included.
2.2. Analysis of Circulating miRNAs by Next-Generation Sequencing
Our exploratory study included 24 samples: 8 pNET (4 patients with low- and 4 with high-CgA), 8 PPGL patients and 8 control samples from 6 healthy individuals (2 of them were also treated with PPI, samples before and after PPI treatment were both included). Altogether, 1525 miRNA were detected in NGS profiling of whole serum samples. While nine miRNAs were the most abundant with an >500 UMI reads/sample representing 0.05% of all detected miRNAs, the great majority of miRNAs (1461 of 1525, 95%) were in the low-expression range (below 50 UMI reads/sample) (Figure 1A,B). Total (global) miRNA expression in patients with pNET or PPGL was significantly decreased compared to normal controls (Figure 1C).
Figure 1.
MiRNA expression in the exploratory study. (A) MiRNA abundance in serum. (B) Expression of the 9 most abundant miRNAs. (C) Global miRNA expression level among normal controls and pNET/PCC samples. Error bars indicate mean ± SE. * represents p-value < 0.05. (D) 33 differentially expressed miRNAs among different groups can discriminate against control and pNET/PCC samples. Green indicates lower, red indicates higher expression.
Low abundance (<50 UMI read number) miRNAs were excluded from further analysis because these miRNAs could not be validated in our experimental set up [26]. 33 miRNAs differentiated pNET/PPGL patients from normal controls irrespective of PPI treatment (Table 1, Figure 1D). In pNET 19 and 7 under- and over-expressed miRNA, while in PPGL 25 and 6 under- and over-expressed miRNAs compared to healthy controls were found (Table 1). However, PNET and PPGL patients could not be differentiated by serum miRNA expression (Figure 1D). Additionally, we did not find significant differences in healthy controls before and after PPI treatment.
Table 1.
33 miRNAs differentially expressed among controls with or without PPI treatment vs. PPGL vs. pNET groups. (“control&PPI” group includes all healthy controls with and without PPI treatment: “tumor-free” healthy individuals irrespective of the usage of PPI).
| miRNA | ANOVA p-Value | pNET vs. Control&PPI | PGGL vs. Control&PPI | pNET vs. PPGL | |||
|---|---|---|---|---|---|---|---|
| log2FC | Post-hoc p-Value | log2FC | Post-hoc p-Value | log2FC | Post-hoc p-Value | ||
| hsa-miR-223-3p | 0.0015 | −1.62 | 0.0304 | −2.27 | 0.0235 | 0.65 | 1 |
| hsa-miR-486-3p | 0.0002 | −1.56 | 0.0177 | −2.51 | 0.0066 | 0.95 | 1 |
| hsa-miR-451a | 0.0003 | −1.42 | 0.0257 | −2.35 | 0.0058 | 0.93 | 1 |
| hsa-miR-16-5p | 0.0009 | −1.48 | 0.0320 | −2.00 | 0.0139 | 0.52 | 1 |
| hsa-miR-25-3p | 0.0001 | −1.48 | 0.0153 | −2.10 | 0.0054 | 0.62 | 1 |
| hsa-miR-143-3p | 0.0001 | −1.35 | 0.0240 | −2.34 | 0.0031 | 1.00 | 1 |
| hsa-miR-101-3p | 0.0040 | −1.31 | 0.0823 | −1.90 | 0.0273 | 0.60 | 1 |
| hsa-miR-486-5p | 0.0005 | −1.27 | 0.0413 | −2.50 | 0.0066 | 1.23 | 1 |
| hsa-miR-425-5p | 0.0000 | −1.23 | 0.0178 | −2.23 | 0.0024 | 0.99 | 1 |
| hsa-miR-148a-3p | 0.0010 | −1.25 | 0.0322 | −1.82 | 0.0146 | 0.57 | 1 |
| hsa-miR-93-5p | 0.0003 | −1.29 | 0.0240 | −1.97 | 0.0066 | 0.68 | 1 |
| hsa-let-7g-5p | 0.0000 | −1.14 | 0.0178 | −2.20 | 0.0024 | 1.06 | 1 |
| hsa-let-7i-5p | 0.0003 | −1.06 | 0.0316 | −1.89 | 0.0055 | 0.83 | 1 |
| hsa-miR-92a-3p | 0.0004 | −1.05 | 0.0440 | −2.05 | 0.0060 | 1.01 | 1 |
| hsa-let-7a-5p | 0.0003 | −1.00 | 0.0235 | −1.66 | 0.0064 | 0.66 | 1 |
| hsa-miR-185-5p | 0.0008 | −1.02 | 0.0859 | −2.23 | 0.0079 | 1.22 | 1 |
| hsa-miR-342-3p | 0.0029 | −0.97 | 0.0624 | −1.63 | 0.0249 | 0.66 | 1 |
| hsa-miR-30e-5p | 0.0001 | −0.93 | 0.0295 | −1.77 | 0.0031 | 0.84 | 1 |
| hsa-miR-142-3p | 0.0055 | −0.85 | 0.1610 | −1.71 | 0.0287 | 0.86 | 1 |
| hsa-miR-30d-5p | 0.0015 | −0.88 | 0.0432 | −1.57 | 0.0165 | 0.69 | 1 |
| hsa-let-7b-5p | 0.0029 | −0.84 | 0.0539 | −1.51 | 0.0261 | 0.67 | 1 |
| hsa-let-7f-5p | 0.0007 | −0.75 | 0.0475 | −1.41 | 0.0081 | 0.66 | 1 |
| hsa-miR-199a-3p | 0.0069 | −0.77 | 0.1009 | −1.47 | 0.0375 | 0.70 | 1 |
| hsa-miR-103a-3p | 0.0003 | −0.74 | 0.0371 | −1.38 | 0.0055 | 0.63 | 1 |
| hsa-miR-26b-5p | 0.0003 | −0.65 | 0.0424 | −1.31 | 0.0054 | 0.66 | 1 |
| hsa-miR-6743-3p | 0.0002 | 0.61 | 0.0179 | 0.45 | 0.0054 | 0.15 | 1 |
| hsa-miR-4440 | 0.0000 | 0.65 | 0.0107 | 0.54 | 0.0031 | 0.11 | 1 |
| hsa-miR-6717-5p | 0.0000 | 0.66 | 0.0009 | 0.43 | 0.0007 | 0.23 | 1 |
| hsa-miR-148a-5p | 0.0000 | 0.89 | 0.0067 | 0.59 | 0.0054 | 0.30 | 1 |
| hsa-miR-7155-5p | 0.0002 | 0.96 | 0.0071 | 0.31 | 0.0358 | 0.65 | 1 |
| hsa-miR-203a-3p | 0.0006 | 1.54 | 0.0716 | 2.07 | 0.0066 | −0.54 | 1 |
| hsa-miR-6857-3p | 0.0071 | 2.67 | 0.0316 | 0.49 | 0.6878 | 2.18 | 1 |
| hsa-miR-4274 | 0.0055 | 3.09 | 0.0279 | 1.23 | 0.6318 | 1.86 | 1 |
PPGL: pheochromocytoma-paraganglioma; PPI: proton pump inhibitor treatment; pNET: pancreatic neuroendocrine tumor, log2FC: log2fold change (counts); post-hoc p-value: p-value following Tukey post-hoc test adjusted by Benjamini–Hochberg method for multiple testing correction.
Expression of 19 miRNAs showed a significant correlation with serum CgA levels among which hsa-let-7g-5p showed the strongest association (R = −0.73; p = 0.03077).
2.3. miRNA Validation
Of the 33 significantly differently expressed miRNAs between controls and tumor sera samples we selected 6 underexpressed miRNAs (let-7b-5p, let-7i-5p; miR-143-3p; miR-30d-5p; miR-451a; miR-486-5p) in pNET/PPGL samples compared to controls) based on miRNA abundance for further investigation. Additionally, we also validated the most overexpressed miR-203a-3p despite its relatively lower abundance (avg. UMI read number in pNET/PPGL samples: 68 vs. avg. UMI read number in controls: 19). The selected miRNAs were measured on an extended sample cohort consisting of 25 pNET and 20 PPGL patients (together with those included in the exploratory cohort), and 29 control samples (5 with PPI treatment, 24 without PPI treatment; including samples from our exploratory cohort).
All the 6 underexpressed miRNAs were confirmed by RT-qPCR as well (Figure 2A). After dissecting tumor groups, the underexpression of miR-30d-5p, miR-451a, and miR-486-5p was significant in pNET patients with high CgA levels and let-7b-5p in PPGL cases compared to healthy controls without PPI treatment (Figure 2B).
Figure 2.
(A,B) CgA levels and miRNA expression among controls and pNET/PPGL samples. Error bars indicate mean ± SE. * represents p-value < 0.05.
The overexpression of miR-203a-3p was not confirmed by RT-qPCR in any of the samples but one pNET patient with extremely high CgA (2490.8 ng/mL).
2.4. Association of miRNA Expression with Clinicopathological Parameters
We could not find a difference in miRNA expression profiles of pNET/PPGL samples compared to healthy controls treated with PPI. However, let-7b-5p, let-7i-5p; miR-143-3p; miR-30d-5p; miR-451a and miR-486-5p showed lower expression in samples with high (>100 ng/mL) CgA levels compared to samples with normal CgA level (≤100 ng/mL) (Figure 3A). The expression of all 6 miRNAs showed a negative correlation with serum CgA level when all samples were included in the analysis. While investigating correlation in different patient groups the negative correlation between miRNAs and CgA remained significant only in the healthy control group but not in pNET or PPGL group (Table 2).
Figure 3.
Individual qPCR validation of miRNAs in CgA high vs. CgA low samples (A), among pNET samples with different grade (B), in sporadic vs. genetically predisposed PPGL (C), and in SDHB mutation associated vs. non-associated PPGL (D). Error bars indicate mean ± SE. * represents p-value < 0.05.
Table 2.
CgA correlation with miRNA expression in the validation set (CgA vs. –dct).
| All Samples | |||
| Correlation | Sample Number | Spearman | p-value |
| CgA & hsa-let-7b-5p | 74 | −0.29 | 0.0125 |
| CgA & hsa-let-7i-5p | 74 | −0.46 | 0.0000 |
| CgA & hsa-miR-143-3p | 74 | −0.34 | 0.0029 |
| CgA & hsa-miR-30d-5p | 74 | −0.39 | 0.0007 |
| CgA & hsa-miR-451a | 74 | −0.50 | 0.0000 |
| CgA & hsa-miR-486-5p | 74 | −0.39 | 0.0006 |
| Healthy Controls (with & without PPI) | |||
| Correlation | Sample number | Spearman | p-value |
| CgA & hsa-let-7b-5p | 29 | −0.27 | 0.1599 |
| CgA & hsa-let-7i-5p | 29 | −0.42 | 0.0249 |
| CgA & hsa-miR-143-3p | 29 | −0.40 | 0.0293 |
| CgA & hsa-miR-30d-5p | 29 | −0.39 | 0.0377 |
| CgA & hsa-miR-451a | 29 | −0.40 | 0.0334 |
| CgA & hsa-miR-486-5p | 29 | −0.17 | 0.3852 |
| PPGL | |||
| Correlation | Sample number | Spearman | p-value |
| CgA & hsa-let-7b-5p | 20 | −0.05 | 0.8256 |
| CgA & hsa-let-7i-5p | 20 | −0.42 | 0.0655 |
| CgA & hsa-miR-143-3p | 20 | −0.37 | 0.1069 |
| CgA & hsa-miR-30d-5p | 20 | −0.35 | 0.1317 |
| CgA & hsa-miR-451a | 20 | -0.38 | 0.1009 |
| CgA & hsa-miR-486-5p | 20 | -0.45 | 0.0451 |
| pNET | |||
| Correlation | Sample number | Spearman | p-value |
| CgA & hsa-let-7b-5p | 25 | −0.04 | 0.8380 |
| CgA & hsa-let-7i-5p | 25 | −0.22 | 0.2838 |
| CgA & hsa-miR-143-3p | 25 | −0.14 | 0.5116 |
| CgA & hsa-miR-30d-5p | 25 | −0.02 | 0.9157 |
| CgA & hsa-miR-451a | 25 | −0.32 | 0.1198 |
| CgA & hsa-miR-486-5p | 25 | −0.18 | 0.3892 |
Investigating miRNAs in relation to the tumor grade, in pNET patients a tendency of inverse correlation between miRNAs: let-7i-5p, miR-30d-5p, and miR-451a and grade was observed (Figure 3B).
In samples obtained from PPGL patients only miR-486-5p showed an inverse correlation with CgA (Table 2). As different miRNA signatures have been described in malignant vs. benign [27] and sporadic vs. hereditary PPGL [28] we aimed to investigate serum miRNAs in correlation to these clinicopathological parameters. We found that in serum samples obtained from PPGL patients with germline mutations (SDHB, RET, VHL, or NF1) miR-486-5p and miR-30d-5p were downregulated compared to sporadic patients (Figure 3C). In patients with SDHB germline mutation beside the underexpression of miR-30d-5p and miR-486-5p, let-7b-5p and let-7i-5p also showed downregulation compared to serum samples of patients with SDHB wild type (Figure 3D).
2.5. Diagnostic Value of the Circulating miRNAs in PPGL/pNET
In the discrimination of healthy controls from pNET and PPGL patients, we performed receiver-operating characteristic (ROC) analysis for CgA and individual miRNAs. Binary logistic regression models were generated for combinations of miRNAs and combinations of CgA with miRNAs. Altogether 6 miRNAs (let-7b-5p, let-7i-5p, miR-143-3p, miR-30d-5p, miR-451a, and miR-486-5p) were assessed individually and in combinations (Table 3). In the pNET group compared to CgA the use of individual let-7b-5p, miR-30d-5p, miR-451a, and miR-486-5p in ROC analysis resulted in better discrimination (Table 3). Additionally, the regression model of the combination of CgA with a panel of 4 (let-7b-5p, let-7i-5p, hsa-miR-143-3p, miR-30d-5p) miRNAs resulted in the best discrimination with 72.2% accuracy (AUC: 0.751; 75.8% sensitivity; 68% specificity) (Table 3).
Table 3.
Diagnostic performance of CgA, individual miRNAs, and the best combination of CgA with miRNAs between different groups. *: Cut off values of CgA in ng/mL and of miRNAs in dCt; **: Cut-off in binary logistic regression model. AUC: area under curve.
| PPGL vs. Controls with & without PPI treatment | AUC | Cutoff * | Sensitivity % | Specificity % | p-value | |
|---|---|---|---|---|---|---|
| CgA | 0.890 | >102.3 | 95.0 | 72.4 | <0.0001 | |
| Individual miRNAs | hsa-let-7b-5p | 0.707 | >12.5 | 90.0 | 48.3 | 0.0147 |
| hsa-let-7i-5p | 0.710 | >5.7 | 100.0 | 3.4 | 0.0135 | |
| hsa-miR-143-3p | 0.598 | >7.7 | 100.0 | 27.6 | 0.2463 | |
| hsa-miR-30d-5p | 0.643 | >9.9 | 65.0 | 65.5 | 0.0914 | |
| miR-451a | 0.678 | >5.8 | 45.0 | 86.2 | 0.0353 | |
| miR-486-5p | 0.660 | >7.3 | 30.0 | 96.6 | 0.0586 | |
| Binary logistic regression model | AUC | cut-off ** | Sensitivity % | Specificity % | p -value | |
| Best of all combinations | CgA+hsa-let-7b-5p+hsa-miR-143-3p+hsa-miR-486-5p | 0.862 | 0.4 | 85.0 | 82.8 | 0.0085 |
| pNET vs. Controls with & without PPI treatment | AUC | cut-off * | Sensitivity % | Specificity % | p -value | |
| CgA | 0.672 | >102.5 | 64.0 | 72.4 | 0.0308 | |
| Individual miRNAs | hsa-let-7b-5p | 0.702 | >12.9 | 80.0 | 62.1 | 0.0111 |
| hsa-let-7i-5p | 0.661 | >7.9 | 80.0 | 51.7 | 0.0433 | |
| hsa-miR-143-3p | 0.661 | >9.0 | 100.0 | 41.4 | 0.0433 | |
| hsa-miR-30d-5p | 0.675 | >9.7 | 76.0 | 62.1 | 0.0276 | |
| miR-451a | 0.692 | >2.9 | 96.0 | 41.4 | 0.0159 | |
| miR-486-5p | 0.712 | >4.2 | 88.0 | 58.6 | 0.0078 | |
| Binary logistic regression model | AUC | cut-off** | Sensitivity % | Specificity % | p -value | |
| Best of all combinations | CgA+hsa-let-7b-5p+hsa-let-7i-5p+hsa-miR-143-3p+hsa-miR-30d-5p | 0.752 | 0.5 | 75.9 | 68.0 | 0.0351 |
| CgA low pNET vs. Controls with & without PPI treatment | AUCa | cut-off * | Sensitivity % | Specificity % | p -value | |
| CgA | 0.613 | <79.6 | 100.0 | 37.9 | 0.3112 | |
| Individual miRNAs | hsa-let-7b-5p | 0.651 | >12.9 | 77.8 | 62.1 | 0.1751 |
| hsa-let-7i-5p | 0.517 | <8.8 | 100.0 | 20.7 | 0.8772 | |
| hsa-miR-143-3p | 0.646 | >9.9 | 100.0 | 48.3 | 0.1920 | |
| hsa-miR-30d-5p | 0.577 | >9.4 | 77.8 | 55.2 | 0.4923 | |
| miR-451a | 0.527 | >2.9 | 88.9 | 41.4 | 0.8101 | |
| miR-486-5p | 0.561 | >4.2 | 66.7 | 58.6 | 0.5828 | |
| Binary logistic regression model | AUC | cut-off ** | Sensitivity % | Specificity % | p -value | |
| Best of all combinations | CgA+hsa-let-7b-5p+hsa-let-7i-5p+hsa-miR-143-3p+hsa-miR-30d-5p+hsa-miR-486-5p | 0.904 | 0.55 | 66.7 | 96.6 | 0.0342 |
Clinically, the most challenging pNET patients are those with normal serum CgA levels (<100 ng/mL). Therefore, miRNA expression profiles are of particular interest in these patients. The use of the individual expression of let-7b-5p or miR-143-3p yielded better discrimination from healthy controls compared to CgA alone (Table 3). However, the combination of CgA value with an expression of 4 miRNAs in a logistic regression model showed the best discrimination between pNET-low CgA group compared to healthy controls including normal or elevated CgA with the accuracy of 89.4% (AUC: 0.904, sensitivity: 66.6%, specificity: 96.5%) (Table 3).
In our sample set all PPGL patients had elevated CgA level, and in line with this CgA, had the highest discriminatory value with 81.6% accuracy (AUC: 0.889; 75% sensitivity, 86% specificity; p = 0.0007). Using binary logistic regression model the combination of CgA with 3 miRNAs (let-7b-5p, miR-143-3p and miR-486-5p) yielded higher specificity compared to CgA alone with 83.6% accuracy in discrimination of normal samples from PPGL samples, however, with lower sensitivity (AUC: 0.862; 85% sensitivity; 82.7% specificity) (Table 3).
2.6. Analysis of Deregulated pNET/PPGL Tissue miRNAs in Serum Samples
To investigate the potential origin of miRNAs in serum, we collected the data of 12 studies reporting tissue miRNA expression profiles in pNET [29,30,31,32,33,34,35] and PPGL [27,28,36,37,38]. By cross-referencing differentially expressed miRNAs from those studies with our current findings 9 miRNAs in pNET and 3 miRNAs in PPGL were found commonly dysregulated in both tissue and serum. (Table 4). Among these, only miR-203a-3p was overexpressed both in pNET tissue and serum. All other miRNAs were upregulated in tumor tissues and downregulated in serum samples. In PPGL, while miR-101-3p showed higher expression in malignant vs. benign PPGLs, in serum, it was downregulated compared to controls. However, miR-16-5p and miR-451a as putative tumor suppressor miRNAs were downregulated in both tissue and serum (Table 4).
Table 4.
Comparison of differentially expressed miRNAs in pNET/PCC tumor tissues vs. serum. miRNAs common in both tissues and sera samples are indicated in the table.
| pNET | |||||
|---|---|---|---|---|---|
| miRNA | Corrected p-Value | Controls | pNET | Reference | |
| avg. UMI Read Number | |||||
| miR-103a-3p | 0.0371 | 109 | 65 | Roldo et al., 2006 [33] | overexpressed in pNET+PACC vs. NP |
| Zimmermann et al., 2018 [35] | negative correlation with Ki-67 in GEP-NET | ||||
| miR-26b-5p | 0.0423 | 115 | 73 | Roldo et al., 2006 [33] | overexpressed in pNET+PACC vs. NP |
| miR-143-3p | 0.0240 | 110 | 43 | Jiang et al., 2015 [29] | overexpressed in INS vs pancreatic islet |
| miR-451a | 0.0257 | 198 | 74 | Jiang et al., 2015 [29] | overexpressed in INS vs pancreatic islet |
| miR-25 | 0.0153 | 383 | 138 | Zimmermann et al., 2018 [35] | overexpressed in nodal met. vs. primary GEP-NET |
| miR-425-5p | 0.01781 | 111 | 47 | Zimmermann et al., 2018 [35] | overexpressed in nodal met. vs. primary GEP-NET |
| miR-93-5p | 0.0240 | 286 | 117 | Grolmusz et al., 2018 [34] | higher expression in higher grade pNET |
| miR-16-5p | 0.0320 | 9670 | 3475 | Zimmermann et al., 2018 [35] | negative correlation with Ki-67 in GEP-NET |
| miR-203a-3p | 0.0715 | 19 | 56 | Roldo et al., 2006 [33] | overexpressed in INS vs NF-pNET |
| PCC | |||||
| miRNA | Corrected p-Value | Controls | PCC | Reference | |
| avg. UMI Read Number | |||||
| miR-101-3p | 0.0273 | 209 | 56 | Zong et al.2015 [36] | higher expression in malignant vs. benign PCC higher expression in SDHD mutation-associated tumors |
| Patterson et al., 2012 [27] | differentially expressed between malignant vs. benign PCC | ||||
| miR-16-5p | 0.0139 | 9670 | 2423 | Meyer-Rochow et al., 2010 [37] | underexpressed in malignant vs. benign PCC |
| miR-451a | 0.005 | 198 | 39 | Meyer-Rochow et al., 2010 [37] | underexpressed in malignant vs. benign PCC |
3. Discussion
Tumors of the neuroendocrine system are rare entities but represent serious diagnostic and therapeutical challenges. Especially, when they are hormonally inactive, the diagnosis is usually delayed due to a lack of specific circulating biomarkers. The delayed diagnosis influences prognosis and survival [2]. Therefore, novel circulating biomarkers are needed. To our best knowledge, no study on the diagnostic accuracy of circulating miRNAs in neuroendocrine tumors in relation to serum CgA has been published.
Our data revealed a low global miRNA expression (abundance) in sera of patients with pNET/PPGL compared to normal controls. The same phenomenon was also observed in blood samples obtained from patients with pituitary adenoma [26]. Interestingly, in tumor tissues, a general downregulation of miRNAs compared to normal tissues was also detected suggesting their general tumor-suppressive role instead of being oncogenes [39]. Based on the individual miRNA measurements, Mitchell et al., 2008 [17] reported that the presence of tumors does not lead to a generalized increase in circulating miRNAs. However, specific individual tumor-derived miRNAs can show increased expression in circulation. With the technical advancement of NGS, total miRNA abundance can be determined easier and more accurately than earlier used platforms (i.e., microarray) allowed. Still, both the causes and the role of the decreased global miRNA expression in circulation related to endocrine tumors are waiting to be further explored.
The origin of circulating miRNAs is still not clearly defined [40]. The high-abundance cell-free circulating miRNAs derive primarily from blood and endothelial cells, and tumor-derived miRNAs are possibly among the moderate or low abundance range which highlights the importance of the accurate detection of moderate-low abundance miRNAs [17,24,40]. The overexpressed miRNAs can originate directly from tumor tissues [17]. By cross-referencing these with the tissue miRNA expression we identified 3 miRNAs commonly dysregulated in both tissue and circulation. MiR-203a-3p was overexpressed both in pNET tissue and serum. Similarly, to our findings, in breast cancer, the same miR-203a-3p was overexpressed both on a tissue level and in exosomes secreted by tumor cells [41,42]. Functionally, it exhibits oncogenic effects in colon and breast cancer, and through MYC and it influences taxane sensitivity [41,43,44]. These data raise the possibility that miR-203a-3p may potentially be originated from tumor cells and can be considered as an oncomiR. However, its low abundance in the sera of patients with NET limits its wide clinical applicability as a tumor marker. Among downregulated miRNAs, miR-16-5p and miR-451a were both downregulated in PPGL tissues and sera indicating their roles as potential tumor suppressors that are well-established in other cancers [45,46].
Based on the expression pattern of 33 miRNAs we were able to separate pNET/PPGL patients from normal controls even on PPI treatment. Based on serum miRNA expression we could not distinguish samples of pNET from those of PPGL patients. This may reflect the common enterochromaffin cell type origin of these tumors [47].
Based on NGS data, several miRNAs showed (mostly inverse) correlation with serum CgA level. However, after validation on an extended sample set, this correlation remained significant only in healthy individuals but not in pNET or PGGL patients (except for miR-486-5p in PPGL patients). This may be due to the loss of the great majority of miRNAs showing correlation with CgA during tumorigenesis (as the global expression of miRNAs decreased in patients compared to healthy individuals) or due to technical issues. NGS allows us to detect any miRNA with low or very low copies but RT-qPCR has a detection limit, in our experimental settings miRNAs with reads <50 UMI could not be validated with RT-qPCR.
Increased CgA level upon PPI treatment decreases the clinical utility of CgA in neuroendocrine tumors. Performing ROC analysis, we found that in pNET samples CgA alone was less effective in discrimination of pNET sera from healthy controls. The addition of miRNAs to CgA increased the diagnostic value of CgA. Importantly, in patients with pNET with normal CgA level where CgA alone was not informative, the combination of CgA with a miRNA panel could reach high diagnostic value (AUC: 0.904).
In pNET patients, the grade, determined by the Ki-67 proliferation index, has an important impact on prognosis [48]. Although the low sample number represents a limitation of our study, the expression of miR-451a, let-7i-5p, and miR-30d-5p showed a tendency of an inverse correlation with a grade in pNET patients. Circulating miR-451a was reported underexpressed in several tumor types and it was described as an immune-regulatory miRNA [45,49,50,51] that may explain its dysregulation according to tumor grade in pNET. Let-7i-5p is a well-known tumor suppressor miRNA which expression is negatively correlated with prognosis [52]. In several studies, it was underexpressed in sera of cancer patients vs. healthy controls [52] but the explanation behind its decreasing expression and its role in pNET patients with higher-grade remains to be clarified. MiR-30d-5p was also reported downregulated in tumor (hepatocellular carcinoma) cells and secreted exosomes and its high expression in hepatocellular carcinoma exhibited improved overall survival [53]. These data suggest that miR-30d-5p, measured both in tissue and in liquid biopsy samples, may indeed have a role in relation to tumor grade, progression, and survival.
Previously, in pNET, only one study investigated circulating miRNA levels compared to healthy controls [30]. The authors found a very similar miRNA expression profile compared to healthy volunteers [30]. Only miR-193b was described to be more abundant in the serum of patients and it was also more abundant in pNET tissue compared to islet cells. However, by analyzing both tissue and serum samples of 6 patients, there was a much lower correlation between expression levels in serum and tissue compared to the mean correlation coefficient within the same tissue [30]. In another study, 5 miRNAs were identified differentially expressed in the sera of pancreatic ductal adenocarcinoma patients compared to pNET but no comparison between pNET and healthy controls was performed [54]. None of these 5 miRNAs showed overlap with our results comparing pNET vs. controls. In a very recent publication, 6 upregulated and 11 downregulated miRNAs were identified in plasma exosome fraction of pNET patients (no functionality reported) compared to chronic pancreatitis [55]. Again, none of the identified miRNAs was identical to those in our study although they had different starting material, different measurement methods, and most importantly, they compared their data to chronic pancreatitis.
The decrease of miR-486-5p and miR-30d-5p was detected in patients with genetically determined PGGLs (mutation in either SDHB, RET, VHL, or NF1 genes) compared to sporadic cases. Let-7b-5p, let-7i-5p, miR-30d-5p, and miR-486-5p were downregulated in SDHB mutant cases compared to SDHB wild type cases indicating that the etiology of PPGL may influence the circulating miRNA pool. This observation needs further studies because no data about serum and tissue miRNA differences between sporadic and genetic PPGL cases were found. Four studies investigated circulating miRNAs in PPGLs [27,36,56,57]. No significant difference was demonstrated between benign and malignant cases but elevated levels of miR-96-5p; miR-182-5p and miR-21-3p in PPGL patients compared to healthy controls were reported [27,36,56]. We could not confirm these results probably due to differences in experimental design (mirVana™ PARIS™ Kit vs. miRNeasy Serum Kit for isolation; TaqMan assays vs. QIAseq™ miRNA Library Kit and droplet digital PCR vs. next-generation sequencing).
As a summary, we assessed for the first time the diagnostic accuracy of circulating miRNAs in relation to CgA in patients with pNET. Using the miRNA profile, we were able to discriminate pNET/PPGL samples from healthy controls, and a global downregulation of circulating miRNA pool was observed in patients with neuroendocrine tumors compared to healthy individuals. Similarly, to CgA, miRNA signature alone was not applicable as a biomarker for PPGL/pNET if PPI treatment is administered. However, the combination of a set of miRNAs together with CgA, even in the most challenging group (pNET patients with low CgA level or receiving PPI treatment) represents a promising diagnostic tool.
4. Materials and Methods
4.1. Patients and Controls
Altogether, 74 consecutive serum samples sent for CgA measurement to the Department of Laboratory Medicine, Semmelweis University were collected (Table 5) between 1 November 2017 and 24 July 2019. Samples were obtained from patients with pancreas nonfunctioning neuroendocrine tumor (pNET, n = 25), with pheochromocytoma-paraganglioma (PPGL, n = 20) and from healthy individuals (n = 29 samples from 24 unrelated cases). PPGL and healthy individuals treated with PPI were included as controls because in clinical practice elevated CgA levels most often can be found in these cases.
Table 5.
Patient characteristics. The following paired samples are from the same healthy control with and without PPI treatment: 45 + 46; 47 + 48; 67 + 68; 33 + 49; 69 + 70.
| Sample ID. | Sex | Age at Sampling | Group | CgA (ng/mL; Ref: 19.4–98.1) | PPGL: Benign/Malignant; pNET: Grade G1-G2-G3 |
Experiment |
|---|---|---|---|---|---|---|
| 51 | F | 12 | PPGL (PCC) | 548.6 | benign (pr) | NGS & qPCR |
| 52 | M | 41 | PPGL (PCC) | 10870 | benign (pr) | NGS & qPCR |
| 53 | M | 51 | PPGL (SDHB mutation associated. PCC; no other malignant tumor yet) | 863.4 | benign (pr) | NGS & qPCR |
| 18 | F | 47 | PPGL (MEN2 assoc. PCC) | 402.9 | malignant (rec & met) | qPCR |
| 19 | F | 45 | PPGL (PCC) | 128.1 | malignant (rec) | qPCR |
| 23 | F | 67 | PPGL (PCC) | 749.6 | benign (pr) | qPCR |
| 20 | M | 56 | PPGL (PGL) | 8166 | malignant (rec & met) | qPCR |
| 56 | M | 40 | PPGL (SDHB mutation associated PGL) | 2265 | malignant (rec & met) | NGS & qPCR |
| 57 | F | 69 | PPGL (PCC) | 1375 | malignant (rec & met) | NGS & qPCR |
| 21 | F | 44 | PPGL (PGL) | 273 | malignant (rec & met) | qPCR |
| 62 | F | 48 | PPGL (PCC) | 2409 | benign (pr) | NGS & qPCR |
| 28 | M | 20 | PPGL (PCC) | 809.5 | NA | qPCR |
| 22 | F | 35 | PPGL (NF1 mutation associated PCC; no other malignant manifestation) | 1602 | malignant (rec & met) | qPCR |
| 64 | F | 35 | PPGL (PCC) | 487.9 | benign (pr) | NGS & qPCR |
| 26 | M | 24 | PPGL (VHL mutation associated PCC; no other malignant tumor) | 63.2 | malignant (bilateral) | qPCR |
| 24 | F | 69 | PPGL (PCC) | 2295 | malignant (rec & met) | qPCR |
| 29 | M | 21 | PPGL (PCC) | 104.1 | benign (pr) | qPCR |
| 27 | F | 62 | PPGL (PCC) | 115 | benign (pr) | qPCR |
| 66 | F | 15 | PPGL (SDHB mutation associated PCC) | 470.8 | malignant (rec & met) | NGS & qPCR |
| 25 | M | 36 | PPGL (PCC) | 1037.4 | malignant (rec & met) | qPCR |
| 1 | M | 75 | pNET | 34.2 | G1 | qPCR |
| 54 | F | 58 | pNET | 191.5 | NA | NGS & qPCR |
| 55 | M | 67 | pNET | 176.6 | G3 | NGS & qPCR |
| 2 | M | 57 | pNET | 35.2 | G2 | qPCR |
| 3 | F | 62 | pNET | 62.2 | G2 | qPCR |
| 4 | M | 77 | pNET | 67.9 | G2 | qPCR |
| 58 | F | 66 | pNET | 162.7 | NA | NGS & qPCR |
| 59 | M | 52 | pNET | 448.5 | G2 | NGS & qPCR |
| 5 | F | 62 | pNET | 44.2 | G2 | qPCR |
| 60 | M | 72 | pNET | 1679 | G2 | NGS & qPCR |
| 61 | F | 61 | pNET | 543.6 | G2 | NGS & qPCR |
| 6 | M | 39 | pNET | 327.4 | G3 | qPCR |
| 63 | F | 47 | pNET | 1009 | G2 | NGS & qPCR |
| 7 | M | 68 | pNET | 219.2 | G2 | qPCR |
| 65 | M | 74 | pNET | 104.5 | G1 | NGS & qPCR |
| 8 | M | 42 | pNET | 190.1 | G3 | qPCR |
| 9 | F | 48 | pNET | 115.4 | NA | qPCR |
| 10 | F | 82 | pNET | 79.1 | G1 | qPCR |
| 11 | F | 76 | pNET | 132 | G2 | qPCR |
| 12 | F | 58 | pNET | 51.5 | G1 | qPCR |
| 13 | M | 75 | pNET | 2490.8 | NA | qPCR |
| 14 | F | 64 | pNET | 4163 | G2 | qPCR |
| 15 | F | 59 | pNET | 275.7 | NA | qPCR |
| 16 | M | 72 | pNET | 49.8 | G2 | qPCR |
| 17 | M | 73 | pNET | 34.4 | NA | qPCR |
| 74 | M | 77 | healthy control | 38.5 | na | qPCR |
| 38 | M | 71 | healthy control | 53.7 | na | qPCR |
| 40 | F | 49 | healthy control | 12.7 | na | qPCR |
| 31 | M | 49 | healthy control | 41.5 | na | qPCR |
| 76 | M | 44 | healthy control | 39.8 | na | NGS & qPCR |
| 36 | F | 68 | healthy control | 100.4 | na | qPCR |
| 30 | F | 13 | healthy control | 18 | na | qPCR |
| 34 | M | 40 | healthy control | 40.2 | na | qPCR |
| 35 | F | 69 | healthy control | 48.7 | na | qPCR |
| 41 | F | 47 | healthy control | 93 | na | qPCR |
| 39 | F | 63 | healthy control | 55 | na | qPCR |
| 75 | M | 65 | healthy control | 39 | na | qPCR |
| 37 | M | 55 | healthy control | 57.2 | na | qPCR |
| 73 | M | 47 | healthy control | 34 | na | NGS & qPCR |
| 43 | F | 16 | healthy control | 52.6 | na | qPCR |
| 42 | F | 33 | healthy control | 68.4 | na | qPCR |
| 72 | F | 46 | healthy control | 42.8 | na | NGS & qPCR |
| 32 | F | 58 | healthy control | 80.2 | na | qPCR |
| 71 | M | 37 | healthy control | 27.7 | na | NGS & qPCR |
| 45 | F | 72 | healthy control without PPI | 494 | na | qPCR |
| 46 | F | 72 | healthy control on PPI | 5775 | na | qPCR |
| 47 | F | 62 | healthy control without PPI | 198.9 | na | qPCR |
| 48 | F | 62 | healthy control on PPI | 516 | na | qPCR |
| 67 | F | 39 | healthy control without PPI | 42.3 | na | NGS & qPCR |
| 68 | F | 39 | healthy control on PPI | 197.8 | na | NGS & qPCR |
| 33 | M | 64 | healthy control without PPI | 186.7 | na | qPCR |
| 49 | M | 64 | healthy control on PPI | 595.4 | na | qPCR |
| 69 | F | 46 | healthy control without PPI | 45.6 | na | NGS & qPCR |
| 70 | F | 46 | healthy control on PPI | 278 | na | NGS & qPCR |
All patients with pNET (12 females, 13 males; avg age: 63.4 years) had metastatic disease. Low-CgA (<100 ng/mL) pNET group consisted of 9, high-CgA (>100 ng/mL) pNET group consisted of 16 patients. Grade of pNET was determined according to WHO 2017 classification of tumors of endocrine organs based on the Ki-67 index (Table 5) [58].
PPGL group consisted of 12 females and 8 males with an average age of 41.8 years. Of them, 8 were benign, 11 were malignant (1 bilateral, 1 locally receive, and 9 metastatic) and there was no information available in one case. 14 of the 20 PPGL cases were sporadic, while 6 cases were associated with germline gene mutations in one of the PPGL susceptibility genes (Table 5). All PPGL patients had elevated CgA levels (avg. CgA: 1751 ng/mL).
Altogether 24 healthy controls were included in the study. Among 29 control samples, 10 sera from 5 healthy volunteers were collected with and without proton pump inhibitor (PPI) treatment. Samples from these individuals were included if high-dose PPI at least for 2 weeks were administered [11]. In our discovery analysis, we used 8 control samples from 6 healthy individuals, 2 samples were taken from two cases after PPI treatment. None of the controls had the endocrine disease, tumor, or renal insufficiency. Eight samples obtained from patients with pNET and 8 samples obtained from PPGL patients were evaluated. In our validation set, we used all samples used in the discovery analysis along with 17 additional samples obtained from pNET, 12 samples obtained from PPGL patients, and 21 samples obtained from healthy controls (Table 5). Clinical information was retrieved from the Semmelweis University medical information system. The study was approved by the Hungarian National Public Health Center (NPHC: 41189-7/2018/EÜIG, 13 December 2018) and the Scientific and Research Committee of the Medical Research Council of Ministry of Health, Hungary (ETT-TUKEB 4457/2012/EKU, 2 February 2012).
4.2. Sample Handling and RNA Extraction
Upon arriving samples were immediately processed for sera separation by centrifugation with 3000× g for 10 min at 4 °C. Then, samples were aliquoted and refrigerated at −20 °C until further processing. Samples for RNA isolation were further processed by centrifugation with 16,000× g for 15 min at 4 °C to deplete platelets.
CgA measurements were done as part of the routine diagnostics using an IVD qualified competitive radioimmunassay method (Chromogranin A kit; REF: CGA-RIACT; Cisbio Bioassays, Codolet, France) following the manufacturer instructions on RIA-mat-280 gamma counter (Byk-Sangtec Diagnostica, Dietzenbach, Germany).
For total RNA extraction containing small RNA fraction miRNeasy Serum/Plasma Kit (Qiagen, Cat #217184, Hilden, Germany) was applied. Custom cel-miR-39 spike-in control was added to samples during RNA extraction following the manufacturer’s instruction (Qiagen, Cat # 219610) [26]. Cellular contamination of serum samples was studied by evaluation of expression of miRNAs related to red blood cells and platelets.
4.3. miRNA Expression Profiling by Next-Generation Sequencing
MiRNA expression profiling and NGS data analysis were done as we earlier reported [26,59]. For miRNA sequencing, libraries were prepared using 5 ul RNA and the QIAseq™ miRNA Library Kit (Qiagen, Cat #331505) following the manufacturer’s instructions. Next-generation sequencing was run on Illumina MiSeq instrument using MiSeq Reagent Kit v3 150-cycle (MS-102-3001, Illumina, San Diego, CA, USA. For count normalization TMM was applied as it is one of the best performing algorithm for comprehensive miRNA profiling studies [60].
4.4. RT-qPCR Validation of NGS Results
For validation TaqMan Advanced miRNA cDNA Synthesis Kit (Cat#: A28007, Thermo Fisher Scientific, Waltham, MA, USA) was applied. The expression of miRNAs was determined using individual Advanced TaqMan MicroRNA Assays (Assay IDs: cel-miR-39-3p: 478293_mir, hsa-let-7b-5p: 478575_mir; hsa-let-7i-5p: 478375_mir; hsa-miR-143-3p: 477912_mir; hsa-miR-203a-3p: 478316_mir; hsa-miR-30d-5p: 478606_mir; hsa-miR-451a: 478107_mir; hsa-miR-486-5p: 478128_mir). Expression levels were calculated by the ddCt method, and fold changes were obtained using the formula 2-ddCt. All measurements were done in triplicates.
4.5. Literature Mining for Tissue-Serum miRNA Expression Cross-Referencing
To investigate the potential origin of serum miRNAs and to compare serum and tissue miRNA expression profiles, we collected data of miRNA expression profiling studies performed on pNET (7 studies) [29,30,31,32,33,34,35] and PPGL (5 studies) [27,28,36,37,38] by PubMed search. We cross-referenced our findings with data retrieved from these studies.
4.6. Statistical Analysis
Shapiro-Wilks test was applied to reveal data distribution. A comparison of differential expression was done by unpaired T-test or Mann–Whitney U test and one-way ANOVA followed by Tukey post-hoc test depending on data distribution and grouping. P-value adjustments were applied by Benjamini–Hochberg. For hierarchical cluster analysis, complete linkage clustering with Kendall’s Tau distance measuring method was used. The receiver–operator characteristic (ROC) analysis of CgA and miRNAs’ were used for their discriminatory role between different groups. Binary logistic regression analyses were applied to evaluate the relationships between miRNAs and the incidence of PPGL/pNET and to find the best logistic model. Diagnostic accuracy was calculated as: Accuracy = (TN + TP)/(TN + TP + FN + FP) = (Number of correct assessments)/(Number of all assessments). (TN: true negative; TP: true positive; FN: false negative; FP: false positive).
p-Value < 0.05 was considered significant. Statistical analyses were done using the R statistical programming language.
5. Conclusions
As a summary, we assessed for the first time the diagnostic accuracy of circulating miRNAs in relation to CgA in patients with pNET. Using the miRNA profile, we were able to discriminate pNET/PPGL samples from healthy controls, and a global downregulation of circulating miRNA pool was observed in patients with neuroendocrine tumors compared to healthy individuals.
In a comparison of pNET or PPGL groups with controls, levels of CgA, and miRNAs showed significant differences. If samples from controls treated with PPI were included either CgA or miRNA signature alone was not applicable as biomarker for PPGL/pNET. In addition, neither CgA nor any miRNA alone was able to discriminate low CgA pNET patients from controls treated with PPI. However, the combination of CgA concentration and expression level of miRNAs in a regression model yielded higher AUC compared to those obtained using individual markers, demonstrating that our model was effective in distinguishing different groups in every comparison. Our results are in line with previous findings showing that in other cancer types, independently of individually being significantly different or not, combining more factors in a regression model increases the discriminatory value of biomarkers [61,62]. Therefore, the combination of a set of miRNAs together with CgA, even in the most challenging group (pNET patients with low CgA level or receiving PPI treatment) represents a promising diagnostic tool.
Acknowledgments
We are grateful to Barna Vásárhelyi, the director of the Department of Laboratory Medicine of Semmelweis University for his support of this work and the critical review of the manuscript.
Abbreviations
| AUC | area under curve |
| CgA | chromogranin A |
| miRNA | micro-RNA |
| MYC | MYC proto-oncogene, bHLH transcription factor |
| NET | Neuroendocrine tumors |
| NF1 | neurofibromin 1 |
| NF-NET | nonfunctioning neuroendocrine tumor |
| NGS | next-generation sequencing |
| PCC | pheochromocytoma |
| PGL | paragangliomas |
| pNET | pancreatic neuroendocrine tumor |
| PPGL | pheochromocytoma-paraganglioma |
| PPI | proton-pump inhibitor |
| RET | ret proto-oncogene |
| RIA | radioimmunoassay |
| ROC | receiver-operating characteristic |
| SDHB | succinate dehydrogenase complex iron-sulfur subunit B |
| UMI | unique molecular index |
| VHL | von Hippel–Lindau tumor suppressor |
| VIPoma | vasoactive intestinal peptide producing neuroendocrine tumor |
Author Contributions
Conceptualization, A.P. and H.B.; formal analysis, O.D. and H.B; funding acquisition, A.P. and H.B.; investigation, A.K., P.A.K., and H.B.; methodology, A.K., G.N., and H.B.; project administration, F.B.; resources, A.P. and H.B.; supervision, A.P. and H.B.; writing—original draft, A.K. and H.B.; writing—review and editing, A.P. and H.B. All authors have read and agreed to the published version of the manuscript.
Funding
The research was financed by the Higher Education Institutional Excellence Programme of the Ministry of Human Capacities in Hungary, within the framework of the Molecular Biology thematic programme of the Semmelweis University to Attila Patócs and by Hungarian Scientific Research Grant of National Research, Development and Innovation Office (OTKA PD116093 to Henriett Butz and K125231 to Attila Patócs). The authors would like to acknowledge the National Program of Bioinics (subtheme medical bionics lead by Attila Patócs). Henriett Butz is a recipient of Bolyai Research Fellowship of Hungarian Academy of Sciences and her work is supported by the ÚNKP-19-4 New National Excellence Program of The Ministry for Innovation and Technology.
Conflicts of Interest
The authors declare no conflict of interest.
References
- 1.Modlin I., Gustafsson B.I., Moss S.F., Pavel M., Tsolakis A.V., Kidd M. Chromogranin A—Biological Function and Clinical Utility in Neuro Endocrine Tumor Disease. Ann. Surg. Oncol. 2010;17:2427–2443. doi: 10.1245/s10434-010-1006-3. [DOI] [PubMed] [Google Scholar]
- 2.Yao J.C., Hassan M., Phan A., Dagohoy C., Leary C., Mares J.E., Abdalla E.K., Fleming J.B., Vauthey J.-N., Rashid A., et al. One Hundred Years After “Carcinoid”: Epidemiology of and Prognostic Factors for Neuroendocrine Tumors in 35,825 Cases in the United States. J. Clin. Oncol. 2008;26:3063–3072. doi: 10.1200/JCO.2007.15.4377. [DOI] [PubMed] [Google Scholar]
- 3.Dasari A., Shen C., Halperin D.M., Zhao B., Zhou S., Xu Y., Shih T., Yao J.C. Trends in the Incidence, Prevalence, and Survival Outcomes in Patients With Neuroendocrine Tumors in the United States. JAMA Oncol. 2017;3:1335–1342. doi: 10.1001/jamaoncol.2017.0589. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Ro C., Chai W., Yu V.E., Yu R. Pancreatic neuroendocrine tumors: Biology, diagnosis, and treatment. Chin. J. Cancer. 2013;32:312–324. doi: 10.5732/cjc.012.10295. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Bílek R., Vlcek P., Šafařík L., Michalský D., Novák K., Dušková J., Vaclavikova E., Widimský J.J., Zelinka T., Widimský J. Chromogranin A in the Laboratory Diagnosis of Pheochromocytoma and Paraganglioma. Cancers. 2019;11:586. doi: 10.3390/cancers11040586. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Gkolfinopoulos S., Tsapakidis K., Papadimitriou K., Papamichael D., Kountourakis P. Chromogranin A as a valid marker in oncology: Clinical application or false hopes? World J. Methodol. 2017;7:9–15. doi: 10.5662/wjm.v7.i1.9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Ozaslan E., Karacan H., Simsek Y., Bayram F. An Overview of Neuroendocrine Tumour Markers. Turk. J. Endocrinol. Metab. 2014;18:132–136. doi: 10.4274/tjem.2422. [DOI] [Google Scholar]
- 8.Nobels F.R.E., Kwekkeboom D.J., Coopmans W., Schoenmakers C.H.H., Lindemans J., De Herder W.W., Krenning E.P., Bouillon R., Lamberts S.W.J. Chromogranin A as Serum Marker for Neuroendocrine Neoplasia: Comparison with Neuron-Specific Enolase and the ?-Subunit of Glycoprotein Hormones. J. Clin. Endocrinol. Metab. 1997;82:2622–2628. doi: 10.1210/jcem.82.8.4145. [DOI] [PubMed] [Google Scholar]
- 9.Di Giacinto P., Rota F., Rizza L., Campana D., Isidori A.M., Lania A., Lenzi A., Zuppi P., Baldelli R. Chromogranin A: From Laboratory to Clinical Aspects of Patients with Neuroendocrine Tumors. Int. J. Endocrinol. 2018;2018:8126087. doi: 10.1155/2018/8126087. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Mosli H.H., Dennis A., Kocha W., Asher L.J., Van Uum S.H.M. Effect of Short-Term Proton Pump Inhibitor Treatment and Its Discontinuation on Chromogranin A in Healthy Subjects. J. Clin. Endocrinol. Metab. 2012;97:E1731–E1735. doi: 10.1210/jc.2012-1548. [DOI] [PubMed] [Google Scholar]
- 11.Pregun I., Herszényi L., Juhasz M., Miheller P., Hritz I., Patocs A., Rácz K., Tulassay Z. Effect of Proton-Pump Inhibitor Therapy on Serum Chromogranin A Level. Digestion. 2011;84:22–28. doi: 10.1159/000321535. [DOI] [PubMed] [Google Scholar]
- 12.Hofland J., Zandee W., De Herder W.W. Role of biomarker tests for diagnosis of neuroendocrine tumours. Nat. Rev. Endocrinol. 2018;14:656–669. doi: 10.1038/s41574-018-0082-5. [DOI] [PubMed] [Google Scholar]
- 13.Mjønes P.G., Sagatun L., Nordrum I.S., Waldum H.L. Neuron-Specific Enolase as an Immunohistochemical Marker Is Better Than Its Reputation. J. Histochem. Cytochem. 2017;65:687–703. doi: 10.1369/0022155417733676. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Baudin E., Gigliotti A., Ducreux M., Ropers J., Comoy E., Sabourin J.C., Bidart J.M., Cailleux A.F., Bonacci R., Ruffié P., et al. Neuron-specific enolase and chromogranin A as markers of neuroendocrine tumours. Br. J. Cancer. 1998;78:1102–1107. doi: 10.1038/bjc.1998.635. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Leader M., Collins M., Patel J., Henry K. Antineuron specific enolase staining reactions in sarcomas and carcinomas: Its lack of neuroendocrine specificity. J. Clin. Pathol. 1986;39:1186–1192. doi: 10.1136/jcp.39.11.1186. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Tischler A.S. Molecular and cellular biology of pheochromocytomas and extra-adrenal paragangliomas. Endocr. Pathol. 2006;17:321–328. doi: 10.1007/s12022-006-0003-3. [DOI] [PubMed] [Google Scholar]
- 17.Mitchell P.S., Parkin R.K., Kroh E.M., Fritz B.R., Wyman S.K., Pogosova-Agadjanyan E.L., Peterson A., Noteboom J., O’Briant K.C., Allen A., et al. Circulating microRNAs as stable blood-based markers for cancer detection. Proc. Natl. Acad. Sci. USA. 2008;105:10513–10518. doi: 10.1073/pnas.0804549105. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Wang H., Peng R., Wang J., Qin Z., Xue L. Circulating microRNAs as potential cancer biomarkers: The advantage and disadvantage. Clin. Epigenet. 2018;10:59. doi: 10.1186/s13148-018-0492-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Malczewska A., Kidd M., Matar S., Kos-Kudła B., Modlin I. A Comprehensive Assessment of the Role of miRNAs as Biomarkers in Gastroenteropancreatic Neuroendocrine Tumors. Neuroendocrinology. 2018;107:73–90. doi: 10.1159/000487326. [DOI] [PubMed] [Google Scholar]
- 20.Zatelli M.C., Grossrubatscher E.M., Guadagno E., Sciammarella C., Faggiano A., Colao A. Circulating tumor cells and miRNAs as prognostic markers in neuroendocrine neoplasms. Endocr. Relat. Cancer. 2017;24:R223–R237. doi: 10.1530/ERC-17-0091. [DOI] [PubMed] [Google Scholar]
- 21.Modlin I., Drozdov I., Alaimo D., Callahan S., Teixiera N., Bodei L., Kidd M. A multianalyte PCR blood test outperforms single analyte ELISAs (chromogranin A, pancreastatin, neurokinin A) for neuroendocrine tumor detection. Endocr. Relat. Cancer. 2014;21:615–628. doi: 10.1530/ERC-14-0190. [DOI] [PubMed] [Google Scholar]
- 22.Shah J.S., Soon P.S., Marsh D.J. Comparison of Methodologies to Detect Low Levels of Hemolysis in Serum for Accurate Assessment of Serum microRNAs. PLoS ONE. 2016;11:e0153200. doi: 10.1371/journal.pone.0153200. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Pritchard C.C., Cheng H.H., Tewari M. MicroRNA profiling: Approaches and considerations. Nat. Rev. Genet. 2012;13:358–369. doi: 10.1038/nrg3198. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Pritchard C.C., Kroh E., Wood B., Arroyo J.D., Dougherty K.J., Miyaji M.M., Tait J.F., Tewari M. Blood cell origin of circulating microRNAs: A cautionary note for cancer biomarker studies. Cancer Prev. Res. 2011;5:492–497. doi: 10.1158/1940-6207.CAPR-11-0370. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Cheng H.H., Yi H.S., Kim Y., Kroh E.M., Chien J.W., Eaton K.D., Goodman M.T., Tait J.F., Tewari M., Pritchard C.C. Plasma Processing Conditions Substantially Influence Circulating microRNA Biomarker Levels. PLoS ONE. 2013;8:e64795. doi: 10.1371/journal.pone.0064795. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Németh K., Darvasi O., Likó I., Szücs N., Czirják S., Reiniger L., Szabó B., Krokker L., Pállinger É., Igaz P., et al. Comprehensive Analysis of Circulating miRNAs in the Plasma of Patients With Pituitary Adenomas. J. Clin. Endocrinol. Metab. 2019;104:4151–4168. doi: 10.1210/jc.2018-02479. [DOI] [PubMed] [Google Scholar]
- 27.Patterson E., Webb R., Weisbrod A., Bian B., He M., Zhang L., Holloway A.K., Krishna R., Nilubol N., Pacak K., et al. The microRNA expression changes associated with malignancy and SDHB mutation in pheochromocytoma. Endocr. Relat. Cancer. 2012;19:157–166. doi: 10.1530/ERC-11-0308. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Tömböl Z., Éder K., Kovács A., Szabó P.M., Kulka J., Likó I., Zalatnai A., Rácz G., Tóth M., Patócs A., et al. MicroRNA expression profiling in benign (sporadic and hereditary) and recurring adrenal pheochromocytomas. Mod. Pathol. 2010;23:1583–1595. doi: 10.1038/modpathol.2010.164. [DOI] [PubMed] [Google Scholar]
- 29.Jiang X., Shan A., Su Y., Cheng Y., Gu W., Wang W., Ning G., Cao Y. miR-144/451 Promote Cell Proliferation via Targeting PTEN/AKT Pathway in Insulinomas. Endocrinology. 2015;156:2429–2439. doi: 10.1210/en.2014-1966. [DOI] [PubMed] [Google Scholar]
- 30.Thorns C., Schurmann C., Gebauer N., Wallaschofski H., Kümpers C., Bernard V., Feller A.C., Keck T., Habermann J.K., Begum N., et al. Global microRNA profiling of pancreatic neuroendocrine neoplasias. Anticancer Res. 2014;34:2249–2254. [PubMed] [Google Scholar]
- 31.Zhou H.Q., Chen Q.C., Qiu Z.T., Tan W.L., Mo C.Q., Gao S.W. Integrative microRNA-mRNA and protein-protein interaction analysis in pancreatic neuroendocrine tumors. Eur. Rev. Med. Pharmacol. Sci. 2016;20:2842–2852. [PubMed] [Google Scholar]
- 32.Lee Y.S., Kim H., Kim H.W., Lee J.C., Paik K.H., Kang J., Kim J., Yoon Y.S., Han H.S., Sohn I., et al. High Expression of MicroRNA-196a Indicates Poor Prognosis in Resected Pancreatic Neuroendocrine Tumor. Medicine. 2015;94:e2224. doi: 10.1097/MD.0000000000002224. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Roldo C., Missiaglia E., Hagan J.P., Falconi M., Capelli P., Bersani S., Calin G.A., Volinia S., Liu C.G., Scarpa A., et al. MicroRNA Expression Abnormalities in Pancreatic Endocrine and Acinar Tumors Are Associated With Distinctive Pathologic Features and Clinical Behavior. J. Clin. Oncol. 2006;24:4677–4684. doi: 10.1200/JCO.2005.05.5194. [DOI] [PubMed] [Google Scholar]
- 34.Grolmusz V.K., Kovesdi A., Borka K., Igaz P., Patocs A. Prognostic relevance of proliferation-related miRNAs in pancreatic neuroendocrine neoplasms. Eur. J. Endocrinol. 2018;179:219–228. doi: 10.1530/EJE-18-0305. [DOI] [PubMed] [Google Scholar]
- 35.Zimmermann N., Knief J., Kacprowski T., Lazar-Karsten P., Keck T., Billmann F., Schmid S., Luley K., Lehnert H., Brabant G., et al. MicroRNA analysis of gastroenteropancreatic neuroendocrine tumors and metastases. Oncotarget. 2018;9:28379–28390. doi: 10.18632/oncotarget.25357. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Zong L., Meng L., Shi R. Role of miR-101 in pheochromocytoma patients with SDHD mutation. Int. J. Clin. Exp. Pathol. 2015;8:1545–1554. [PMC free article] [PubMed] [Google Scholar]
- 37.Meyer-Rochow G.Y., Jackson N.E., Conaglen J.V., Whittle D.E., Kunnimalaiyaan M., Chen H., Westin G., Sandgren J., Stålberg P., Khanafshar E., et al. MicroRNA profiling of benign and malignant pheochromocytomas identifies novel diagnostic and therapeutic targets. Endocr. Relat. Cancer. 2010;17:835–846. doi: 10.1677/ERC-10-0142. [DOI] [PubMed] [Google Scholar]
- 38.De Cubas A.A., Leandro-García L.J., Schiavi F., Mancikova V., Comino-Méndez I., Inglada-Pérez L., Perez-Martinez M., Ibarz N., Ximénez-Embún P., López-Jiménez E., et al. Integrative analysis of miRNA and mRNA expression profiles in pheochromocytoma and paraganglioma identifies genotype-specific markers and potentially regulated pathways. Endocr. Relat. Cancer. 2013;20:477–493. doi: 10.1530/ERC-12-0183. [DOI] [PubMed] [Google Scholar]
- 39.Lu J., Getz G., Miska E.A., Alvarez-Saavedra E., Lamb J., Peck D., Sweet-Cordero A., Ebert B.L., Mak R.H., Ferrando A.A., et al. MicroRNA expression profiles classify human cancers. Nature. 2005;435:834–838. doi: 10.1038/nature03702. [DOI] [PubMed] [Google Scholar]
- 40.Ma R., Jiang T., Kang X. Circulating microRNAs in cancer: Origin, function and application. J. Exp. Clin. Cancer Res. 2012;31:38. doi: 10.1186/1756-9966-31-38. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Aakko S., Straume A.H., Birkeland E.E., Chen P., Qiao X., ’Lønning P.E., Kallio M. MYC-Induced miR-203b-3p and miR-203a-3p Control Bcl-xL Expression and Paclitaxel Sensitivity in Tumor Cells. Transl. Oncol. 2018;12:170–179. doi: 10.1016/j.tranon.2018.10.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Shen M., Dong C., Ruan X., Yan W., Cao M., Pizzo D., Wu X., Yang L., Liu L., Ren X., et al. Chemotherapy-Induced Extracellular Vesicle miRNAs Promote Breast Cancer Stemness by Targeting ONECUT2. Cancer Res. 2019;79:3608–3621. doi: 10.1158/0008-5472.CAN-18-4055. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.An N., Zheng B. MiR-203a-3p Inhibits Pancreatic Cancer Cell Proliferation, EMT, and Apoptosis by Regulating SLUG. Technol. Cancer Res. Treat. 2020;19:1533033819898729. doi: 10.1177/1533033819898729. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Chen L., Gao H., Liang J., Qiao J., Duan J., Shi H., Zhen T., Li H., Zhang F., Zhu Z., et al. miR-203a-3p promotes colorectal cancer proliferation and migration by targeting PDE4D. Am. J. Cancer Res. 2018;8:2387–2401. [PMC free article] [PubMed] [Google Scholar]
- 45.Di C., Jiang Y., Li M., Juan X., Xu C. Circulating Exosomal microRNA Signature As a Noninvasive Biomarker for Diagnosis of Diffuse Large B-Cell Lymphoma. Blood. 2018;132:5406. doi: 10.1182/blood-2018-99-115940. [DOI] [Google Scholar]
- 46.Huang Z., Chen W., Du Y., Guo Q., Mao Y., Zhou X., Hua D. Serum miR-16 as a potential biomarker for human cancer diagnosis: Results from a large-scale population. J. Cancer Res. Clin. Oncol. 2019;145:787–796. doi: 10.1007/s00432-019-02849-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Barakat M.T., Meeran K., Bloom S.R. Neuroendocrine tumours. Endocr. Relat. Cancer. 2004;11:1–18. doi: 10.1677/erc.0.0110001. [DOI] [PubMed] [Google Scholar]
- 48.Klöppel S., Couvelard A., Perren A., Komminoth P., McNicol A.M., Nilsson O., Scarpa A., Scoazec J.Y., Wiedenmann B., Papotti M., et al. ENETS Consensus Guidelines for the Standards of Care in Neuroendocrine Tumors: Towards a Standardized Approach to the Diagnosis of Gastroenteropancreatic Neuroendocrine Tumors and Their Prognostic Stratification. Neuroendocrinology. 2008;90:162–166. doi: 10.1159/000182196. [DOI] [PubMed] [Google Scholar]
- 49.Li M., Song Q., Song Q., Li H., Lou Y., Wang L. Circulating miR-25-3p and miR-451a May Be Potential Biomarkers for the Diagnosis of Papillary Thyroid Carcinoma. PLoS ONE. 2015;10:e0132403. doi: 10.1371/journal.pone.0132403. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Lario S., Brunet-Vega A., Quílez M.E., Ramírez-Lázaro M.J., Lozano J.J., Garcia-Martinez L., Pericay C., Miquel M., Junquera F., Campo R., et al. Expression profile of circulating microRNAs in the Correa pathway of progression to gastric cancer. United Eur. Gastroenterol. J. 2018;6:691–701. doi: 10.1177/2050640618759433. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Miyashita Y., Ishikawa K., Fukushima Y., Kouwaki T., Nakamura K., Oshiumi H. Immune-regulatory microRNA expression levels within circulating extracellular vesicles correspond with the appearance of local symptoms after seasonal flu vaccination. PLoS ONE. 2019;14:e0219510. doi: 10.1371/journal.pone.0219510. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Chirshev E., Oberg K.C., Ioffe Y.J., Unternaehrer J. Let -7 as biomarker, prognostic indicator, and therapy for precision medicine in cancer. Clin. Transl. Med. 2019;8:24. doi: 10.1186/s40169-019-0240-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Yu L.X., Zhang B.L., Yang Y., Wang M.C., Lei G.L., Gao Y., Liu H., Xiao C.H., Xu J.J., Qin H., et al. Exosomal microRNAs as potential biomarkers for cancer cell migration and prognosis in hepatocellular carcinoma patient-derived cell models. Oncol. Rep. 2018;41:257–269. doi: 10.3892/or.2018.6829. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Li A., Yu J., Kim H., Wolfgang C.L., Canto M.I., Hruban R.H., Goggins M. MicroRNA array analysis finds elevated serum miR-1290 accurately distinguishes patients with low-stage pancreatic cancer from healthy and disease controls. Clin. Cancer Res. 2013;19:3600–3610. doi: 10.1158/1078-0432.CCR-12-3092. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Vicentini C., Calore F., Nigita G., Fadda P., Simbolo M., Sperandio N., Luchini C., Lawlor R.T., Croce C.M., Corbo V., et al. Exosomal miRNA signatures of pancreatic lesions. BMC Gastroenterol. 2020;20:137. doi: 10.1186/s12876-020-01287-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Calsina B., Castro-Vega L.J., Torres-Pérez R., Inglada-Pérez L., Currás-Freixes M., Roldán-Romero J.M., Mancikova V., Letón R., Remacha L., Santos M., et al. Integrative multi-omics analysis identifies a prognostic miRNA signature and a targetable miR-21-3p/TSC2/mTOR axis in metastatic pheochromocytoma/paraganglioma. Theranostics. 2019;9:4946–4958. doi: 10.7150/thno.35458. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Ruff S.M., Ayabe R.I., Malekzadeh P., Good M.L., Wach M.M., Gonzales M.K., Tirosh A., Nilubol N., Pacak K., Kebebew E., et al. MicroRNA-210 May Be a Preoperative Biomarker of Malignant Pheochromocytomas and Paragangliomas. J. Surg. Res. 2019;243:1–7. doi: 10.1016/j.jss.2019.04.086. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.Lloyd R.V., Osamura R.Y., Klöppel G., Rosai J. WHO Classification of Tumours of Endocrine Organs. [(accessed on 18 May 2020)]; Available online: https://publications.iarc.fr/Book-And-Report-Series/Who-Classification-Of-Tumours/WHO-Classification-Of-Tumours-Of-Endocrine-Organs-2017.
- 59.Krokker L., Nyírő G., Reiniger L., Darvasi O., Szücs N., Czirják S., Tóth M., Igaz P., Patócs A., Butz H. Differentially Expressed miRNAs Influence Metabolic Processes in Pituitary Oncocytoma. Neurochem. Res. 2019;44:2360–2371. doi: 10.1007/s11064-019-02789-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Tam S., Tsao M., McPherson J.D. Optimization of miRNA-seq data preprocessing. Brief. Bioinform. 2015;16:950–963. doi: 10.1093/bib/bbv019. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.Liu J., Gao J., Du Y., Li Z., Ren Y., Gu J., Wang X., Gong Y., Wang W., Kong X. Combination of plasma microRNAs with serum CA19-9 for early detection of pancreatic cancer. Int. J. Cancer. 2011;131:683–691. doi: 10.1002/ijc.26422. [DOI] [PubMed] [Google Scholar]
- 62.Pesta M., Kucera R., Topolčan O., Karlikova M., Houfkova K., Polivka J., Macanova T., Machová I., Slouka D., Kulda V. Plasma microRNA Levels Combined with CEA and CA19-9 in the Follow-Up of Colorectal Cancer Patients. Cancers. 2019;11:864. doi: 10.3390/cancers11060864. [DOI] [PMC free article] [PubMed] [Google Scholar]



