Abstract
Neuroblastoma (NB) is a pediatric tumor presenting at diagnosis either as localized or metastatic disease, which mainly involves the bone marrow (BM). The physical occupancy of BM space by metastatic NB cells has been held responsible for impairment of BM function. Here, we investigated whether localized or metastatic NB may alter hematopoietic lineages’ maturation and release of mature cells in the periphery, through gene expression profiling, analysis of BM smears, cell blood count and flow cytometry analysis.
Gene ontology and disease-associated analysis of the genes significantly under-expressed in BM resident cells from children with localized and metastatic NB, as compared to healthy children, indicated anemia, blood group antigens, and heme and porphyrin biosynthesis as major functional annotation clusters. Accordingly, in children with NB there was a selective impairment of erythrocyte maturation at the ortho-chromic stage that resulted in reduced erythrocyte count in the periphery, regardless of the presence of metastatic cells in the BM. By considering all NB patients, low erythrocyte count at diagnosis associated with worse survival. Moreover, in the subset of metastatic patients, low erythrocyte count, hemoglobin and hematocrit and high red cell distribution width at follow-up also associated with worse outcome.
These observations provide an alternative model to the tenet that infiltrating cells inhibit BM functions due to physical occupancy of space and may open a new area of research in NB to understand the mechanism(s) responsible for such selective impairment.
Keywords: neuroblastoma, erythrocytes, bone marrow, survival, microenvironment
INTRODUCTION
Neuroblastoma (NB) is a pediatric tumor, whose biology and clinical behavior continuously puzzles researchers and clinicians. NB displays a broad spectrum of clinical features that vary from tumors that spontaneously regress [1] to metastatic disease at onset [2]. A genetic alteration, namely MYCN amplification, was demonstrated to control NB aggressiveness [3–5]. However, the number of driving mutations, essential to initiate and/or sustain tumor growth, has been identified only in a fraction of NB [6, 7]. NB was the first solid tumor found to selectively express a surface tumor-specific antigen, the GD2 di-sialoganglioside [8, 9], allowing a “precision medicine approach” for specific immunotherapy [10], now included in standard therapeutic regimen for metastatic NB patients [2, 11]. Notwithstanding, the survival rate of NB patients treated with anti-GD2 antibodies increased only slightly [2].
The deep knowledge of NB tumor genetics and biology have allowed to establish effective treatments for some of NB patients, such as infants and children with localized, MYCN not amplified tumors, with 5-year survival rates between 90 and 100%, depending on age and stage [12]. Unfortunately, prognosis of children with either localized MYCN amplified tumors and of children with metastatic disease (high-risk patients) is still poor with 5-year survival rates around 65 and 30%, respectively [11, 13, 14]. High-risk NB patients that do not respond to standard chemotherapy or relapse have less than 10% 5-year survival rate [15, 16].
Metastatic patients present massive bone marrow (BM) infiltration by NB cells that were considered identical to the primary tumor cells. However, in the last decade, it has become evident that metastatic cells were not exactly the same as the correspondent primary tumor cells [17, 18]. In addition, many studies demonstrated that the properties of both neoplastic and resident cells were deeply modified by the bi-directional signals occurring within the local microenvironment [19].
Based on these premises, we previously studied the gene expression profiles of BM-infiltrating NB cells as compared to NB primary tumor cells [20]. BM-infiltrating NB cells shared the same neuronal characteristics of primary tumor cells, but acquired expression of surface proteins typical of the hematopoietic cell lineages. BM-infiltrating NB cells showed also different microRNA profile [21], and different rates of potential driving mutations and chromosomal rearrangements [22, 23]. Altogether, these data suggested that the BM environment could modify NB cell features.
As for the resident BM cells, we previously showed that in NB patients their gene expression profile was different from that of healthy children, regardless of the presence of BM-infiltrating NB cells. These data suggested a remote effect operated by the primary tumor cells on the BM resident cells [24]. In particular, the genes over-expressed in NB patients belonged to the IFN and IFRD signatures, suggestive of innate immunity activation, whereas the most under-expressed gene was CXCL12 (SDF-1) [24].
To better characterize the BM microenvironment of NB patients, we here investigated whether the genes under-expressed in BM resident cells belonged to particular functional pathway(s) and/or signature(s) which may relate to impairment of BM function.
RESULTS
Gene expression profiles of BM resident cells from NB patients and healthy children
The gene expression profile of BM resident cells from 44 NB patients, whose main features are shown in Table 1, were compared to those of BM resident cells from 13 healthy children (http://www.ncbi.nlm.nih.gov/geo/, GEO accession number GSE90689). By setting the statistical significance for differential expression at 0.01 Bonferroni's adjusted P value, samples from patients with metastatic and localized NB showed to under-express 641 and 1239 genes, respectively (Supplementary Table 1A and 1B), as compared to BM resident cells from healthy children. Twenty-nine genes were found to be differentially expressed between metastatic and localized NB, but statistical significance was not reached (Supplementary Table 1C), confirming that the gene expression profiles of BM resident cells from metastatic and localized NB patients were similar [24]. Thus, by considering all NB patients in our cohort, the genes significantly under-expressed were 1085, of whom 533 in common between metastatic and localized patients (Supplementary Table 1D and 1E, respectively).
Table 1. Main features of the cohorts of NB patients analyzed for gene expression profiling, BM smears, flow cytometry and cell blood count (CBC).
NB patients | ||||||||
---|---|---|---|---|---|---|---|---|
Gene expression | % | BM smear | % | Flowcytometry | % | CBC | % | |
N | 44 | 70 | 16 | 115 | ||||
Sex | ||||||||
Female | 17 | 38.6 | 33 | 47.1 | 9 | 56.2 | 51 | 44.3 |
Male | 27 | 61.4 | 37 | 52.9 | 7 | 43.8 | 64 | 55.7 |
Age | ||||||||
< 18 months | 24 | 54.5 | 33 | 47.1 | 10 | 62.5 | 55 | 47.8 |
≥18 months | 20 | 45.5 | 37 | 52.9 | 6 | 37.5 | 60 | 52.2 |
Stage | ||||||||
L1/L2 | 34 | 77.3 | 20 | 28.6 | 10 | 62.5 | 64 | 55.7 |
M | 10 | 22.7 | 37 | 52.8 | 6 | 37.5 | 38 | 33.0 |
Ms | 13 | 18.6 | 13 | 11.3 | ||||
MYCN | ||||||||
Amplified | 6 | 13.6 | 22 | 31.4 | 4 | 25.0 | 28 | 24.4 |
Single copy | 35 | 79.6 | 43 | 61.5 | 12 | 75.0 | 72 | 62.6 |
ND | 3 | 6.8 | 5 | 7.1 | 0 | 15 | 13.0 |
Gene ontology analysis
To check whether the under-expressed genes clustered for annotation or associated to a specific disease, the list of 533 genes under-expressed in both metastatic and localized NB (Supplementary Table 1E) was run into the DAVID bioinformatics database. In addition to functional annotation clusters containing more than one-hundred genes, such as phosphoprotein, acetylation, cytosol and cytoplasm, the most significant functional annotation clusters referred to genes involved in anemia, blood group antigens, heme and porphyrin biosynthesis (Table 2). Moreover, 63 of the 533 under-expressed genes associated to diseases involving erythrocytes (Table 3). Altogether these data suggested possible alterations of erythropoiesis in NB patients.
Table 2. Functional annotation chart with adjusted P value < 0.01 obtained by running the list of genes significantly down-modulated in BM resident cells from patients with metastatic and localized NB as compared to healthy children.
Category | Term | Number of genes | % | P value | Benjamini P value |
---|---|---|---|---|---|
UP_KEYWORDS | Hereditary hemolytic anemia | 16 | 4,2 | 5,50E-18 | 9,80E-16 |
UP_KEYWORDS | Blood group antigen | 16 | 4,2 | 3,00E-18 | 1,10E-15 |
BIOCARTA | Hemoglobin's Chaperone | 10 | 2,6 | 1,30E-11 | 1,60E-09 |
UP_KEYWORDS | Phosphoprotein | 217 | 56,5 | 1,70E-11 | 2,00E-09 |
UP_KEYWORDS | Heme biosynthesis | 9 | 2,3 | 3,40E-11 | 3,00E-09 |
UP_KEYWORDS | Porphyrin biosynthesis | 7 | 1,8 | 1,00E-09 | 7,30E-08 |
GOTERM_BP_DIRECT | heme biosynthetic process | 10 | 2,6 | 1,40E-10 | 2,50E-07 |
UP_KEYWORDS | Acetylation | 109 | 28,4 | 4,80E-09 | 2,90E-07 |
GOTERM_CC_DIRECT | cytosol | 115 | 29,9 | 1,60E-09 | 5,60E-07 |
GOTERM_BP_DIRECT | protoporphyrinogen IX biosynthetic process | 7 | 1,8 | 5,80E-09 | 5,10E-06 |
GOTERM_BP_DIRECT | porphyrin-containing compound biosynthetic process | 6 | 1,6 | 7,20E-08 | 4,30E-05 |
UP_KEYWORDS | Elliptocytosis | 5 | 1,3 | 7,50E-06 | 3,80E-04 |
KEGG_PATHWAY | Porphyrin and chlorophyll metabolism | 9 | 2,3 | 7,50E-06 | 1,60E-03 |
GOTERM_BP_DIRECT | response to methylmercury | 6 | 1,6 | 4,00E-06 | 1,80E-03 |
UP_KEYWORDS | Oxygen transport | 5 | 1,3 | 7,10E-05 | 2,80E-03 |
UP_KEYWORDS | Disease mutation | 74 | 19,3 | 6,80E-05 | 3,00E-03 |
UP_KEYWORDS | Cytoplasm | 121 | 31,5 | 1,10E-04 | 3,80E-03 |
UP_KEYWORDS | Cell cycle | 27 | 7 | 1,80E-04 | 5,80E-03 |
UP_KEYWORDS | Transferase | 52 | 13,5 | 2,30E-04 | 6,90E-03 |
UP_KEYWORDS | Iron | 17 | 4,4 | 3,60E-04 | 9,90E-03 |
Table 3. Results of analysis for disease of hematopoietic lineages associated to genes significantly under-expressed in BM resident cells from patients with metastatic and localized NB as compared to healthy children.
OMIM_DISEASE | Gene name |
---|---|
Acatalasemia, | CAT |
Anemia, hypochromic microcytic, with iron overload 2, | STEAP3 |
Anemia, sideroblastic, pyridoxine-refractory, autosomal recessive, | GLRX5 |
Anemia, sideroblastic, pyridoxine-refractory, autosomal recessive, | SLC25A38 |
Anemia, sideroblastic, X-linked, Protoporphyria, erythropoietic, X-linked, | ALAS2 |
Bleeding disorder, platelet-type, 17, | GFI1B |
Blood group GIL, | AQP3 |
Blood group, Colton, Aquaporin-1 deficiency, | AQP1 |
Blood group, Diego, Blood group, Waldner, Blood group, Wright, Ovalocytosis, SA type, Renal tubular acidosis, distal, AD, Cryohydrocytosis, Blood group, Swann, Blood group, Froese, Malaria, resistance to, Renal tubular acidosis, distal, AR, Spherocytosis, type 4, | SLC4A1 |
Blood group, Dombrock, | ART4 |
Blood group, Kell, | KEL |
Blood group, Kidd, | SLC14A1 |
Blood group, Landsteiner-Wiener, | ICAM4 |
Blood group, Langereis system, Pseudohyperkalemia, familial, 2, due to red cell leak, Microphthalmia, isolated, with coloboma 7, Dyschromatosisuniversalishereditaria 3, | ABCB6 |
Blood group, OK, | BSG |
Blood group, Radin, Blood group, Scianna system, | ERMAP |
Blood group, Rhesus, Rh-null disease, amorph type, | RHCE |
Blood group--Lutheran inhibitor, Hereditary persistence of fetal hemoglobin, Dyserythropoietic anemia, congenital, type IV, | KLF1 |
Bombay phenotype, | FUT1 |
C4B deficiency, | C4B |
Coproporphyria, Harderoporphyria, | CPOX |
D-2-hydroxyglutaric aciduria 2, | IDH2 |
Elliptocytosis-2, Pyropoikilocytosis, Spherocytosis, type 3, | SPTA1 |
Erythrocytosis due to bisphosphoglyceratemutase deficiency, | BPGM |
Erythrocytosis, familial, 1, | EPOR |
Filippi syndrome, | CKAP2L |
Glutaricaciduria, type I, | GCDH |
Glyoxalase II deficiency, | HAGH |
Heinz body anemia, Thalassemia, alpha-, Hemoglobin H disease, nondeletional, Erythrocytosis, Hypochromic microcytic anemia, | HBA2 |
Heinz body anemias, alpha-, Thalassemias, alpha-, Hemoglobin H disease, nondeletional, Erythremias, alpha-, Methemoglobinemias, alpha-, | HBA1 |
Hemolytic anemia due to adenylate kinase deficiency, | AK1 |
Hemolytic anemia due to gamma-glutamylcysteinesynthetase deficiency, Myocardial infarction, susceptibility to, | GCLC |
Hermansky-Pudlak syndrome 6, | HPS6 |
Lead poisoning, susceptibility to, Porphyria, acute hepatic, | ALAD |
Leukemia, acute pre-B-cell, | PBX1 |
Leukemia, megakaryoblastic, with or without Down syndrome, somatic, Thrombocytopenia, X-linked, with or without dyserythropoietic anemia, Anemia, X-linked, with/without neutropenia and/or platelet abnormalities, Thrombocytopenia with beta-thalassemia, X-linked, | GATA1 |
Leukemia, T-cell acute lymphocytic, somatic, | TAL1 |
Majeed syndrome, | LPIN2 |
Malaria, resistance to, Blood group, Gerbich, | GYPC |
Malaria, resistance to, Blood group, MN, | GYPA |
Malaria, resistance to, Blood group, Ss, | GYPB |
McLeod syndrome with or without chronic granulomatous disease, | XK |
Mitochondrial complex I deficiency, | NDUFS2 |
Mitochondrial complex III deficiency, nuclear type 6, | CYC1 |
Myelodysplastic syndrome, Myelogenous leukemia, acute, | ACSL6 |
Overhydrated hereditary stomatocytosis, Anemia, hemolytic, Rh-null, regulator type, Rh-mod syndrome, | RHAG |
Platelet glycoprotein IV deficiency, Coronary heart disease, susceptibility to, 7, Malaria, cerebral, reduced risk of, Malaria, cerebral, susceptibility to, Macrothrombocytopenia, | CD36 |
Porphyria cutanea tarda, Porphyria, hepatoerythropoietic, | UROD |
Porphyria variegata, | PPOX |
Porphyria, acute intermittent, Porphyria, acute intermittent, nonerythroid variant, | HMBS |
Porphyria, congenital erythropoietic, | UROS |
Protoporphyria, erythropoietic, autosomal recessive, | FECH |
Pyruvate carboxylase deficiency, | PC |
Ribose 5-phosphate isomerase deficiency, | RPIA |
Senior-Loken syndrome 9, | TRAF3IP1 |
Spherocytosis, type 1, | ANK1 |
Spherocytosis, type 2, Anemia, neonatal hemolytic, fatal and near-fatal, Elliptocytosis-3, | SPTB |
Spherocytosis, type 5, | EPB42 |
Succinic semialdehyde dehydrogenase deficiency, | ALDH5A1 |
Symmetric circumferential skin creases, congenital, 1, Cortical dysplasia, complex, with other brain malformations 6, | TUBB |
Thalassemia due to Hb Lepore, Thalassemia, delta-, | HBD |
Uric acid concentration, serum, QTL1, Junior blood group system, | ABCG2 |
Warfarin resistance, Vitamin K-dependent clotting factors, combined deficiency of, 2, | VKORC1 |
Since a cluster of 16 genes belonged to blood group antigens expressed on mature erythrocytes, we checked in a cohort of 115 NB patients (Table 1, CBC) whether the distribution into the ABO system and the frequency of Rh D antigen was in accordance with that of the European population [25, 26]. As shown in Supplementary Figure 1, no difference was observed, thus excluding any type of skewing for NB susceptibility depending on blood group antigens.
Erythrocyte precursors and erythroblasts are altered in BM samples from NB patients
Since the expression profiles of BM resident cells from NB patients suggested a possible alteration in erythrocyte count, we next scored BM smears from 70 NB patients with localized (L, N=20) or metastatic (M, N=50) NB (Table 1, Smears) for total myeloid-, erythroid- and lymphoid-precursors, and compared them to BM smears from 11 healthy children. As shown in Figure 1A, healthy children showed higher proportions of erythrocyte precursors (median±SEM % of total cells: 26±2.48) than patients with localized (23±1.75, p=0.02) or metastatic (21±1.68, p=0.03) NB. Conversely, no difference was detected in count of myeloid (healthy: 56±2.3; L NB: 58±2.9; M NB: 55±2.5) and lymphoid (healthy: 12±2; L NB: 16±2.7; M NB: 15±1.6) precursors.
The same BM smears were then scored for presence of erythroid precursors. No significant difference was detected in the percentage of pro-erythroblasts (mean±SD % of total cells: healthy: 4.1±2.2; L NB: 4.5±1.8; M NB: 4.6±2.5), baso-erythroblasts (healthy: 14.2±8.6; L NB: 17.7±8.8; M NB: 15.4±9.7) and poly-chromatophilic erythroblasts (healthy: 38.2±8.4; L NB: 39.5±8.8; M NB: 41.4±10), whereas the percentage of ortho-chromic erythroblasts was significantly higher in healthy children (43.2±5.8) than in patients with localized (38.6±10.1, p=0.01) and metastatic (36.9±11.7, p=0.04) NB (Figure 1B).
Maturation of erythrocytes is altered in BM from NB patients
To confirm the data obtained in BM smears suggestive of a selective impairment of late stage erythrocyte maturation, we collected BM aspirates from 16 NB patients (Table 1, flow cytometry) and 10 healthy subjects and analyzed them by flow cytometry for percentage of monocytes, neutrophils and stage II/III erythroblasts. As shown in Figure 2A, the monocyte and granulocyte counts were similar between NB patients (mean±SD % of total cells: monocytes 3.86±2.82; granulocytes 29.38±13.49) and healthy subjects (monocytes 2.46±0.83; granulocytes 29.4±7.76). Conversely, the percentage of stage II (CD45−CD35+CD44hiCD117+) and stage III (CD45−CD35+CD44lowCD117+) erythroblasts was significantly lower in NB patients (median±SEM % of total cells, stage II: 2.82±0.72; stage III: 0.85±0.41) than in healthy subjects (stage II: 5.96±1.18;stage III: 3.58±1.05; p=0.02 and p=0.002, respectively) (Figure 2B), confirming that late erythrocytes’ maturation was indeed altered in NB patients.
Peripheral blood (PB) samples from NB patients displays several abnormalities in different cell populations
To check whether the altered count of BM erythrocyte precursors impacted on the mature cell population present in the periphery, we collected cell blood counts (CBCs) at diagnosis from a cohort of 115 patients with localized and metastatic NB (Table 1, CBC) and compared them to CBCs from 32 age- and sex-matched healthy children. In general, all the red blood cell and leukocyte counts were within the lower limit of the normal range. However, healthy children had significantly higher amount of mature erythrocytes (mean±SD x1012cell/L: 4.85±0.38) than children with localized (4.34±0.71; p=0.0003) or metastatic (mean±SD:3.72±0.58; p<0.0001) NB (Figure 3A), confirming the impairment observed in the BM. As for the other mature hematopoietic cell populations, patients with localized NB had significantly higher proportion of neutrophils (median±SEM x109cell/L: 5.7±0.45) than healthy children (3.1±0.23; p<0.0001) or patients with metastatic NB (3.8±0.32; p=0.0015) (Figure 3B). Similarly, patients with localized NB had higher platelet count (mean±SD x109cell/L: 395±114.3) than healthy children (297.8±85.25, p<0.0001) or patients with metastatic NB (349.3±135.2) (Figure 3C). In contrast, the monocyte count was lower in metastatic patients (median±SEM x109cell/L: 0.4±0.03) than in localized patients (0.5±0.03, p=0.02) or healthy children (0.5±0.04, p=0.03) (Figure 3D).
No difference in lymphocyte count (Figure 3E) was observed among patients with localized NB (median±SEMx109cell/L: 3.2±0.31), metastatic NB (2.8±0.19) and healthy children (2.85±0.33).
Monocyte, neutrophil and erythrocyte count at diagnosis associated with clinical outcome of NB patients
Taken together the above findings showed that at diagnosis all NB patients had decreased erythrocyte and increased platelet count, as compared to healthy children. Differently from children with metastatic NB, those with localized NB showed a significant increase in neutrophil and a normal monocytes’ count. We thus checked whether the number of mature neutrophils, monocytes, erythrocytes and platelets associated to outcome. NB patients with number of neutrophil, monocyte and erythrocyte counts above the cut-off values determined by ROC curves displayed a significantly better overall survival (OS) than those with counts below the cut-off values (Figure 4A, 4B and 4C, p=0.0008, p=0.039 and p=0.0048, respectively). In contrast, the number of platelets at diagnosis (Figure 4D) did not associate with different OS.
The outcome of patients with metastatic NB associated with the number of erythrocytes at follow-up
Since prognosis of patients with metastatic NB is poor despite multimodal therapies, we asked whether in this subset of patients erythrocyte count at end of treatment or at follow-up associated with outcome. No association with event-free survival (EFS) and OS was found at the end of the high-risk therapeutic regimen (Supplementary Figure 2A and 2B, respectively), whereas patients with erythrocyte countsat follow-up above the cut-off value displayed significantly better EFS and OS (Supplementary Figure 2C and 2D respectively, p=0.0003).
Thus, we checked which of the erythrocyte-related analytical parameters, such as mean corpuscular volume (MCV), mean corpuscular hemoglobin (MCH), and mean corpuscular hemoglobin content (MCHC), hemoglobin, hematocrit and red blood cell distribution width (RDW) at end of cure and at follow-up also associated to OS. No association between MCV, MCH and MCHC values was found (data not shown). In contrast, hemoglobin and hematocrit values above the cut-off, and RDW values below the cut-off significantly associated to better OS, both at the end of cure and at follow-up (Figure 5).
Taken together these analyses suggested that maintenance of a low number of dis-homogeneous mature erythrocytes in the periphery may indicate persistence of impaired erythrocyte maturation in the BM. However, none of the growth factors and cytokines involved in erythrocytes’ maturation, such as SCF, IL-3, IL-4, TPO and EPO (http://www.genome.jp/kegg/pathway.html), were under-expressed in BM resident cells from NB patients as compared to healthy children (Supplementary Table 2), suggesting that other, still unknown, factors may have a role.
DISCUSSION
So far, the physical occupancy of the BM space by metastatic NB cells has been thought to be the cause of impaired BM function observed in children with metastatic NB. Here, we showed that the impairment was selective and occurred only in the erythrocyte lineage, regardless of the presence of metastatic NB cells. Both myeloid- and lymphoid-lineages were normally represented in the BM, as well as the proportion of pro-erythroblasts, baso-erythroblasts and poly-chromatophilic erythroblasts. Conversely, ortho-chromic erythroblast count was significantly lower in NB patients than in healthy children and adults, making it unlikely that flow cytometry results on fresh BM aspirates could be ascribed to difference in age between NB patients and BM donors. We also excluded that the decreased representation of blood group antigens expressed by mature erythrocytes could be ascribed to skewing in NB susceptibility depending on ABO system, as observed in other type of cancers [27–29].
In this study we were unable to identify a potential cause for such a specific impairment of late stage erythrocyte maturation. From the microarray data, no cytokines and/or chemokines implicated in the erythrocyte maturation were significantly under-expressed. The finding of a specific impairment of erythrocyte maturation at late stages may relate to a deficient heme and porphyrin biosynthesis, as suggested by bio-informatics analysis. It is interesting to note that heme biosynthesis occurs in the mitochondria, the site of energetic metabolism and of apoptotic signals [30]. It is well known that oxidative stress is enhanced in NB, and indeed our previous microarray data showed an increase of SOD mRNA expression, as well as altered expression of genes involved in glutathione metabolism [24]. Moreover, an ultra-structural study on NB primary tumors recently showed consistent auto-phagic vacuoles and abnormality of mitochondria structure in all undifferentiated NB cells [31]. Therefore, it cannot be excluded that the impaired erythrocyte maturation observed in patients with NB was a peculiar effect consequent to the disruption of mitochondria in this particular lineage, and impairment of mitochondria structure and/or function may be a more general feature of NB tumors.
Since we confirmed here that BM resident cells of patients with NB have similar gene expression profiles and low erythrocyte counts, independently of the physical presence of neoplastic NB cells in the BM space [24], it is conceivable that primary tumor cells produced effects at distance. In this view it is tempting to speculate that the observed impairment could be mediated by extracellular vesicles released by the tumor cells, which transfer protein, mRNA, miRNA, DNA and lipids to other cells [32]. Therefore, further investigations on the potential role of NB-related vesicles are warranted.
Differently from children with metastatic NB, however, children with localized NB had significantly higher platelet and neutrophil counts than healthy children. This finding is in accordance with previous observations in smaller cohorts, showing that the proportion of innate effectors in this subset of patients was higher than in high-risk patients [33–36]. It has been suggested that increased number of innate effectors were responsible for the favorable outcome of patients with localized NB. Here, we showed that the number of neutrophils associated with better survival; however, it remains to be established why children with metastatic disease fail to elicit innate response. Interestingly, in our study no difference was observed in lymphocyte count in both BM and PB, limiting the potential role of this lineage in the natural history of NB.
Our study has some limitations: it is a mono-center, retrospective analysis, which must be confirmed in a prospective cooperative international study. However, the number of patients with localized and metastatic NB, and of controls, is meaningful. In addition, patients were diagnosed throughout a decade at the Italian NB reference center, and they were all treated according to international protocols, thus excluding effects due to different treatment. As stated above, we were unable to identify the possible cause(s) of erythropoiesis impairment in NB. The disruption of mitochondria structure and/or function, as well as the potential role of NB-specific vesicles, as putative player in erythrocyte impairment needs to be further addressed. The study was limited to children with NB; it would be interesting to check whether in children with soft tissue sarcomas, and/or in adult cancers with BM as major site of metastasis, the same selective impairment occurs.
In conclusion, our study showed that NB cells selectively disrupted the late stage of erythrocytes’ maturation, thus decreasing their number in the periphery. Since failure to fully restore erythrocyte count associated with a worse outcome, this observation may be clinically relevant. In addition, future studies may lead to understand the mechanism(s) responsible for the impairment and eventually to a better cure for children with NB.
MATERIALS AND METHODS
NB patients
Patients included in the study were diagnosed with NB at the Gaslini Institute between September 2005 and March 2016. Written consent for research use of samples and clinical data was obtained by the legal guardians. The study was approved by the Gaslini Institute Ethical Committee and all analyses were performed according to the Helsinki declaration.
Disease staging was made according to INSS till 2010 [37], and to INRG-SS criteria afterwards [12, 38]. For uniformity, the old INSS stage was converted to the INRG-Staging. After diagnosis, patients were treated according to the European protocol suited for her/his risk category, dependent on age, stage and MYCN status.
Demographic, genetic, clinical and follow-up data at 31st December 2016 were retrieved from the Italian NB Registry [39]. The main features of the patients included in the different analysis are summarized in Table 1. All the analyses were made using samples taken at diagnosis.
Controls
As controls in BM smears’ evaluation and gene expression profiling, samples were obtained from healthy siblings of children admitted at the Gaslini Institute to undergo BM transplants.
As controls in flow cytometer study, BM aspirates were obtained from healthy BM donors, selected according to the Transplant Unit Clinical Protocol of Ematologia 2 at the IRCCS San Martino-IST in Genoa, following a written informed consent at the time of donation. Samples were processed as described [40]. At the end of processing, an aliquot was taken to perform quality control tests. The remaining part was used in this study.
As controls for cell blood counts (CBC), PB samples were obtained from age- and sex-matched healthy children admitted to the Gaslini Institute for accidental injuries.
RNA extraction, gene expression profiling and gene ontology analysis
Total RNA was extracted from BM aspirates of 13 healthy children, 20 patients with localized NB, 14 GD2-negative fraction of BM aspirates [24] from patients with localized NB and 10 GD2-negative fraction of BM aspirates from patients with metastatic NB. Five-hundred ng of total RNA were hybridized to Human GE 4×44K v2 Microarray Kit (Agilent Technologies, Santa Clara, CA) following the One-color microarray-based gene expression analysis protocol. Slides were scanned by Agilent G2565BA scanner and images were processed by Feature Extraction software v.9.5.3.1. Microarray data are MIAME compliant and are accessible through GEO (http://www.ncbi.nlm.nih.gov/geo/) accession GSE90689.
The genes significantly under-expressed in NB patients were run in the DAVID bioinformatics website (https://david.ncifcrf.gov/) [41].
Smears analysis, cell blood count (CBC), erythrocyte-related parameters, and blood group antigens
Six May-Grunwald Giemsa-stained smears of BM aspirates were analyzed under light microscope by two independent morphologists (FS and MLB).
CBCs and erythrocyte-related parameters were obtained by using an automated cell counting device (Advia 2120i, Siemens, Milan, Italy).
ABO blood group and Rh negative/positive determinations were made according to certified standard procedures.
Flow cytometry analysis
Flow cytometer analysis was performed on whole BM samples, using 50 μl of whole blood/tube. Briefly, samples were incubated with specific antibodies (20′ at 4°C in the dark) and then subjected to erythrocytes lysis using BD FACS lysis (BD Biosciences, Milan, Italy) by incubating 15′ at RT in the dark. Cells were washed with PBS 0.5% BSA, suspended in PBS 0.5% BSA and run on Gallios cytometer (Beckman Coulter, Cassina dei Pecchi, Italy), acquiring at least 104 events. Data were analyzed using Kaluza software (Beckman Coulter). The antibodies used were: anti-CD45 PC5 (Beckman Coulter), anti-CD35 FITC (Immunotools, Friesoythe, Germany), anti-CD44 PE (Immunotools), anti-CD117 APC (Miltenyi Biotec, Calderara di Reno, BO, Italy), anti-CD16 PC7 and anti-CD14 FITC (Beckman Coulter), following manufacturer's protocol. PB from 11 NB patients and 10 controls were analyzed for monocytes and granulocytes, whereas PB from 15 NB patients and 10 controls were analyzed for stage II and III erythroblasts.
Statistical analyses
For gene expression profiling, text files were acquired and analyzed with Rv3.2.1 software using the limma package of Bioconductor [42]. Data were preliminarily corrected for background and normalized in order to have similar distributions across the set of arrays. Ranking of genes by their evidence for differential expression was made using the paired moderated t-statistics based on empirical Bayes moderation of the standard errors.
For other analyses, normal distribution was tested by Kolmogorov-Smirnov. When data distribution was not normal, differences in median between: i) patients and controls, or ii) different groups of patients, were compared by Mann-Whitney test. When data distribution was normal comparison was made by the t Student test. Analyses were made using the Prism software (GraphPad Software Inc., La Jolla, CA).
EFS and OS analyses were performed by Kaplan-Meier method and compared by log-rank test, after determining the cut-off value for each parameter. Cut-off values were determined by ROC curves, using MedCalc Software (version 17.4, MedCalc, Ostend, Belgium) and analysis was performed using method developed by DeLong et al. [43]. ROC curves for each parameter are represented in Supplementary Figure 3.
SUPPLEMENTARY FIGURES AND TABLES
Acknowledgments
F.M was recipient of a Fondazione Italiana Neuroblastoma fellowship, and presently of a Fondazione Veronesi fellowship. S.B., M.C. and G.E. are recipients of Fondazione Italiana Neuroblastoma fellowships. V.R. is recipient of a FIRC (Italian Foundation for Cancer Research, n°16533) fellowship.
Abbreviations
- BM
bone marrow
- CBC
cell blood counts
- EFS
event-free survival
- MCH
mean corpuscular hemoglobin
- MCHC
mean corpuscular hemoglobin content
- MCV
mean corpuscular volume
- NB
neuroblastoma
- OS
overall survival
- PB
peripheral blood
- RDW
red blood cell distribution width
Footnotes
Author contributions
F.M. performed the experiments, interpreted data and wrote the manuscript; S.B. and G.C. provided CBC counts; S.S. and P.S. performed microarray experiments and analyzed data; L.P. and C.L. performed statistical analysis; F.S. and M.L.B. provided and scored BM smears; M.M provided ABO data; S.P. provided BM samples from healthy subjects; M.C and V.R. performed experiments; L.A. managed NB patients; G.E. provided clinical data from the Italian NB Registry; V.P. and S.F. helped in the study design and critically discussed themanuscript; M.V.C. designed the study, analyzed and interpreted the data and wrote the manuscript.
All authors read and approved the final manuscript.
FUNDING
This work was supported by Fondazione Italiana Neuroblastoma (Progetto clinico to M.V.C. and Progetto Immunoterapia to M.C.); and by Ministero della Salute (Progetti di Ricerca Corrente to V.P. and 5×1000 to S.F.).
CONFLICTS OF INTEREST
The authors declare no conflicts of interest.
REFERENCES
- 1.Brodeur GM, Bagatell R. Mechanisms of neuroblastoma regression. Nat Rev Clin Oncol. 2014;11:704–713. doi: 10.1038/nrclinonc.2014.168. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Louis CU, Shohet JM. Neuroblastoma: molecular pathogenesis and therapy. Annu Rev Med. 2015;66:49–63. doi: 10.1146/annurev-med-011514-023121. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Schwab M. MYCN amplification in neuroblastoma: a paradigm for the clinical use of an oncogene. Pathol Oncol Res. 1997;3:3–7. doi: 10.1007/BF02893344. [DOI] [PubMed] [Google Scholar]
- 4.Schwab M, Alitalo K, Klempnauer KH, Varmus HE, Bishop JM, Gilbert F, Brodeur G, Goldstein M, Trent J. Amplified DNA with limited homology to myc cellular oncogene is shared by human neuroblastoma cell lines and a neuroblastoma tumour. Nature. 1983;305:245–248. doi: 10.1038/305245a0. [DOI] [PubMed] [Google Scholar]
- 5.Brodeur GM, Seeger RC, Schwab M, Varmus HE, Bishop JM. Amplification of N-myc in untreated human neuroblastomas correlates with advanced disease stage. Science. 1984;224:1121–1124. doi: 10.1126/science.6719137. [DOI] [PubMed] [Google Scholar]
- 6.Molenaar JJ, Koster J, Zwijnenburg DA, van Sluis P, Valentijn LJ, van der Ploeg I, Hamdi M, van Nes J, Westerman BA, van Arkel J, Ebus ME, Haneveld F, Lakeman A, et al. Sequencing of neuroblastoma identifies chromothripsis and defects in neuritogenesis genes. Nature. 2012;483:589–593. doi: 10.1038/nature10910. [DOI] [PubMed] [Google Scholar]
- 7.Pugh TJ, Morozova O, Attiyeh EF, Asgharzadeh S, Wei JS, Auclair D, Carter SL, Cibulskis K, Hanna M, Kiezun A, Kim J, Lawrence MS, Lichenstein L, et al. The genetic landscape of high-risk neuroblastoma. Nat Genet. 2013;45:279–284. doi: 10.1038/ng.2529. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Schulz G, Cheresh DA, Varki NM, Yu A, Staffileno LK, Reisfeld RA. Detection of ganglioside GD2 in tumor tissues and sera of neuroblastoma patients. Cancer Res. 1984;44:5914–5920. [PubMed] [Google Scholar]
- 9.Mujoo K, Cheresh DA, Yang HM, Reisfeld RA. Disialoganglioside GD2 on human neuroblastoma cells: target antigen for monoclonal antibody-mediated cytolysis and suppression of tumor growth. Cancer Res. 1987;47:1098–1104. [PubMed] [Google Scholar]
- 10.Handgretinger R, Baader P, Dopfer R, Klingebiel T, Reuland P, Treuner J, Reisfeld RA, Niethammer D. A phase I study of neuroblastoma with the anti-ganglioside GD2 antibody 14.G2a. Cancer Immunol Immunother. 1992;35:199–204. doi: 10.1007/BF01756188. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Irwin MS, Park JR. Neuroblastoma: paradigm for precision medicine. Pediatr Clin North Am. 2015;62:225–256. doi: 10.1016/j.pcl.2014.09.015. [DOI] [PubMed] [Google Scholar]
- 12.Cohn SL, Pearson AD, London WB, Monclair T, Ambros PF, Brodeur GM, Faldum A, Hero B, Iehara T, Machin D, Mosseri V, Simon T, Garaventa A, et al. The International Neuroblastoma Risk Group (INRG) classification system: an INRG Task Force report. J Clin Oncol. 2009;27:289–297. doi: 10.1200/JCO.2008.16.6785. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Kohler JA, Rubie H, Castel V, Beiske K, Holmes K, Gambini C, Casale F, Munzer C, Erminio G, Parodi S, Navarro S, Marquez C, Peuchmaur M, et al. Treatment of children over the age of one year with unresectable localised neuroblastoma without MYCN amplification: results of the SIOPEN study. Eur J Cancer. 2013;49:3671–3679. doi: 10.1016/j.ejca.2013.07.002. [DOI] [PubMed] [Google Scholar]
- 14.Kreissman SG, Seeger RC, Matthay KK, London WB, Sposto R, Grupp SA, Haas-Kogan DA, Laquaglia MP, Yu AL, Diller L, Buxton A, Park JR, Cohn SL, et al. Purged versus non-purged peripheral blood stem-cell transplantation for high-risk neuroblastoma (COG A3973): a randomised phase 3 trial. Lancet Oncol. 2013;14:999–1008. doi: 10.1016/S1470-2045(13)70309-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Garaventa A, Parodi S, De Bernardi B, Dau D, Manzitti C, Conte M, Casale F, Viscardi E, Bianchi M, D'Angelo P, Zanazzo GA, Luksch R, Favre C, et al. Outcome of children with neuroblastoma after progression or relapse. A retrospective study of the Italian neuroblastoma registry. Eur J Cancer. 2009;45:2835–2842. doi: 10.1016/j.ejca.2009.06.010. [DOI] [PubMed] [Google Scholar]
- 16.London WB, Castel V, Monclair T, Ambros PF, Pearson AD, Cohn SL, Berthold F, Nakagawara A, Ladenstein RL, Iehara T, Matthay KK. Clinical and biologic features predictive of survival after relapse of neuroblastoma: a report from the International Neuroblastoma Risk Group project. J Clin Oncol. 2011;29:3286–3292. doi: 10.1200/JCO.2010.34.3392. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Celia-Terrassa T, Kang Y. Distinctive properties of metastasis-initiating cells. Genes Dev. 2016;30:892–908. doi: 10.1101/gad.277681.116. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Turajlic S, Swanton C. Metastasis as an evolutionary process. Science. 2016;352:169–175. doi: 10.1126/science.aaf2784. [DOI] [PubMed] [Google Scholar]
- 19.Jiang WG, Sanders AJ, Katoh M, Ungefroren H, Gieseler F, Prince M, Thompson SK, Zollo M, Spano D, Dhawan P, Sliva D, Subbarayan PR, Sarkar M, et al. Tissue invasion and metastasis: Molecular, biological and clinical perspectives. Semin Cancer Biol. 2015;35:S244–275. doi: 10.1016/j.semcancer.2015.03.008. [DOI] [PubMed] [Google Scholar]
- 20.Morandi F, Scaruffi P, Gallo F, Stigliani S, Moretti S, Bonassi S, Gambini C, Mazzocco K, Fardin P, Haupt R, Arcamone G, Pistoia V, Tonini GP, Corrias MV. Bone marrow-infiltrating human neuroblastoma cells express high levels of calprotectin and HLA-G proteins. PLoS One. 2012;7:e29922. doi: 10.1371/journal.pone.0029922. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Stigliani S, Scaruffi P, Lagazio C, Persico L, Carlini B, Varesio L, Morandi F, Morini M, Gigliotti AR, Esposito MR, Viscardi E, Cecinati V, Conte M, Corrias MV. Deregulation of focal adhesion pathway mediated by miR-659-3p is implicated in bone marrow infiltration of stage M neuroblastoma patients. Oncotarget. 2015;6:13295–13308. doi: 10.18632/oncotarget.3745. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Khan FH, Pandian V, Ramraj S, Natarajan M, Aravindan S, Herman TS, Aravindan N. Acquired genetic alterations in tumor cells dictate the development of high-risk neuroblastoma and clinical outcomes. BMC Cancer. 2015;15:514. doi: 10.1186/s12885-015-1463-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Wei JS, Johansson P, Chen L, Song YK, Tolman C, Li S, Hurd L, Patidar R, Wen X, Badgett TC, Cheuk AT, Marshall JC, Steeg PS, et al. Massively parallel sequencing reveals an accumulation of de novo mutations and an activating mutation of LPAR1 in a patient with metastatic neuroblastoma. PLoS One. 2013;8:e77731. doi: 10.1371/journal.pone.0077731. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Scaruffi P, Morandi F, Gallo F, Stigliani S, Parodi S, Moretti S, Bonassi S, Fardin P, Garaventa A, Zanazzo G, Pistoia V, Tonini GP, Corrias MV. Bone marrow of neuroblastoma patients shows downregulation of CXCL12 expression and presence of IFN signature. Pediatr Blood Cancer. 2012;59:44–51. doi: 10.1002/pbc.23339. [DOI] [PubMed] [Google Scholar]
- 25.McLachlan S, Giambartolomei C, White J, Charoen P, Wong A, Finan C, Engmann J, Shah T, Hersch M, Podmore C, Cavadino A, Jefferis BJ, Dale CE, et al. Replication and characterization of association between ABO SNPs and red blood cell traits by meta-analysis in Europeans. PLoS One. 2016;11:e0156914. doi: 10.1371/journal.pone.0156914. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Klein HG, Anstee DJ. Mollison’s Blood Transfusion in Clinical Medicine. 12. Hoboken, NJ: Wiley-Blackwell; 2014. p. 944. [Google Scholar]
- 27.Gates MA, Xu M, Chen WY, Kraft P, Hankinson SE, Wolpin BM. ABO blood group and breast cancer incidence and survival. Int J Cancer. 2012;130:2129–2137. doi: 10.1002/ijc.26220. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Wang Z, Liu L, Ji J, Zhang J, Yan M, Zhang J, Liu B, Zhu Z, Yu Y. ABO blood group system and gastric cancer: a case-control study and meta-analysis. Int J Mol Sci. 2012;13:13308–13321. doi: 10.3390/ijms131013308. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Allouh MZ, Al Barbarawi MM, Hiasat MY, Al-Qaralleh MA, Ababneh EI. Glioblastoma and ABO blood groups: further evidence of an association between the distribution of blood group antigens and brain tumours. Blood Tranfus. 2016:1–5. doi: 10.2450/2016.0041-16. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Brdiczka DG, Zorov DB, Sheu SS. Mitochondrial contact sites: their role in energy metabolism and apoptosis. Biochim Biophys Acta. 2006;1762:148–163. doi: 10.1016/j.bbadis.2005.09.007. [DOI] [PubMed] [Google Scholar]
- 31.Samardzija G, Stevovic TK, Djuricic S, Djokic D, Djurisic M, Ciric D, Martinovic T, Bumbasirevic V, Vujic D. Aggressive human neuroblastomas show a massive increase in the numbers of autophagic vacuoles and damaged mitochondria. Ultrastruct Pathol. 2016;40:240–248. doi: 10.1080/01913123.2016.1187689. [DOI] [PubMed] [Google Scholar]
- 32.Gopal SK, Greening DW, Rai A, Chen M, Xu R, Shafiq A, Mathias RA, Zhu HJ, Simpson RJ. Extracellular vesicles: their role in cancer biology and epithelial-mesenchymal transition. Biochem J. 2017;474:21–45. doi: 10.1042/BCJ20160006. [DOI] [PubMed] [Google Scholar]
- 33.Facchetti P, Prigione I, Ghiotto F, Tasso P, Garaventa A, Pistoia V. Functional and molecular characterization of tumour-infiltrating lymphocytes and clones thereof from a major-histocompatibility-complex-negative human tumour: neuroblastoma. Cancer Immunol Immunother. 1996;42:170–178. doi: 10.1007/s002620050267. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Song L, Asgharzadeh S, Salo J, Engell K, Wu HW, Sposto R, Ara T, Silverman AM, DeClerck YA, Seeger RC, Metelitsa LS. Valpha24-invariant NKT cells mediate antitumor activity via killing of tumor-associated macrophages. J Clin Invest. 2009;119:1524–1536. doi: 10.1172/JCI37869. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Asgharzadeh S, Salo JA, Ji L, Oberthuer A, Fischer M, Berthold F, Hadjidaniel M, Liu CW, Metelitsa LS, Pique-Regi R, Wakamatsu P, Villablanca JG, Kreissman SG, et al. Clinical significance of tumor-associated inflammatory cells in metastatic neuroblastoma. J Clin Oncol. 2012;30:3525–3532. doi: 10.1200/JCO.2011.40.9169. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Gowda M, Godder K, Kmieciak M, Worschech A, Ascierto ML, Wang E, Marincola FM, Manjili MH. Distinct signatures of the immune responses in low risk versus high risk neuroblastoma. J Transl Med. 2011;9:170. doi: 10.1186/1479-5876-9-170. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Brodeur GM, Pritchard J, Berthold F, Carlsen NL, Castel V, Castelberry RP, De Bernardi B, Evans AE, Favrot M, Hedborg F, Di Cataldo A, Garaventa A, Boni L. Revisions of the international criteria for neuroblastoma diagnosis, staging, and response to treatment. J Clin Oncol. 1993;11:1466–1477. doi: 10.1200/JCO.1993.11.8.1466. [DOI] [PubMed] [Google Scholar]
- 38.Monclair T, Brodeur GM, Ambros PF, Brisse HJ, Cecchetto G, Holmes K, Kaneko M, London WB, Matthay KK, Nuchtern JG, von Schweinitz D, Simon T, Cohn SL, Pearson AD. The International Neuroblastoma Risk Group (INRG) staging system: an INRG Task Force report. J Clin Oncol. 2009;27:298–303. doi: 10.1200/JCO.2008.16.6876. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Haupt R, Garaventa A, Gambini C, Parodi S, Cangemi G, Casale F, Viscardi E, Bianchi M, Prete A, Jenkner A, Luksch R, Di Cataldo A, Favre C, et al. Improved survival of children with neuroblastoma between 1979 and 2005: a report of the Italian Neuroblastoma Registry. J Clin Oncol. 2010;28:2331–2338. doi: 10.1200/JCO.2009.24.8351. [DOI] [PubMed] [Google Scholar]
- 40.Vicente D, Podesta M, Pitto A, Pozzi S, Lucchetti S, Lamparelli T, Tedone E, Ibatici A, Figari O, Frassoni F, Van Lint MT, Piaggio G, Sacchi N, Bacigalupo A. Progenitor cells trapped in marrow filters can reduce GvHD and transplant mortality. Bone Marrow Transplant. 2006;38:111–117. doi: 10.1038/sj.bmt.1705413. [DOI] [PubMed] [Google Scholar]
- 41.Huang DW, Sherman BT, Tan Q, Kir J, Liu D, Bryant D, Guo Y, Stephens R, Baseler MW, Lane HC, Lempicki RA. DAVID Bioinformatics Resources: expanded annotation database and novel algorithms to better extract biology from large gene lists. Nucleic Acids Res. 2007;35:W169–175. doi: 10.1093/nar/gkm415. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Ritchie ME, Phipson B, Wu D, Hu Y, Law CW, Shi W, Smyth GK. limma powers differential expression analyses for RNA-sequencing and microarray studies. Nucleic Acids Res. 2015;43:e47. doi: 10.1093/nar/gkv007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.DeLong ER, DeLong DM, Clarke-Pearson DL. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics. 1988;44:837–845. [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.