Skip to main content
Diagnostics logoLink to Diagnostics
. 2021 Apr 1;11(4):643. doi: 10.3390/diagnostics11040643

Glycomic-Based Biomarkers for Ovarian Cancer: Advances and Challenges

Francis Mugeni Wanyama 1,2, Véronique Blanchard 1,*
Editor: Jill Marie Kolesar
PMCID: PMC8065431  PMID: 33916250

Abstract

Ovarian cancer remains one of the most common causes of death among gynecological malignancies afflicting women worldwide. Among the gynecological cancers, cervical and endometrial cancers confer the greatest burden to the developing and the developed world, respectively; however, the overall survival rates for patients with ovarian cancer are worse than the two aforementioned. The majority of patients with ovarian cancer are diagnosed at an advanced stage when cancer has metastasized to different body sites and the cure rates, including the five-year survival, are significantly diminished. The delay in diagnosis is due to the absence of or unspecific symptoms at the initial stages of cancer as well as a lack of effective screening and diagnostic biomarkers that can detect cancer at the early stages. This, therefore, provides an imperative to prospect for new biomarkers that will provide early diagnostic strategies allowing timely mitigative interventions. Glycosylation is a protein post-translational modification that is modified in cancer patients. In the current review, we document the state-of-the-art of blood-based glycomic biomarkers for early diagnosis of ovarian cancer and the technologies currently used in this endeavor.

Keywords: ovarian cancer, biomarker, clinical biomarker, glycan

1. Introduction

In 2018, the Global Cancer Observatory GLOBOCAN reported an estimate of 295,414 ovarian cancer (OvCa) cases out of the total incidences of female cancers of about 8.8 million globally. Of the total incidences of death from female cancers of 4.1 million globally, 184,799 mortalities were from ovarian cancer. Further predictions indicate a worldwide increase of OvCa incidences to 404,268 and 268,302 deaths by the year 2035 [1]. OvCa exhibits a high amount of heterogeneity by the very nature of their histological or molecular origin. OvCas are classified into five major types based on their histological and molecular genetics. They are high-grade serous type, which is the most abundant, followed by endometrioid, clear cell, mucinous and the least abundant, the low-grade serous ovarian carcinoma [2,3].

The importance of diagnosing OvCa while still in its early stages is underscored by the benefits accrued to the patient that include increased chances of successful cure or prolonged survival period. A diagnosis made in the early stages allows sufficient duration of time to institute various mitigative therapeutic approaches with a 90% chance of cure [4]. Past research findings have shown that about 90% of patients diagnosed with stage I OvCa have a 5-year survival rate. Unfortunately, only about 30% of the women are diagnosed with stage I OvCa, whereas the majority are diagnosed in stages III and IV, with reduced 5-year survival rates of 20% and 6%, respectively. Important to note is that the patient’s survival rate has a strong correlation with the stage of the disease at which the diagnosis is made [5,6].

Diagnosis of OvCa in its early stage is impeded by the very nature of its unspecific symptoms whereby in the majority of cases, signs and symptoms become only clear when the tumor is in its advanced stages (FIGO Stage III and IV) [4,5]. Moreover, the lack of effective screening and early diagnostic strategies that can detect OvCa in its formative stages, before manifestation of full-blown symptoms, has been the missing link in the fight to reduce the mortalities associated with late-stage diagnosis [7]. Introduction of new, effective and less-invasive biomarkers that will help to detect OvCa promptly are, therefore, urgently needed.

Glycosylation is an essential protein’s post-translational modification that is deferentially reflected in an individual’s health or pathological status. Glycans are made up of monosaccharides that are linked by glycosidic bonds in many different ways to form highly branched structures, hence they exhibit enormous heterogeneity. This is in contrast to the highly conserved template-driven DNA and proteins [8]. Aberrant modifications of glycans have been reported for many forms of cancer and they correlate with the overexpression of enzymes that are responsible for the biological processing of glycans, namely glycosidases and glycosyltransferases [9]. They are usually protein-specific, cell-specific, site-specific and their mechanisms have been studied in detail; for a review, see [10]. In human blood, all proteins, except albumin, are glycosylated. N-Glycosylation occurs at the side chain of asparagine residues in nascent glycoproteins according to the consensus motif asparagine-X-serine/threonine, where X can be any amino acid except proline, while O-glycans are linked to the hydroxyl group of serine or threonine.

In the following, we review the clinically approved glycan-based biomarkers for OvCa, the milestones achieved in the ongoing glycomics research, as well as the state of technology used in the field and the challenges encountered.

2. Clinically Approved Blood-Based Glycan Biomarkers for Ovarian Cancer

Cancer antigen-125 (CA125) is a glycoprotein blood-based biomarker used for the detection of OvCa. It was clinically approved in 1981 and it is the major OvCa biomarker used routinely in clinical settings. However, CA125 is unreliable for the detection of early stage OvCa due to its associated limitations of low sensitivity and specificity. Other glycoprotein-based tests that have since received clinical approvals include human epididymis 4 (HE4), carbohydrate antigen 19-9 (CA19-9), and multi-parametric assays such as the risk of ovarian malignancy algorithm (ROMA), OVA1 and OVA2 [4,11,12] (Table 1). Multi-parametric tests find their clinical utility mostly in the risk stratification of the subjects into low- or high-risk groups.

Table 1.

Clinically approved glycosylated ovarian cancer biomarkers.

Marker Detection Type Sensitivity
(%)
Specificity
(%)
Clinical Use FDA Approval
(Year)
Reference
CA 125 Protein concentration 79–94 59–82 Monitoring therapy and relapse 1981 [16,22,23]
HE4 Protein concentration 64–71 85–96 Monitoring therapy and relapse 2008 [12,22,24]
CA 1-9 Protein concentration 50–53 84–97 Monitoring therapy and relapse 2002 [25,26]
ROMA test Protein concentration 91–94 75–84 Prediction 2011 [18,22,27]
OVA1 test Protein concentration 77–96 28–35 Prediction 2009 [28,29]
OVA2 (Overa) Protein concentration 91 69 Prediction 2016 [30]

2.1. CA125 (MUC16)

The CA125 mucin is a highly N- and O-glycosylated transmembrane glycoprotein expressed in the epithelium of Müllerian and coelomic types, namely ciliated cells, endometrium, endocervix and pericardium, peritoneum, mesothelial cells of the pleura, respectively [6]. The current CA125 automated ELISA test uses a combination of two monoclonal antibodies OC125 and M11 generated against non-overlapping domains of CA125 [13]. The concentration of more than 35 U/mL are suggestive of a possible ovarian malignancy [14,15]. It is the most widely studied blood-based biomarker for ovarian cancer and has been the gold standard routine biomarker for ovarian cancer ever since its approval by the FDA in 1981 [16] (Table 1). However, CA125 is neither specific nor sensitive as a diagnostic marker for ovarian cancer because it is found to be elevated in gynecological benign diseases affecting pre-menopausal women as well as in conditions such as liver cirrhosis and heart failure, thereby limiting its applicability as a biomarker for OvCa [4,15,17,18]. Furthermore, fluctuations in CA125 levels are also evident in physiological conditions such as pregnancy and menstruation hence, negating its importance as a diagnostic marker for OvCa [18,19]. Of importance to note is that about 20% of the epithelial OvCa cases of serous origin do not show overexpression of CA125 hence, the likelihood to miss out such cases when CA125 is used as the only biomarker [20,21]. The meta-analysis study of Ferraro et al., revealed an overall sensitivity of 79% and specificity of 78% [16]. Mixed results have been reported by subsequent studies [22,23]. CA125 is, therefore, neither a definitive test that meets expectations of an accurate early diagnostic marker for ovarian cancer nor a reliable screening tool for the general population. However, it is highly recommended for monitoring the effectiveness of the treatment responses and detection of relapse in the remission period by conducting serial measurements [4].

2.2. Human Epididymis 4 (HE4)

Human epididymis protein 4 (HE4), a secretory product of the WFDC2 gene, is a glycoprotein that originates from the epithelial cells of the human epididymis, which is overexpressed in ovarian tumors [18,28]. It is an 11 kDa small secretory glycoprotein with hydrophobic amino acids at the terminus, expressed in patients with endometrioid, clear cell, epithelial, and mucinous ovarian cancers [31]. HE4 was approved by the FDA in 2008 for use in monitoring patients with an established diagnosis of ovarian cancer but not for screening early stage OvCa in asymptomatic women [6]. Unlike CA 125, HE4 values are upregulated in mucinous ovarian malignancy, giving it a wide detection scope for the subtypes of OvCa. Furthermore, its values are not influenced by common benign gynecological and medical conditions, as is the case with CA 125, hence they are better in terms of specificity [31]. Moreover, previous research findings demonstrated that the HE4 level is elevated in over 50% of ovarian tumor cases, which otherwise show normal expression of CA 125. Hence, HE4 exhibits superior sensitivity and specificity for detecting early stage OvCa as well as discriminating OvCa from benign ovarian tumors compared to CA 125. HE4 also performs better in premenopausal women as well, compared to CA125 [20,28,32].

When CA125 and HE4 tests were used as a dual marker, improved diagnostic performance characteristics were registered. Moore et al. reported the analysis of the combined premenopausal and postmenopausal patients with benign neoplasms, or with cancer or low malignant potential (LMP) tumors using the dual marker algorithm, and found a sensitivity of 86% at a specificity of 74.7%. While using the dual marker in postmenopausal women, a sensitivity of 92.5% at a specificity of 74.7% was reported and finally, in premenopausal women only, a sensitivity of 67.4% and specificity of 74.8% was obtained [18]. When distinguishing benign ovarian tumor from early stage ovarian cancer, Nolen et al. reported improved sensitivity and specificity of 74.2% and 85%, respectively, when CA125 and HE4 tests were used as a dual test [33]. Moore et al. reported a sensitivity of 72.9% at a specificity of 95% for the HE4 test when used alone to discriminate benign ovarian tumors from OvCa. While at the same specificity of 95%, CA125 produced a sensitivity of 43.3%. Improved sensitivity of 76.4% at a specificity of 95% was reported when the two tests were done as a combination [12].

2.3. CA 19-9

Carbohydrate antigen 19-9 (CA19-9) is a tetrasaccharide carbohydrate also named sialyl Lewisa (N-acetylneuraminic acid-α2-3-galactose-β1-3[fucoseα1–4]-N-acetylglucosamine) that belongs to the larger family of mucinous markers secreted by human pancreatic and biliary ductal cells. Other sources of CA19-9 secretion are colon, gastric, endometrial and salivary epithelia [34]. CA19-9 is an established marker for pancreatic ductal adenocarcinoma, which received FDA approval in 2002. It is also found to be elevated in ovarian tumors, particularly the mucinous type [26,34]. However, its clinical utility is hampered by its insufficient sensitivity and specificity to discriminate early cancer from benign diseases [34,35]. One of the reasons for this is that α1-4-fucosyltransferase is not produced by about 6% of Caucasians and 22% of non-Caucasians [34]. A number of studies have suggested the use of serum CA-19-9 as a diagnostic marker for benign dermoid cysts, where they were successfully correlated with the tumor size, bilateral tumor involvement, and tumor torsion with CA19-9 values [36,37]. To this end, various studies have shown mixed results of CA19-9 analytical performance as a marker of OvCa. Santotoribio et al. reported a sensitivity of 50% with a specificity of 97% for the CA125. When they used CA19-9 and CA125 as a dual marker, an improved sensitivity of 66.7% at a specificity of 95% were obtained [25]. In another study, CA19-9 was able to detect mucinous ovarian cancer with a sensitivity and specificity of 52.7% and 83.8%, respectively [26]. Although previous studies have shown the usefulness of CA19-9 in predicting ovarian neoplasm of mucinous type, it was unable to differentiate benign, from borderline or malignant tumors [38].

2.4. Risk of Ovarian Malignancy Algorithm (ROMA)

ROMA is a multi-variable screening test designed by Moore et al. and approved by the FDA in 2011 for predicting the risk of ovarian malignancy in women presenting with pelvic masses [27]. It is a combination of CA125, HE4 and the menopausal status of the subject. Using this score, patients presenting with pelvic masses are categorized either as high or low risk to malignancy [27]. ROMA produced impressive performance characteristics for detecting ovarian cancer in a combined analysis of the pre-and postmenopausal women with a sensitivity of 93.8% and specificity of 74.9% [27]. In another study that involved patients with invasive and borderline ovarian cancer, ROMA produced overall sensitivity and specificity of 93.8% and 74.9%, respectively. On the other hand, premenopausal patients had a sensitivity of 100% and a specificity of 74.2% for detecting OvCa, while the postmenopausal had a sensitivity of 92.3% and a specificity of 76% [27]. Subsequent studies have provided mixed results [22,39,40].

2.5. OVA1

The OVA1 screening strategy is also a multi-variable index biomarker approved by the FDA in 2009 to distinguish malignancy from pelvic masses. It is a combination of five serum protein assays namely, second-generation CA 125-II, transthyretin, transferrin, β-2-microglobulin, and apoliprotein A1. The OVA1 test is useful in the stratification of the patients as low- or high-risk groups in terms of developing ovarian cancer [11,28,41]. OVA1 achieves its optimal potential when used as an add-on to physical examination and imaging. Improved sensitivity of 96% and a specificity of 35% were obtained when OVA1 was used along with the physical assessment of the patient by the physician [28]. Subsequent studies produced mixed performance characteristics [29].

2.6. OVA2

OVA2, also called Overa, is the second-generation test for OVA1. OVA2 is a multi-parametric test that stems from a combination of CA 125-II, HE4, apoliprotein A1, transferrin, and follicle-stimulating hormone. Coleman et al. reported improved performance characteristics from that of OVA1 with a sensitivity and specificity of 91% and 69%, respectively [30]. As a result, the FDA-approved Overa test in 2016 for screening women with pelvic masses, for either high or low risk of developing ovarian cancer [11].

3. Glycomics Methodologies

Glycomic studies can be approached at three different levels; by analysis of the free glycans, glycopeptides, or intact glycoprotein. The choice of the approach or strategy to use is dependent on various factors such as the nature and purity of the sample, level of technology vis-à-vis expert knowledge, and most importantly, the nature of information being sought. In general, glycan analysis consists of the isolation of free glycans or glycopeptides.

3.1. N-Glycan Profiling

Analysis of the released glycans is preferred when seeking to understand the compositional and structural characteristics of the total N-glycome. This is because of their conferred lower degree of complexity compared to glycopeptide or intact glycoprotein samples. Glycoproteins are deglycosylated either enzymatically or chemically. The tertiary structure of glycoproteins is first disrupted using proteases and/or denaturing reagents in order to make the glycosylation sites accessible. Enzymatic deglycosylation is achieved by treating a glycoprotein with endoglycosidases, preferably peptide-N-glycosidase F (PNGase F), which hydrolyzes the amide bond of the asparagine side chain for all types of N-glycans, except for those being α1-3 core-fucosylated. Endo H is used to specifically remove the high-mannose and hybrid structures [42]. On the other hand, Endo S is commonly used in immunological research questions as it specifically releases N-glycans of immunoglobulins (Ig) at asparagine-297 between the two N-acetylglucosamine (GlcNAc) of their reducing end [43]. Moreover, N- and O-glycans could also be released chemically, either separately or as a mixture of both, by hydrazinolysis through cleavage of the amide bonds under controlled conditions [44,45]. Alternatively, β-elimination is another chemical approach used to release both N- and O-glycans from the glycoprotein, but this technique is mostly employed on de-N-glycosylated proteins to release the remaining O-glycans. Sialic acids that terminate glycans can then be stabilized using permethylation, peracetylation, or dimethylamidation [45,46,47,48], which also improves ionization efficiency through increased sample volatility. Alternatively, the free reducing end of N-glycans may be labeled with a fluorescent tag, thereby increasing the sensitivity as well as the limit of quantitation and detection [45].

3.2. Glycopeptide Profiling

Glycopeptide analysis is the only bottom-up strategy that allows studying site-specific glycosylation. In other words, simultaneous analysis of glycan structures and the peptides they are bound on [49,50]. Prior to that, glycoproteins of interest are enriched using specific proteins or antibodies [51,52,53]. IgG, the most abundant immunoglobulin in human circulation is one of the most reported glycan-based biomarkers. Individual IgG subclass isolation consists of consecutive affinity purification using Protein A and/or Protein G. Protein A captures IgG1, IgG2 and IgG4, while Protein G, which is capable of capturing all IgG subclasses, can be applied at last to capture IgG3, after IgG1, IgG2 and IgG4 have been bound by protein A [54]. The resultant IgG preparation is then proteolytically digested by trypsin into glycopeptides, followed by purification using hydrophilic interaction liquid chromatography. Glycopeptide samples are subsequently profiled by mass spectrometry either in their native form or with derivatized sialic acids [52,54,55].

3.3. Profiling of Intact Glycoproteins

This middle-up approach is broadly used in research laboratories, clinical chemistry laboratories for routine diagnostics, or by pharmaceutical companies for product quality controls. Target proteins are analyzed either directly without purification or isolated by immuno-purification using specific antibodies prior to analysis [52,56,57,58]. Thereafter, glycoforms are analyzed by capillary electrophoresis, and also capillary electrophoresis coupled to mass spectrometry and hydrophilic interaction liquid chromatography coupled to mass spectrometry [57,59,60]. Clinical chemistry laboratories use the glycoforms of transferrin as a marker for alcohol abuse in adults and to detect congenital disorders of glycosylation in newborns [60]. The quality of biopharmaceuticals such as therapeutic antibodies, interferon-beta-1a, and human erythropoietin are verified after purification of the recombinant products [57,59]. Alternatively, intact glycoproteins can be purified with lectins, which are glycan-binding proteins. Glycoproteins resulting from the lectin pulldowns can be digested with proteases prior to analysis of the resulting glycopeptides [61].

3.4. Advances in High-Throughput Sample Preparation

The standard sample deglycosylation protocol using PNGase F enzymatic digestion takes about a day due to a time-consuming N-glycan cleavage step. The major improvement of high-throughput workflows lies in the fact that analytical turnaround times are reduced significantly. High-throughput workflows do not only reduce the time of analysis, they also significantly improved robustness and repeatability by introducing automation. They also support large-scale glycan analyses in 96- or 384-well-plates, which fosters compatibility between glycomics and clinical diagnosis [62,63].

Kronewitter and co-workers developed a high-throughput workflow for serum and plasma, where a microwave reactor was applied to hasten PNGase F digestion. Purification was subsequently performed using automated graphitic carbon solid-phase extraction and later subjected to mass spectrometric measurements of the N-glycans. Microwave-assisted N-glycan release takes about 10 min to achieve comparable levels of N-glycan release to the standard 16 h protocol [64]. Szabo et al. used the pressure-cycling technology to achieve the rapid release of glycoprotein N-glycans by PNGase F digestion. Pressure cycling technology alters protein conformation by forcing water molecules into the interior of proteins, causing them to unfold. On the other hand, cyclization between high and atmospheric pressure was shown to enhance the probability of endoglycosidase accessing the digestion site as a result glycan release is hastened [65]. In another approach, a reactor with immobilized PNGase F on monolithic polymer support in a capillary was used to allow the rapid and efficient release of N-glycans from IgG. Complete deglycosylation was achieved in 5.5 min at room temperature. The optimized reactor could also be integrated into a multidirectional system that is comprised of online glycan release, chromatographic separation and the mass spectrometric measurement [64,66]. Similarly, high-throughput 96-well plate protocols were developed for the isolation and analysis of IgG [54,67] and more recently, for IgA [54,67,68].

3.5. Analytical Instrumentation

There has been massive technological advancement in the last decade that led to the development of high-throughput methods. The most commonly used technologies include capillary electrophoresis (CE), ultra-performance liquid chromatography (UPLC) and mass spectrometry (MS).

Capillary electrophoresis is a relatively recent analytical platform for profiling labeled glycans. Glycan migration is mediated by an electric field, leading to the separation of positional glycan isomers and quantification can be achieved using labeled maltose [69,70]. The advantage of this technique is that it has high separation power, only requiring a small sample amount and with a quick turnaround time [71]. Glycan separation can also be performed on UPLC via hydrophilic interaction and fluorescence detection. Just like in CE, it is possible to resolve glycan isomers by UPLC. Retention times are standardized using an external glucose ladder [63] and a repertoire of elution positions for glycans has been made publicly available [72].

MS instruments are broadly used as well for glycomic studies. An MS instrument is made up of an ion source, which energizes the analyte, a mass analyzer that sorts the ions based on their m/z ratios, and a detector, which quantifies the resultant ions into a mass spectrum that is a plot of the relative abundance of the ions m/z ratio. Matrix-assisted laser desorption/ionization time-of-flight (MALDI-TOF) is a stand-alone instrument majorly used in the quantification of glycans or glycopeptides released chemically or enzymatically from the parent glycoprotein. It is the most frequently used soft ionization MS platform in glycobiology not only because of its good sensitivity but also due to its comprehensive analytical output. Several established research groups have extensively used this method in the sub-discipline of OvCa glycan biomarker discovery [73,74,75,76,77,78]. Unlike MALDI-TOF, UPLC or nano LC coupled electrospray ionization are used with mass analyzers such as quadrupole time of flight, orbitrap and Fourier transform ion cyclotron resonance mass analyzers.

The choice of one analyzer over the other depends on the analytical problem at hand. The factors that are considered in choosing the appropriate analyzer to use are the mass range, laser power, resolution, sensitivity, and ion transmission of the analyzer [79,80].

4. N-Glycosylation Traits Modulated in Human Serum of Ovca Patients

4.1. Total N-Glycome

Aberrant modifications of glycans have been reported for many forms of cancer and always correlate with overexpression of enzymes that are responsible for their biological processing, namely glycosidases and glycosyltransferases, but also the sugar nucleotide donors and transporters [9]. Glycome modulations are usually protein-specific, cell-specific, site-specific and their mechanisms have been studied in detail; for a review, see [10]. Glycan modifications occur within tumors and their microenvironment (Figure 1). Abnormal glycosylation also occurs in the liver after receiving signaling from tumors [9]. As a result, modified glycosylation at the level of total N-glycome and acute-phase proteins measured in the blood (serum or plasma) is a prominent feature of ovarian cancer (Table 2). Inflammatory processes being also part of tumor development, variations of IgG glycosylation in the blood have also been noted.

Figure 1.

Figure 1

(A) Overview of the glycosyltransferases that are upregulated in cancer. GnT-IV, N-acetylglucosaminyltransferase IV; GnT-V, N-acetylglucosaminyltransferase IV; ST3Gal I, β-galactoside alpha-2,3-sialyltransferase 1; ST6Gal I, β-galactoside alpha-2,6-sialyltransferase 1; FucT, α1-3-fucosyltransferase. (B) N-Glycan structures that are of relevance in glycan biomarker studies on OvCa. At the level of total serum, high-mannose and biantennary bisecting N-glycans are downregulated, whereas sialylated fucosylated tri- and tetraantennary N-glycans are upregulated when primary OvCa patients as compared with controls. Besides, elevated bisecting N-glycans and some sialylated fucosylated tetraantennary structures have also been proposed as a marker for resistance to chemotherapy. Green circle, mannose; yellow circle, galactose; blue square, N-acetylglucosamine; red triangle, fucose; purple diamond, N-acetylneuraminic acid.

Table 2.

Serum total N-glycan biomarkers for ovarian cancer. ↑- upregulation, ↓- downregulation.

Glycosylation Trait Regulation in OvCa Reference
high-mannosylation [74,78,81,82,83]
hybrid structures [82]
branching
- mono-, biantennary [78,82]
- triantennary [74,76,78,81,82,84]
- tetraantennary [76,78,81,82]
bisection [76,83]
[85]
Sialylation
- asialylated structures [78]
- sialylated structures [74,76,78,81,86]
- ratio α2-3/α2-6 [73,81,84]

High-mannose N-glycans are downregulated in OvCa, the same was observed for gastric cancer but not all types of cancer [74,78,81,82,83,87]. A decrease in hybrid structures was reported as well [78,82]; however, neither the molecular cause nor the role of high-mannose and hybrid N-glycans have been investigated in OvCa so far. Increased branching has been associated with the early stages of OvCa invasion and metastasis [73,74,76]. Branching is increased in OvCa due to the upregulation of mannoside acetylglucosaminyltransferases 4 and 5, genes that encode N-acetylglucosaminyltransferase IV (GnT-IV) and V (GnT-V). They catalyze the addition of β1-4-GlcNAc and β1-6-GlcNAc on the N- glycan core [10,84]. Branching leads to the formation of many tri- and tetraantennary structures that are fully galactosylated, which creates more substrates for the addition of terminal sialic acids [78]. An increase in tri- and tetraantennary structures is also associated with cancer progression due to its negative correlation with bisecting structures, which, in turn, are downregulated upon OvCa progression as observed in recurrent patients [76]. Indeed, the presence of tri- and tetraantennary structures do inhibit the action of N-acetylglucosaminyltransferase III (GnT III) that participate in the formation of bisecting N-glycans [88]. Interestingly, bisecting GlcNAcylated biantennary structures were associated with resistance to primary chemotherapy [85]. Increased branching is the reason for increased sialylation in OvCa and was associated with tumor progression and metastasis [76]. In human blood, increases in the sialic acid linkage ratio α2,3-/α2,6 were measured even in early stage OvCa [78] and correlate with increased ST3Gal I and ST6Gal I sialyltransferases measured in ovarian cancer tissues [89]. Increased fucosylation was observed in the form of sialyl LewisX (N-acetylneuraminic acid-α2-3-galactose-β1-4[fucoseα1-3] N-acetylglucosamine, sLeX) epitopes [73,74,76,81,82] and correlates with the expression of the corresponding α1-3-fucosyltransferase [90].

4.2. Immunoglobulin Glycosylation

Features of Immunoglobin G Fc glycosylation, especially galactosylation, reflect the body’s physiological (age, gender, pregnancy) or pathological state [91,92]. Galactosylation of complex-type N-glycans decreases with an increase in age, especially in women after menopause [92]. Glycome modulations also occur in autoimmune diseases, infectious diseases and malignancies including ovarian cancer [92,93]. These observed IgG glycan changes are most likely due to the inflammation occurring in the tumor and surrounding tissues as similar patterns are observed in rheumatoid arthritis [72]. In OvCa patients, a decrease in the levels of IgG galactosylation is observed [52,73,75] (Table 3).

Table 3.

IgG glycopeptide biomarkers of ovarian cancer. ↑- upregulation, ↓- downregulation.

Potential Biomarker Regulation in OvCa References
agalactosylation [52,73,75,76,94]
core fucosylation [52,73]
IgG1 sialylation [52]

Ruhaak and coworkers found differentially expressed IgA, IgG, and IgM glycopeptides in OvCa, whereby the IgG1 glycopeptide bearing a bisected biantennary N-glycan at asparagine-180 could efficiently discriminate EOC patients from healthy controls better than other Ig types [94]. In a study on subclass-specific IgG glycosylation in OvCa, it was found that IgG1 glycopeptide presented the greatest increase in agalactosylation and was strongly associated with CA125. Of interest to note in this study is that IgG2 and IgG3 were analyzed separately. IgG3 was more sialylated and galactosylated than IgG2 and consequently, was decreased in EOC patients [52].

4.3. Acute-Phase Proteins Glycosylation

Inflammation is a complex biological response to a stimulus such as infection, physical injury, cell damage or malignancy. During an inflammatory response, cytokines released from the site of inflammation travel to the hepatocytes to trigger an acute phase response that causes modification in the secretion and glycosylation of acute-phase proteins (APPs) (Table 4). The resultant concentration of APPs may increase by about 25% (positive acute-phase proteins) or may reduce by 25% (negative acute-phase proteins) [95,96].

Table 4.

Potential acute phase proteins N-glycan biomarkers for ovarian cancer. LeX, LewisX.

Acute Phase Glycoprotein Glycosylation Modulations Reference
haptoglobin antennarity, Lex, sialyl Lex [73,97]
α-1-antichymotrypsin antennarity, Lex,
sialyl Lex
[73]
α-1-antitrypsin Lex [73]
α-1-acid glycoprotein core-fucosylated
bi-antennary
digalactosylated
sialyl Lex
[73,97]

The most abundant glycosylated APPs include haptoglobin, α-1 acid glycoprotein, α-1 antitrypsin, anti-chymotrypsin, fibrinogen, complement, fetuin, and transferrin. The changes in their N-glycan chains were studied for ovarian cancer by performing in-gel digestion of the corresponding 2D gel bands [73,97]. An increase in branching, core-fucosylation, sialylation, antennary fucosylation (named LewisX antigen, LeX) and antennary fucosylation on a sialylated branch (named sialyl LeX antigen) were reported for haptoglobin, α1-antichymotrypsin, α1-antitrypsin, α1-acid glycoprotein, C1 esterase inhibitor and hemopexin [73,97,98]. Interestingly, the N-glycomes of transferrin, C1 esterase inhibitor, hemopexin and α2-HS-glycoprotein, which contain over 75% of biantennary structures, were not significantly changed in OvCa [73,97].

4.4. Diagnostic Performances of Glycan-Based Biomarkers

Several research groups have evaluated the diagnostic performances of glycan biomarkers with cohort sizes ranging from 58 to 299 individuals (Table 5). The GLYCOV score, integrating seven upregulated N-glycans and four downregulated N-glycans, demonstrated better diagnostic performance characteristics than the routine test CA125. At sensitivity of 97%, GLYCOV had a specificity of 98.4% for OvCa compared to the routine test CA 125, which had a specificity of 88.9% [74]. In another study addressing benign ovarian diseases versus early stage OvCa, GLYCOV had a sensitivity of 95%, whereas CA125 showed only 60% sensitivity [81].

Table 5.

Diagnostic performances reported for glycan-based biomarkers.

Reference Biomarker Sensitivity/Specificity
(%/%)
Cohort Size
[74] GLYCOV
(N-glycan score)
97/98.4 96
[81] GLYCOV
(N-glycan score)
95/97 73
[78] CA-125 + sialic acid ratio 89.6/100 110
[77] N-glycan score 80–90/70–83 80
[83] N-glycan score 70/86.5 299
[94] IgG1 + IgA + IgM + CA125
glycopeptide score
96.2/92.3 168
[75] IgG agalactosylation ratio + CA125 90/84.6 58

A combination of a ratio of α-2,3-linked/α-2,6-linked sialylated structures and CA 125 to stratify early- and late-stage OvCa yielded improved sensitivity and specificity of 89.6% and 100%, respectively, compared to a sensitivity of 84.4% and specificity of 97% when CA 125 was used alone [78]. The candidate glycan-based biomarker developed by Leiserowitz and coworkers had better performances than CA125 with sensitivity and specificity ranging from 80–90% and 70–83%, respectively, whereas CA 125 had a sensitivity of 74% [77,83]. In another study of their working group, the IgG1 glycopeptide at asparagine 180 used in combination with CA125 improved the specificity from 86% to 95% in a validation cohort. When IgG1, IgA and IgM glycopeptides were combined with CA125, the sensitivity and specificity reached 96.2% and 92.3%, respectively [94]. The Gu laboratory showed that when IgG agalactosylation was used in addition to CA 125, the specificity could be improved by 19.4%, while the sensitivity was maintained at 90% [75].

4.5. Glycan Biomarker Traits for Ovarian Cancer Staging and Monitoring

Previous findings have shown the association between various modulated glycosylated structures with tumor growth and metastasis, which are key factors that inform cancer staging. Follow-up studies have also shown either reduction or increase of modulated glycan traits towards the normal baseline levels upon treatment [76]. The glycan traits that could potentially be helpful in OvCa staging and disease monitoring include sLex, agalactosylation, galactosylation, branching (tri- and tetraantennary structures) and bisecting structures. Several research groups have shown how these modulated features of glycosylation in OvCa promote the invasiveness and metastasis of the disease [76,99,100].

It was previsouly shown that downregulation of high-mannose structures and upregulation of sialylated tri- and tetra-antennary structures containing mono- or difucosylation differentially expressed in stage I and stage II of the epithelial OvCa patients. GLYCOV value was able to discriminate OvCa stage I from stage II satisfactorily, whereas CA125 was not able to [81]. Similarly, high-mannose, complex type asialylation and the bi-, tri- and tetra-antennary sialylated structures are differentially expressed in early and late-stages of OvCa. Moreover, a combination of sialic acid ratio and CA 125 stratified early and late-stage OvCa patients with improved sensitivity and specificity of 89.6% and 100%, respectively, when compared to a CA125 sensitivity of 84.4% and 97% specificity when used as a single marker, as shown in Table 5 [78]. To affirm the place of glycan alterations in the possible staging of OvCa, a study of an OvCa mouse model reported an increase in sialylation with increasing tumor size, implying that sialylation is associated with OvCa progression and, therefore, likely to be useful in staging [86]. These findings imply that apart from its demonstrated potential to make an early diagnosis of OvCa, glycan-based biomarkers could also find applications in monitoring disease progression and staging of OvCa, which could eliminate the need to carry out surgical procedures to obtain a biopsy for histological examination and staging.

5. Challenges of Glycan Biomarker Discovery

Although there exist many opportunities in the field of glycomics with regard to the discovery of biomarkers including those of OvCa, it has not been without challenges that have delayed reaping the full benefits it offers. The glycome complexity is enormous and had previously made it extremely complicated to undertake glycan biomaker studies. However, the introduction of the new broad-spectrum high-throughput analytical technologies has sufficiently addressed the questions of identification and characterization of the glycans. Consequently, there is increased output of research activities in OvCa glycan-based biomarker discovery.

The very nature of OvCa heterogeneity is partly responsible for the delay in delivery of an efficient screening and diagnostic strategy. Ovarian tumors manifest in different phenotypes, molecular biology, etiology and tumor progression, each of them taking different disease paths and with varied outcomes [101]. However, recent modernization of high-throughput technologies has equipped glycomics research with high-precision MS analyzers that are helping to unravel the heterogeneity dilemma. Consequently, high possibilities of developing sets of glycan-based parameters that will aid in the screening and early diagnosis of OvCa irrespective of their originality are now in sight. Variations in sample handling (sample collection, shipment, storage and processing) are unlikely to be a major source of result variability as others we have previously shown [102,103].

Several glycan-biomarker studies on OvCa have suffered from the fate of low statistical power due to the often-low sample size used, leading to frequent less conclusive findings. The problem of the small sample size is partly attributed to the low global prevalence rates of OvCa, which may require a prolonged duration of research, especially in follow-up studies. The problem of low prevalence means that a successful screening strategy must meet an incredibly higher performance threshold to eliminate chances of unnecessary surgeries due to false-positive results. The dangers of surgeries occasioned by false-positive results may far outweigh the benefits that the patients derive from the expected early diagnosis of OvCa as some surgeries may become complicated and even fatal. In our view, the problem of sampling can be overcome by embracing the strategy of broad multi-site collaborative studies that will attain high numbers of study participants quickly and cut recruitment duration.

6. Conclusions

To conclude, the parallel development of instrumentation and high-throughput platforms has allowed the discovery of new glycome-based biomarkers in recent years. The ultimate aim being to find effective screening and early diagnostic strategies that will bring about a reduction in mortalities associated with late diagnosis of OvCa. To date, much of the research findings on glycomic-based OvCa biomarkers still fall within the discovery phase. As methods are affordable and non-invasive, glycan-based biomarkers have the potential to be clinically approved in the future but they are yet to be subjected through the rigor of validation in multi-center studies in order to pave way for clinical approval.

Author Contributions

Conceptualization, V.B., literature search, manuscript writeup, review and editing, F.M.W. and V.B. All authors have read and agreed to the published version of the manuscript.

Funding

F.M.W. was financially supported by a Stipendium of the Deutsche Akademische Austauschdienst. We acknowledge support from the German Research Foundation (DFG) and the Open Access Publication Fund of Charité—Universitätsmedizin Berlin.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

Footnotes

Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  • 1.Bray F., Ferlay J., Soerjomataram I., Siegel R.L., Torre L.A., Jemal A. Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J. Clin. 2018;68:394–424. doi: 10.3322/caac.21492. [DOI] [PubMed] [Google Scholar]
  • 2.Prat J. Ovarian carcinomas: Five distinct diseases with different origins, genetic alterations, and clinicopathological features. Virchows Arch. 2012;460:237–249. doi: 10.1007/s00428-012-1203-5. [DOI] [PubMed] [Google Scholar]
  • 3.Romero I., Leskelä S., Mies B.P., Velasco A.P., Palacios J. Morphological and molecular heterogeneity of epithelial ovarian cancer: Therapeutic implications. Eur. J. Cancer Suppl. 2020;15:1–15. doi: 10.1016/j.ejcsup.2020.02.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Bast R.C., Jr., Hennessy B., Mills G.B. The biology of ovarian cancer: New opportunities for translation. Nat. Rev. Cancer. 2009;9:415–428. doi: 10.1038/nrc2644. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Hippisley-Cox J., Coupland C. Identifying women with suspected ovarian cancer in primary care: Derivation and validation of algorithm. BMJ. 2011;344:d8009. doi: 10.1136/bmj.d8009. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Kirwan A., Utratna M., O’Dwyer M.E., Joshi L., Kilcoyne M. Glycosylation-Based Serum Biomarkers for Cancer Diagnostics and Prognostics. BioMed Res. Int. 2015;2015:1–16. doi: 10.1155/2015/490531. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Badgwell D., Bast R.C., Jr. Early detection of ovarian cancer. Dis. Mark. 2007;23:397–410. doi: 10.1155/2007/309382. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Berger M., Kaup M., Blanchard V. Protein glycosylation and its impact on biotechnology. Adv. Biochem. Eng. Biotechnol. 2012;127:165–185. doi: 10.1007/10_2011_101. [DOI] [PubMed] [Google Scholar]
  • 9.Guo H., Abbott K.L. Functional Impact of Tumor-Specific N-Linked Glycan Changes in Breast and Ovarian Cancers. Adv. Cancer Res. 2015;126:281–303. doi: 10.1016/bs.acr.2014.11.006. [DOI] [PubMed] [Google Scholar]
  • 10.Pinho S.S., Reis C.A. Glycosylation in cancer: Mechanisms and clinical implications. Nat. Rev. Cancer. 2015;15:540–555. doi: 10.1038/nrc3982. [DOI] [PubMed] [Google Scholar]
  • 11.Ueland F.R., DeSimone C.P., Seamon L.G., Miller R.A., Goodrich S., Podzielinski I., Sokoll L., Smith A., Van Nagell J.R., Zhang Z. Effectiveness of a Multivariate Index Assay in the Preoperative Assessment of Ovarian Tumors. Obstet. Gynecol. 2011;117:1289–1297. doi: 10.1097/AOG.0b013e31821b5118. [DOI] [PubMed] [Google Scholar]
  • 12.Moore R.G., Brown A.K., Miller M.C., Skates S., Allard W.J., Verch T., Steinhoff M., Messerlian G., DiSilvestro P., Granai C., et al. The use of multiple novel tumor biomarkers for the detection of ovarian carcinoma in patients with a pelvic mass. Gynecol. Oncol. 2008;108:402–408. doi: 10.1016/j.ygyno.2007.10.017. [DOI] [PubMed] [Google Scholar]
  • 13.Scholler N., Urban N. CA125 in ovarian cancer. Biomark. Med. 2007;1:513–523. doi: 10.2217/17520363.1.4.513. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Canney P.A., Moore M., Wilkinson P.M., James R.D. Ovarian cancer antigen CA125: A prospective clinical assessment of its role as a tumour marker. Br. J. Cancer. 1984;50:765–769. doi: 10.1038/bjc.1984.254. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Nossov V., Amneus M., Su F., Lang J., Janco J.M.T., Reddy S.T., Farias-Eisner R. The early detection of ovarian cancer: From traditional methods to proteomics. Can we really do better than serum CA-125? Am. J. Obstet. Gynecol. 2008;199:215–223. doi: 10.1016/j.ajog.2008.04.009. [DOI] [PubMed] [Google Scholar]
  • 16.Ferraro S., Braga F., Lanzoni M., Boracchi P., Biganzoli E.M., Panteghini M. Serum human epididymis protein 4 vs carbohydrate antigen 125 for ovarian cancer diagnosis: A systematic review. J. Clin. Pathol. 2013;66:273–281. doi: 10.1136/jclinpath-2012-201031. [DOI] [PubMed] [Google Scholar]
  • 17.Muinao T., Boruah H.P.D., Pal M. Diagnostic and Prognostic Biomarkers in ovarian cancer and the potential roles of cancer stem cells—An updated review. Exp. Cell Res. 2018;362:1–10. doi: 10.1016/j.yexcr.2017.10.018. [DOI] [PubMed] [Google Scholar]
  • 18.Moore R.G., McMeekin D.S., Brown A.K., DiSilvestro P., Miller M.C., Allard W.J., Gajewski W., Kurman R., Bast R.C., Skates S.J. A novel multiple marker bioassay utilizing HE4 and CA125 for the prediction of ovarian cancer in patients with a pelvic mass. Gynecol. Oncol. 2009;112:40–46. doi: 10.1016/j.ygyno.2008.08.031. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Sarojini S., Tamir A., Lim H., Li S., Zhang S., Goy A., Pecora A., Suh K.S. Early Detection Biomarkers for Ovarian Cancer. J. Oncol. 2012;2012:1–15. doi: 10.1155/2012/709049. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Chang X., Ye X., Dong L., Cheng H., Cheng Y., Zhu L., Liao Q., Zhao Y., Tian L., Fu T., et al. Human Epididymis Protein 4 (HE4) as a Serum Tumor Biomarker in Patients With Ovarian Carcinoma. Int. J. Gynecol. Cancer. 2011;21:852–858. doi: 10.1097/IGC.0b013e31821a3726. [DOI] [PubMed] [Google Scholar]
  • 21.Cramer D.W., O’Rourke D.J., Vitonis A.F., Matulonis U.A., DiJohnson D.A., Sluss P.M., Crum C.P., Liu B.C.-S. CA125 Immune Complexes in Ovarian Cancer Patients with Low CA125 Concentrations. Clin. Chem. 2010;56:1889–1892. doi: 10.1373/clinchem.2010.153122. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Bandiera E., Romani C., Specchia C., Zanotti L., Galli C., Ruggeri G., Tognon G., Bignotti E., Tassi R.A., Odicino F., et al. Serum Human Epididymis Protein 4 and Risk for Ovarian Malignancy Algorithm as New Diagnostic and Prognostic Tools for Epithelial Ovarian Cancer Management. Cancer Epidemiol. Biomark. Prev. 2011;20:2496–2506. doi: 10.1158/1055-9965.EPI-11-0635. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Nakae M., Iwamoto I., Fujino T., Maehata Y., Togami S.-I., Yoshinaga M., Douchi T. Preoperative plasma osteopontin level as a biomarker complementary to carbohydrate antigen 125 in predicting ovarian cancer. J. Obstet. Gynaecol. Res. 2006;32:309–314. doi: 10.1111/j.1447-0756.2006.00403.x. [DOI] [PubMed] [Google Scholar]
  • 24.Zhang L., Chen Y., Wang K. Comparison of CA125, HE4, and ROMA index for ovarian cancer diagnosis. Curr. Probl. Cancer. 2019;43:135–144. doi: 10.1016/j.currproblcancer.2018.06.001. [DOI] [PubMed] [Google Scholar]
  • 25.Santotoribio J.D., La Torre A.G.-D., Cañavate-Solano C., Arce-Matute F., Pino M.J.S.-D., Perez-Ramos S. Cancer antigens 19.9 and 125 as tumor markers in patients with mucinous ovarian tumors. Eur. J. Gynaecol. Oncol. 2016;37:26–29. [PubMed] [Google Scholar]
  • 26.Lertkhachonsuk A.A., Buranawongtrakoon S., Lekskul N., Rermluk N., Wee-Stekly W.-W., Charakorn C. Serum CA19-9, CA-125 and CEA as tumor markers for mucinous ovarian tumors. J. Obstet. Gynaecol. Res. 2020;46:2287–2291. doi: 10.1111/jog.14427. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Moore R.G., Miller M.C., DiSilvestro P., Landrum L.M., Gajewski W., Ball J.J., Skates S.J. Evaluation of the Diagnostic Accuracy of the Risk of Ovarian Malignancy Algorithm in Women With a Pelvic Mass. Obstet. Gynecol. 2011;118:280–288. doi: 10.1097/AOG.0b013e318224fce2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Nolen B.M., Lokshin A.E. Biomarker Testing for Ovarian Cancer: Clinical Utility of Multiplex Assays. Mol. Diagn. Ther. 2013;17:139–146. doi: 10.1007/s40291-013-0027-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Miller R.W., Smith A., DeSimone C.P., Seamon L., Goodrich S., Podzielinski I., Sokoll L., Van Nagell J.R., Zhang Z., Ueland F.R. Performance of the American College of Obstetricians and Gynecologists’ Ovarian Tumor Referral Guidelines With a Multivariate Index Assay. Obstet. Gynecol. 2011;117:1298–1306. doi: 10.1097/AOG.0b013e31821b1d80. [DOI] [PubMed] [Google Scholar]
  • 30.Coleman R.L., Herzog T.J., Chan D.W., Munroe D.G., Pappas T.C., Smith A., Zhang Z., Wolf J. Validation of a second-generation multivariate index assay for malignancy risk of adnexal masses. Am. J. Obstet. Gynecol. 2016;215:82.e1–82.e11. doi: 10.1016/j.ajog.2016.03.003. [DOI] [PubMed] [Google Scholar]
  • 31.Galgano M.T., Hampton G.M., Frierson H.F., Jr. Comprehensive analysis of HE4 expression in normal and malignant human tissues. Mod. Pathol. 2006;19:847–853. doi: 10.1038/modpathol.3800612. [DOI] [PubMed] [Google Scholar]
  • 32.Elzek M.A., Rodland K.D. Proteomics of ovarian cancer: Functional insights and clinical applications. Cancer Metastasis Rev. 2015;34:83–96. doi: 10.1007/s10555-014-9547-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Nolen B., Velikokhatnaya L., Marrangoni A., De Geest K., Lomakin A., Bast R.C., Lokshin A. Serum biomarker panels for the discrimination of benign from malignant cases in patients with an adnexal mass. Gynecol. Oncol. 2010;117:440–445. doi: 10.1016/j.ygyno.2010.02.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Scara S., Bottoni P., Scatena R. CA 19-9: Biochemical and Clinical Aspects. Adv. Exp. Med. Biol. 2015;867:247–260. doi: 10.1007/978-94-017-7215-0_15. [DOI] [PubMed] [Google Scholar]
  • 35.Poruk K.E., Gay D.Z., Brown K., Mulvihill J.D., Boucher K.M., Scaife C.L., Firpo M.A., Mulvihill S.J. The clinical utility of CA 19-9 in pancreatic adenocarcinoma: Diagnostic and prognostic updates. Curr. Mol. Med. 2013;13:340–351. doi: 10.2174/1566524011313030003. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Coskun A., Kiran G., Ozdemir O. CA 19-9 can be a useful tumor marker in ovarian dermoid cysts. Clin. Exp. Obstet. Gynecol. 2008;35:137–139. [PubMed] [Google Scholar]
  • 37.DeDe M., Gungor S., Yenen M., Alanbay I., Duru N., Haşimi A. CA19-9 may have clinical significance in mature cystic teratomas of the ovary. Int. J. Gynecol. Cancer. 2006;16:189–193. doi: 10.1111/j.1525-1438.2006.00284.x. [DOI] [PubMed] [Google Scholar]
  • 38.Kelly P.J., Archbold P., Price J.H., Cardwell C., McCluggage W.G. Serum CA19.9 levels are commonly elevated in primary ovarian mucinous tumours but cannot be used to predict the histological subtype. J. Clin. Pathol. 2010;63:169–173. doi: 10.1136/jcp.2009.072355. [DOI] [PubMed] [Google Scholar]
  • 39.Molina R., Escudero J.M., Augé J.M., Filella X., Foj L., Torné A., Lejarcegui J., Pahisa J. HE4 a novel tumour marker for ovarian cancer: Comparison with CA 125 and ROMA algorithm in patients with gynaecological diseases. Tumor Biol. 2011;32:1087–1095. doi: 10.1007/s13277-011-0204-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Bast R.C., Jr., Skates S., Lokshin A., Moore R.G. Differential diagnosis of a pelvic mass: Improved algorithms and novel biomarkers. Int. J. Gynecol. Cancer. 2012;22:5–8. doi: 10.1097/IGC.0b013e318251c97d. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Muinao T., Boruah H.P.D., Pal M. Multi-biomarker panel signature as the key to diagnosis of ovarian cancer. Heliyon. 2019;5:e02826. doi: 10.1016/j.heliyon.2019.e02826. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Hamouda H., Ullah M., Berger M., Sittinger M., Tauber R., Ringe J., Blanchard V. N-Glycosylation Profile of Undifferentiated and Adipogenically Differentiated Human Bone Marrow Mesenchymal Stem Cells: Towards a Next Generation of Stem Cell Markers. Stem Cells Dev. 2013;22:3100–3113. doi: 10.1089/scd.2013.0108. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Epp A., Hobusch J., Bartsch Y.C., Petry J., Lilienthal G.-M., Koeleman C.A., Eschweiler S., Möbs C., Hall A., Morris S.C., et al. Sialylation of IgG antibodies inhibits IgG-mediated allergic reactions. J. Allergy Clin. Immunol. 2018;141:399–402. doi: 10.1016/j.jaci.2017.06.021. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Kozak R.P., Royle L., Gardner R.A., Fernandes D.L., Wuhrer M. Suppression of peeling during the release of O-glycans by hydrazinolysis. Anal. Biochem. 2012;423:119–128. doi: 10.1016/j.ab.2012.01.002. [DOI] [PubMed] [Google Scholar]
  • 45.Rudd P., Karlsson N.G., Khoo K.-H., Packer N.H. Glycomics and Glycoproteomics. In: Varki A., editor. Essentials of Glycobiology. Cold Spring Harbor Laboratory Press; Cold Spring Harbor, NY, USA: The Consortium of Glycobiology; La Jolla, CA, USA: 2015. pp. 653–666. [Google Scholar]
  • 46.Harvey D.J. Analysis of carbohydrates and glycoconjugates by matrix-assisted laser desorption/ionization mass spectrometry: An update for 2007–2008. Mass Spectrom. Rev. 2012;31:183–311. doi: 10.1002/mas.20333. [DOI] [PubMed] [Google Scholar]
  • 47.Leymarie N., Zaia J. Effective Use of Mass Spectrometry for Glycan and Glycopeptide Structural Analysis. Anal. Chem. 2012;84:3040–3048. doi: 10.1021/ac3000573. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Kyselova Z., Mechref Y., Kang P., Goetz J.A., Dobrolecki L.E., Sledge G.W., Schnaper L., Hickey R.J., Malkas L.H., Novotny M.V. Breast Cancer Diagnosis and Prognosis through Quantitative Measurements of Serum Glycan Profiles. Clin. Chem. 2008;54:1166–1175. doi: 10.1373/clinchem.2007.087148. [DOI] [PubMed] [Google Scholar]
  • 49.Zauner G., Selman M.H.J., Bondt A., Rombouts Y., Blank D., Deelder A.M., Wuhrer M. Glycoproteomic Analysis of Antibodies. Mol. Cell. Proteom. 2013;12:856–865. doi: 10.1074/mcp.R112.026005. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Dalpathado D.S., Desaire H. Glycopeptide analysis by mass spectrometry. Analyst. 2008;133:731–738. doi: 10.1039/b713816d. [DOI] [PubMed] [Google Scholar]
  • 51.Vidic U., Trbojević-Akmačić I., Černigoj U., Albers M., Gašperšič J., Pučić-Baković M., Vidič J., Štrancar A., Lauc G., Josic D. Semi-high-throughput isolation andN-glycan analysis of human fibrinogen using monolithic supports bearing monoclonal anti-human fibrinogen antibodies. Electrophoresis. 2017;38:2922–2930. doi: 10.1002/elps.201700140. [DOI] [PubMed] [Google Scholar]
  • 52.Wieczorek M., Braicu E.I., Oliveira-Ferrer L., Sehouli J., Blanchard V. Immunoglobulin G Subclass-Specific Glycosylation Changes in Primary Epithelial Ovarian Cancer. Front. Immunol. 2020;11 doi: 10.3389/fimmu.2020.00654. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.O’Flaherty R., Muniyappa M., Walsh I., Stöckmann H., Hilliard M., Hutson R., Saldova R., Rudd P.M. A Robust and Versatile Automated Glycoanalytical Technology for Serum Antibodies and Acute Phase Proteins: Ovarian Cancer Case Study*. Mol. Cell. Proteom. 2019;18:2191–2206. doi: 10.1074/mcp.RA119.001531. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Wuhrer M., Stam J.C., Van De Geijn F.E., Koeleman C.A.M., Verrips C.T., Dolhain R.J.E.M., Hokke C.H., Deelder A.M. Glycosylation profiling of immunoglobulin G (IgG) subclasses from human serum. Proteomics. 2007;7:4070–4081. doi: 10.1002/pmic.200700289. [DOI] [PubMed] [Google Scholar]
  • 55.de Haan N., Reiding K.R., Haberger M., Reusch D., Falck D., Wuhrer M. Linkage-specific sialic acid derivatization for MALDI-TOF-MS profiling of IgG glycopeptides. Anal. Chem. 2015;87:8284–8291. doi: 10.1021/acs.analchem.5b02426. [DOI] [PubMed] [Google Scholar]
  • 56.Quaranta A., Spasova M., Passarini E., Karlsson I., Ndreu L., Thorsén G., Ilag L.L. N-Glycosylation profiling of intact target proteins by high-resolution mass spectrometry (MS) and glycan analysis using ion mobility-MS/MS. Analyst. 2019;145:1737–1748. doi: 10.1039/C9AN02081K. [DOI] [PubMed] [Google Scholar]
  • 57.Montacir O., Montacir H., Springer A., Hinderlich S., Mahboudi F., Saadati A., Parr M.K. Physicochemical Characterization, Glycosylation Pattern and Biosimilarity Assessment of the Fusion Protein Etanercept. Protein J. 2018;37:164–179. doi: 10.1007/s10930-018-9757-y. [DOI] [PubMed] [Google Scholar]
  • 58.Sénard T., Gargano A.F.G., Falck D., de Taeye S.W., Rispens T., Vidarsson G., Wuhrer M., Somsen G.W., Domínguez-Vega D. MS-Based Allotype-Specific Analysis of Polyclonal IgG-Fc N-Glycosylation. Front. Immunol. 2020;11:2049. doi: 10.3389/fimmu.2020.02049. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59.Domínguez-Vega E., Tengattini S., Peintner C., Van Angeren J., Temporini C., Haselberg R., Massolini G., Somsen G.W. High-resolution glycoform profiling of intact therapeutic proteins by hydrophilic interaction chromatography-mass spectrometry. Talanta. 2018;184:375–381. doi: 10.1016/j.talanta.2018.03.015. [DOI] [PubMed] [Google Scholar]
  • 60.Van Scherpenzeel M., Steenbergen G., Morava E., Wevers R.A., Lefeber D.J. High-resolution mass spectrometry glycoprofiling of intact transferrin for diagnosis and subtype identification in the congenital disorders of glycosylation. Transl. Res. 2015;166:639–649. doi: 10.1016/j.trsl.2015.07.005. [DOI] [PubMed] [Google Scholar]
  • 61.Miyamoto S., Ruhaak L.R., Stroble C., Salemi M.R., Phinney B., Lebrilla C.B., Leiserowitz G.S. Glycoproteomic Analysis of Malignant Ovarian Cancer Ascites Fluid Identifies Unusual Glycopeptides. J. Proteome Res. 2016;15:3358–3376. doi: 10.1021/acs.jproteome.6b00548. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62.Kim Y.-G., Jeong H.-J., Jang K.-S., Yang Y.-H., Song Y.-S., Chung J., Kim B.-G. Rapid and high-throughput analysis of N-glycans from ovarian cancer serum using a 96-well plate platform. Anal. Biochem. 2009;391:151–153. doi: 10.1016/j.ab.2009.05.015. [DOI] [PubMed] [Google Scholar]
  • 63.Reiding K.R., Bondt A., Hennig R., Gardner R.A., O’Flaherty R., Trbojević-Akmačić I., Shubhakar A., Hazes J.M.W., Reichl U., Fernandes D.L., et al. High-throughput Serum N-Glycomics: Method Comparison and Application to Study Rheumatoid Arthritis and Pregnancy-associated Changes. Mol. Cell. Proteom. 2019;18:3–15. doi: 10.1074/mcp.RA117.000454. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 64.Krenková J., Lacher N.A., Svec F. Multidimensional system enabling deglycosylation of proteins using a capillary reactor with peptide-N-glycosidase F immobilized on a porous polymer monolith and hydrophilic interaction liquid chromatography–mass spectrometry of glycans. J. Chromatogr. A. 2009;1216:3252–3259. doi: 10.1016/j.chroma.2009.02.036. [DOI] [PubMed] [Google Scholar]
  • 65.Szabo Z., Guttman A., Karger B.L. Rapid Release of N-Linked Glycans from Glycoproteins by Pressure-Cycling Technology. Anal. Chem. 2010;82:2588–2593. doi: 10.1021/ac100098e. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 66.Palm A.K., Novotny M.V. A monolithic PNGase F enzyme microreactor enabling glycan mass mapping of glycoproteins by mass spectrometry. Rapid Commun. Mass Spectrom. 2005;19:1730–1738. doi: 10.1002/rcm.1979. [DOI] [PubMed] [Google Scholar]
  • 67.Pučić M., Knežević A., Vidič J., Adamczyk B., Novokmet M., Polašek O., Gornik O., Šupraha-Goreta S., Wormald M.R., Redžić I., et al. High Throughput Isolation and Glycosylation Analysis of IgG–Variability and Heritability of the IgG Glycome in Three Isolated Human Populations. Mol. Cell. Proteom. 2011;10:M111.010090. doi: 10.1074/mcp.M111.010090. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 68.Momčilović A., de Haan N., Ederveen A.L.H., Bondt A., Koeleman C.A.M., Falck D., de Neef L.A., Mesker W.E., Tollenaar R.A., de Ru A., et al. Simultaneous Immunoglobulin A and G Glycopeptide Profiling for High-Throughput Applications. Anal. Chem. 2020;92:4518–4526. doi: 10.1021/acs.analchem.9b05722. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 69.Ruhaak L.R., Hennig R., Huhn C., Borowiak M., Dolhain R.J.E.M., Deelder A.M., Rapp E., Wuhrer M. Optimized Workflow for Preparation of APTS-Labeled N-Glycans Allowing High-Throughput Analysis of Human Plasma Glycomes using 48-Channel Multiplexed CGE-LIF. J. Proteome Res. 2010;9:6655–6664. doi: 10.1021/pr100802f. [DOI] [PubMed] [Google Scholar]
  • 70.Bunz S.-C., Rapp E., Neusüss C. Capillary Electrophoresis/Mass Spectrometry of APTS-Labeled Glycans for the Identification of Unknown Glycan Species in Capillary Electrophoresis/Laser-Induced Fluorescence Systems. Anal. Chem. 2013;85:10218–10224. doi: 10.1021/ac401930j. [DOI] [PubMed] [Google Scholar]
  • 71.Schwedler C., Häupl T., Kalus U., Blanchard V., Burmester G.-R., Poddubnyy D., Hoppe B. Hypogalactosylation of immunoglobulin G in rheumatoid arthritis: Relationship to HLA-DRB1 shared epitope, anticitrullinated protein antibodies, rheumatoid factor, and correlation with inflammatory activity. Arthritis Res. 2018;20:1–13. doi: 10.1186/s13075-018-1540-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 72.Zhao S., Walsh I., Abrahams J.L., Royle L., Nguyen-Khuong T., Spencer D., Fernandes D.L., Packer N.H., Rudd P.M., Campbell M.P. GlycoStore: A database of retention properties for glycan analysis. Bioinformatics. 2018;34:3231–3232. doi: 10.1093/bioinformatics/bty319. [DOI] [PubMed] [Google Scholar]
  • 73.Saldova R.F., Royle L., Radcliffe C.M., Hamid U.M.A., Evans R., Arnold J.N., E Banks R., Hutson R., Harvey D.J., Antrobus R., et al. Ovarian Cancer is Associated with Changes in Glycosylation in Both Acute-Phase Proteins and IgG. Glycobiology. 2007;17:1344–1356. doi: 10.1093/glycob/cwm100. [DOI] [PubMed] [Google Scholar]
  • 74.Biskup K., Braicu E.I., Sehouli J., Fotopoulou C., Tauber R., Berger M., Blanchard V. Serum Glycome Profiling: A Biomarker for Diagnosis of Ovarian Cancer. J. Proteome Res. 2013;12:4056–4063. doi: 10.1021/pr400405x. [DOI] [PubMed] [Google Scholar]
  • 75.Qian Y., Wang Y., Zhang X., Zhou L., ZeJian Z., Xu J., Ruan Y., Ren S., Xu C., Gu J. Quantitative Analysis of Serum IgG Galactosylation Assists Differential Diagnosis of Ovarian Cancer. J. Proteome Res. 2013;12:4046–4055. doi: 10.1021/pr4003992. [DOI] [PubMed] [Google Scholar]
  • 76.Alley W.R., Vasseur J.A., Goetz J.A., Svoboda M., Mann B.F., Matei D.E., Menning N., Hussein A., Mechref Y., Novotny M.V. N-linked Glycan Structures and Their Expressions Change in the Blood Sera of Ovarian Cancer Patients. J. Proteome Res. 2012;11:2282–2300. doi: 10.1021/pr201070k. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 77.Kim J.-H., Park C.W., Um D., Baek K.H., Jo Y., An H., Kim Y., Kim T.J. Mass Spectrometric Screening of Ovarian Cancer with Serum Glycans. Dis. Mark. 2014;2014:1–9. doi: 10.1155/2014/634289. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 78.Dědová T., Braicu E.I., Sehouli J., Blanchard V. Sialic Acid Linkage Analysis Refines the Diagnosis of Ovarian Cancer. Front. Oncol. 2019;9:261. doi: 10.3389/fonc.2019.00261. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 79.Kuzmanov U., Kosanam H., Diamandis E.P. The sweet and sour of serological glycoprotein tumor biomarker quantification. BMC Med. 2013;11:31. doi: 10.1186/1741-7015-11-31. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 80.Kavallaris M., Marshall G.M. Proteomics and disease: Opportunities and challenges. Med. J. Aust. 2005;182:575–579. doi: 10.5694/j.1326-5377.2005.tb06817.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 81.Biskup K., Braicu E.I., Sehouli J., Tauber R., Blanchard V. The Serum Glycome to Discriminate between Early-Stage Epithelial Ovarian Cancer and Benign Ovarian Diseases. Dis. Mark. 2014;2014:1–10. doi: 10.1155/2014/238197. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 82.Hua S., Williams C.C., Dimapasoc L.M., Ro G.S., Ozcan S., Miyamoto S., Lebrilla C.B., An H.J., Leiserowitz G.S. Isomer-specific chromatographic profiling yields highly sensitive and specific potential N-glycan biomarkers for epithelial ovarian cancer. J. Chromatogr. A. 2013;1279:58–67. doi: 10.1016/j.chroma.2012.12.079. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 83.Kim K., Ruhaak L.R., Nguyen U.T., Taylor S.L., Dimapasoc L., Williams C., Stroble C., Ozcan S., Miyamoto S., Lebrilla C.B., et al. Evaluation of Glycomic Profiling as a Diagnostic Biomarker for Epithelial Ovarian Cancer. Cancer Epidemiol. Biomark. Prev. 2014;23:611–621. doi: 10.1158/1055-9965.EPI-13-1073. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 84.Saldova R.F., Piccard H., Pérez-Garay M., Harvey D.J., Struwe W.B., Galligan M.C., Berghmans N., Madden S.F., Peracaula R., Opdenakker G., et al. Increase in Sialylation and Branching in the Mouse Serum N-glycome Correlates with Inflammation and Ovarian Tumour Progression. PLoS ONE. 2013;8:e71159. doi: 10.1371/journal.pone.0071159. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 85.Zahradnikova M., Ihnatova I., Lattova E., Uhrik L., Stuchlikova E., Nenutil R., Valik D., Nalezinska M., Chovanec J., Zdrahal Z., et al. N-Glycome changes reflecting resistance to platinum-based chemotherapy in ovarian cancer. J. Proteom. 2021;230:103964. doi: 10.1016/j.jprot.2020.103964. [DOI] [PubMed] [Google Scholar]
  • 86.Saldova R., Struwe W.B., Wynne K., Elia G., Duffy M.J., Rudd P.M. Exploring the Glycosylation of Serum CA125. Int. J. Mol. Sci. 2013;14:15636–15654. doi: 10.3390/ijms140815636. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 87.Ozcan S., Barkauskas D.A., Ruhaak L.R., Torres J., Cooke C.L., An H.J., Hua S., Williams C.C., Dimapasoc L.M., Kim J.H., et al. Serum Glycan Signatures of Gastric Cancer. Cancer Prev. Res. 2014;7:226–235. doi: 10.1158/1940-6207.CAPR-13-0235. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 88.Abbott K.L., Lim J.-M., Wells L., Benigno B.B., McDonald J.F., Pierce M. Identification of candidate biomarkers with cancer-specific glycosylation in the tissue and serum of endometrioid ovarian cancer patients by glycoproteomic analysis. Proteomics. 2010;10:470–481. doi: 10.1002/pmic.200900537. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 89.Wang P.-H., Lee W.-L., Juang C.-M., Yang Y.-H., Lo W.-H., Lai C.-R., Hsieh S.-L., Yuan C.-C. Altered mRNA expressions of sialyltransferases in ovarian cancers. Gynecol. Oncol. 2005;99:631–639. doi: 10.1016/j.ygyno.2005.07.016. [DOI] [PubMed] [Google Scholar]
  • 90.Ogawa J.I., Inoue H., Koide S. alpha-2,3-Sialyltransferase type 3N and alpha-1,3-fucosyltransferase type VII are related to sialyl Lewis(x) synthesis and patient survival from lung carcinoma. Cancer. 1997;79:1678–1685. doi: 10.1002/(SICI)1097-0142(19970501)79:9<1678::AID-CNCR7>3.0.CO;2-8. [DOI] [PubMed] [Google Scholar]
  • 91.Ercan A., Kohrt W.M., Cui J., Deane K.D., Pezer M., Yu E.W., Hausmann J.S., Campbell H., Kaiser U.B., Rudd P.M., et al. Estrogens regulate glycosylation of IgG in women and men. JCI Insight. 2017;2:e89703. doi: 10.1172/jci.insight.89703. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 92.Gudelj I., Lauc G., Pezer M. Immunoglobulin G glycosylation in aging and diseases. Cell. Immunol. 2018;333:65–79. doi: 10.1016/j.cellimm.2018.07.009. [DOI] [PubMed] [Google Scholar]
  • 93.De Haan N., Falck D., Wuhrer M. Monitoring of immunoglobulin N- and O-glycosylation in health and disease. Glycobiology. 2020;30:226–240. doi: 10.1093/glycob/cwz048. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 94.Ruhaak L.R., Kim K., Stroble C., Taylor S.L., Hong Q., Miyamoto S., Lebrilla C.B., Leiserowitz G. Protein-Specific Differential Glycosylation of Immunoglobulins in Serum of Ovarian Cancer Patients. J. Proteome Res. 2016;15:1002–1010. doi: 10.1021/acs.jproteome.5b01071. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 95.Gabay C., Kushner I. Acute-Phase Proteins and Other Systemic Responses to Inflammation. N. Engl. J. Med. 1999;340:448–454. doi: 10.1056/NEJM199902113400607. [DOI] [PubMed] [Google Scholar]
  • 96.McCarthy C., Saldova R.F., Wormald M.R., Rudd P.M., McElvaney N.G., Reeves E.P. The Role and Importance of Glycosylation of Acute Phase Proteins with Focus on Alpha-1 Antitrypsin in Acute and Chronic Inflammatory Conditions. J. Proteome Res. 2014;13:3131–3143. doi: 10.1021/pr500146y. [DOI] [PubMed] [Google Scholar]
  • 97.Weiz S., Wieczorek M., Schwedler C., Kaup M., Braicu E.I., Sehouli J., Tauber R., Blanchard V. Acute-phase glycoprotein N-glycome of ovarian cancer patients analyzed by CE-LIF. Electrophoresis. 2016;37:1461–1467. doi: 10.1002/elps.201500518. [DOI] [PubMed] [Google Scholar]
  • 98.Peracaula R., Sarrats A., Rudd P.M. Liver proteins as sensor of human malignancies and inflammation. Proteom. Clin. Appl. 2010;4:426–431. doi: 10.1002/prca.200900170. [DOI] [PubMed] [Google Scholar]
  • 99.Saldova R.F., Wormald M.R., Dwek R.A., Rudd P.M. Glycosylation Changes on Serum Glycoproteins in Ovarian Cancer May Contribute to Disease Pathogenesis. Dis. Mark. 2008;25:219–232. doi: 10.1155/2008/601583. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 100.Christiansen M.N., Chik J., Lee L., Anugraham M., Abrahams J.L., Packer N.H. Cell surface protein glycosylation in cancer. Proteomics. 2014;14:525–546. doi: 10.1002/pmic.201300387. [DOI] [PubMed] [Google Scholar]
  • 101.Meinhold-Heerlein I., Hauptmann S. The heterogeneity of ovarian cancer. Arch. Gynecol. Obstet. 2014;289:237–239. doi: 10.1007/s00404-013-3114-3. [DOI] [PubMed] [Google Scholar]
  • 102.Dědová T., Grunow D., Kappert K., Flach D., Tauber R., Blanchard V. The effect of blood sampling and preanalytical processing on human N-glycome. PLoS ONE. 2018;13:e0200507. doi: 10.1371/journal.pone.0200507. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 103.Gornik O., Wagner J., Pučić M., Knežević A., Redžić I., Lauc G. Stability of N-glycan profiles in human plasma. Glycobiology. 2009;19:1547–1553. doi: 10.1093/glycob/cwp134. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

Not applicable.


Articles from Diagnostics are provided here courtesy of Multidisciplinary Digital Publishing Institute (MDPI)

RESOURCES