Skip to main content
International Journal of Molecular Sciences logoLink to International Journal of Molecular Sciences
. 2016 Sep 20;17(9):1484. doi: 10.3390/ijms17091484

Effect of Thyrotropin on Osteopontin, Integrin αvβ3, and VCAM-1 in the Endothelium via Activation of Akt

Yumeng Yan 1, Fengwei Jiang 1, Yaxin Lai 1, Haoyu Wang 1, Aihua Liu 1, Chuyuan Wang 1, Yuanyuan Zhang 1, Weiping Teng 1, Zhongyan Shan 1,*
Editor: Masatoshi Maki1
PMCID: PMC5037762  PMID: 27657042

Abstract

Numerous epidemiological studies have shown that subclinical hypothyroidism (SCH) can impair endothelial function and cause dyslipidemia. Studies have evaluated the effects of thyroid stimulating hormone (TSH) on endothelial cells, but the mechanism underlying the proatherosclerotic effect of increased TSH levels remains unclear. In the present study, SCH rat models were established in thyroidectomized Wistar rats that were given l-T4 daily. The results showed that in vivo, the expression of osteopontin (OPN) vascular cell adhesion molecule (VCAM-1), and levels of integrin αvβ3 in the aortic tissue in SCH and Hypothyroidism (CH) groups was higher than in the control group. However, the effect in the SCH group was higher than in the CH group. In vitro, results showed that different concentration and time gradients of TSH stimulation could increase the expression of OPN, VCAM-1, and integrin αvβ3, and this was accompanied by extracellular signal regulated kinase 1/2 (Erk1/2) and Akt activation in human umbilical vein endothelial cells (HUVECs). TSH induced elevation of these proatherosclerotic factors was partially suppressed by a specific Akt inhibitor but not by a specific Erk inhibitor. Findings suggested that the endothelial dysfunction caused by SCH was related to increased proatherosclerotic factors induced by TSH via Akt activation.

Keywords: thyrotropin, atherosclerosis, subclinical hypothyroidism, osteopontin

1. Introduction

Subclinical hypothyroidism (SCH) which is defined as elevated serum thyroid stimulating hormone (TSH) levels with concomitant normal serum free thyroid hormone levels (free T3 (fT3) and free T4 (fT4)), has garnered more attention in recent years. The morbidity SCH is 4%–20% of the adult population [1,2]. Numerous epidemiological studies demonstrated that SCH could be a strong risk indicator for atherosclerosis [3] and is associated with increased carotid intima-media thickness (IMT) [4] and dyslipidemia [5,6,7].

Osteopontin (OPN), which is a phosphorylated glycoprotein originally found in bone, has recently been shown to be involved in the pathological processes of which atherosclerosis is a key factor [8,9]. Numerous articles report increased OPN expression in human atherosclerotic plaques and its association with the severity of coronary artery disease [10,11]. Integrin αvβ3, which acts as an adhesion receptor, also plays a crucial role in the progression of atherosclerosis. Previous studies have demonstrated that both the endothelium along the lumen of nonatherosclerotic diffuse intimal thickening and atherosclerotic plaques are associated with increased expression of integrin αvβ3 [12,13]. Vascular cell adhesion molecule (VCAM-1) is an important adhesion molecule for endothelial cells and also plays a critical role in inflammation, such as mediating the interaction of monocytes with the arterial wall.

Vascular endothelial cells, such as human aorta endothelial cells and human umbilical vein endothelial cells (HUVECs), express TSH receptor (TSHR) [14,15]. Endothelial dysfunction is considered a crucial early step in the pathological process of atherosclerosis. Some studies have provided evidence for the acute enhancement of recombinant human thyrotropin (rhTSH) in the endothelium-mediated vasodilation independent of thyroid hormones [16,17], but other studies have suggested the opposite [18]. Studies performed on different types of endothelial cells have shown that TSH stimulation can rapidly elevate cyclic adenosine monophosphate (cAMP) concentration, accompanied by increased nitric oxide (NO) and decreased vasoconstrictor endothelin, which proved that TSH had a protective effect on endothelial function [14]. Nevertheless, some studies have demonstrated that TSH can induce lower levels of endothelial nitric oxide synthase (eNOS) and prostaglandin I2 (PGI2) and higher levels of endothelin and plasminogen activator inhibitor-1 (PAI-1) expression. This was consistent with the destructive effect of TSH [15]. However, it remains unclear whether TSH has any direct impact on proatherosclerotic factors, such as OPN, VCAM-1, and integrin αvβ3, and its signaling pathway remains to be elucidated.

In the present study, the effect of TSH on OPN, VCAM-1, and integrin αvβ3 was determined in HUVECs, as well as its possible mechanisms. The results also showed the proatherosclerotic effect of subclinical hypothyroidism in Wistar rat models.

2. Results

2.1. Hormone Levels in Rats of Three Groups of Rats

The Wistar rats were randomly divided into three groups, control (CON), subclinical hypothyroidism (SCH), and hypothyroidism (CH) groups. To confirm the thyroid status of each group, plasma levels of total thyroxine (TT4) and TSH were detected as shown in Table 1. The CH group showed significantly higher TSH levels and lower TT4 levels than did in the CON group. Then, 4 or 14 weeks after l-T4 injection, the SCH group showed significantly higher TSH levels than the CON group, but there was no statistically significant difference in TT4 between the SCH and CON groups. In summary, the CH and SCH rat models were successful.

Table 1.

Plasma levels of TT4 and TSH in each group.

CON SCH CH
TSH (mIU/L) TT4 (μg/dL) TSH (mIU/L) TT4 (μg/dL) TSH (mIU/L) TT4 (μg/dL)
4 Weeks after surgery 0.19 ± 0.10 4.24 ± 0.82 21.65 ± 8.54 * 1.52 ± 0.93 * 21.8 ± 3.65 * 1.34 ± 0.35 *
4 Weeks after l-T4 injection 0.36 ± 0.19 4.01 ± 0.97 4.01 ± 0.97 3.16 ± 1.09 13.0 ± 6.09 * 1.61 ± 0.55 *
14 Weeks after l-T4 injection 0.37 ± 0.26 3.51 ± 0.97 6.79 ± 3.70 * 3.86 ± 0.78 16.14 ± 4.58 * 1.77 ± 0.73 *

Values are presented as the means ± SEM; * p < 0.05, versus CON group; SEM, standard error of the mean; TSH, thyrotropin; TT4, total thyroxine.

2.2. Western Blot Analysis of Osteopontin (OPN), Integrin αvβ3, and Vascular Cell Adhesion Molecule (VCAM-1) Expression of Aorta Tissues from CH, SCH, and CON Groups

The Western blot results are shown in Figure 1. OPN, integrin αvβ3, VCAM-1, and Glyceraldehyde-3-phosphate dehydrogenase (GAPDH) levels were measured at 42, 87, 110, and 36 KD, respectively. The expression of OPN, integrin αvβ3, and VCAM-1 was significantly higher in aorta tissues from the SCH group than in those from the CON group, and the expression of OPN, integrin αvβ3, and VCAM-1 in aorta tissues was also significantly higher in the CH group. Although the expression of OPN, integrin αvβ3, and VCAM-1 was higher in aorta tissues from the CH group than in those from the SCH group, this difference was not statistically significant.

Figure 1.

Figure 1

Osteopontin (OPN), integrin αvβ3, and vascular cell adhesion molecule (VCAM-1) expression in aorta; tissues of control (CON), subclinical hypothyroidism (SCH), and hyoithyroidism (CH) rats. (A) The bands depict representative findings regarding protein expression levels of OPN, integrin αvβ3, and VCAM-1 protein expression in the aortic tissues in CON, SCH, and CH rats. These were evaluated by Western blotting using protein extracted from 20 mg of aorta tissues; (B) The bar graph shows the results of the semiquantitative measurements of OPN, integrin αvβ3, and VCAM-1. Values are shown as the means ± SEM. * p < 0.05 versus CON group; ** p < 0.01 versus CON group.

2.3. Immunohistochemical Analysis of OPN, Integrin αvβ3, and VCAM-1 Expression of Aorta Endothelium from CH, SCH, and CON Groups

The results of the immunohistochemical analysis are shown in Figure 2. After immunohistochemical staining, positive endothelial cells appeared yellow-brown. In the CON aorta group, few endothelial cells in the endothelium were found to be positive for OPN, integrin αvβ3, or VCAM-1. However, the SCH and CH aorta groups showed significantly more cells that were positive for OPN, integrin αvβ3-positive, and VCAM-1. The optical density (OD) of positive cells in each field of the slide was determined to evaluate the average OD. The OD values of OPN-positive, integrin αvβ3-positive, and VCAM-1-positive endothelial cells from the SCH and CH groups were statistically significantly higher than those of the CON group (Figure 2B). Although the OD values of the CH group were much higher than those of the SCH group, the difference was not statistically significant, which is consistent with the results of the Western blot analysis.

Figure 2.

Figure 2

OPN, integrin αvβ3, and VCAM-1 expression in the aorta endothelium from CON, SCH, and CH rats, as indicated by immunostaining. (A) Immunostaining of OPN, integrin αvβ3 and VCAM-1 in the endothelia of aortas from CON, SCH, and CH rats; (B) Semiquantitative analysis of the difference in OPN, integrin αvβ3, and VCAM-1 expression in the endothelia of the aortas from CON, SCH, and CH rats. Data were presented as the means ± SEM. * p < 0.05 versus CON group; ** p < 0.01 versus CON group. Scale bar = 50 µm.

2.4. Morphological Changes in the Aortic Endothelium in CH, SCH, and CON Groups by TEM

Under TEM, the endothelial cells of the aorta endothelium from the CON group showed complete structures which included clear nuclear and cell membranes, and there were tight junctions between the endothelial cells (Figure 3A). In the SCH group, some of the endothelial cells of the aortic endothelium had broken and dissolved cell membranes, and abnormal nuclear features; some mitochondria showed vague outer membranes and crest degeneration not observed in the CON group (Figure 3B). In the CH group, some endothelial cells had been shed and parts of the elastic membrane were exposed, some of the nuclear features were abnormal, and some cells showed heterogeneous chromatin edge accumulation, dissolution of the cell membrane, and even some degrees of breakage. In the cytoplasm, some of the cells showed mitochondrial vacuolar degeneration and broken outer membranes not observed in the CON group (Figure 3C,D).

Figure 3.

Figure 3

The figure shows the endothelium in the CON, SCH, and CH groups. (A) Normal endothelial cell (E) in the CON group; (B) Dissolved endothelial cell membrane and abnormal nuclear (N) feature in the SCH group; (C) Dissolved endothelial cell membrane and heterogeneous chromatin edge accumulation in the CH group; (D) Endothelial cells shed and parts of the elastic membrane exposed in the CH group (→). Scale bar = 4 µm.

2.5. Effects of TSH on OPN, Integrin αvβ3, and VCAM-1 in Human Umbilical Vein Endothelial Cells (HUVECs)

To investigate whether TSH could directly induce a proinflammatory effect on HUVECs, the expression of OPN, integrin αvβ3, and VCAM-1 was detected after HUVEC stimulation with TSH. HUVECs were starved in serum-free ECM for 12h and then treated with various concentrations of TSH (0, 0.1, 1, 10, 100 mIU/mL) for 24 h. As shown in Figure 4, TSH increased OPN expression in a dose-dependent manner from 0.1 to 10 mIU/mL, and the increase became significant after treatment with 10 mIU/mL TSH. With 10 mIU/mL TSH, the expression of OPN increased by 1.87-fold compared with the controls. As shown in Figure 5, the increase in OPN was evident at 6, 24, and 48 h after treatment with 10 mIU/mL TSH and with a more significant effect at 24 h. The expression of OPN at 6, 24, and 48 h increased by 1.92-, 2.55-, and 2.24-fold, respectively compared with the controls. The results of the Western blot were consistent with Real Time PCR.

Figure 4.

Figure 4

Effects of concentrations of TSH (0, 0.1, 1, 10, 100 mIU/mL) in HUVECs over 24 h. (A) The bands depict representative findings of OPN, integrin αvβ3, and VCAM-1 protein expression levels in HUVECs stimulated by different concentration of TSH; (B) The bar graphs showed the results of the semiquantitative measurements of OPN, integrin αvβ3, and VCAM-1, respectively; (C) The bar graphs showed the results of the quantitative analysis of OPN, integrin αvβ3, and VCAM-1 from real-time PCR. The OPN, integrin αvβ3, and VCAM-1 mRNA levels were expressed as ratios relative to GAPDH. The results are shown as the means ± SEM of three independent experiments. * p < 0.05 versus control; ** p < 0.01 versus control.

Figure 5.

Figure 5

The effects of 10 mIU/mL TSH for 0, 2, 6, 12, 24, and 48 h in HUVECs. (A) The bands depicted representative protein expression level findings for OPN, integrin αvβ3, and VCAM-1 in HUVECs stimulated by different durations of TSH; (B) The bar graphs show the results of the semiquantitative measurements of OPN, integrin αvβ3, and VCAM-1; (C) The bar graphs show the results of the quantitative analysis of OPN, integrin αvβ3, and VCAM-1 from real-time PCR. The OPN, integrin αvβ3, and VCAM-1 mRNA levels are expressed as ratios relative to GAPDH. The results are shown as the means ± SEM of three independent experiments. * p < 0.05 versus control; ** p < 0.01 versus control.

The effect of TSH on integrin αvβ3 was also directly investigated. The upregulation of integrin αvβ3 was statistically significant at 24 h, and it was 2.35-fold that of the controls (Figure 4). The results also showed that the effect of TSH on integrin αvβ3 was similar to the effect on OPN. As shown in Figure 4, 10 mIU/mL TSH stimulation statistically significantly upregulated integrin αvβ3 at 6, 24, and 48 h, and the increase was 2.08-, 2.35-, and 1.76-fold, respectively, that of the controls.

The results indicated that various concentrations could increase VCAM-1 expression, and the upregulation was statistically significant at 1 and 10 mIU/mL TSH for 24 h; the increase was 1.88- and 1.95-fold that of the controls, respectively, as shown in Figure 4. When treated with 10 mIU/mL TSH for 0, 2, 6, 12, 24, and 48 h, the increase in VCAM-1 expression became evident at 6, 12, and 24 h and was 1.49-, 1.67-, and 2.02-fold, respectively, of that of the controls (Figure 5). The expression of VCAM-1 protein after TSH stimulation was similar to mRNA detected by RT-PCR.

2.6. Effects of Specific Inhibitors on TSH-Induced OPN, Integrin αvβ3, and VCAM-1 Upregulation in HUVECs

TSH was found to upregulate the activation of both p-Akt and p-Erk. The specific Akt inhibitor LY294002 prevented TSH-induced upregulation of OPN, integrin αvβ3, and VCAM-1 to a significant extent (Figure 6A,B). The specific Erk inhibitor PD98059 showed no effect on basal or TSH-induced OPN, integrin αvβ3, or VCAM-1 expression (Figure 6C,D).

Figure 6.

Figure 6

Effects of specific inhibitors on TSH-induced OPN, integrin αvβ3, and VCAM-1 upregulation in HUVECs. HUVECs were pretreated with either 20 µmol/L LY294002 or 20 µmol/L PD98059 for 1 h and then treated with 10 mIU/mL TSH for 24 h. (A) The bands depicted representative findings for the protein expression levels of p-Akt, OPN, integrin αvβ3, and VCAM-1 in HUVECs as determined by Western blotting; (B) The bar graphs show the results of the semiquantitative measurements of of p-Akt, OPN, integrin αvβ3, and VCAM-1; (C) The bands depicted representative findings for protein expression levels of p-Erk, OPN, integrin αvβ3, and VCAM-1 in HUVECs, as determined by Western blotting; (D) The bar graphs showed the results of the semiquantitative measurements of p-Erk, OPN, integrin αvβ3, and VCAM-1. The results are shown as the means ± SEM of three independent experiments. * p < 0.05 versus control; ** p < 0.01 versus control.

3. Discussion

Endothelial cells from healthy arteries exhibit a non-adhesive and anti-thrombotic state which is crucial to cardiovascular control in response to substances given off by nerves, circulating hormones (e.g., thyroid hormones, TSH), and other stimulants [19]. In this way, endothelial function plays specific and critical roles in the pathogenesis of atherosclerosis. Its agents include relaxing and contracting factors, such as nitric oxide (NO) and endothelin (ET), and pro-inflammatory and anti-inflammatory mediators [20]. Injured endothelia induce atherosclerosis by inducing smooth muscle cell migration and proliferation, increasing expression of growth factors, and disrupting the balance of the coagulation and fibrinolytic system [21]. Some studies have shown subclinical hypothyroidism to be associated with increased carotid intima-media thickness (IMT), a significant marker of the early stage of atherosclerosis [4,22,23]. The association between subclinical hypothyroidism and atherosclerosis could be complex. It might be attributable to dyslipidemia, hypertension, metabolic disorders, and increased level of serum TSH.

To assess the long-term effects of SCH on the cardiovascular system, SCH and CH models were established in Wistar rats to demonstrate the proatherosclerotic effects on aorta tissues. l-T4 treatment was conducted long-term, and the levels of thyroid hormones and TSH were assessed for 14 weeks. Some of the endothelial cells in the SCH and CH groups showed irregular cell membranes, abnormal nuclear features, and abnormal mitochondria, as detected by TEM, which were not observed in the CON group. The results suggested that the integrity of the endothelium was broken, which might lead to the expression of some adhesion molecules. This was consistent with previous studies that showed subclinical hypothyroidism and hypothyroidism to be associated with the early stages of atherosclerosis [3,22,24,25].

OPN is a multifunctional extracellular matrix protein. It can be biosynthesized by several types of cells, such as osteoblasts, smooth muscle cells, macrophages, and endothelial cells. Its crucial role in the pathological process of atherosclerosis and coronary artery disease occurs through its ability to induce chemotactic movement [10,26]. OPN has also been associated with thyroid disease due to its pro-inflammatory effect [27,28]. In propylthiouracil-induced (PTU) CH rat models, OPN expression was found to be higher in the aorta and heart. Furthermore, supplementation with T3 was found to decrease serum lipid levels and reduce OPN mRNA expression in the aorta [29]. Consistent with this result, the current study also showed significantly higher levels of OPN in the aorta tissues in the CH and SCH groups compared to the CON group. In vitro, treatment with TSH from 0.1 to 10 mIU/mL for 24 h elevated the mRNA and protein expression of OPN in a dose-dependent manner in HUVECs, which may have caused the lower levels of OPN expression observed in SCH aortic tissues relative to the CH group. The results of immunohistochemical analysis of OPN also showed more expression in the endothelium in the CH and SCH groups. Moreover, the direct effect of TSH on OPN in vitro also indicated that TSH might have an independent influence on the lumen of the aorta.

Studies in animal models of vascular injury showed that factors that promote and restore endothelial integrity are of great importance. Integrins and their ligands, which are cell-cell and cell-matrix adhesive proteins, play a crucial role in protecting endothelial integrity. One receptor for OPN, integrin αvβ3, has been shown to be an important migratory receptor in endothelial cells and participates in several pathological processes, such as vascular remodeling [30] and angiogenesis [31]. Previous studies have demonstrated that both the endothelium along the lumen of nonatherosclerotic diffuse intimal thickening and atherosclerotic plaques express more integrin αvβ3 than do normal vessels [12,13]. Carotid injury in aopE/ mice induced neointima and media thickening, and the expression of integrin αvβ3 was upregulated in the vessel wall [32]. In the present study, integrin αvβ3 expression was significantly increased in aorta tissues in both the SCH and CH groups, as indicated by immunochemistry, which could suggest that SCH and CH rats had abnormal endothelia. The expression of integrin αvβ3 was higher in aorta tissues from CH than in the SCH group; there were no statistically significant differences between the two groups. No obvious morphological changes were observed in the endothelium by hematoxylin and eosin (HE) staining. This might be attributable to the duration of the experiment which was not sufficiently long. For further research, the mRNA and protein expression of integrin αvβ3 and OPN were detected in HUVECs after TSH stimulation. Consistent with previous studies, the current results showed that the expression of integrin αvβ3 increased in a dose-dependent manner with 0.1 to 10 mIU/mL TSH over 24 h at the same rate as OPN, which may indicate the ligand-receptor interaction of OPN and integrin αvβ3 during the early stage of atherosclerosis.

After stimulation by specific factors, including proinflammatory cytokines and hormones, the activated endothelium expresses cell surface adhesion molecules such as VCAM-1 and intercellular adhesion molecule-1 (ICAM-1), which mediate interactions between the endothelial cells and circulating leukocytes [33,34]. Previous studies have shown that TSH may enhance the expression of ICAM-1 induced by TNF-α in a concentration-dependent manner [15]. In this work, another traditional endothelial adhesion molecule, VCAM-1, was detected. The results also showed more VCAM-1 expression in the aortic tissues of the SCH and CH groups than in the CON group.

Studies have proven that HUVECs can express TSHR, which is a g-protein-coupled cell surface protein receptor [35,36]. The TSHR signaling pathway is not only activated in thyroid epithelium, but is also functional in other cells, such as aorta cells [14], adipocytes [37], HUVECs [15], and fibrocytes [36]. It activates cAMP and the phosphoinositide 3-kinase (PI3K) pathway [38,39,40]. It then induces the activation of downstream kinases such as protein kinase C (PKC) and Akt (PKB). TSH treatment of the human dermal microvascular endothelial cell line (HMEC-1) was found to activate Akt and Erk1/2 [41], so levels of both kinases were measured in HUVECs. The results also showed the activation of p-Akt and p-Erk after TSH stimulation. However, the specific Akt inhibitor LY294002, but not the specific Erk inhibitor PD98059, stimulated levels of OPN, integrin αvβ3, and VCAM-1, which might predict a proinflammatory role for Akt. Previous studies have shown that the PI3K/Akt signaling pathway plays a pivotal role in TNF-α induced activation of NF-κB signaling pathway; TSH was found to increase TNF-α levels in vivo and in vitro [42,43,44]. Consequently, it is feasible that TSH might play a role in the proatherosclerotic effect via the activation of Akt, independently or through TNF-α.

According to previous studies, TSH increased nitric oxide (NO), decreased vasoconstrictor endothelin, decreased tissue type plasminogen activator (t-PA) production, and had no effect on plasminogen activator inhibitor-1 (PAI-1) expression, which indicated that TSH had a protective effect on vasodilatation and induced the impairment of the fibrinolytic system in cultured human aortic endothelial cells [14]. Balzan et al. have demonstrated that TSH increased eNOS and vascular endothelial growth factor (VEGF) expression in human dermal microvascular endothelial cell line (HMEC-1), which might affect capillary network formation [41]. Tian et al. showed that TSH treatment in cultured HUVECs resulted in decreased eNOS and PGI2 expression and increased levels of endothelin-1 and PAI-1 compared to control [15]. Few articles show the relationship between TSH and endothelial function, but their conclusions are controversial. In the present study, our results showed that TSH increased the expression of OPN, VCAM-1, and integrin αvβ3 in HUVECs, which were regarded as proatherosclerosis factors.

This study has some limitations. First, the animal experiments did not include female rats, which might limit the findings; second, the animal experiments might not have lasted long enough to show all the relevant morphological findings; Third, only HUVECs were used for the in vitro experiments. More types of endothelial cells might provide more useful results.

4. Materials and Methods

4.1. Materials

Human umbilical vein endothelial cells (HUVEC) and endothelial cell medium (ECM) were purchased from Sciencell Research Laboratories (Carlsbad, CA, USA). Thyrotropic hormone from bovine pituitary (T8931) and l-T4 were purchased from Sigma (St. Louis, MO, USA). Bovine TSH was prepared by dissolving 10mg of TSH in double distilled water to a final concentration of 1 IU/mL. Antibodies against osteopontin (ab63856) and integrin αvβ3 (ab75872) were purchased from Abcam (Cambridge, UK). Antibodies against VCAM-1 (sc8304) were purchased from Santa Cruz Biotechnology (Dallas, TX, USA). Antibodies against GAPDH (TA-08), peroxidase-conjugated Affinipure goat anti-mouse IgG (H + L) (ZB-2305) and peroxidase-conjugated Affinipure goat anti-rabbit IgG (H + L) (ZB-2301) were purchased from Zhongshan Goldenbridge-Biotechnology (Beijing, China). Antibodies against phospho-p44/42 MAPK (Erk1/2) (Thr202/Tyr204) (4370S), and phospho-Akt (Thr308) (D25E6) (13038), PD98059 (9900), and LY294002 (9901) were purchased from Cell Signaling Technology (Danvers, MA, USA).

4.2. Animals

Thirty male Wistar rats weighing 180–200 g were purchased from Vital River (Beijing, China) and fed normal rat chow. The animal experiments were conducted according to the National Institute of Health Guide for the Care and Use of Laboratory Animals. All experiments were approved by the Animal Care and Use Committee of the First Affiliated Hospital of China Medical University (project identification code: 2010-I3, Date: 6 January 2010). The rats were randomly divided into three groups: subclinical hypothyroidism (SCH, n = 10), hypothyroidism (CH, n = 10), and control (CON, n = 10). The rats were injected with 10% chloral hydrate (i.p. 0.35 mL/100 g) and placed on an operating table. Rats in the CH and SCH groups were subjected to thyroidectomy, removal of the thyroid gland, to establish a hypothyroid model. Rats in the CON group were given a sham operation that did not involve removal of the thyroid gland, as described in a previous work [45]. Four weeks after surgery, the thyroidectomized rats of the SCH group were injected with l-T4 (s.c 1.0 µg/100 g) daily, and the rats in the CH and CON groups received injections of physiological sodium chloride solution. After surgery, all rats were provided with 0.1% (w/v) calcium lactate in their drinking water and fed normal rat chow.

4.3. Hormone Measurements

All blood samples from the three groups were immediately centrifuged at 13,000 rpm for 10min and stored at −80 °C for further research. Total T4 and TSH were detected using immunochemiluminometric assay (Immulite, Diagnostic Products Corporation, Los Angeles, CA, USA). The intra-assay coefficients of variation for TT4 and TSH were 4.34%–6.13% and 1.16%–4.12%, respectively. The inter-assay coefficients of variation for TT4 and TSH were 1.26%–3.27% and 1.73%–5.75%, respectively.

4.4. Cell Culture

HUVECs were maintained in ECM including basal medium, 5% fetal bovine serum, endothelial cell growth supplement, and penicillin/streptomycin solution, at 37 °C in a humidified incubator (95% air and 5% CO2). HUVECs were starved in serum-free ECM for 12 h before stimulation, and PD98059 and LY294002 were given 1 h before stimulation. The cells were then stimulated by recombinant bovine TSH at different concentrations and for different periods.

4.5. Western Blot

The aortas were removed from the rats, cut into several parts, and immediately stored at −80 °C for further use. HUVECs were stimulated by TSH (0, 0.1, 1, 10, 100 mIU/mL) for different times (0, 2, 6, 12, 24, 48 h), or pretreated with 20 µmol/L PD98059 or 20 µmol/L LY294002, washed with PBS, and incubated in lysis buffer for 30 min on ice. All protein samples (30 µg for cells, 50 µg for tissues) were separated by 10% SDS-acrylamide gel electrophoresis and transferred onto PVDF membranes (Millipore, Billerica, MA, USA) at a constant voltage of 100 V for 100 min. Then, the membranes were incubated at 4 °C overnight with the following primary antibodies: at anti-osteopontin (ab63856,1:500), anti-integrin β 3 (ab75872, 1:500), anti-VCAM-1 (sc8304, 1:100), anti-GAPDH (TA-08,1:5000), anti-phospho-p44/42 MAPK (Erk1/2) (Thr202/Tyr204) (4370S, 1:1000), anti-p44/42 MAPK (Erk1/2) (4695S, 1:1000), anti-Akt (pan) (C67E7) (4691, 1:1000), anti-phospho-Akt (Thr308) (D25E6) (13038, 1:1000). After that, the membranes were incubated for 2 h with the following secondary antibodies: peroxidase-conjugated Affinipure goat anti-mouse IgG (H + L) (ZB-2305, 1:5000) and peroxidase-conjugated Affinipure goat anti-rabbit IgG (H + L) (ZB-2301, 1:2000). Bands were detected by chemiluminescence using an ECL detection system. The relative densitometry of the band was measured using Image J software (Bethesda, MD, USA).

4.6. Quantitative Real-Time PCR

Total RNA was used for RNA extraction using TRIzol reagent according to the manufacturer’s instructions. Then RNA was reverse-transcribed to cDNA using a TaKaRa PrimeScript RT Master Mix (Takara, Shiga, Japan) and amplified in a total volume of 20 µL. The samples were mixed with SYBR Premix Ex TaqII, primers, and DEPC water. PCR was performed for 40 cycles with an initial denaturing step at 95 °C for 5 s and annealing at 60 °C for 30 s and were terminated by a cooling step at 50 °C using a LightCycler Real-Time PCR System (Roche 480, Berlin, Germany). The primers were synthesized by TaKaRa. They are presented in Table 2.

Table 2.

Sequence of primers used for Real Time-PCR.

Gene Primer (5′ to 3′)
VCAM1 Forward: GCGGAGACAGGAGACACAGTACTAA
Reverse: GAGCACGAGAAGCTCAGGAGAA
SPP1 Forward: ACAGCCACAAGCAGTCCAGATTA
Reverse: TCCTGACTATCAATCACATCGGAAT
ITGB3 Forward: GAGGTCATCCCTGGCCTCAA
Reverse: CTGGCAGGCACAGTCACAATC
GAPDH Forward: CAATGACCCCTTCATTGACC
Reverse: GACAAGCTTCCCGTTCTCAG

4.7. Immunohistochemistry (IHC)

The aorta of each rat was washed in PBS and fixed in 4% paraformaldehyde (Beijing Chemical Works, Beijing, China) for 24 h. Paraffin sections were cut to sections 4 µm thick for immunohistochemical staining. The tissue sections were dewaxed and hydrated (Mai Xin_Bio, Fuzhou, China), then boiled to restore antigen epitopes and incubated overnight at 4 °C with the following antibodies: anti-osteopontin (ab63856, 1:50), anti-integrin β3 (ab75872, 1:50), and anti-VCAM-1 (sc8304, 1:50). Then, the sections were washed with PBS and incubated with anti-rabbit or anti-mouse IgG-HRP antibody (Boster, Wuhan, China) for 30 min at 37 °C. The sections began to turn brown after approximately 5–10 min of exposure to 3,3′-diaminobenzidine (DAB) (Mai Xin Bio) for different antibodies. To assess nonspecific staining, some sections were incubated without primary antibodies. Five visual fields per slide were randomly selected. To assess the expression of each target, the optical density (OD) of positive cells in each field was calculated using a MetaMorph/DPIO/BX51 morphology image analysis system (Olympus, Tokyo, Japan), and the results were analyzed using ImagePro Plus software (Bethesda, MD, USA).

4.8. Transmission Electron Microscope (TEM)

Each group of aorta samples was dissected into pieces and fixed with 2.5% glutaraldehyde (Sinopharm Chemical Reagent Co., Ltd., Shanghai, China) at 4 °C. After stimulation, HUVECs were washed with PBS and harvested by trypsinization, centrifuged at 1000 rpm for 5 min and fixed with 2.5% glutaraldehyde at 4 °C for 24 h. Then the samples were post-fixed with 1% osmium tetroxide at 4 °C (1 h for HUVECs, 2 h for aorta tissue) and washed with PBS three times. Specimens were dehydrated in ethanol (Beijing Chemical Works, Beijing, China) with a gradient series and 100% acetone (Beijing Chemical Works), infused with Epon812 (Serva, New York, NY, USA) and embedded in pure Epon812 at 65 °C (48 h for HUVECs, 72 h for aorta tissue). After the semi-thin sections were observed, the aortic cross-section was located, and five serial ultra-thin sections (70 nm) from each rat were stained with 4% uranyl acetate (Kojima Chemicals Co., Ltd., Tokyo, Japan) and lead citrate (Alfa Aesar, Ward Hill, MA, USA). The samples were examined with TEM (H-7650, Hitachi, Tokyo, Japan).

4.9. Statistical Analysis

All results were expressed as the means ± SEM. Comparisons between groups were examined by one-way ANOVA followed by Student-Newman-Keuls testing using SPSS 20.0 software (SPSS, Chicago, IL, USA). p-value < 0.05 was considered statistically significant. All graphs were constructed using Graph Prism (5.0) software (San Diego, CA, USA).

5. Conclusions

In conclusion, rats with subclinical hypothyroidism showed high levels of OPN, integrin αvβ3, and VCAM-1 expression in their aortic tissues. TSH induced OPN, integrin αvβ3, and VCAM-1 expression in HUVECs. This process involved the activation of Akt. These proatherosclerosis factors may become new biomarkers for the early diagnosis of atherosclerosis in subclinical hypothyroidism patients.

Acknowledgments

We thank the staff at Institute of Endocrinology of the First Affiliated Hospital of China Medical University, for their involvement in this study. This work was supported by Funding: The Diagnostic Criteria and Specifications of the Metabolic Syndrome (2009BAI80B01), and National Natural Science Foundation of China (81300645).

Author Contributions

Yumeng Yan performed the experimental work, analyzed the results, and composed the manuscript. Fengwei Jiang, Yaxin Lai, and Haoyu Wang participated in the animal experiments. Aihua Liu, Chuyuan Wang, and Yuanyuan Zhang contributed to the interpretation of data, and reviewed and edited the manuscript; Weiping Teng helped with coordination of this study; Zhongyan Shan supervised the statistical analyses, contributed to the design of the study, analyses, and interpretation of the results, and produced the final version of the manuscript.

Conflicts of Interest

The authors declare no conflict of interest.

References

  • 1.Cooper D.S., Biondi B. Subclinical thyroid disease. Lancet. 2012;379:1142–1154. doi: 10.1016/S0140-6736(11)60276-6. [DOI] [PubMed] [Google Scholar]
  • 2.Surks M.I., Ortiz E., Daniels G.H., Sawin C.T., Col N.F., Cobin R.H., Franklyn J.A., Hershman J.M., Burman K.D., Denke M.A., et al. Subclinical thyroid disease: Scientific review and guidelines for diagnosis and management. J. Am. Med. Assoc. 2004;291:228–238. doi: 10.1001/jama.291.2.228. [DOI] [PubMed] [Google Scholar]
  • 3.Hak A.E., Pols H.A., Visser T.J., Drexhage H.A., Hofman A., Witteman J.C. Subclinical hypothyroidism is an independent risk factor for atherosclerosis and myocardial infarction in elderly women: The Rotterdam Study. Ann. Intern. Med. 2000;132:270–278. doi: 10.7326/0003-4819-132-4-200002150-00004. [DOI] [PubMed] [Google Scholar]
  • 4.Gao N., Zhang W., Zhang Y.Z., Yang Q., Chen S.H. Carotid intima-media thickness in patients with subclinical hypothyroidism: A meta-analysis. Atherosclerosis. 2013;227:18–25. doi: 10.1016/j.atherosclerosis.2012.10.070. [DOI] [PubMed] [Google Scholar]
  • 5.Duntas L.H. Thyroid disease and lipids. Thyroid Off. J. Am. Thyroid Assoc. 2002;12:287–293. doi: 10.1089/10507250252949405. [DOI] [PubMed] [Google Scholar]
  • 6.Wang F., Tan Y., Wang C., Zhang X., Zhao Y., Song X., Zhang B., Guan Q., Xu J., Zhang J., et al. Thyroid-stimulating hormone levels within the reference range are associated with serum lipid profiles independent of thyroid hormones. J. Clin. Endocrinol. Metab. 2012;97:2724–2731. doi: 10.1210/jc.2012-1133. [DOI] [PubMed] [Google Scholar]
  • 7.Lai Y., Wang J., Jiang F., Wang B., Chen Y., Li M., Liu H., Li C., Xue H., Li N., et al. The relationship between serum thyrotropin and components of metabolic syndrome. Endocr. J. 2011;58:23–30. doi: 10.1507/endocrj.K10E-272. [DOI] [PubMed] [Google Scholar]
  • 8.Heinegard D., Hultenby K., Oldberg A., Reinholt F., Wendel M. Macromolecules in bone matrix. Connect. Tissue Res. 1989;21:3–11. doi: 10.3109/03008208909049990. [DOI] [PubMed] [Google Scholar]
  • 9.Tousoulis D., Siasos G., Maniatis K., Oikonomou E., Kioufis S., Zaromitidou M., Paraskevopoulos T., Michalea S., Kollia C., Miliou A., et al. Serum osteoprotegerin and osteopontin levels are associated with arterial stiffness and the presence and severity of coronary artery disease. Int. J. Cardiol. 2013;167:1924–1928. doi: 10.1016/j.ijcard.2012.05.001. [DOI] [PubMed] [Google Scholar]
  • 10.Ohmori R., Momiyama Y., Taniguchi H., Takahashi R., Kusuhara M., Nakamura H., Ohsuzu F. Plasma osteopontin levels are associated with the presence and extent of coronary artery disease. Atherosclerosis. 2003;170:333–337. doi: 10.1016/S0021-9150(03)00298-3. [DOI] [PubMed] [Google Scholar]
  • 11.Dhore C.R., Cleutjens J.P., Lutgens E., Cleutjens K.B., Geusens P.P., Kitslaar P.J., Tordoir J.H., Spronk H.M., Vermeer C., Daemen M.J. Differential expression of bone matrix regulatory proteins in human atherosclerotic plaques. Arterioscler. Thromb. Vasc. Biol. 2001;21:1998–2003. doi: 10.1161/hq1201.100229. [DOI] [PubMed] [Google Scholar]
  • 12.Hoshiga M., Alpers C.E., Smith L.L., Giachelli C.M., Schwartz S.M. αvβ3 integrin expression in normal and atherosclerotic artery. Circ. Res. 1995;77:1129–1135. doi: 10.1161/01.RES.77.6.1129. [DOI] [PubMed] [Google Scholar]
  • 13.Hynes R.O. Integrins: Bidirectional, allosteric signaling machines. Cell. 2002;110:673–687. doi: 10.1016/S0092-8674(02)00971-6. [DOI] [PubMed] [Google Scholar]
  • 14.Donnini D., Ambesi-Impiombato F.S., Curcio F. Thyrotropin stimulates production of procoagulant and vasodilative factors in human aortic endothelial cells. Thyroid Off. J. Am. Thyroid Assoc. 2003;13:517–521. doi: 10.1089/105072503322238764. [DOI] [PubMed] [Google Scholar]
  • 15.Tian L., Zhang L., Liu J., Guo T., Gao C., Ni J. Effects of thyroid-stimulating hormone on the function of human umbilical vein endothelial cells. J. Mol. Endocrinol. 2014;52:215–222. doi: 10.1530/JME-13-0119. [DOI] [PubMed] [Google Scholar]
  • 16.Napoli R., Biondi B., Guardasole V., D’Anna C., de Sena A., Pirozzi C., Terracciano D., Mazzarella C., Matarazzo M., Sacca L. Enhancement of vascular endothelial function by recombinant human thyrotropin. J. Clin. Endocrinol. Metab. 2008;93:1959–1963. doi: 10.1210/jc.2007-2797. [DOI] [PubMed] [Google Scholar]
  • 17.Napoli R., Apuzzi V., Bosso G., D’Anna C., de Sena A., Pirozzi C., Marano A., Lupoli G.A., Cudemo G., Oliviero U., et al. Recombinant human thyrotropin enhances endothelial-mediated vasodilation of conduit arteries. J. Clin. Endocrinol. Metab. 2009;94:1012–1016. doi: 10.1210/jc.2008-2298. [DOI] [PubMed] [Google Scholar]
  • 18.Dardano A., Ghiadoni L., Plantinga Y., Caraccio N., Bemi A., Duranti E., Taddei S., Ferrannini E., Salvetti A., Monzani F. Recombinant human thyrotropin reduces endothelium-dependent vasodilation in patients monitored for differentiated thyroid carcinoma. J. Clin. Endocrinol. Metab. 2006;91:4175–4178. doi: 10.1210/jc.2006-0440. [DOI] [PubMed] [Google Scholar]
  • 19.Vane J.R. The Croonian Lecture, 1993. The endothelium: Maestro of the blood circulation. Philos. Trans. R. Soc. Lond. Ser. B Biol. Sci. 1994;343:225–246. doi: 10.1098/rstb.1994.0023. [DOI] [PubMed] [Google Scholar]
  • 20.Poredos P. Endothelial dysfunction and cardiovascular disease. Pathophysiol. Haemost. Thromb. 2002;32:274–277. doi: 10.1159/000073580. [DOI] [PubMed] [Google Scholar]
  • 21.Ruschitzka F.T., Noll G., Luscher T.F. The endothelium in coronary artery disease. Cardiology. 1997;88:3–19. doi: 10.1159/000177500. [DOI] [PubMed] [Google Scholar]
  • 22.Valentina V.N., Marijan B., Chedo D., Branka K. Subclinical hypothyroidism and risk to carotid atherosclerosis. Arq. Bras. Endocrinol. Metabol. 2011;55:475–480. doi: 10.1590/S0004-27302011000700007. [DOI] [PubMed] [Google Scholar]
  • 23.Kim S.K., Kim S.H., Park K.S., Park S.W., Cho Y.W. Regression of the increased common carotid artery-intima media thickness in subclinical hypothyroidism after thyroid hormone replacement. Endocr. J. 2009;56:753–758. doi: 10.1507/endocrj.K09E-049. [DOI] [PubMed] [Google Scholar]
  • 24.Sara J.D., Zhang M., Gharib H., Lerman L.O., Lerman A. Hypothyroidism is associated with coronary endothelial dysfunction in women. J. Am. Heart Assoc. 2015 doi: 10.1161/JAHA.115.002225. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Del Busto-Mesa A., Cabrera-Rego J.O., Carrero-Fernandez L., Hernandez-Roca C.V., Gonzalez-Valdes J.L., de la Rosa-Pazos J.E. Changes in arterial stiffness, carotid intima-media thickness, and epicardial fat after l-thyroxine replacement therapy in hypothyroidism. Endocrinol. Nutr. 2015;62:270–276. doi: 10.1016/j.endonu.2015.02.005. [DOI] [PubMed] [Google Scholar]
  • 26.Denhardt D.T., Noda M., O’Regan A.W., Pavlin D., Berman J.S. Osteopontin as a means to cope with environmental insults: Regulation of inflammation, tissue remodeling, and cell survival. J. Clin. Investig. 2001;107:1055–1061. doi: 10.1172/JCI12980. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Xu L., Ma X., Wang Y., Li X., Qi Y., Cui B., Li X., Ning G., Wang S. The expression and pathophysiological role of osteopontin in Graves’ disease. J. Clin. Endocrinol. Metab. 2011;96:E1866–E1870. doi: 10.1210/jc.2011-1339. [DOI] [PubMed] [Google Scholar]
  • 28.Reza S., Shaukat A., Arain T.M., Riaz Q.S., Mahmud M. Expression of osteopontin in patients with thyroid dysfunction. PLoS ONE. 2013;8:1484. doi: 10.1371/journal.pone.0056533. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Liou Y.M., Chang L.Y., Liaw J.M., Jiang M.J. Osteopontin gene expression in the aorta and the heart of propylthiouracil-induced hypothyroid mice. J. Biomed. Sci. 2005;12:869–880. doi: 10.1007/s11373-005-9023-0. [DOI] [PubMed] [Google Scholar]
  • 30.Sajid M., Stouffer G.A. The role of αvβ3 integrins in vascular healing. Thromb. Haemost. 2002;87:187–193. [PubMed] [Google Scholar]
  • 31.Eliceiri B.P., Cheresh D.A. Adhesion events in angiogenesis. Curr. Opin. Cell Biol. 2001;13:563–568. doi: 10.1016/S0955-0674(00)00252-0. [DOI] [PubMed] [Google Scholar]
  • 32.Sadeghi M.M., Krassilnikova S., Zhang J., Gharaei A.A., Fassaei H.R., Esmailzadeh L., Kooshkabadi A., Edwards S., Yalamanchili P., Harris T.D., et al. Detection of injury-induced vascular remodeling by targeting activated αvβ3 integrin in vivo. Circulation. 2004;110:84–90. doi: 10.1161/01.CIR.0000133319.84326.70. [DOI] [PubMed] [Google Scholar]
  • 33.Spiecker M., Peng H.-B., Liao J.K. Inhibition of endothelial vascular cell adhesion molecule-1 expression by nitric oxide involves the induction and nuclear translocation of IκBα. J. Biol. Chem. 1997;272:30969–30974. doi: 10.1074/jbc.272.49.30969. [DOI] [PubMed] [Google Scholar]
  • 34.Masseau I., Bowles D.K. Carotid endothelial VCAM-1 is an early marker of carotid atherosclerosis and predicts coronary artery disease in swine. J. Biomed. Sci. Eng. 2015;8:789–796. doi: 10.4236/jbise.2015.811073. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Douglas R.S., Afifiyan N.F., Hwang C.J., Chong K., Haider U., Richards P., Gianoukakis A.G., Smith T.J. Increased generation of fibrocytes in thyroid-associated ophthalmopathy. J. Clin. Endocrinol. Metab. 2010;95:430–438. doi: 10.1210/jc.2009-1614. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Gillespie E.F., Papageorgiou K.I., Fernando R., Raychaudhuri N., Cockerham K.P., Charara L.K., Goncalves A.C., Zhao S.X., Ginter A., Lu Y., et al. Increased expression of TSH receptor by fibrocytes in thyroid-associated ophthalmopathy leads to chemokine production. J. Clin. Endocrinol. Metab. 2012;97:E740–E746. doi: 10.1210/jc.2011-2514. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Chen J., Ren J., Jing Q., Lu S., Zhang Y., Liu Y., Yu C., Gao P., Zong C., Li X., et al. TSH/TSHR signaling suppresses fatty acid synthase (FASN) expression in adipocytes. J. Cell. Physiol. 2015;230:2233–2239. doi: 10.1002/jcp.24952. [DOI] [PubMed] [Google Scholar]
  • 38.Tsygankova O.M., Saavedra A., Rebhun J.F., Quilliam L.A., Meinkoth J.L. Coordinated regulation of Rap1 and thyroid differentiation by cyclic AMP and protein kinase A. Mol. Cell. Biol. 2001;21:1921–1929. doi: 10.1128/MCB.21.6.1921-1929.2001. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Tsygankova O.M., Feshchenko E., Klein P.S., Meinkoth J.L. Thyroid-stimulating hormone/cAMP and glycogen synthase kinase 3β elicit opposing effects on Rap1GAP stability. J. Biol. Chem. 2004;279:5501–5507. doi: 10.1074/jbc.M305824200. [DOI] [PubMed] [Google Scholar]
  • 40.Suh J.M., Song J.H., Kim D.W., Kim H., Chung H.K., Hwang J.H., Kim J.M., Hwang E.S., Chung J., Han J.H., et al. Regulation of the phosphatidylinositol 3-kinase, Akt/protein kinase B, FRAP/mammalian target of rapamycin, and ribosomal S6 kinase 1 signaling pathways by thyroid-stimulating hormone (TSH) and stimulating type TSH receptor antibodies in the thyroid gland. J. Biol. Chem. 2003;278:21960–21971. doi: 10.1074/jbc.M300805200. [DOI] [PubMed] [Google Scholar]
  • 41.Balzan S., del Carratore R., Nicolini G., Beffy P., Lubrano V., Forini F., Iervasi G. Proangiogenic effect of TSH in human microvascular endothelial cells through its membrane receptor. J. Clin. Endocrinol. Metab. 2012;97:1763–1770. doi: 10.1210/jc.2011-2146. [DOI] [PubMed] [Google Scholar]
  • 42.Puri K.D., Doggett T.A., Huang C.Y., Douangpanya J., Hayflick J.S., Turner M., Penninger J., Diacovo T.G. The role of endothelial PI3Kγ activity in neutrophil trafficking. Blood. 2005;106:150–157. doi: 10.1182/blood-2005-01-0023. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Reddy S.A., Huang J.H., Liao W.S. Phosphatidylinositol 3-kinase as a mediator of TNF-induced NFκB activation. J. Immunol. 2000;164:1355–1363. doi: 10.4049/jimmunol.164.3.1355. [DOI] [PubMed] [Google Scholar]
  • 44.Ozes O.N., Mayo L.D., Gustin J.A., Pfeffer S.R., Pfeffer L.M., Donner D.B. NF-κB activation by tumour necrosis factor requires the Akt serine-threonine kinase. Nature. 1999;401:82–85. doi: 10.1038/43466. [DOI] [PubMed] [Google Scholar]
  • 45.Zhang Y., Fan Y., Yu X., Wang X., Bao S., Li J., Fan C., Shan Z., Teng W. Maternal subclinical hypothyroidism impairs neurodevelopment in rat offspring by inhibiting the CREB signaling pathway. Mol. Neurobiol. 2015;52:432–441. doi: 10.1007/s12035-014-8855-x. [DOI] [PubMed] [Google Scholar]

Articles from International Journal of Molecular Sciences are provided here courtesy of Multidisciplinary Digital Publishing Institute (MDPI)

RESOURCES