Abstract
With the development of effective antiretroviral therapy, HIV-infected women are living longer and transitioning through menopause. The purpose of our study was to systematically examine the evidence that menopause is an additional risk predictor for osteoporosis and fractures in HIV-infected women. Electronic databases were searched for studies of low bone density or fractures in HIV-infected postmenopausal women. Studies that met the inclusion criteria (n = 10) were appraised using a validated quality assessment tool. The majority of studies were rated as good quality and the remaining were fair. The prevalence of osteoporosis reported in these studies ranged from 7.3% to 84% and 0.7% to 23% in HIV-infected and uninfected postmenopausal women, respectively. In the two qualifying studies, postmenopausal status was not a predictor of fractures in HIV-infected women. Findings suggest that HIV care providers should accurately assess postmenopausal status and modifiable risk factors for osteoporosis in all older HIV-infected women.
Keywords: bone mineral density (BMD), fractures, HIV, menopause
Access to antiretroviral therapy (ART) has increased life expectancy among HIV-infected individuals. By 2020, roughly 70% of all people living with HIV will be ages 50 years and older (Karpiak, 2014). Not only is the aging HIV population at greater risk of developing comorbidities such as osteopenia and osteoporosis, but these conditions may also occur at a younger age (Guaraldi et al., 2011). Accelerated bone loss is a common complication of HIV infection and ART (McComsey et al., 2011). Studies have estimated an osteoporosis prevalence rate of 15% in people living with HIV (Bonjoch et al., 2010; Brown & Qaqish, 2006), and a 58% higher fracture rate compared to the general population (Shiau, Broun, Arpadi, & Yin, 2013). With the growing prevalence of HIV among people in middle and old age, there is an urgent need to better characterize the impact of HIV on osteoporosis.
From 2007 to 2010, the estimated number of adults ages 50 years or older living with HIV in the United States increased by nearly 47,000, with a growing proportion of women represented in this older group (Centers for Disease Control and Prevention, 2013). HIV-infected women face the additional consequences of estrogen withdrawal and deficiency during meno-pause transition, which give rise to some of the same metabolic alterations as HIV such as insulin resistance, elevated waist circumference, low high-density lipoprotein levels, and bone loss (Adeyemi, Rezai, Bahk, Badri, & Thomas-Gossain, 2008). Accordingly, menopause may accelerate HIV-related bone loss, and in turn, place HIV-infected postmenopausal women at greater risk for osteoporosis and associated fractures. While the National Osteoporosis Foundation (Cosman et al., 2013) added HIV to their list of conditions that cause or contribute to osteoporosis and fractures, the quality of the evidence on bone loss specifically in HIV-infected older women has not been previously examined.
Over the past several years, a number of reviews have been published on menopause-associated metabolic manifestations in HIV-infected women (Imai, Sutton, Mdodo, & Del Rio, 2013; Kojic, Wang, & Cu-Uvin, 2007; Looby, 2012). The evidence on the effect of ART on bone density in HIV-infected women has also been explored (Carvalho, Gelenske, Bandeira, & Albuquerque, 2010). However, to date, the quality of the literature on menopause-associated changes involving bone in HIV-infected women has not been systematically appraised. Therefore, to evaluate the evidence that menopause is an additional risk predictor for accelerated bone pathology in HIV-infected women, we carried out a systematic review of the current literature.
Methods
The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) Statement was used as a guideline (Moher, Liberati, Tetzlaff, & Altman, 2009). The PRISMA Statement consists of a 27-item checklist to ensure a standard method of transparent reporting of systematic reviews and meta-analyses.
Search Strategy
The following electronic databases were thoroughly searched for all studies published through September 2014 on low bone density or fractures in HIV-infected postmenopausal women: Medline, Scopus, and the Cumulative Index to Nursing and Allied Health Literature (CINAHL). A combination of the search terms “HIV infections,” “osteoporosis,” “bone density,” and “fractures” were used. The search was limited to English-language peer-reviewed articles, and studies with postmenopausal women. A detailed outline of the search is provided in Table 1. Reference lists of retrieved articles were reviewed to identify additional relevant studies.
Table 1.
Databases and Search Terms Used in the Search Strategy
| Database | Years | Search Terms |
|---|---|---|
| Medline | Up to September 2014 | Exp “HIV infections” (MeSH Terms) AND exp “Bone density” (MeSH Terms) OR exp “Fractures, Bone” (MeSH Terms) OR exp “Osteoporosis, Postmenopausal” (MeSH Terms) |
| Scopus | Up to September 2014 | Bone density OR Osteoporosis OR Fractures AND HIV infections |
| CINAHL | Up to September 2014 | Bone density (MW) OR Osteoporosis (MW) OR Fractures (MW) AND HIV infections (MW) |
Note. Exp = exploded; MeSH = Medical Subject Heading; CI-NAHL = Cumulative Index to Nursing and Allied Health Literature; MW = Word in Subject Heading.
Eligibility Criteria
The titles and abstracts of all studies retrieved in the literature search were reviewed. No time limit was imposed and the last search was performed on September 17, 2014. Studies were eligible for analysis if they included a sample of HIV-infected postmenopausal women, and reported bone mineral density (BMD) or fracture data for HIV-infected postmenopausal women. Studies were included regardless of how postmenopausal was defined (e.g., amenorrhea for ≥12 consecutive months without confirmational hormone measures). Study selection was limited to BMD data obtained using dual-energy X-ray absorptiometry (DXA). DXA is a validated measure of BMD and meets the requirements of the World Health Organization diagnostic classification of osteopenia and osteoporosis (World Health Organization, 2004). Studies were excluded if they did not report any BMD or fracture data specifically for HIV-infected postmenopausal women.
Data Extraction
The following categories were used for data extraction: authors, year of publication, study design, sample size, number of HIV-infected participants, number of controls (if applicable), and findings. When available, sample characteristics such as age, race/ethnicity, body mass index (BMI), use of hormone replacement therapy (HRT), and ART exposure were also abstracted. Given that bone density and fractures were the outcomes of interest, information on DXA scan body site and fracture type were collected from each study.
Quality Assessment
The methodological quality of each study was assessed using a validated checklist developed by Downs and Black (1998). The checklist consists of 27 items, with a total possible score of 28 for randomized and 25 for nonrandomized health care interventions. The checklist assesses quality across five domains: (a) how well study aims and procedures are reported in the paper, (b) external validity, (c) bias, (d) confounding, and (e) power. With the exception of confounding and power, each item is scored as 0 or 1, with a score of 1 indicating that the quality criterion is satisfied. One of the items on confounding is scored from 0 to 2, indicating the criterion is not satisfied (= 0), partially satisfied (= 1), or fully satisfied (= 2).
As in previously published reviews using the Downs and Black quality assessment tool (Gaynes et al., 2005; Samoocha, Bruinvels, Elbers, Anema, & van der Beek, 2010; Uchida, Pogorzelska-Maziarz, Smith, & Larson, 2013), the checklist was slightly modified for our review given that none of our included articles were interventional studies. Specifically, the item on statistical power was simplified to a score from 0 to 2 (0 = no power analysis conducted, 1 = power analysis conducted for 1 outcome measure, 2 = power analysis conducted for 2 or more outcome measures, if applicable). A quality score was calculated based on the number of quality assessment items satisfied. Items that did not pertain to the study were rated as not applicable and were not included in the overall score. Quality assessment scores were grouped into four quality ratings: 18 to 20 (excellent), 14 to 17 (good), 10 to 13 (fair), and less than 10 (poor).
Two reviewers (YC, NR) pilot-tested the assessment of methodological quality by independently rating quality scores of two eligible studies and then together determining consensus. As there was no major disagreement in scores, one reviewer (YC) assessed the remaining articles.
Results
Study Selection
The literature search identified 1,093 potentially relevant articles for review. After excluding duplicate records from the electronic databases, 646 titles and abstracts were screened for eligibility. Of these, 618 studies were excluded for two main reasons: postmenopausal women were not included in the sample or the studies did not provide fracture or BMD data. This resulted in the retrieval of 28 articles for full-text review. Upon full-text review, 18 articles were excluded: seven did not include HIV-infected postmenopausal women in the sample, four did not assess BMD or fractures, three studies did not specifically report BMD or fracture data for postmenopausal women, and four articles were duplicate reports. In total, 10 studies were included in our systematic review. Figure 1 provides detailed results of the literature search and study selection process.
Figure 1.
Flow diagram of the study selection process. Note. CINAHL = Cumulative Index to Nursing and Allied Health Literature; BMD = bone mineral density. aInclusion criteria: (a) peer-reviewed English-language articles; (b) includes a sample of HIV-infected postmenopausal women; (c) reports BMD or fracture incidence data for HIV-infected postmenopausal women; and (d) BMD data obtained using dual-energy X-ray absorptiometry.
The study characteristics of the 10 investigations included in the systematic review are presented in Table 2. Of these, six were conducted in the United States, two in Brazil, and one each in Italy and France. The majority of articles were cross-sectional in design (n = 6); the remaining were longitudinal cohort studies (n = 4). Eight of the 10 analyses of BMD or fractures compared HIV-infected postmenopausal women with either HIV-infected premenopausal (Cazanave et al., 2008; Jacobson, Spiegelman, Knox, & Wilson, 2008; Yin et al., 2012) or HIV-uninfected postmenopausal women (Anastos et al., 2007; Li Vecchi et al., 2012; Sharma, Cohen, Freeman, Santoro, & Schoenbaum, 2011; Yin et al., 2005; Yin et al., 2010). Comparison groups in the remaining analyses included: HIV-infected pre- and perimenopausal women (Gomes et al., 2014), and HIV-infected men and premenopausal women (Pinto Neto et al., 2011). Five reports described sub-studies of larger investigations, including the Women's Interagency HIV Study (Anastos et al., 2007; Yin et al., 2010), the Menopause Study Cohort (Sharma et al., 2011), the AIDS Clinical Trials Group Longitudinal-Linked Randomized Trial database (Yin et al., 2012), and the Agence National Recherche sur la Sida (ANRS) CO3 Aquitaine Cohort (Cazanave et al., 2008). The primary outcome in three of the studies was incident fractures. Seven studies reported on BMD features.
Table 2.
Characteristics of Studies Included in the Review (n = 10)
| Study (Year) | Study Design | N (Total) | N (HIV+ PoM) | N (Comparison) | Age (Years) | Race/Ethnicity (%) | BMI (kg/m2) | % ART Exposure |
|---|---|---|---|---|---|---|---|---|
| Anastos et al. (2007) | Cross-sectional | 426 | 73 | 10 (HIV–/PoM) | 42.8 (Mean) | 61.3 B; 19.7 W; 19 L/H | 28.0 (Mean) | 72.3 |
| Cazanave et al. (2008) a | Cross-sectional | 492 | 31 | 102 (HIV+/PrM) | 41.0 (Median) | — | 38.8% with BMI < 20 | 93.1 |
| Gomes et al. (2014) | Cross-sectional | 273 | 111 | 162 (HIV+/PrM and PeriM) | 47.7 (Mean) | 60.1 NW | 48.3% with BMI ≥ 25 | 92 |
| Pinto Neto et al. (2011) a | Cross-sectional | 300 | 45 | 255 (HIV+/PrM and HIV+ men) | — | 70.7 W | 41.1% with BMI > 25 | 88.3 |
| Yin et al. (2005) | Cross-sectional | 217 | 31 | 186 (HIV–/PoM) | 56 (Mean) | 26 AA; 74 L/H | 26 (Mean) | 90.3 |
| Jacobson et al. (2008) a | Longitudinal cohort | 379 | 20 | 76 (HIV+/PrM) | 43 (Median) | 51 AA; 34.4 W; 14.6 O | 29.2% with BMI ≥ 30 | 60.6 |
| Li Vecchi et al. (2012) a | Cross-sectional | 188 | 18 | 26 (HIV–/PoM) | 47 (Mean) | 100 C | 31.2% with BMI ≥ 25 | 93 |
| Sharma et al. (2011) | Longitudinal cohort | 620 | 46 | 41 (HIV–/PoM) | 45 (Mean) | 57.6 B; 5.7 W; 31.4 L/H; 5.3 O | 28.2 (Mean) | 87.8 |
| Yin et al. (2010) | Longitudinal cohort | 2,391 | 338 | 74 (HIV–/PoM) | 40.4 (Mean) | 56.3 B; 13.3 W; 27.2 L/H; 3.2 O | 28.5 (Mean) | 65.6 |
| Yin et al. (2012) a | Longitudinal cohort | 4,640 | 185 (PoM or PeriM) | 477 HIV+/PrM | 39 (Mean) | 28.7 B; 48 W; 20.4 L/H; 1.8 A; 1.2 O | 25 (Mean) | 99.7 |
Note. A = Asian; AA = African American; ART = antiretroviral therapy; B = Black; BMD = bone mineral density; BMI = body mass index; C = Caucasian; FN = femoral neck; L/H = Latino/Hispanic; HRT = hormone replacement therapy; LS = lumbar spine; NW = Non-white; O = Other; PeriM = perimenopausal; PoM = postmenopausal; PrM = premenopausal; W = White.
Study sample included men and women.
One or more of the following sample characteristics were reported in each study: age, race/ethnicity, BMI, and ART exposure. Two studies reported current or past use of HRT (Yin et al., 2005; Yin et al., 2010). Mean or median ages ranged from 38 to 59 years. Five studies included samples of both men and women (Cazanave et al., 2008; Jacobson et al., 2008; Li Vecchi et al., 2012; Pinto Neto et al., 2011; Yin et al., 2012). Overall, nine studies reported data on race/ethnicity; in four cases, the majority of participants identified as Black or African American (Anastos et al., 2007; Jacobson et al., 2008; Sharma et al., 2011; Yin et al., 2010). Participants were mostly overweight across studies (e.g., mean BMI of 25 to 28.5 kg/m2).
The majority of the subjects in each report were on ART, ranging from 61% (Jacobson et al., 2008) to 100% (Yin et al., 2012). In the two studies that reported current or past use of HRT, rates were low: 7% (Yin et al., 2010) and 26% (Yin et al., 2005). While one of the selected investigations purposefully enrolled postmenopausal women with HIV (Yin et al., 2005), the remaining studies included subsets of subjects meeting these criteria. The proportion of subjects meeting these criteria ranged from 5% (20/379) in the study by Jacobson and colleagues (2008) to 15% (45/300) in Pinto Neto and colleagues (2011). Four studies defined postmenopause status as self-reported amenorrhea for at least 12 consecutive months (Anastos et al., 2007; Gomes et al., 2014; Sharma et al., 2011; Yin et al., 2010). One study confirmed postmenopausal status using serum estradiol and follicle-stimulating hormone levels (Yin et al., 2005).
Methodological Quality of Studies
Table 3 summarizes the methodological quality of studies using the checklist by Downs and Black (1998). The mean quality assessment score for included studies was 13.8. None of the studies fulfilled all of the quality criteria. The majority of studies (n = 6) were rated good and the remainder of studies had fair quality. Of the studies with the highest quality scores, two were cohort studies (Sharma et al., 2011; Yin et al., 2010) and one was a cross-sectional investigation (Yin et al., 2005). All studies scored well on the reporting criteria (7 to 9 out of a possible 9).
Table 3.
Methodological Quality of Studies Included in the Review
| Author (Year) | Reportinga | External Validityb | Biasc | Confoundingd | Powere | Quality Score | Rating |
|---|---|---|---|---|---|---|---|
| Anastos et al. (2007) | 8 | 1 | 3 | 2 | 0 | 14 | Good |
| Cazanave et al. (2008) | 8 | 1 | 3 | 1 | 0 | 13 | Fair |
| Gomes et al. (2014) | 8 | 0 | 3 | 1 | 2 | 12 | Fair |
| Pinto Neto et al. (2011) | 8 | 1 | 3 | 2 | 0 | 14 | Good |
| Yin et al. (2005) | 8 | 1 | 3 | 3 | 0 | 15 | Good |
| Jacobson et al. (2008) a | 7 | 0 | 4 | 1 | 0 | 12 | Fair |
| Li Vecchi et al. (2012) a | 7 | 0 | 3 | 1 | 0 | 11 | Fair |
| Sharma et al. (2011) | 8 | 1 | 4 | 3 | 0 | 16 | Good |
| Yin et al. (2010) | 9 | 1 | 4 | 3 | 0 | 17 | Good |
| Yin et al. (2012) | 7 | 1 | 4 | 2 | 0 | 14 | Good |
Note. Methodological quality was assessed using a checklist by Downs and Black (1998). Each criterion was scored from 0 to 1 (0 = no, 1 = yes, n/a = not applicable), with the exception of confounding and power, which were scored from 0 to 2. Ratings were as follows: excellent (18-20), good (14-17) fair (10-13), poor (<10).
Reporting: how well study aims and procedures are reported in the paper.
External validity: generalizability to study findings to the population from which the study subjects were derived.
Bias: examines biases in measurement of the intervention and the outcome.
Confounding: assesses selection bias and comparability of groups.
Power: whether a power analysis was conducted.
External validity was limited across studies because the source population was not adequately described and representativeness of the sample could not be determined. As all bone density studies assessed BMD using DXA, a well-established approach for the classification of osteopenia and osteoporosis (World Health Organization, 2004), outcome misclassification bias was low across these studies. In both investigations of fractures, the incidence of fractures was determined by self-report (Yin et al., 2010; Yin et al., 2012). Higher quality studies scored better on the confounding criteria, having sufficiently described sample selection (Sharma et al., 2011; Yin et al., 2005; Yin et al., 2010). Potential confounders examined across studies included: age, BMI, ART use, tobacco use/smoking history, and CD4 count. The most common weakness among studies was the failure to report a power analysis, with only one study having addressed power (Gomes et al., 2014).
Outcomes
Individual study findings are summarized in Table 4. Five studies reported on low BMD or osteoporosis. Two of these investigations reported that the odds of osteoporosis were significantly higher for HIV-infected postmenopausal women compared with uninfected controls. Studies comparing low BMD and osteoporosis in HIV-infected postmenopausal versus premenopausal women also found a greater likelihood of low BMD in postmenopausal women (Cazanave et al., 2008; Gomes et al., 2014). Odds of low BMD were also significantly higher in postmenopausal women with HIV compared to HIV-infected men and premenopausal women (Pinto Neto et al., 2011). The prevalence of osteoporosis reported in these studies ranged from 7.3% to 84% in HIV-infected postmenopausal women (Anastos et al., 2007; Cazanave et al., 2008; Gomes et al., 2014; Pinto Neto et al., 2011; Yin et al., 2005) and 0.7% to 23% (Anastos et al., 2007; Yin et al., 2005) in uninfected controls.
Table 4.
Individual Study Findings of Postmenopausal Status and Low BMD or Fractures in HIV Infection
| Author | Outcome Variable | Findings (95% CI) | Significant Predictors in Multivariate Models |
|---|---|---|---|
| OR/PR of low BMD or osteoporosis | |||
| Anastos et al. (2007) | Low BMD (T-score <–1.0) and osteoporosis (T-score <–2.5) at LS or FN in HIV+ PoM versus HIV+ PrM | OR low BMD: 3.2 (1.6 to 6.2) OR osteoporosis: 4.8 (1.2 to 18.9) |
ART-naïve, HIV on ART with PI, postmenopause |
| Cazanave et al. (2008) | Low BMD (T-score < –1.0) at LS or FN in HIV+ PoM versus HIV+ PrM | OR low BMD: 1.2 (0.54 to 2.7)b OR osteoporosis: 7.1 (1.9 to 26.4)b |
Older age, nadir CD4 cell count |
| Gomes et al. (2014) d | Low BMD (T-score <–1.0) at LS and FN in HIV+ PoM versus HIV+ PrM or perimenopausal | PR low BMD LS: 23.3 (7.3 to 74.2) PR low BMD FN: 56.7 (7.9 to 409.4) |
Postmenopause |
| Pinto Neto et al. (2011) d | Odds of low BMD (T-score <–1.0) at LS, FN, or total hip in HIV+/PoM versus HIV+ men and women not PoM | OR: 13.4 (2.5 to 71.1) | Male, lower BMI, postmenopause, undetectable viral load |
| Yin et al. (2005) c | Osteoporosis (T-score < –2.5) at LS, FN, and non-dominant radius in HIV+ PoM versus HIV– PoM | OR osteoporosis: 2.4 (1.1 to 5.3)b | Years since menopause, lowest historical weight |
| Change in BMD | |||
| Jacobson et al. (2008) | Annual percent change in total body BMD in HIV+ PoM versus HIV+ PrM | PoM: –1.0 (–1.7 to –0.34)a PrM: 0.12 (–0.16 to 0.41)a |
Postmenopause, low albumin (mg/dL), lower BMI, no strength training, prednisone/hydrocortisone use, time on ART (d4T, ddi, tenofovir, saquinavir) |
| Li Vecchi et al. (2012) | Correlation between postmenopause and BMD T-score at LS and FN | Correlation coefficient LS = –0.17a Correlation coefficient FN =–0.17a |
HIV/HCV co-infection, older age, low yogurt intake, nadir CD4, drug addiction |
| Sharma et al. (2011) | Annual change in BMD (g/cm2) at LS, FN, and total hip associated with PoM in HIV+ | LS: –0.010 (–0.019 to –0.001) FN: –0.007 (–0.014 to 0.000) TH: –0.016 (–0.024 to –0.008) |
Postmenopause, methadone use, baseline BMD, lower BMI, no protease inhibitor use |
| HR of fractures | |||
| Yin et al. (2010) | Self-reported fragility and nonfragility fractures in HIV+ PoM versus HIV– PoM | HR: 1.5 (1.1 to 2.2)a | Older age, white race, HIV/HCV co-infection, higher serum creatinine |
| Yin et al. (2012) d | Self-reported fragility and nonfragility fractures in HIV+ PoM and perimenopausal versus HIV+ PrM | HR: 5.8 (1.4 to 23.3)a | Bisphosphonate use, HIV/HCV co-infection, current smoking, glucocorticoid use |
Note. ART = antiretroviral therapy; BMD = bone mineral density; BMI = body mass index; FN = femoral neck; HCV = hepatitis C virus; HIV+ = HIV-infected; HIV– = HIV uninfected; HR= hazard ratio; LS = lumbar spine; OR = odds ratio; PoM = postmenopausal; PeriM = perimenopausal; PrM = premenopausal; PR = prevalence ratio.
Unadjusted model.
Calculated by reviewer (YC) from information available in article.
Study population limited to postmenopausal women.
Study population limited to HIV-infected ART-naïve women.
Three studies in our review reported on bone loss in HIV infection (Jacobson et al., 2008; Li Vecchi et al., 2012; Sharma et al., 2011). Annual change in BMD was significantly higher for HIV-infected postmenopausal women compared to premenopausal women (Jacobson et al., 2008) and uninfected postmenopausal women (Sharma et al., 2011). Similarly, in a study of HIV-infected men and women, postmenopausal status was correlated with lower DXA T-scores (Li Vecchi et al., 2012).
Of the two studies reporting on fractures, one found that the likelihood of fractures was 1.5 times higher in HIV-infected postmenopausal women compared to uninfected controls (Yin et al., 2010). In the second study, in 614 ART-naïve women, the likelihood of fractures was significantly higher in peri- and postmenopausal women with HIV than the HIV-infected premenopausal comparison group.
Predictors of Low BMD and Fractures
Predictors of low BMD and fractures for the entire sample in each study are presented in Table 4. Several traditional risk factors were independently associated with low BMD: older age (Cazanave et al., 2008; Li Vecchi et al., 2012), lower BMI (Jacobson et al., 2008; Pinto Neto et al., 2011; Sharma et al., 2011), or lowest historical weight (Yin et al., 2005), and corticosteroid use (Jacobson et al., 2008). Behavioral predictors of low BMD included strength training (Jacobson et al., 2008) and substance abuse (Li Vecchi et al., 2012; Sharma et al., 2011). HIV characteristics independently associated with low BMD included: ART with (Anastos et al., 2007) or without (Sharma et al., 2011) a protease inhibitor, time on ART (Jacobson et al., 2008), low nadir CD41 T cell count (Cazanave et al., 2008; Li Vecchi et al., 2012), and higher viral load (Pinto Neto et al., 2011). HIV-hepatitis C virus (HCV) co-infection was associated with low BMD in a single report (Li Vecchi et al., 2012). In six (75%) of the eight BMD studies, postmenopause, or time since menopause, was independently associated with low BMD or bone loss in HIV infection (Anastos et al., 2007; Gomes et al., 2014; Jacobson et al., 2008; Pinto Neto et al., 2011; Sharma et al., 2011; Yin et al., 2005).
Among the fracture studies, older age (Yin et al., 2010), White race (Yin et al., 2010), corticosteroid use (Yin et al., 2012), and current smoking (Yin et al., 2012) were independent predictors of fractures. While HIV characteristics were not independently associated with fractures, both studies found that HIV/HCV co-infection was a predictor of fractures for HIV-infected men and women (Yin et al., 2012; Yin et al., 2010). Postmenopause was not independently associated with fractures in multivariate models (Yin et al., 2010; Yin et al., 2012).
Discussion
In the general population, BMD screening is recommended for women ages 65 years or older, postmenopausal women of any age, and those in the menopause transition with one or more of the following clinical risk factors for fractures: lower BMI, a prior osteoporotic fracture, use of glucocorticoids, current smoking, and alcohol intake (Cosman et al., 2013). Similarly, in our review of studies of HIV-infected women, older age (Cazanave et al., 2008; Li Vecchi et al., 2012; Yin et al., 2010), lower BMI (Jacobson et al., 2008; Pinto Neto et al., 2011; Sharma et al., 2011), postmenopausal status (Anastos et al., 2007; Gomes et al., 2014; Jacobson et al., 2008; Pinto Neto et al., 2011; Sharma et al., 2011; Yin et al., 2005), and glucocorticoid use (Jacobson et al., 2008; Yin et al., 2010) were associated with lower BMD. Strength training had a protective effect on bone (Jacobson et al., 2008), which was consistent with evidence from studies of healthy women (Wallace & Ballard, 2002). HIV/HCV co-infection was independently related to fractures in both of the fracture studies (Yin et al., 2010; Yin et al., 2012), a finding previously reported for the general HIV patient population (Lo Re et al., 2012; Maalouf et al., 2013). Studies in this review also confirmed that ART exposure was associated with reduced BMD and osteoporosis (Anastos et al., 2007; Jacobson et al., 2008; Sharma et al., 2011).
This is the first systematic review to assess the quality of the evidence on low BMD and fractures in HIV-infected postmenopausal women. Our review found moderately strong evidence that HIV-infected postmenopausal women are at heightened risk for osteoporosis, beyond that normally experienced by uninfected women after menopause or HIV-infected premenopausal women. The majority of the studies in our review observed that postmenopausal status, or years since menopause, was independently associated with lower BMD. These findings suggest that the additive effects of HIV infection and menopause may worsen bone loss, perhaps due to an increase in inflammatory markers such as tumor necrosis factor-alpha (TNFα) and interleukin-6 (IL6). TNFα and IL6 levels have been shown to increase after menopause (Pfeilschifter, Koditz, Pfohl, & Schatz, 2002) and HIV infection (Deeks, 2011). Higher levels of TNFα and IL6 are associated with increased activation and differentiation of osteoclasts, which lead to greater bone resorption (Fouda et al., 2012).
The literature search resulted in only two studies of fractures in HIV-infected postmenopausal women. While these studies found a modest increase in fracture risk for postmenopausal women compared to HIV-uninfected or premenopausal controls, postmenopausal status was not an independent predictor of fractures, despite the higher risk of low BMD. These findings may be attributed to the relatively young age of study participants. Although the incidence of fractures in uninfected individuals increases after age 50 years (Kanis et al., 2001), the mean ages of HIV-infected individuals across fracture studies in this review were 39-40 years (Yin et al., 2012; Yin et al., 2010). At the same time, a recent meta-analysis of 13 studies, conducted primarily in men younger than 50 years of age, found that HIV infection was associated with a modest increase in fractures. To better address the risk of fractures in HIV-infected women, longitudinal studies assessing age, menopause status, and time since menopause will be needed.
Our review identified several gaps in the current research on bone density and fractures in HIV-infected postmenopausal women. First, the literature on postmenopausal women with HIV is limited. Five of the 10 studies in this review were conducted solely in women, with the remaining studies including a large sample of men. Comparison groups varied from uninfected postmenopausal women to HIV-infected premenopausal women and men. Studies with a larger sample of HIV-infected postmenopausal women would strengthen overall validity of findings in this review.
Next, the majority of studies classified women as postmenopausal based on the exclusive criterion of self-reported amenorrhea for at least 12 consecutive months (Anastos et al., 2007; Gomes et al., 2014; Jacobson et al., 2008; Sharma et al., 2011; Yin et al., 2010). The Stages of Reproductive Aging Workshop (STRAW) defines postmenopause as the cessation of menses for more than 12 consecutive months with confirmational changes in follicle-stimulating hormone, estradiol, and antimüullerian hormone concentrations (Harlow et al., 2012). The importance of reproductive hormone measures was evident in a recent study of low BMD in HIV-infected individuals, where higher levels of estradiol were significantly related to higher BMD measures (El-Maouche, Xu, Cofrancesco, Dobs, & Brown, 2011). Studies have also shown that HIV-infected women experienced prolonged amenorrhea and early menopause more frequently than women in the general population (Cejtin et al., 2006; Prior et al., 2007), indicating the need for more reliable endocrine measures to avoid misclassification of reproductive stage. Thus, the application of the STRAW guidelines for staging menopause may be especially useful in research with middle-aged HIV-infected women.
Another gap in the current literature is the lack of research on emerging risk factors for osteoporosis and fractures in HIV-infected women. Recent studies in otherwise healthy individuals have shown that both depression (Cizza, Primma, Coyle, Gourgiotis, & Csako, 2010) and surgical menopause (Yoshida, Takahashi, Yamatani, Takata, & Kurachi, 2011) were independently associated with lower BMD and fractures. A meta-analysis of 20 studies found that BMD was up to 7.32% lower for individuals of both genders with major or minor depression (Cizza et al., 2010). The sympathetic activation of proinflammatory cytokines in depression, such as IL6 (Anderson et al., 2013), is one potential explanation for the association between bone metabolism and depression. The odds of depressive symptoms are significantly higher for HIV-infected women in early perimenopause (Maki et al., 2012), suggesting its potential role as an important but understudied confound of bone loss in HIV-infected postmenopausal women. One study in our review assessed depression but did not include this variable in its analyses of BMD (Sharma et al., 2011).
Similarly, the role of hysterectomy as a contributing risk factor to elevated bone loss in HIV-infected postmenopausal women remains understudied. In healthy women, serum bone turnover markers rapidly increase after bilateral oophorectomy (Bahar et al., 2011). Women with HIV are more likely than uninfected women to require a hysterectomy, most often due to a higher prevalence of cervical neoplasia (Massad et al., 2007). Although information on hysterectomy was collected at baseline in several of the reports reviewed here, none of these studies included surgical menopause in their analyses of bone loss predictors (Anastos et al., 2007; Jacobson et al., 2008; Yin et al., 2012; Yin et al., 2010).
Our systematic review highlights areas for strengthening design and methods in future research of reduced BMD and fractures in HIV-infected postmenopausal women. Going forward, studies should plan for an adequate sample size of postmenopausal women, sufficient to determine the potential additive effects of menopause and HIV infection on bone. Serial endocrine biomarkers should be incorporated into study designs to confirm menopause status, as well as confirmatory records of surgical procedures to avoid the misclassification of postmenopausal women. Finally, given the well-established influence of depression on bone in uninfected individuals, and the high rates of depression in HIV-infected patients, mental health status should also be adjusted for when calculating bone loss and fracture risk in HIV-infected postmenopausal women.
This review has several limitations. Included studies were restricted to English-language articles published in peer-reviewed journals. Only studies that assessed BMD by DXA were included, so it is possible that other less rigorous studies were missed. Given the significant heterogeneity, a meta-analysis was not conducted.
Conclusions
Although there is sufficient evidence to support menopause as an important predictor of bone loss and low BMD in HIV-infected postmenopausal women, there is still inadequate evidence to suggest a role in fracture rates at this time. Future studies that follow women across the menopause transition, using confirmatory endocrine biomarkers, are needed to gain a better understanding of the impact of menopause on HIV disease progression and bone loss. Longer-than-usual follow-up of HIV-infected women may be necessary to determine risk for fractures in this population, given their earlier age of menopause and age at which fractures commonly occur. In addition, a greater understanding of the effect of reproductive hormones on HIV-associated non-AIDS conditions, such as low BMD, is important to prevent and treat these conditions more effectively in the growing population of older women with HIV (High et al., 2012). Findings in our review are relevant to health care providers with an HIV-infected patient population because they highlight the need to accurately assess postmenopausal status and modifiable risk factors for osteoporosis in all older HIV-infected women.
Key Considerations.
With the development of antiretroviral therapy, HIV-infected women are living longer and transitioning through menopause. The current state of the evidence suggests that HIV-infected postmenopausal women are at greater risk of bone loss compared to HIV-infected premenopausal women and HIV-uninfected postmenopausal women.
The evidence on fractures in HIV-infected postmenopausal women is limited. However, studies have found a modest increase in fracture risk for postmenopausal women compared to HIV-uninfected or premenopausal controls.
The quality of the evidence of bone mineral density and fractures in HIV-infected postmenopausal women is fair to good, suggesting the need for HIV care providers to more accurately assess postmenopausal status and modifiable risk factors for osteoporosis in all older HIV-infected women.
Acknowledgments
Yamnia Cortés was funded as a predoctoral trainee by the National Institute of Nursing Research, National Institutes of Health, Training in Interdisciplinary Research to Prevent Infections (TIRI), 5T32NR013454.
Footnotes
Disclosures
The authors report no real or perceived vested interests that relate to this article that could be construed as a conflict of interest.
Contributor Information
Yamnia I. Cortés, Columbia University School of Nursing, New York, New York, USA..
Michael T. Yin, Division of Infectious Disease, Department of Medicine, Columbia University Medical Center, New York, New York, USA..
Nancy K. Reame, Columbia University School of Nursing, New York, New York, USA..
References
- Adeyemi O, Rezai K, Bahk M, Badri S, Thomas-Gossain N. Metabolic syndrome in older HIV-infected patients: Data from the CORE50 cohort. AIDS Patient Care and STDS. 2008;22(12):941–945. doi: 10.1089/apc.2008.0119. [DOI] [PubMed] [Google Scholar]
- Anastos K, Lu D, Shi O, Mulligan K, Tien PC, Freeman R, Hessol NA. The association of bone mineral density with HIV infection and antiretroviral treatment in women. Antiviral Therapy. 2007;12(7):1049–1058. doi: 10.1177/135965350701200701. [DOI] [PubMed] [Google Scholar]
- Anderson G, Kubera M, Duda W, Lason W, Berk M, Maes M. Increased IL-6 trans-signaling in depression: Focus on the tryptophan catabolite pathway, melatonin and neuroprogression. Pharmacological Report. 2013;65(6):1647–1654. doi: 10.1016/s1734-1140(13)71526-3. [DOI] [PubMed] [Google Scholar]
- Bahar S, Abali R, Guzel S, Bozkurt S, Guzel EC, Aral H, Boran AB. Comparison of the acute alterations in serum bone turnover markers and bone mineral density among women with surgical menopause. European Journal of Obstetrics and Gynecology and Reproductive Biology. 2011;159(1):194–197. doi: 10.1016/j.ejogrb.2011.06.033. [DOI] [PubMed] [Google Scholar]
- Bonjoch A, Figueras M, Estany C, Perez-Alvarez N, Rosales J, del Rio L, Negredo N. High prevalence of and progression to low bone mineral density in HIV-infected patients: a longitudinal cohort study. AIDS. 2010;24(18):2827–2833. doi: 10.1097/QAD.0b013e328340a28d. [DOI] [PubMed] [Google Scholar]
- Brown TT, Qaqish RB. Antiretroviral therapy and the prevalence of osteopenia and osteoporosis: A meta-analytic review. AIDS. 2006;20(17):2165–2174. doi: 10.1097/QAD.0b013e32801022eb. [DOI] [PubMed] [Google Scholar]
- Carvalho EH, Gelenske T, Bandeira F, Albuquerque M. Bone mineral density in HIV-infected women taking antiretroviral therapy: A systematic review. Arquivos Brasileiros de Endocrinologia e Metabologia. 2010;54(2):133–142. doi: 10.1590/s0004-27302010000200008. [DOI] [PubMed] [Google Scholar]
- Cazanave C, Dupon M, Lavignolle-Aurillac V, Barthe N, Lawson-Ayayi S, Mehsen N, Dabis F. Reduced bone mineral density in HIV-infected patients: Prevalence and associated factors. AIDS. 2008;22(3):395–402. doi: 10.1097/QAD.0b013e3282f423dd. [DOI] [PubMed] [Google Scholar]
- Cejtin HE, Kalinowski A, Bacchetti P, Taylor RN, Watts DH, Kim S, Minkoff HL. Effects of human immunodeficiency virus on protracted amenorrhea and ovarian dysfunction. Obstetrics and Gynecology. 2006;108(6):1423–1431. doi: 10.1097/01.AOG.0000245442.29969.5c. [DOI] [PubMed] [Google Scholar]
- Centers for Disease Control and Prevention Diagnoses of HIV infection among adults aged 50 years and older in the United States and dependent areas, 2007-2010. 2013 Retrieved from http://www.cdc.gov/topics/surveillance/resources/reports/#supplemental.
- Cizza G, Primma S, Coyle M, Gourgiotis L, Csako G. Depression and osteoporosis: A research synthesis with meta-analysis. Hormone and Metabolic Research. 2010;42(7):467–482. doi: 10.1055/s-0030-1252020. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cosman F, de Beur JR, LeBoff MS, Lewiecki EM, Tanner B, Randall S, Lindsay R. Clinician's guide to prevention and treatment of osteoporosis. Osteoporosis International. 2013;25(10):2359–2381. doi: 10.1007/s00198-014-2794-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Deeks SG. HIV infection, inflammation, immunosenescence, and aging. Annual Review of Medicine. 2011;62:141–155. doi: 10.1146/annurev-med-042909-093756. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Downs SH, Black N. The feasibility of creating a checklist for the assessment of the methodological quality both of randomised and non-randomised studies of health care interventions. Journal of Epidemiology and Community Health. 1998;52(6):377–384. doi: 10.1136/jech.52.6.377. [DOI] [PMC free article] [PubMed] [Google Scholar]
- El-Maouche D, Xu X, Cofrancesco J, Jr., Dobs AS, Brown TT. Prevalence of low bone mineral density in a low-income inner-city population. Journal of Bone and Mineral Research. 2011;26(2):388–396. doi: 10.1002/jbmr.221. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fouda MA, Khan AA, Sultan MS, Rios LP, McAssey K, Armstrong D. Evaluation and management of skeletal health in celiac disease: Position statement. Canadian Journal of Gastroenterology. 2012;26(11):819–829. doi: 10.1155/2012/823648. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gaynes BN, Gavin N, Meltzer-Brody S, Lohr KN, Swinson T, Gartlehner G, Miller WC. Peri-natal depression: Prevalence, screening accuracy, and screening outcomes. 2005 doi: 10.1037/e439372005-001. Retrieved from http://archive.ahrq.gov/downloads/pub/evidence/pdf/peridepr/peridep.pdf. [DOI] [PMC free article] [PubMed]
- Gomes DC, Valadares AL, de Moraes MJ, Lagrutta BB, Pinto-Neto AM, Costa-Paiva L. Low bone mass in human immunodeficiency virus-infected climacteric women receiving antiretroviral therapy: Prevalence and associated factors. Menopause. 2014;22(2):224–230. doi: 10.1097/GME.0000000000000282. [DOI] [PubMed] [Google Scholar]
- Guaraldi G, Orlando G, Zona S, Menozzi M, Carli F, Garlassi E, Palella F. Premature age-related comorbidities among HIV-infected persons compared with the general population. Clinical Infectious Diseases. 2011;53(11):1120–1126. doi: 10.1093/cid/cir627. [DOI] [PubMed] [Google Scholar]
- Harlow SD, Gass M, Hall JE, Lobo R, Maki P, Rebar RW, de Villers TJ. Executive summary of the Stages of Reproductive Aging Workshop 1 10: Addressing the unfinished agenda of staging reproductive aging. Journal of Clinical Endocrinology and Metabolism. 2012;97(4):1159–1168. doi: 10.1210/jc.2011-3362. [DOI] [PMC free article] [PubMed] [Google Scholar]
- High KP, Brennan-Ing M, Clifford DB, Cohen MH, Currier J, Deeks SG, Volberding P. HIV and aging: state of knowledge and areas of critical need for research. A report to the NIH Office of AIDS Research by the HIV and Aging Working Group. Journal of Acquired Immune Deficiency Syndromes. 2012;60(Suppl. 1):S1–S18. doi: 10.1097/QAI.0b013e31825a3668. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Imai K, Sutton MY, Mdodo R, Del Rio C. HIV and menopause: A systematic review of the effects of HIV infection on age at menopause and the effects of menopause on response to antiretroviral therapy. Obstetrics and Gynecology International. 2013;2013:340309. doi: 10.1155/2013/340309. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jacobson DL, Spiegelman D, Knox TK, Wilson IB. Evolution and predictors of change in total bone mineral density over time in HIV-infected men and women in the nutrition for healthy living study. Journal of Acquired Immune Deficiency Syndromes. 2008;49(3):298–308. doi: 10.1097/QAI.0b013e3181893e8e. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kanis JA, Oden A, Johnell O, Jonsson B, de Laet C, Dawson A. The burden of osteoporotic fractures: A method for setting intervention thresholds. Osteoporosis International. 2001;12(5):417–427. doi: 10.1007/s001980170112. [DOI] [PubMed] [Google Scholar]
- Karpiak S. Adherence to antiretroviral therapy (ART) in older adults living with HIV/AIDS. 2014 Retrieved from http://www.apa.org/pi/aids/resources/exchange/2014/01/anti-retroviral-therapy.aspx.
- Kojic EM, Wang CC, Cu-Uvin S. HIV and menopause: A review. Journal of Women’s Health. 2007;16(10):1402–1411. doi: 10.1089/jwh.2007.0345. [DOI] [PubMed] [Google Scholar]
- Li Vecchi V, Soresi M, Giannitrapani L, Mazzola G, La Sala S, Tramuto F, Di Carlo P. Dairy calcium intake and lifestyle risk factors for bone loss in HIV-infected and uninfected Mediterranean subjects. BMC Infectious Diseases. 2012;12:192. doi: 10.1186/1471-2334-12-192. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lo Re V, 3rd, Volk J, Newcomb CW, Yang YX, Freeman CP, Hennessy S, Localio AR. Risk of hip fracture associated with hepatitis C virus infection and hepatitis C/human immunodeficiency virus coinfection. Hepatology. 2012;56(5):1688–1698. doi: 10.1002/hep.25866. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Looby SE. Menopause-associated metabolic manifestations and symptomatology in HIV infection: A brief review with research implications. Journal of the Association of Nurses in AIDS Care. 2012;23(3):195–203. doi: 10.1016/j.jana.2011.06.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Maalouf NM, Zhang S, Drechsler H, Brown GR, Tebas P, Bedimo R. Hepatitis C co-infection and severity of liver disease as risk factors for osteoporotic fractures among HIV-infected patients. Journal of Bone and Mineral Research. 2013;28(12):2577–2583. doi: 10.1002/jbmr.1988. [DOI] [PubMed] [Google Scholar]
- Maki PM, Rubin LH, Cohen M, Golub ET, Greenblatt RM, Young M, Cook JA. Depressive symptoms are increased in the early perimenopausal stage in ethnically diverse human immunodeficiency virus-infected and human immunodeficiency virus-uninfected women. Menopause. 2012;19(11):1215–1223. doi: 10.1097/gme.0b013e318255434d. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Massad LS, Evans C, Weber K, Cejtin HE, Golub ET, DiGilio K, Watts DH. Hysterectomy among women with HIV: Indications and incidence. Journal of Acquired Immune Deficiency Syndromes. 2007;44(5):566–568. doi: 10.1097/QAI.0b013e318032387a. [DOI] [PubMed] [Google Scholar]
- McComsey GA, Kitch D, Daar ES, Tierney C, Jahed NC, Tebas P, Sax PE. Bone mineral density and fractures in antiretroviral-naive persons randomized to receive abacavir-lamivudine or tenofovir disoproxil fumarate-emtricitabine along with efavirenz or atazanavirritonavir: AIDS Clinical Trials Group A5224s, a substudy of ACTG A5202. Journal of Infectious Diseases. 2011;203(12):1791–1801. doi: 10.1093/infdis/jir188. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. Journal of Clinical Epidemiology. 2009;62(10):1006–1012. doi: 10.1016/j.jclinepi.2009.06.005. [DOI] [PubMed] [Google Scholar]
- Pfeilschifter J, Koditz R, Pfohl M, Schatz H. Changes in proinflammatory cytokine activity after meno-pause. Endocrine Reviews. 2002;23(1):90–119. doi: 10.1210/edrv.23.1.0456. [DOI] [PubMed] [Google Scholar]
- Pinto Neto LFS, Ragi-Eis S, Vieira NFR, Soprani M, Neves MB, Ribeiro-Rodrigues R, Miranda AE. Low bone mass prevalence, therapy type, and clinical risk factors in an HIV-infected Brazilian population. Journal of Clinical Densitometry. 2011;14(4):434–439. doi: 10.1016/j.jocd.2011.06.004. [DOI] [PubMed] [Google Scholar]
- Prior J, Burdge D, Maan E, Milner R, Hankins C, Klein M, Walmsley S. Fragility fractures and bone mineral density in HIV positive women: A case-control population-based study. Osteoporosis International. 2007;18(10):1345–1353. doi: 10.1007/s00198-007-0428-7. [DOI] [PubMed] [Google Scholar]
- Samoocha D, Bruinvels DJ, Elbers NA, Anema JR, van der Beek AJ. Effectiveness of web-based interventions on patient empowerment: A systematic review and meta-analysis. Journal of Medical Internet Research. 2010;12(2):e23. doi: 10.2196/jmir.1286. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sharma A, Cohen HW, Freeman R, Santoro N, Schoenbaum EE. Prospective evaluation of bone mineral density among middle-aged HIV-infected and uninfected women: Association between methadone use and bone loss. Maturitas. 2011;70(3):295–301. doi: 10.1016/j.maturitas.2011.08.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shiau S, Broun EC, Arpadi SM, Yin MT. Incident fractures in HIV-infected individuals: A systematic review and meta-analysis. AIDS. 2013;27(12):1949–1957. doi: 10.1097/QAD.0b013e328361d241. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Uchida M, Pogorzelska-Maziarz M, Smith PW, Larson E. Infection prevention in long-term care: A systematic review of randomized and nonrandomized trials. Journal of the American Geriatrics Society. 2013;61(4):602–614. doi: 10.1111/jgs.12175. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wallace LS, Ballard JE. Lifetime physical activity and calcium intake related to bone density in young women. Journal of Women's Health Gender Based Medicine. 2002;11(4):389–398. doi: 10.1089/152460902317586029. [DOI] [PubMed] [Google Scholar]
- World Health Organization WHO scientific group on the assessment of osteoporosis at primary health care level. 2004 Retrieved from http://www.who.int/chp/topics/Osteoporosis.pdf.
- Yin MT, Dobkin J, Brudney K, Becker C, Zadel JL, Manandhar M, Shane E. Bone mass and mineral metabolism in HIV1 postmenopausal women. Osteoporosis International. 2005;16(11):1345–1352. doi: 10.1007/s00198-005-1845-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Yin MT, Kendall MA, Wu X, Tassiopoulos K, Hochberg M, Huang JS, McComsey GA. Fractures after antiretroviral initiation. AIDS. 2012;26(17):2175–2184. doi: 10.1097/QAD.0b013e328359a8ca. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Yin MT, Shi Q, Hoover DR, Anastos K, Sharma A, Young M, Tien PC. Fracture incidence in HIV-infected women: Results from the Women's Interagency HIV Study. AIDS. 2010;24(17):2679–2686. doi: 10.1097/QAD.0b013e32833f6294. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Yoshida T, Takahashi K, Yamatani H, Takata K, Kurachi H. Impact of surgical menopause on lipid and bone metabolism. Climacteric. 2011;14(4):445–452. doi: 10.3109/13697137.2011.562994. [DOI] [PubMed] [Google Scholar]

