Skip to main content
HIV/AIDS (Auckland, N.Z.) logoLink to HIV/AIDS (Auckland, N.Z.)
. 2018 Nov 5;10:225–237. doi: 10.2147/HIV.S176587

Prevalence of extrapulmonary tuberculosis among people living with HIV/AIDS in sub-Saharan Africa: a systemic review and meta-analysis

Hussen Mohammed 1,, Nega Assefa 2, Bezatu Mengistie 2
PMCID: PMC6225852  PMID: 30464643

Abstract

Background

The double burden of infectious diseases such as tuberculosis (TB) and HIV disproportionately affects Africa. Our objective was to summarize the prevalence of extrapulmonary TB (EPTB) among people living with HIV/AIDS (PLWHA) in sub-Saharan Africa (SSA).

Methods

We searched PubMed and Google Scholar for studies done on the prevalence of EPTB among PLWHA which published in English from 1990 to 2017. We also searched bibliographic indices and browsed through reference lists of articles and journals. We critically appraised the quality of articles and abstracted the data with Joanna Briggs Institute (JBI) checklists. We used Review Manager Software (version 5.3) and Compressive Meta-analysis Software (version 2.2) for analysis. Finally, we summarized the effect estimate by using random-effects model and explored potential sources of heterogeneity by subgroup and sensitivity analyses. We assessed publication bias by funnel plot and statistical test. Finally, we used PRISMA format for reporting.

Results

We included, in this review, 31 studies that fulfilled our inclusion criteria, with a total population of 28,659. The prevalence estimate of EPTB among PLWHA ranged from 6.4% (95% CI: 3.8, 9.0) to 36.8% (95% CI: 28.6, 45); random-effects pooled prevalence of EPTB among PLWHA was found to be 20% (95% CI: 17, 22; heterogeneity: τ2=0; χ2=509.09, degrees of freedom [df]=30, P<0.00001; I2=94%). No evidence of publication bias was observed (P=0.44 for Egger’s regression analysis and P=0.11 for Begg’s rank correlation analysis).

Conclusion

We can conclude from our analyses that the prevalence of EPTB among PLWHA was high. It is necessary to give emphasis for EPTB, especially when screening TB among PLWHA, widening the spectrum of screening to include all EPTB sites in the countries with high EPTB and/or HIV prevalence in the general population.

Keywords: extrapulmonary tuberculosis, HIV, sub-Saharan Africa, systemic review, meta-analysis, co-infection

Introduction

Tuberculosis (TB) is the ninth leading cause of death worldwide and the leading cause from a single infectious agent that is ranking above HIV/AIDS. The disproportionate burden of HIV and TB infection and disease in Africa at the start of the new millennium continues unabated. In 2016, of all estimated 10.4 million new cases of (25% in Africa) TB that resulted in 1.7 million (44% in Africa) deaths worldwide, Africa though, home to only 13% of the world’s population have been living in Africa. Africa bears 30% of HIV prevalence among TB patients or its co-infection as compared to 1.3% by the Eastern Mediterranean region. HIV prevalence in TB patients or co-infection was low in Eastern Mediterranean region (1.3%), nevertheless, it was 30% in Africa.1

Furthermore, Africa bears 75% of about 1.03 million of TB/HIV co-infection cases that occur each year globally. Furthermore, in Africa, TB is often observed first in HIV-infected patients, and it is the leading cause of death among them.1 In addition, the UNAIDS global report in 2016 showed that sub-Saharan Africa (SSA) takes the lead by contributing the highest burden of HIV: 70% (25.5 million) of 36.7 million people living with HIV, 64% of 1.8 million newly infected, and 73% of 1.0 million deaths.2

Extrapulmonary TB (EPTB) is the TB of organs other than the lungs, eg, pleura, lymph nodes, abdomen, genitourinary tract, skin, joints, bones, and meningeal.3,4 A majority of individuals after exposure control the spread of bacillia in pulmonary site, but in others bacilli disseminate through lymphatic or hematogenous system and subsequently affect single or multiple extrapulmonary sites.5 The prevalence of EPTB among notified TB cases in African region in 2017 was 16%, which is the second highest next to Eastern Mediterranean region (24%), which is more than global prevalence of EPTB (15%). The lowest prevalence was reported from Western Pacific region (8%).1

To mitigate the burden of EPTB/HIV co-infection, the WHO took the initiative. In 2007, it published guidelines on how to diagnose EPTB among HIV-positive people which were based on one culture-positive specimen or histological or strong clinical evidence consistent with active EPTB, followed by a decision by a clinician to treat with a full course of anti-TB treatments.6 In addition, the WHO published an up-to-date policy on collaborative TB/HIV activities in 2012.7 This policy emphasized the importance of surveillance of HIV among TB patients and vice versa in all countries. Furthermore, in 2013, the WHO updated the policy on the diagnosis of TB using GeneXpert Mycobacterium tuberculosis/rifampicin as an initial diagnostic test at point of care. It could replace microscopy and be used for diagnosis of all presumptive pulmonary TB (PTB) patients, pediatrics patients, TB/HIV co-infected patients, and selected specimen of the diagnosis of EPTB patients.8,9

A wide range of estimates for the prevalence of EPTB among people living with HIV/AIDS (PLWHA) have been reported from different SSA countries. For instance, in Ethiopia, more than half, 54.7% co-infection among HIV/AIDS individuals, had EPTB.10 In Cameroon and Ghana, HIV co-infection with EPTB was 37.1% and 45.2%, respectively.11,12 However, an estimate reported on the prevalence of EPTB among PLWHA was inconsistent and unclear.

Therefore, for the dual burden of TB/HIV affecting the Africa, we aimed to summarize and synthesize the prevalence of EPTB among HIV-positive individuals in SSA. This is important for public health policy and planning and development of clinical services that address the needs of EPTB and HIV/AIDS patients.

Methods

Study participants

The study participants included as a sample in reviewed studies could be males and females; all age groups; the time of screening or diagnosing EPTB among HIV had been at the same time (both tested at a time) or after the HIV status is known. The time of reviewed studies performed could be either when HIV/AIDS patients have been in pre-antiretroviral therapy or taking antiretroviral therapy.

Outcome

This review considered studies that include the prevalence estimate of EPTB among PLWHA.

Eligibility criteria

For our review, we included the studies that have been done on PLWHA and reported the proportion of co infection for EPTB and HIV. Included studies were observational study design, which includes cohort (prospective or retrospective), cross-sectional or medical review. Studies that were written only in English, health facilities that could be hospitals, health centers or similar that belong to governmental or nongovernmental, or private, and published between January 1, 1990, and November 30, 2017, were included. The screening or investigations were included irrespective of diagnostic methods. Abstracts without full texts, articles without journal name and/or authors, conference proceeding or presentation, studies with total population of less than 50 people, study with incidence, qualitative study, review, case study, TB/HIV co-infection or PTB/HIV only co-infection, and book chapters were excluded from the final analysis.

Search strategy

A three-stage search strategy was used to identify all relevant published literature. First, an initial search of PubMed database and Google Scholar was made. Second, searching the reference lists or bibliographies of all identified articles was checked manually for articles of interest, and finally gray literature was sought from institutions and government websites. Available electronic journal articles were searched through HINARI. We also searched relevant reference lists and relevant journals manually. The dates of publication covered were January 1, 1990, to November 30, 2017. The search engine used with modification was with initial keywords and Medical Subject Headings (MeSH) term for PubMed database: “Tuberculosis, lymph node” OR “tuberculosis, cardiovascular” OR “tuberculosis, central nervous system” OR “tuberculosis, cutaneous” OR “tuberculosis, endocrine” “tuberculosis, gastrointestinal” OR “tuberculosis, hepatic” OR “tuberculosis, ocular” OR “tuberculosis, oral” OR “tuberculosis, osteoarticular” OR “tuberculosis, pleural” OR “tuberculosis, splenic” OR “tuberculosis, urogenital” OR “tuberculosis” AND “HIV” OR “AIDS” OR “human immunodeficiency virus” OR “acquired immunodeficiency syndrome” OR “co-infection” OR “opportunistic infection” OR “opportunistic” OR “sub Saharan Africa”.

Methods of EPTB screening or diagnosis among PLWHA

WHO or National TB Control Program diagnostic methods of the respective country were used; either combination or individual screening methods were used; either of the following methods were used: microbiologically determined sputum microscopy or sputum culture, PCR, GeneXpert, X-ray, broncho-alveolar lavage, histopathology, and ultrasound. Clinical signs and symptoms and response to treatment in combination with one of the abovementioned diagnostic methods were also used. In addition, methods of HIV screening or diagnosis as per WHO or national HIV screening or diagnosis protocol which mainly either rapid test or ELISA test or both were used.

Methodological quality assessment

All articles selected for inclusion in the review were subjected to a rigorous, independent appraisal by the investigators prior to inclusion in the review using standardized critical appraisal instruments from the Joanna Briggs Institute (JBI).13 Two reviewers independently appraised the studies. Disagreement was resolved by consensus between the two reviewers or through consultation with the third author, if required. The checklists were focused on setting, method of sampling techniques and sample size determination, screening/diagnostic method, and validity and reliability of measurements and data analysis. All relevant studies with optimum score were included and discussed with its limitations and risk of biases and how that might affect the results of this review.

Study selection

After studies were identified, we selected studies by passing through four steps primarily screening through titles and abstracts with over inclusion; second, full-text review for eligibility checkup was performed. Third, methodological critical appraisal was performed, and finally studies having optimum quality were included for systemic review and meta-analysis.

Data collection process: data item and extraction tools

We used a standardized form of JBI for data item and extraction.13 This data extraction form was used to extract the relevant information from appraised articles. A number of variables including study locations or country, years of publications, study periods, study designs, number of patients included in the study, and prevalence of EPTB/HIV co-infection were extracted from all studies included in the review. For this review, we used summary estimate rather than individual patient-level data.

Data analysis and statistical methods

Prevalence of EPTB was calculated as a number of EPTB cases per total number of PLWHA. The prevalence data were identified and abstracted or calculated from the given data from respective studies. In studies, when the standard error (SE) was not reported, we calculated it from the prevalence by using the following formula: SE = √P (1–P)/N and 95% CI = P±1.96 × SE, where P is the prevalence, N is the sample size or included PLWHA.

Meta-analysis was done by using Review Manager Software (version 5.3; the Cochrane Collaboration, 2014) and Compressive Meta-analysis Software (version 2.2). Heterogeneity of studies was assessed using Cochran’s Q (reported as χ2, P-values, and degrees of freedom [df]) and I2 statistics, which described the percentage of total variation between studies that were due to inconsistency rather than chance.14 Unlike Q, I2 is inherently dependent on the number of studies included in the review: its values of 25%, 50%, and 75% show low, moderate, and high degrees of heterogeneity, respectively. We also used inverse variance, random-effects model and proportion for the effect size estimate. Unlike fixed-effects model, random-effects model enabled us to see within and between study variations using Kendall’s τ2.15 Sensitivity analysis and subgroup analysis were also performed. Funnel plot was used to see the possibility of publication bias and statistical tests of Egger’s regression analysis and Begg’s rank correlation analysis.16 We used forest plot to summarize the effect size. Finally, we used PRISMA standard for reporting.17

Results

Study characteristics

In our search, we found 341 records. After the removal of duplicates and initial screening of titles and abstracts, we identified 121 potential full-text articles for eligibility. After screening the full-text articles, we included 31 studies in the review with 28,659 HIV-positive people (Figure 1).

Figure 1.

Figure 1

Study flow.

Notes: The number of studies and the sample size contributed by 12 countries from SSA that had included studies were as follows: ten studies with 2,837 people with HIV/AIDS were from Ethiopia,1827 four each were from Nigeria (2,042)2831 and South Africa (13,929),3235 and three were from Cameroon (2,246).11,36,37 Two each were from Uganda (245)38,39 and Zambia (471),40,41 one each was from Tanzania (175),42 Benin (521),43 Burkina Faso (112),44 Malawi (5,561),45 Kenya (846),46 and Gabon (205)47 (Table 1).

Abbreviations: EPTB, extrapulmonary TB; TB, tuberculosis.

Methodological quality assessment of included studies

The methodological quality assessments of studies were assessed by using JBI critical appraisal. As per the standard, the study that had optimum quality that was above the mean for “yes” was included (Table 2).

Table 2.

Critical appraisal results of studies of EPTB among PLWHA by using JBI prevalence critical appraisal checklist, SSA, 2017

Study Q1 Q2 Q3 Q4 Q5 Q6 Q7 Q8 Q9 Q10 Total
Y N U
Ade et al43 Y Y Y Y Y Y Y Y N Y 9 1 0
Adejumo et al30 N N U Y Y Y Y Y N N 5 4 1
Affusim et al29 Y Y Y Y Y Y Y Y Y U 9 0 1
Agbor et al11 Y Y Y Y Y Y Y Y Y Y 10 0 0
Alemie and Gebreselassie18 U Y N U Y Y U Y Y Y 6 2 2
Amare19 Y Y Y Y Y N N Y Y Y 8 2 0
Gebreegziabher et al20 Y Y Y Y U Y Y Y Y Y 9 0 1
Daniel et al28 Y Y Y Y Y Y Y Y Y Y 10 0 0
Deribew et al21 Y N Y Y Y Y Y Y Y Y 9 1 0
Esmael et al22 Y Y Y Y Y Y Y Y Y Y 10 0 0
Feldacker et al45 Y Y Y Y Y Y Y Y Y Y 10 0 0
Gupta et al32 Y Y Y Y Y Y Y Y Y Y 10 0 0
Hailu et al23 Y U Y Y Y Y Y Y Y Y 9 0 1
Hoffmann et al33 Y Y Y Y Y Y Y Y Y Y 10 0 0
Iliyasu and Babashani31 Y Y Y Y Y Y Y Y N Y 9 1 0
Kamenju and Said42 Y Y N Y Y Y Y Y U Y 8 1 1
Malkin et al44 Y Y Y Y Y Y Y Y Y Y 10 0 0
Mekonnen et al24 Y U U Y Y Y Y Y U Y 7 0 3
Muttai et al46 Y Y U Y Y Y Y Y Y Y 9 0 1
Namme et al36 Y N U Y Y Y Y Y Y Y 8 1 1
Njozing et al37 Y Y Y Y Y N N Y Y Y 8 2 0
Ocama et al38 Y Y Y Y Y Y Y Y Y Y 10 0 0
Nglazi et al34 Y Y Y Y Y Y Y Y Y Y 10 0 0
Siddiqi et al40 Y Y U Y Y Y Y Y Y Y 9 0 1
Skogmar et al25 Y Y Y Y Y Y Y Y Y Y 10 0 0
Tarekegne et al26 Y Y Y Y Y Y Y Y Y Y 10 0 0
Wobudeya et al39 Y Y Y Y Y Y Y Y Y Y 10 0 0
Yassin et al27 Y Y U Y Y Y Y Y Y Y 9 0 1
Sinkala et al41 Y Y Y Y Y Y Y Y Y Y 10 0 0
Stolp et al47 Y Y Y Y Y Y Y Y U Y 9 0 1
van der Plas et al35 Y Y U Y Y Y Y Y Y Y 9 0 0

Abbreviations: EPTB, extrapulmonary tuberculosis; JBI, Joanna Briggs Institute; N, number; PLWHA, people living with HIV/AIDS; Q, question; SSA, sub-Saharan Africa; U, unclear; Y, yes.

Meta-analysis

Our primary meta-analyses aimed to summarize the prevalence of EPTB among PLWHA.

On meta-analysis, data of 28,659 PLWHA as a sample were used to estimate the proportion of EPTB. The summary effect or pooled proportional estimate of meta-analysis of EPTB among PLWHA was found to be 20% (95% CI: 17, 22; heterogeneity: τ2=0; χ2=509.09, df=30, P<0.00001; I2=94%; Figure 2).

Figure 2.

Figure 2

Forest plot including all available relevant studies on EPTB among PLWHA in SSA, 2017.

Abbreviations: df, degrees of freedom; EPTB, extrapulmonary tuberculosis; PLWHA, people living with HIV/AIDS; SE, standard error; SSA, sub-Saharan Africa.

Sensitivity analysis

For the statistical fidelity, sensitivity analysis was performed using Compressive Meta-Analysis Software by removing one study while keeping the others in random-effects model, and by excluding one large study,32 the prevalence estimate of EPTB among PLWHA was not changed, 20% (95% CI: 17, 23; heterogeneity: τ2=0.01; χ2=507.37, df=29, P<0.00001; I2=94%; Table 3).

Table 3.

Heterogeneity assessment summary by using sensitivity and subgroup analyses, SSA, 2017

Subgroup analysis (PICO) Number of studies Prevalence of EPTB (95% CI), random-effects model Heterogeneity
τ2 I2 (%) P-value (Q)
Overall 31 20% (17, 22) 0 94 <0.00001
Sensitivity analysis by removing one large study 30 20% (17, 23) 0.01 94 <0.00001
Clinical heterogeneity by age groups
Children <15 years
Adults >15 or >18 years
All age groups
3
7
21
17% (3, 31)
23% (14, 32)
18% (16, 19)
0.01
0.01
0
97
97
86
<0.00001
<0.00001
<0.00001
Clinical heterogeneity by EPTB types
Different EPTB
TB of lymph node
TB of hepatic or TB of abdomen
27
2
2
22% (19, 25)
14% (12, 16)
One each, not estimated
0.01
0
97
0
<0.00001
0.65
Methodological heterogeneity by study design
Cross-sectional
Retrospective record review
Retrospective cohort
Prospective cohort
9
14
5
2
20% (13, 27)
19% (16, 22)
23% (17, 29)
16% (11, 20)
0.01
0
0
0
96
91
97
36
<0.00001
<0.00001
<0.00001
0.21
By subregion of SSA
Eastern SSA
Southern SSA
Western SSA
Central SSA
16
4
10
1
20% (16, 23)
21% (15, 26)
19% (13, 24)
Not estimated
0
0
0.01
92
92
96
<0.00001
<0.00001
<0.00001
By countries of SSA having ≥ two studies
Ethiopia
Nigeria
Cameroon
South Africa
Uganda
Zambia
Others
10
4
3
4
2
2
6
23% (17, 29)
15% (7, 24)
25% (12, 37)
17% (14, 20)
12% (7, 17)
15% (12, 18)
17% (14, 20)
0.01
0.01
0.01
0
0
0
0
93
94
97
84
35
0
84
<0.00001
<0.00001
<0.00001
0.0003
0.21
0.74
<0.0001
Study time variation
1990–2000
2001–2010
2011–2017
1
3
27
Not estimated
19% (3, 34)
20% (18, 23)
0.02
0
94
94
<0.00001
<0.00001

Abbreviations: EPTB, extrapulmonary tuberculosis; PICO, people, intervention, comparison, outcomes; SSA, sub-Saharan Africa; TB, tuberculosis.

Subgroup analysis

Subgroup analysis was done to find heterogeneity based on age, types of EPTB, study design, subregion of SSA, and countries having two or more studies and the time variation. For instance, by study population age group, inconsistency of the estimate was not removed, the EPTB among PLWHA did not vary by age group when we compared children <15 years,23,28,39 adults ≥15 years11,21,46 or ≥18 years25,29,33 and all age groups in remaining 21 studies (Table 3).

Effect of publication year on estimate

To determine the effect of year of publications on EPTB prevalence estimate among PLWHA, we performed meta-regression using Compressive Meta-analysis (CMA) Software. We observed that publication year increased by a year and the point estimate of EPTB prevalence among PLWHA increased with 0.4% at 95% CI (0.2, 0.6%), P=0.00067 (Figure 3).

Figure 3.

Figure 3

Scatter plot showing the effect of publication year on point estimate of prevalence of EPTB among PLWHA, SSA, 2017.

Abbreviations: EPTB, extrapulmonary tuberculosis; PLWHA, people living with HIV/AIDS; SSA, sub-Saharan Africa.

Publication bias

We assessed publication bias using CMA Software through funnel plot and regression tests with random-effects model for included studies (Figure 4). There was no publication bias. In addition, we performed statistical test, and no evidence of publication bias was observed (P=0.44 for Egger’s regression analysis; P=0.11 for Begg’s rank correlation analysis).

Figure 4.

Figure 4

Funnel plot for SE by point estimate (A) for included studies (B) and input studies that shown similar pooled estimate.

Abbreviation: SE, standard error.

Discussion

In our systematic review and meta-analysis of EPTB among PLWHA, we selected 31 studies with 28,659 HIV/AIDS people. Our main findings showed that there was a high and diverse prevalence of EPTB among PLWHA in SSA which ranged from 6.4% (95% CI: 3.8, 9.0) in Nigeria29 to 36.8% (95% CI: 28.6, 45.0) in Ethiopia.19 The overall pooled estimate prevalence of EPTB among PLWHA was 20% (95% CI: 17, 22; heterogeneity: τ2=0; χ2=509.09, df=30, P<0.00001; I2=94%).

This is high when we compared with the prevalence estimate of EPTB among notified TB cases in Africa. According to the WHO report of 2017, the prevalence of EPTB in Africa and world was 16% and 15%, respectively, among notified TB cases in 2016.1 From the WHO report of 2017, we observed the prevalence of EPTB among notified TB cases for respective sub-Saharan countries, when we compared SSA by the geographical area, the eastern SSA was the lead, followed by Southern SSA, and the western was the least. One-third of the studies (ten of 31 studies) were conducted in Ethiopia, with highest prevalence of EPTB (32%) from SSA in notified TB cases, followed by Malawi 26%, Tanzania 21%, Zambia 18%, Burkina Faso, Kenya and Cameroon each 17%, South Africa 10%, Uganda 8%, and Nigeria 5%.1

However, the pooled prevalence of EPTB among PLWHA in subregions of SSA showed a slight difference with highest from southern SSA, 21% (95% CI: 15, 26); followed by eastern SSA, 20% (95% CI: 16, 23), and finally, western SSA, 19% (95% CI: 13, 24). This might be explained that the prevalence of HIV in population was high for the countries with evidence that included in the synthesis. That is, in 2016, SSA had the highest HIV/AIDS burden by sharing 70% (25.5 million) of 36.7 million people living with HIV, 64% of 1.8 million newly infected, and 73% of 1.0 million deaths worldwide.2 The HIV/AIDS burden varies among subregions of SSA countries as eastern and southern Africa is the region hardest hit by HIV/AIDS with lion share, 53% of 36.7 million PLWHA and western and central Africa shares 17%, making 70% of PLWHA in SSA.2

In SSA, the pooled estimate of prevalence of EPTB among PLWHA by countries having two or more studies in subgroup analysis showed higher when compared with estimated prevalence of EPTB among notified TB cases for Africa, 16%. For instance, in Cameroon from western Africa with three studies, the pooled prevalence was 25% (95% CI: 12, 37), which was more than national estimate 17%, in Ethiopia from eastern with 10 studies was 23% (95% CI: 17, 29) that was less than national estimate of 32%, and South Africa was 17% (95% CI: 14, 20) more than national estimate 10%,1 but comparable with study done in respective countries.

Although the clinical presentations of TB among PLWHA vary by stage of HIV-positive individuals, TB is the common disease among them.48 At an early stage of HIV infection, the ratio of PTB to EPTB is 80:20 and at late stage is 50:50.49 In SSA, TB is often the first manifestation of HIV infection, and it is the leading cause of death among HIV-infected individuals.50 Similarly, HIV infection is one of the most important risk factors associated with an increased risk of latent TB infection progressing to active TB disease. While only 10% of immunocompetent individuals infected with M. tuberculosis go on to develop active disease in their lifetime; 50% of those coinfected with HIV develop active TB.51

To reduce the burden of TB, the WHO’s policy on collaborative TB/HIV activities recommends a combination of measures among HIV-infected individuals. These measures include intensified case finding, isoniazid preventive therapy, and infection control and antiretroviral therapy.7

Although good progress was made in countries of SSA for intensified TB case findings among HIV-positive individuals or vice versa, still more intensified case finding of TB among PLWHA shall be performed. More over, if TB screened among PLWHA, the documentation was low as 18% in Africa, thus, documentation needs more focus in Africa.1 In addition, the SSA that had reviewed studies had not fulfilled the three 90th objectives, which is to indicate that, the 1st 90 means 90% of people who are living with HIV, know their HIV status(positive or negative), the 2nd 90 means 90% of people living with HIV are on ART treatment, and the 3rd 90 means among people using ART, 90% of their virus is suppressed.2

These findings are potentially important from a public health perspective since it suggests that more attention should be paid to screen EPTB among PLWHA, especially in countries with high EPTB in population of SSA (eg, Ethiopia and Malawi) and high HIV prevalence in population (eg, southern African countries).

Our sensitivity analyses showed that our overall results had no difference when we excluded one study with largest sample size.32 The heterogeneity was substantial (I2=94%), and we performed subgroup analysis by age group, types of EPTB, study design, time period, subregion, and countries having two or more studies and observed reduced or zero heterogeneity (Table 3). Thus, we explored and investigated the sources of inconsistence and finally performed the pooled estimate. We determined the effect of publication year on effect estimate that also one of the sources of heterogeneity. We expected the clinical variation as EPTB could be varied based on the organ involved, and in the way that the setting at which laboratory investigation performed, by whom and by how many people performed and interpreted. In reviewed studies, there was study design variations. Some studies we reviewed were performed with retrospective review of medical records, this results in underestimating the prevalence of EPTB among PLWHA. Others could be conducted with cross-sectional design in which comes the difficulty to judge which comes first.52 Similarly, at the analysis stage, appropriate analysis was not conducted in some studies that is why we excluded some studies when the prevalence of EPTB was not calculated, or not clear, and/or no data.

Overall, the bias that could possibly occur in some of the individual studies included in our review was selection bias that resulted from primary exposure or outcome measurement as the diagnosis of EPTB is challenging.6 Especially, in HIV-positive individuals, TB is atypical, and some facilities where the studies conducted were at health centers or similar. In these facilities, the required material or profession might not present, and in some studies the HIV statuses of some EPTB patients were unknown.

Second, selection bias could occur at design stage, in which a majority of evidence suggested that 19 out of 31 studies were retrospective in nature. In this case, authors were endorsed to underway studies with entry criteria majorly including those records that had complete data and excluded incomplete that could lead to nonresponse or missed variables or cases even without indicating the proportion of incomplete records.53 Finally, the information bias particularly during data collection time could be committed in some studies included in the review as mentioned earlier, because more than half of the studies involved data abstraction from article-based register without piloting or standardizing data abstraction checklists in addition to poor data handling practice in low-income developing countries.54 Thus, in both cases, the prevalence of EPTB among PLWHA, we found in this review, could have been underestimated. For future study, we recommend that further details on exposures and outcome measurement, samples and sampling techniques, and analysis are required.

However, our study has derived its strengths from its capability of having estimating EPTB among PLWHA in double burdened and leading continent, Africa, although not without limitation. As there were diverse and overlapping diagnostic techniques that had been performed in studies we reviewed, we could not perform the analysis of diagnosis that limited us to compare the prevalence of EPTB among PLWHA by diagnostic techniques. In addition, we reviewed articles written and/or published only in English; data published in other languages were not obtained. We therefore recommend collaboration of researchers from different language backgrounds to do a more exhaustive research in the future.

Conclusion

We can conclude from our analyses that the prevalence of EPTB among PLWHA was high. It is necessary to give emphasis for EPTB rather than assuming as a rare event and focusing only on PTB, specifically, when screening TB among PLWHA, widening the spectrum of screening to include all common EPTB types in countries with high EPTB and/or HIV prevalence in the population.

Table 1.

Characteristics of the studies included in the systemic review in SSA, 2017

Study Country Population characteristics Setting EPTB investigation Study types Date Sample size or total included (HIV/AIDS) Event
Ade et al43 Benin All EPTB and new PTB patients with or without HIV and all age groups Hospital As per national program Retrospective cohort January to December 2011 521 72
Adejumo et al30 Nigeria All TB patients with or without HIV and all age groups UBTH Diagnosed as per Nigerian national program Retrospective review of treatment cards of patients January 1, 2014, to December 31, 2014 72 10
Affusim et al29 Nigeria All HIV-positive TB patients, >18 years Teaching hospital As per national program Cross-sectional January to April 2007 330 21
Agbor et al11 Cameroon All HIV/TB patients and inpatients, aged ≥15 years Hospital As per national program Cross-sectional January 1, 2006, to June 30, 2013 335 119
Alemie and Gebreselassie18 Ethiopia All TB patients with or without HIV and all age groups Private health institution As per national program Cross-sectional In the year 2008/2009 159 52
Amare19 Ethiopia All children with TB aged <15 years with or without HIV Private, public (primary, secondary, tertiary) As per national TB program, for histological and radiological performance Retrospective cohort January 1, 2012, to December 31, 2013 133 49
Gebreegziabher et al20 Ethiopia All TB patients with or without HIV and all age groups 30 public health facilities As per national guidelines Retrospective cohort study July 2007 and June 2012 753 249
Daniel et al28 Nigeria All TB patients with or without HIV and all age groups Hospital Culture and/or sputum smear, rapid test for HIV Retrospective review January 1, 1991, to December 31, 1991 320 23
Deribew et al21 Ethiopia All adult ≥15-year TB patients with or without HIV Health centers TB lymphadenitis was diagnosed based on clinical parameters and cytological examination Cross-sectional February 2009 to March 2009 81 10
Esmael et al22 Ethiopia All TB patients with or without HIV and all age groups Referral hospital AFB, chest radiographs, and for EPTB, pathological examination Retrospective record review June 2008 to August 2013 321 51
Feldacker et al45 Malawi All TB patients with or without HIV and all age groups TB/HIV integrated clinic Bacteriological or histopathological, opt-out HIV testing Retrospective cohort January 2008 to December 2010 5,561 1,117
Gupta et al32 South Africa All TB patients with or without HIV and all age groups Electronic TB registry ICD-10 classification used for EPTB, serology for HIV Retrospective analysis 2009 13,237 2,328
Hailu et al23 Ethiopia All children with TB aged <15 years with or without HIV Health centers Clinical history, chest X-ray, HIV testing, and histopathology Retrospective study January 2007 to December 2011 346 103
Hoffmann et al33 South Africa All adult >18-year HIV-positive patients with liver TB Hospital Clinical, laboratory, and radiography Retrospective study 2001–2009 108 28
Iliyasu and Babashani31 Nigeria All HIV-positive patients with or without TB and all age groups Teaching hospital Biopsy of tissue specimen, TB culture Retrospective review of charts January 2006 to December 2006 138 50
Kamenju and Said42 Tanzania All TB patients with or without HIV and all age groups Hospital Smear, radiological tests, culture, biopsy, or a combination Retrospective cross-sectional analyses August 2008 to July 2009 175 19
Malkin et al44 Burkina Faso All TB patients with or without HIV and all age groups TB center Smear, radiological tests, culture, biopsy, or a combination Cohort study October 1988 to March 1992 112 22
Mekonnen et al24 Ethiopia All TB patients with or without HIV and all age groups Hospital and private clinic Clinical history with X-ray, ultrasound, and/or pathological techniques Retrospective study January 2011 to December 2014 236 78
Muttai et al46 Kenya Adult ≥15-year TB patients diagnosed with HIV+ Hospitals and health centers Not reported Retrospective chart review October 2006 to April 2008 846 145
Namme et al36 Cameroon All TB patients with or without HIV and all age groups Hospital Smear, radiological tests, biopsy, or combination Cross-sectional July 1, 2007, to June 30, 2011 438 108
Njozing et al37 Cameroon All TB patients with or without HIV and all age groups TB/HIV treatment center Clinical and/or radiological, biopsies and laboratory examination of aspirates from affected areas Retrospective cohort January 2006 to December 2007 1,473 206
Ocama et al38 Uganda All HIV-positive patients who suspected for liver disease Teaching hospital Stool analysis, ultrasound-guided liver biopsies Cross-sectional May 2004 to March 2005 77 7
Nglazi et al34 South Africa All TB patients with or without HIV aged ≥15 years Hospital As per national guidelines Retrospective cohort study October 2009 and June 2011 472 159
Siddiqi et al40 Zambia All HIV-positive patients with a CNS infection requiring a LP Teaching hospital Receiving an LP microscopy, culture, Gram stain, and India ink testing on CSF Cross-sectional study October 1, 2010 to May 31, 2012 331 48
Skogmar et al25 Ethiopia All TB patients with or without HIV and ≥18 years old Hospitals and health centers As per national program Cross-sectional study September 2010 to March 2012 307 91
Tarekegne et al26 Ethiopia All TB patients with or without HIV and all age groups Hospital Pathological examination and/or clinical symptoms Retrospective study September 2009 to August 2012 404 58
Wobudeya et al39 Uganda All children with TB aged <15 years with or without HIV Five districts As per national program and WHO Retrospective cross-sectional study January 1, 2009, to December 31, 2010 168 24
Yassin et al27 Ethiopia All TB patients with or without HIV and all age groups District hospital Sputum microscopy, X-ray facilities Prospective cohort Not reported 97 10
Sinkala et al41 Zambia All abdominal TB and HIV positive University Teaching Hospital, Lusaka, Zambia Culture and/or granulomatous on histopathological examination microscopy Cross-sectional study September 2005 until May 2006 140 22
Stolp et al47 Gabon All TB with or without HIV and all age groups Albert Schweitzer Hospital, Lambarene, Gabon Neelsen-stained sputum smear or on clinical grounds, HIV test Retrospective study January 2007 to December 2012 205 40
van der Plas et al35 South Africa Adults (>18 years), hospitalized HIV and PTB or EPTB patients, not on ART BCH, Cape town Smear or culture, WHO guidelines, smear negative or EPTB in HIV-1-infected people Prospective observational cohort April 29, 2009, until February 28, 2011 112 20

Abbreviations: AFB, acid-fast bacilli; ART, antiretroviral therapy; BCH, Brooklyn Chest Hospital; CNS, central nervous system; CSF, cerebrospinal fluid; extrapulmonary TB; LP, lumbar puncture; PTB, pulmonary TB; SSA, sub-Saharan Africa; TB, tuberculosis; UBTH, University of Benin Teaching Hospital.

Footnotes

Disclosure

The authors report no conflicts of interest in this work.

References

  • 1.World Health Organization . Global Tuberculosis Report. Geneva: World Health Organization; 2017. 2017. Licence: CC BY-NCSA 3.0 IGO. [Google Scholar]
  • 2.UNAIDS Joint United Nations Programme on HIV/AIDS (UNAIDS) Geneva: UNAIDS; 2017. [PubMed] [Google Scholar]
  • 3.Ait-Khalid N, Alarcon E, Armengol R, et al. Management of Tuberculosis: A Guide to Essentials of Good Practice. 6th edn. Paris, France: International Union Ageinest Tuberculosis and Lung Disease; 2010. [Google Scholar]
  • 4.World Health Organization . TB/HIV Clinical Manual. Geneva, Switzerland: World Health Organization; 2004. [Google Scholar]
  • 5.Wani RS. Clinical manifestations of pulmonary and extra-pulmonary tuberculosis. South Sudan Med J. 2013;6(3):52–56. [Google Scholar]
  • 6.World Health Organization . Diagnosis and Treatment of Smear-Negative Pulmonary and Extrapulmonary Tuberculosis Among Adults and Blescents. Geneva, Switzerland: World Health Organization; 2007. [Google Scholar]
  • 7.World Health Organization . Collaborative TB/HIV Activities Guidelines for National Programmes and Other Stake Holders. Geneva, Switzerland: World Health Organization; 2012. [Google Scholar]
  • 8.Dheda K, Ruhwald M, Theron G, Peter J, Yam WC. Point-of-care diagnosis of tuberculosis: Past, present and future. Asian Pacific Soc Respir. 2012;18:217–232. doi: 10.1111/resp.12022. [DOI] [PubMed] [Google Scholar]
  • 9.World Health Organization . Global Tuberculosis Report. Geneva, Switzerland: World Health Organization; 2016. [Google Scholar]
  • 10.Sinkala E, Gray S, Zulu I, et al. Clinical and ultrasonographic features of abdominal tuberculosis in HIV positive adults in Zambia. BMC Infect Dis. 2009;9:44–51. doi: 10.1186/1471-2334-9-44. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Agbor AA, Bigna JJ, Billong SC, et al. Factors associated with death during tuberculosis treatment of patients co-infected with HIV at the Yaoundé Central Hospital, Cameroon: an 8-year hospital-based retrospective cohort study (2006–2013) PLoS One. 2014;9(12):e115211. doi: 10.1371/journal.pone.0115211. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Nassikas N, Yang H, Forson A, Kwarteng E, Kwara A. Factors associated with mortality in extrapulmonary tuberculosis patients at a teaching hospital in Ghana. Ghana Med J. 2015;49(4):233–238. [Google Scholar]
  • 13.Joanna Briggs Institute Reviewers’ Manual . The Systematic Review of Prevalence and Incidence Data. South Australia: 2014. [Google Scholar]
  • 14.Thorlund K, Imberger G, Johnston BC, et al. Evolution of heterogeneity (I2) estimates and their 95% confidence intervals in large meta-analyses. PLoS One. 2012;7(7):e39471. doi: 10.1371/journal.pone.0039471. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Higgins JP, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta-analyses. BMJ. 2003;327(7414):557–560. doi: 10.1136/bmj.327.7414.557. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Egger M, Davey Smith G, Schneider M, Minder C. Bias in meta-analysis detected by a simple, graphical test. BMJ. 1997;315(7109):629–634. doi: 10.1136/bmj.315.7109.629. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Moher D, Liberati A, Tetzlaff J, Altman DG, PRISMA Group Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009;6(7):e1000097–6. doi: 10.1371/journal.pmed.1000097. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Alemie GA, Gebreselassie F. Common types of tuberculosis and co-infection with HIV at private health institutions in Ethiopia: a cross sectional study. BMC Public Health. 2014;14:319–323. doi: 10.1186/1471-2458-14-319. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Amare D. Tuberculosis and HIV co-infection among patients on tuberculosis treatment at Fenote Selam District Hospital, Amhara Regional State, Northwest Ethiopia. Global J Med Res. 2015;15(5):2249–4618. [Google Scholar]
  • 20.Gebreegziabher SB, Yimer SA, Bjune GA. Tuberculosis case notification and treatment outcomes in West Gojjam Zone, Northwest Ethiopia: A Five-Year Retrospective Study. J Tuberc Res. 2016;4(1):23–33. doi: 10.1155/2016/2036234. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Deribew A, Negussu N, Melaku Z, Deribe K. Investigation outcomes of tuberculosis suspects in the health centers of Addis Ababa, Ethiopia. PLoS One. 2011;6(4):e18614. doi: 10.1371/journal.pone.0018614. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Esmael A, Tsegaye G, Wubie M, Endris M. Tuberculosis and human immune deficiency virus co-infection in Debre Markos Referral Hospital in Northwest Ethiopia: a five years retrospective study. J AIDS Clin Res. 2013;4(12):263–267. [Google Scholar]
  • 23.Hailu D, Abegaz WE, Belay M. Childhood tuberculosis and its treatment outcomes in Addis Ababa: a 5-years retrospective study. BMC Pediatr. 2014;14:61–67. doi: 10.1186/1471-2431-14-61. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Mekonnen D, Awoke D, Endalkachew D. Tuberculosis and human immunodeficiency virus in western Burkina Faso: clinical presentation and clinical evaluation. BMC Res Notes. 2015;8:666–671. [Google Scholar]
  • 25.Skogmar S, Balcha TT, Jemal ZH, et al. Development of a clinical scoring system for assessment of immunosuppression in patients with tuberculosis and HIV infection without access to CD4 cell testing--results from a cross-sectional study in Ethiopia. Glob Health Action. 2014;7:23105–23110. doi: 10.3402/gha.v7.23105. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Tarekegne D, Jemal M, Atanaw T, et al. Prevalence of human immunodeficiency virus infection in a cohort of tuberculosis patients at Metema Hospital, Northwest Ethiopia: a 3 years retrospective study. BMC Res Notes. 2016;9:192–197. doi: 10.1186/s13104-016-2004-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Yassin MA, Takele L, Gebresenbet S, et al. HIV and tuberculosis coinfection in the southern region of Ethiopia: a prospective epidemiological study. Scand J Infect Dis. 2004;36(9):670–673. doi: 10.1080/00365540410020848. [DOI] [PubMed] [Google Scholar]
  • 28.Daniel OJ, Adejumo OA, Gidado M, Abdur-Razzaq HA, Jaiyesimi EO. HIV-TB co-infection in children: associated factors and access to HIV services in Lagos, Niger. Public Health Action. 2015;5(3):165–169. doi: 10.5588/pha.15.0027. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Affusim CC, Kesieme E, Abah VO. The Pattern of presentation and prevalence of tuberculosis in HIV-seropositive patients seen at Benin City, Nigeria. Int Scholar Res Network. 2012:1–6. [Google Scholar]
  • 30.Adejumo OA, Daniel OJ, Otesanya AF, et al. Factors associated with TB/HIV co-infection among drug sensitive tuberculosis patients managed in a secondary health facility in Lagos, Nigeria. Afr J Infect Dis. 2017;11(2):75–82. doi: 10.21010/ajid.v11i2.10. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Iliyasu Z, Babashani M. Prevalence and predictors of tuberculosis coinfection among HIV-seropositive patients attending the Aminu Kano Teaching Hospital, northern Nigeria. J Epidemiol. 2009;19(2):81–87. doi: 10.2188/jea.JE20080026. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Gupta RK, Lawn SD, Bekker LG, Caldwell J, Kaplan R, Wood R. Impact of human immunodeficiency virus and CD4 count on tuberculosis diagnosis: analysis of city-wide data from Cape Town, South Africa. Int J Tuberc Lung Dis. 2013;17(8):1014–1022. doi: 10.5588/ijtld.13.0032. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Hoffmann CJ, Hoffmann JD, Kensler C, et al. Tuberculosis and hepatic steatosis are prevalent liver pathology findings among HIV-infected patients in South Africa. PLoS One. 2015;10(2):e0117813. doi: 10.1371/journal.pone.0117813. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Nglazi MD, Bekker LG, Wood R, Kaplan R. The impact of HIV status and antiretroviral treatment on TB treatment outcomes of new tuberculosis patients attending co-located TB and ART services in South Africa: a retrospective cohort study. BMC Infect Dis. 2015;15:536–543. doi: 10.1186/s12879-015-1275-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.van der Plas H, Meintjes G, Schutz C, et al. Complications of antiretroviral therapy initiation in hospitalised patients with HIV-associated tuberculosis. PLoS One. 2013;8(2):e54145. doi: 10.1371/journal.pone.0054145. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Namme LH, Solange DM, Bertrand MN, Elvis T, Ach JH, Christopher K. Extrapulmonary Tuberculosis and HIV co infection in patients treated for tuberculosis at the Doula Hospital in Cameroon. Ann Tropical Med Public Health. 2013;6(1):100–104. [Google Scholar]
  • 37.Njozing NB, Miguel SS, Tih PM, Hurtig AK, Karin HA. Assessing the accessibility of HIV care packages among tuberculosis patients in the Northwest Region, Cameroon. BMC Public Health. 2010;10:129–139. doi: 10.1186/1471-2458-10-129. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Ocama P, Katwere M, Piloya T, et al. The spectrum of liver diseases in HIV infected individuals at an HIV treatment clinic in Kampala, Uganda. Afr Health Sci. 2008;8(1):8–12. [PMC free article] [PubMed] [Google Scholar]
  • 39.Wobudeya E, Lukoye D, Lubega IR, Mugabe F, Sekadde M, Musoke P. Epidemiology of tuberculosis in children in Kampala district, Uganda, 2009-2010; a retrospective cross-sectional study. BMC Public Health. 2015;15:967–1004. doi: 10.1186/s12889-015-2312-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Siddiqi OK, Ghebremichael M, Dang X, et al. Diagnosis of central nervous system opportunistic infections in HIV-infected Zambian adults. Clin Infect Dis. 2014;58(12):1771–1777. doi: 10.1093/cid/ciu191. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Sinkala E, Gray S, Zulu I, et al. Clinical and ultrasonographic features of abdominal tuberculosis in HIV positive adults in Zambia. BMC Infect Dis. 2009;9:44–51. doi: 10.1186/1471-2334-9-44. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Kamenju P, Said A. Tuberculosis-HIV co-infection among patients admitted at Muhimbili National Hospital in Dares salaam, Tanzania. Tanzania J Health Res. 2011;13(1):25–31. doi: 10.4314/thrb.v13i1.60682. [DOI] [PubMed] [Google Scholar]
  • 43.Ade S, Harries AD, Trébucq A, et al. National profile and treatment outcomes of patients with extrapulmonary tuberculosis in Bénin. PLoS One. 2014;9(4):e95603. doi: 10.1371/journal.pone.0095603. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Malkin JE, Prazuck T, Simonnet F, et al. Tuberculosis and human immunodeficiency virus in western Burkina Faso: clinical presentation and clinical evaluation. Int J Tubercul Lung Dis. 1999;1(1):68–74. [PubMed] [Google Scholar]
  • 45.Feldacker C, Tweya H, Keiser O, et al. Characteristics of adults and children diagnosed with tuberculosis in Lilongwe, Malawi: findings from an integrated HIV/TB clinic. Trop Med Int Health. 2012;17(9):1108–1116. doi: 10.1111/j.1365-3156.2012.03041.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Muttai H, Laserson KF, Akello I, et al. Antiretroviral therapy uptake among adult tuberculosis patients newly diagnosed with HIV in Nyanza Province, Kenya. Public Health Action. 2013;3(4):286–293. doi: 10.5588/pha.13.0072. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Stolp SM, Huson MA, Janssen S, Beyeme JO, Grobusch MP. Tuberculosis patients hospitalized in the Albert Schweitzer Hospital, Lambaréné, Gabon-a retrospective observational study. Clin Microbiol Infect. 2013;19(11):E499–E501. doi: 10.1111/1469-0691.12278. [DOI] [PubMed] [Google Scholar]
  • 48.Leeds IL, Magee MJ, Kurbatova EV, et al. Site of extrapulmonary tuberculosis is associated with HIV infection. Clin Infect Dis. 2012;55(1):75–81. doi: 10.1093/cid/cis303. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Sharma SK, Mohan A, Kadhiravan T. HIV-TB co-infection: epidemiology, diagnosis & management. Indian J Med Res. 2005;121(4):550–567. [PubMed] [Google Scholar]
  • 50.Corbett EL, Marston B, Churchyard GJ, de Cock KM. Tuberculosis in sub-Saharan Africa: opportunities, challenges, and change in the era of antiretroviral treatment. Lancet. 2006;367(9514):926–937. doi: 10.1016/S0140-6736(06)68383-9. [DOI] [PubMed] [Google Scholar]
  • 51.Adeiza M, Okpapi J, Abba A. HIV-Associated tuberculosis: A sub-Saharan African perspective. Sub-Saharan Afr J Med. 2014;1(1):1–14. [Google Scholar]
  • 52.Song JW, Chung KC. Observational studies: cohort and case-control studies. Plast Reconstr Surg. 2010;126(6):2234–2242. doi: 10.1097/PRS.0b013e3181f44abc. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Benchimol EI, Smeeth L, Guttmann A, et al. The Reporting of studies Conducted using Observational Routinely-collected health Data (RECORD) statement. PLoS Med. 2015;12(10):e1001885. doi: 10.1371/journal.pmed.1001885. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Vassar M, Holzmann M. The retrospective chart review: important methodological considerations. J Educ Eval Health Prof. 2013;10:12–18. doi: 10.3352/jeehp.2013.10.12. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from HIV/AIDS (Auckland, N.Z.) are provided here courtesy of Dove Press

RESOURCES