Abstract
Despite effectiveness of antiretroviral therapy in reducing mortality of opportunistic infections among HIV infected children, however tuberculosis (TB) remains a significant cause for morbidity and attributed for one in every three deaths. HIV-infected children face disproportionate death risk during co-infection of TB due to their young age and miniatures immunity makes them more vulnerable. In Ethiopia, there is lack of aggregated data TB and HIV mortality in HIV infected children. We conducted an extensive systematic review of literature using Preferred Reporting of Systematic Review and Meta-Analysis (PRISMA) guideline. Five electronic databases were used mainly Scopus, PubMed, Medline, Web of Science, and Google scholar for articles searching. The pooled proportion of TB was estimated using a weighted inverse variance random-effects meta-regression using STATA version-17. Heterogeneity of the articles was evaluated using Cochran’s Q test and I2 statistic. Subgroup analysis, sensitivity test, and Egger’s regression were conducted for publication bias. This met-analysis is registered in Prospero-CRD42024502038. In the final met-analysis report, 13 out of 1221 articles were included and presented. During screening of 6668 HIV-infected children for active TB occurrence, 834 cases were reported after ART was initiated. The pooled proportion of active TB among HIV infected children was found 12.07% (95% CI: 10.71–13.41). In subgroup analysis, the Oromia region had 15.6% (95%CI: 10.2–20.6) TB burden, followed by southern Ethiopia 12.8% (95%CI: 10.03–15.67). During meta-regression, missed isoniazid Preventive therapy (IPT) (OR: 2.28), missed contrimoxazole preventive therapy (OR: 4.26), WHO stage III&IV (OR: 2.27), and level of Hgb ≤ 10gm/dl (OR = 3.11.7) were predictors for active TB. The systematic review found a higher proportion of active TB in HIV-infected children in Ethiopia compared to estimated rates in end TB strategy. To prevent premature death during co-infection, implement effective TB screening and cases tracing strategies in each follow up is needed.
Introduction
People living with the Human Immune deficiency virus (PLHIV) are more susceptible to tuberculosis (TB), which is a leading cause of mortality [1, 2]. There is a strong synergy between HIV infection and TB, while PLHIV is at high risk of dying from TB and HIV infection is the biggest risk factor for active TB incidence through declining cellular immunity and increased endogenous reactivation of latent TB bacilli in the lungs [3, 4]. HIV infected children are at increased risk of acquiring active TB. HIV-infected persons are sixteen times more likely to be co-infected by TB disease as compared to HIV-negative person [5].
Tuberculosis continued to be the leading cause of morbidity and mortality for people living with HIV (PLHIV) worldwide [6]. Globally, in 2022, an estimated 1.3 million children (aged 0–14 years) were diagnosed with TB, accounting for approximately 12% of the total TB cases of 10.6 million [5, 7]. The co-infection of HIV and TB is particularly dangerous, with around 214,000 children dying from TB disease in 2022 where 31,000 of those were attributed to children TB and HIV infections [5]. The burden of TB infection varies significantly across each continents, African and Southeast Asian regions attributed for 81% of global TB deaths in 2022 [8]. In Sub-Saharan African countries, 10% to 15% of HIV-infected children suffer from the dual burden of HIV and TB, with a lifetime risk of 21% and two-thirds of cases remain undiagnosed [5, 9–11].
By the end of 2022, only 46% of children (aged 0–14 years) who were receiving antiretroviral therapy (ART) were able to achieve viral load suppression, which is a crucial factor in reducing the occurrence of new opportunistic infections [5, 8, 11]. However, TB infection remains responsible for one in every third deaths of HIV infected children in source-limited setting [7, 12, 13]. Ethiopia is one of the top 30 countries burdened by tuberculosis (TB) and experiences a significant distribution of TB and HIV co-infection across all regions. The incidence rates was estimated as 0.17 cases per 1000 population for HIV and 1.64 per 1000 for TB [1, 2]. Previous national level study finding among 1,830,880 HIV and 192,359 TB patients reported,7.34% of TB patient had HIV infection with a significant regional variation across regions [14]. The prevalence of TB/HIV co-infection varies considerably in across each regions including 7.2% in Amhara region (Northern Ethiopia) [15] to 23.6% southern Ethiopian (SNNR) [16]. The differences in healthcare accessibility and socio-demographic factors including wealth index and literacy rate contribute to variations in TB/HIV co-infection prevalence [14]. HIV-infected children face a higher risk of morbidity and mortality during co-infection due to their young age and immature immune makes them more vulnerable [4, 17].
Previous studies finding in Ethiopia [7, 18, 19] reported that multifactorial causative factors were attributed for active TB occurrence among HIV infected children including underweight, advanced WHO clinical stages, missed IPT and CPT [5, 7, 13, 20]. However, CD4 count being ≤200 cells/ml serves as a proxy indicator for incidence of active TB [13]. Concomitant administration of ART with isoniazid preventive Therapy (IPT) had significantly effect of reducing active TB cases by over 80% HIV infected Children [21]. However, IPT completion rate and adherence of ART has affected by caregivers and regimen characteristic [18]. Although several small-scale studies have reported on the epidemiology of TB/HIV co-infection among HIV-infected children in various parts of Ethiopia [5, 12, 13]; however, there is a lack of aggregated data on co-infection after HIV-infected children started antiretroviral therapy. Therefore, this systematic review and meta-analysis aimed to estimate the pooled burden of active TB among HIV-infected children.
Methods
Study area and setting
This study was conducted in Ethiopia from January 1, 2013, to December 30, 2022, spanning a period of 10 years. In Ethiopia, there are nine regions including Tigray, Afar, Amhara, Oromia, SNNR, Somalia, Gambella, Benishangul Gumuz, Harari and two city administrative [13].
Searching strategy and protocol
The Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) guideline was followed to report the findings of the selected articles presented clearly described in (S1 Checklist) [22].
Additionally, this systematic review and meta-analysis have registered in the Prospero protocol with CRD42024502038 (https://www.crd.york.ac.uk/prospero/#recordDetails).
Furthermore, this systematic review was used five international electronic databases were mainly used including Scopus, PubMed, Medline, Web of Science, and Google scholar. The searching was focused on English language published articles and the searching was done. We employed controlled vocabulary terms (MeSH) and free text to extract articles (S1 Text).
The search included topics such as active tuberculosis, pulmonary TB, extra pulmonary TB, HIV infection, individuals, children, pediatrics, neonates, lymphadenitis, disseminated TB, and Ethiopia. The search terms used to identify relevant studies included "Epidemiology" OR "Incidence" OR "Case fatality" "Tuberculosis" OR "Pulmonary Tuberculosis" OR "Disseminated Tuberculosis" OR "Lymphadenitis" AND "HIV" OR "AIDS" AND "Children" OR "Pediatrics" OR "Infant" AND "Ethiopia". Furthermore, this systematic review and meta-analysis employed the PICO (Population, Intervention, Comparison, and Outcomes) framework to assess the eligibility of the articles and enhance evidence-based medicine and research by facilitating the structuring of clinical or research questions. This included as follows (P) Population of interest: Children living with HIV on anti-retroviral therapy in Ethiopia,(I) Intervention; all children HIV infected children started Anti-retroviral therapy, (C) Comparison; children without active TB with stand on HIV cohort (O) Outcome of interest: active TB in HIV-infected children found in Ethiopia were used for PICO frameworks.
Eligibility criteria
Inclusion criteria
This systematic review and meta-analysis report had included a given articles with defined outcome of any TB types in HIV infected children with the following inclusion criteria. 1) scientific papers reporting co-infections of TB and HIV in HIV-infected children in Ethiopia, 2) articles containing burden or incidence reports of active TB in HIV-infected children, 3) studies published within the past ten years with cross-sectional or cohort designs and published in English, and 4) study subjects limited to children aged ≤15 years.
Exclusion criteria
Studies that reported lacking abstracts and/or full-text, anonymous reports, editorials, and qualitative studies were excluded from the analysis. Furthermore, prior to the analysis, unfitted articles without a journal name and/or author, lacked the year of publication, and citations without abstracts and/or full-text were removed.
Outcome ascertainment
The first outcome was the proportion of active TB cases (including all types of TB) among HIV infected children after anti-retroviral therapy. The proportions of TB burden was calculated by the number of children who developed active TB during on ART treatment divided by the total children from thirteen study and multiplied it by 100. Identifying independent predictors for active TB occurrence in HIV infected children on ART was the second objective. Accordingly, we collected significant predictors reported from included articles with their adjusted odd ratio with its 95% confidence interval was extracted from original studies and to computed the pooled odds ratio for final predictors.
Operational words
Advanced HIV disease
Defined as WHO clinical stages III and IV in children older than five years. However, in children younger than five years living with HIV, they are considered to have advanced HIV disease regardless of their clinical stages. Mild WHO clinical stages refer to stages II and I in HIV-positive children. ART adherence for children; is categorized as follows: Good (>95%) if ≤2 doses are missed out of 30 doses or ≤3 doses out of 60 doses and Fair (85–94%) if 3–4 doses are missed out of 30 doses and poor (<85%) if >5 doses are missed out of 30 doses of ART drug [23].
Data extraction
Four Authors (FK, BN, DT, and TK) extracted articles and evaluated the quality of each study by determining the eligibility based on given criteria for selection of studies. The discussion was used to settle any disagreement or uncertainty that arose during the article extraction and removing duplication process. These reviewers assessed the full-text articles; if one or more of them believed an article could be significant, it qualified after the article was carefully examined its titles, abstracts, and full text by three authors (FK, TK, and DT) used a Microsoft Excel spreadsheet to extract the specifics of each article. Three independent reviewers assessed each included article’s quality using the JBI checklists given for all articles as described in (S1 Table) [24, 25]. All eligible studies approved by all authors’ agreements about principal investigators, year of publication, study period, study setting, study population, and sample size retrieved from the identified articles. The biases of primary studies checked, assessed and screened by three authors (FK, BN and TK), evaluated, and screened (S2 Table). Any disagreements among reviewers regarding the critical appraisal were settled through discussion and building consensus for submission.
Software and statistical-analysis
Using End-Note Aversion 8.1, all detected and potentially suitable published article citations were exported and gathered; duplications were eliminated during the selection and screening processes. Two independent reviewers (FK, and TK) first reviewed the abstracts of the publications before moving on to the full-text articles, which they then evaluated following the particular standards for ultimate inclusion and modifying the data on a Microsoft Excel spreadsheet, and employed the STATA version 17 for further analysis. Descriptive statistics, and weighted inverse variance random-effects meta-regression were used to present the review’s results to estimate pooled burden of active TB in HIV infected children [26]. The eligible articles were extracted using Meta-XL Excel version 5.3sheet [27] using identified risk factors from each selected studies and made combined each categorical variables and estimated risk factors for active TB [26]. The Higgs I2 statistics were utilized to detect heterogeneity among studies and elaborated using Cochran’s Q test [28]. The degrees of statistical heterogeneity between the studies were assessed using I2 statistics; values of 25%, 50%, and 75% were thought to indicate modest, medium, and high levels of heterogeneity, respectively [38]. The source of heterogeneity among studies was examined using the subgroup and sensitivity analysis. The random effect regression model was used for the data-identified heterogeneous analysis [26]. The publication biases were assessed by visual inspection of funnel plots of the graph and quantitative using Egger’s weighted regression at p <0.1 [29, 30].
Results
Descriptive characteristics of the studies
A total of 1221 primary studies were identified including 43 from Web of Science, 631 from PubMed, 352 from Medline, 15 from Scopus, and 162 articles from Google Scholar. After care full screening throughout the articles titles and abstracts, 1208 articles excluded. Thirteen (N = 13) individual studies that met inclusion criteria were included for the final meta-analysis reported [4, 15–17, 31–39] as presented and described in PRISMA diagram (Fig 1).
Regarding to include articles description all are published in scientific journals from December 30, 2012 to January 1st, 2023. Regionally seven(N = 7)of articles among eligible articles were from Amhara region (Northern parts of Ethiopia) [15, 31–33, 38, 39] and three articles were from southern nation nationalities region (SNNRs) of Ethiopia [16, 34], two of the remaining articles were from Benishangul Gumuz (North west) part of Ethiopia [4, 17], and one were from Oromia [37] regions which is clearly described in (Table 1).
Table 1. Characteristics of included articles/studies reporting the prevalence of TB in HIV-positive children in Ethiopia after ART initiation in Ethiopia.
Full first author name | Year | Region | Design | Sample size | MA/Years | Events (TB cases) | Proportion (%) | Incidence/100 PPY | Follow up time | Study setting | Quality |
---|---|---|---|---|---|---|---|---|---|---|---|
Yihun Mulugeta Alemu et al. [31] | 2016 | Amhara | Follow up | 647 | 6 | 79 | 12.2 | 4.2 | 5 | HT&HC | 3 |
Fassikaw Kebede Bizuneh et al. [17] | 2021 | Benishangul | Cohort | 421 | 8 | 52 | 12.4 | 5.9 | 5 | HT | 3 |
Firew Tiruneh et al. [16] | 2020 | SNNRS | cohort | 800 | 9 | 189 | 23.6 | 7.9 | 5 | HT&HC | 3 |
Fassikaw Kebede Bizuneh et al. [4] | 2021 | Benishangul | Cohort | 428 | 10.3 | 64 | 14.9 | 5.78 | 10 | HT&HC | 3 |
Firew Tiruneh et al. [35] | 2020 | SNNr | Cohort | 844 | 9 | 113 | 13.4 | 3.36 | 5 | HT&HC | 3 |
Aklilu Endalamaw et al. [30] | 2018 | Amhara | Cohort | 352 | 6.7 | 34 | 9.6 | 2.63 | 13 | HT | 3 |
Beshir Masino Tessu et al. [36] | 2019 | Oromia | Cohort | 428 | 6 | 67 | 15.6 | 6.03 | 5 | HT | 3 |
Sualiha Gebeyaw Ayalaw et al. [32] | 2015 | Amhara | Follow up | 271 | 9.8 | 44 | 16.2 | 4.9 | 6 | HT | 3 |
Mamaru Wubale Melkamu et al. [37] | 2020 | Amhara | Cohort | 408 | 6.3 | 42 | 10.3 | Not Reported | 15 | HT&HC | 3 |
Ermias Sisay Chanie et al. [15] | 2022 | Amhara | Follow up | 349 | 7.3 | 25 | 7.2 | Not Reported | 11 | HT | 3 |
Dagnaw Amare Mequanente et al. [38] | 2022 | Amhara | Cohort | 389 | 7.9 | 57 | 10.5 | Not Reported | 6 | HT | 3 |
Endalk Birrie Wondifraw et al. [19] | 2022 | Amhara | Follow up | 358 | 8.3 | 57 | 15.9 | 2.0 | 14 | HT | 3 |
Emil Westerlund et al. [33] | 2014 | Arba Minch | Cohort | 139 | 5.9 | 11 | 7.9 | Not Reported | 6 | HT | 2 |
* HC = Health center, HT = hospital, PPY = person per years, Mean age/Y = Years, SNNR = south nation, nationalities’ region
Description reports of included studies
From included 13 individual studies, 6668 HIV infected children were participated and 834 cases of TB among HIV, infected children reported. The mean (±SD age of the participants was reneged from 8.2(±3.6) years. Of the total, nine(9/13) included articles were employed cohort design [16, 17, 32, 34, 38, 39], whereas four of the included articles data were collected by correctional recorded review of follow up design [4, 15, 31, 35, 38] were used. The highest number of active TB cases (23.6%) was reported from the SNNPR region (Southern Ethiopia) [16] and the lowest number (7.2%) of active TB cases was from Amhara region (North West Ethiopia) [15] regions respectively.
Pooled prevalence of TB in HIV infected children on ART
In the final meta-analysis report, utilizing 13 published studies, we discovered that the estimated pooled burden of active TB among HIV-infected children in Ethiopia was 12.1% (95% CI: 10.7–13.4; I2 = 63.4%, P = 0.001) as described in (Fig 2).
Factors associated with active TB in HIV infected children on ART
In our final report, there was significant heterogeneity observed among the studies included in the meta-analysis (I2 = 63.4%, P <0.001 as depicted in pooled proportion of active TB in HIV infected children. Accordingly, the pooled TB prevalence was slightly lower in hospital setups at 11.05% (95%CI: 9.4–12.3) compared to health center studies, which reported 14.1% (95%CI: 11.74–16.33) (Fig 3). Likewise, the pooled TB burden among HIV-infected children was significantly higher in studies conducted in the Oromia region at 15.6% (95%CI: 10.2–20.6) compared to studies included from the SNNR, which had a result of 12.8% (95%CI: 10.03–15.67) as described in (Fig 3).
In this report, the duration of follow-up periods was found to be significantly associated with the occurrence of active TB. Sub-group analysis revealed that the pooled burden of TB among HIV-infected children with a follow-up period of ≤10 years was significantly higher at 13.67% (95%CI: 11.24–15.1) compared to those with a follow-up period of >10 years, which had estimation of 10.9% (95%CI: 9.1–12.8) as described in (Fig 4).
In this systematic review, to identify factors associated with active TB we analyzed adjusted odds ratios from primary studies and made grouped significant categorical variables from previous studies by themes, including WHO advanced clinical stages (III&IV), baseline CD4 count, missed isoniazid preventive therapy (IPT), missed cotrimoxazole preventive therapy (CPT), level of hemoglobin, antiretroviral therapy (ART) adherence status, and functional status of children. But, it is noted that only missed IPT, missed CPT, WHO advanced clinical stages (III&IV) and level of hemoglobin were found predictors for TB as shown in (Table 2).
Table 2. Factors associated with active TB occurrence among HIV infected children in Ethiopia.
Variables | OR | 95%CI | I2 | Q2 | P value of Q | P value of estimation |
---|---|---|---|---|---|---|
Advanced WHO Clinical stages | Ref | Ref | Ref | Ref | < 0.001 | |
Stages I&II | ||||||
Stage III&IV | 2.27 | [1.18–2.73] | 89.5% | 0.99 | 0.001 | |
Cotrimoxazole preventive therapy (CPT) | Ref | Ref | Ref | < 0.001 | ||
Given | ||||||
Not given | 4.26 | [3.47–5.28] | 43.3% | 2.99 | 0.116 | |
Isoniazid preventive therapy status (IPT) | Ref | Ref | Ref | < 0.001 | ||
Given | ||||||
Not Given | 2.28 | [1.99–3.18] | 38.8% | 2.07 | 0.22 | |
Level of Hemoglobin Hgb ≤ 10 gm/dl | 3.11 | (1.57–4.7 | 77.6% | 3.11 | < 0.001 | |
Hgb > 10 gm/dl | Ref |
Hgb = hemoglobin, IPT = Isoniazid preventive therapy status (IPT), Cotrimoxazole preventive therapy (CPT)
Accordingly, studies containing HIV infected children who missed IPT was double fold increase the odds of active TB occurrence compared with ever given children (OR: 2.28; 95% CI: 1.99–3.08) and also the likelihood of active TB occurrence in HIV infected children who are on advanced WHO clinical stage (III&IV) was 2.27 times (OR: 2.27; 95% CI: 1.81–2.73) higher than with children were on WHO clinical stage II and I. Furthermore, the probability of TB co-infection for HIV-infected children was 3.11 times higher (OR = 3.11, 95% CI: 1.57–4.7) for cases having hemoglobin≤10 mg/dl compared to children with a Hgb >10 mg/dl as described in (Fig 5). Furthermore HIV-infected children who missed CPT had 4 time higher odds of TB co-infection than counter group (OR: 4.26, 95% CI: 3.47–5.28) clearly depicted in (Fig 6).
Publication bias assessment
The publication bias was assessed graphically using funnel plots, and the findings revealed no systematic deviation as depicted in (Fig 7).
In addition, Quantitative analysis we had conducted and assessed using Begg’s and Egger’s tests for biases. Egger’s regression was performed, and the report indicated the absence of publication bias for using two factors sample size and follow up periods as elaborated in (Table 3).
Table 3. Potential sources of heterogeneity for pooled active TB burden among HIV infected children in Ethiopia.
Logrr | Coefficient | SE | t | p > (t) | P>95%CI |
Sample size | -0.317 | 0.181 | -0.37 | 0.14 | −0.01, 0.015 |
Follow up periods | −0.443 | 0.512 | - 0.68 | 0.42 | −1.59, 1.089 |
Constant | 905.22 | 711.3 | 0.311 | 0.15 | −1863.5, 1112.4 |
CI = confidence interval, SE = Standard error
Discussion
This systematic review and meta-analysis revealed the pooled burden of active (TB) among HIV-infected children in Ethiopia and further identified predictors associated with active TB.
In the final report of 13 individual studies with including 5834 participants, 834 TB and HIV co-infected cases were found at national level. This made the pooled estimated prevalence of active TB was 12.07% (95%CI: 10.73–13.4). This finding is higher than previously reported 0.78% in Ethiopia [40], 43% in SSA countries [41], and 1.03% in Portugal [42]. The findings indicate a significantly high burden of active and need for immediate attention to meet the targets set by the End TB Strategy to achieved the goal of a 90% reduction should to be (≤ 10 TB cases per 100,000 population) by 3035 requires urgent action [1, 2]. Conversely, this report is lower than the previous meta-analysis finding 15% in middle-income countries [43, 44] and 32% meta-analysis reported in Nigeria [45]. The variation in the pooled estimate of active TB among the included studies may be attributed to differences in study time TB control measures, and variations among the studies in Nigeria and in Ethiopia [46].Also the variation in healthcare infrastructure, treatment practices, and regional differences also influence pooled prevalence rates.
This systematic review and meta-analysis revealed that HIV-infected children with advanced WHO clinical stage (III&IV) have a twofold increased likelihood of experiencing active TB compared with mild advanced WHO clinical stage. This finding is supported by previous meta-analyses conducted in Ethiopia [47–50]. This possible justification for this finding is that children with advanced HIV disease may have compromised immune systems due to their clinical stage III&IV, which is associated with low CD4 counts and could lead to an increased risk of developing opportunistic infections, including TB [51].
The report of this meta-analysis revealed that, the risk of developing active TB was four fold increased for HIV infected children with Hgb ≤10 gm/dl than in those with Hgb >10 gm /dl. This is consistent with the previous study finding [52–54]. This could be attributed to the fact that anemia can indeed impair the immune response and the bactericidal activity of leukocytes, making individuals more vulnerable to infections, including tuberculosis.
The odds of developing active TB among HIV infected children who missed CPT had a four-fold risk as compared ever given children. This is consistent with previously reported meta-analysis in finding in Ethiopia [53, 55, 56]. This might be due to cotrimoxazole, is prescribed to HIV-infected children to prevent lethal opportunistic by preventing production of nucleic acids and proteins essential for the growth of opportunistic infections including PCP, and toxoplasmosis thus helping to counteract immunosuppression and disease progression.
Consistent with previous studies finding in [12, 17, 32, 33, 38, 57–60],concurrent administering of IPT after ruled-out of active TB symptoms with ART demoted more than 90% of active TB-associated incidence of morbidity [3, 61, 62]. In the final report of this systematic review and meta-analysis, it was found that HIV-infected children who did not receive IPT (preventive therapy) were at a twofold higher risk compared to the control group. This might be IPT (Isoniazid Preventive Therapy) has the potential to reduce the burden of latent mycobacteria in the lungs. This is because Isoniazid preventive therapy can effectively stop the progression of latent TB infection from developing into active TB disease [17, 63].
In contrast to previous systematic review findings [53, 55] and primary studies reported [12, 17, 32, 33, 38, 57–60] this meta-regression found no significant association between declined CD4 count (≤200 cells/cml), age of patients, duration of follow-up, comorbidity status, and functional status with the risk developing active TB in HIV co-infection children. This might be related to the methodological differences, heterogeneity of included study populations, sample size limitations, publication bias, unaccounted factors, and further experimental studies are highly needed to better understand this relationship.
Strengths and limitations of the study
The strengths of this study include an extensive search strategy, clear inclusion criteria, and the involvement of five independent authors in the quality, inclusion and analysis for this systematic review and meta-analysis. However, there are several methodological limitations including focusing on articles published only on English were included and the extracted articles were from four Ethiopian regions were included in the analysis, such that some of the region may not be represented. In addition, limitations such as reliance on clinical stratification or non-laboratory-supported staging, sub-standard diagnostic capacities in health facilities, a small number of included studies, and the use of retrospective data may potentially affect the validity of the results.
Conclusion and recommendation
This systematic review found a higher prevalence of active TB in HIV-infected children in Ethiopia compared to the estimated rates in the end TB strategy. Risk factors for active TB were identified included WHO clinical stages IV and III, low hemoglobin, missed IPT, and missed CPT were predictors. To reduce the risk of active TB, it is crucial to implement effective strategies such as regular IPT mission and addressing the gaps in treatment, and routine screening for active TB during follow-ups to prevent premature death.
Supporting information
Acknowledgments
Author contributions
Fassikaw Kebede Bizune’s; Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Software, Supervision, Validation, Visualization, Writing–original draft, Writing–review & editing.
Dejen Tsegaye’s; Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Software, Supervision, Validation, Visualization.
Belete Negese; Resources, Software, Supervision, Validation, Visualization, Writing -review & editing.
Tsehay Kebede’s Bizueneh: Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Validation, Visualization, Writing–original draft, Writing–review & editing.
Abbreviations
- TB
uberculosis
- WHO
World Health Organization
- FMOH
Federal Ministry of Health
- HIV
human immune deficiency virus
- HAAR
highly active antiretroviral therapy
- IPT
isoniazid preventive Therapy
- CPT
co-trimoxazole preventive therapy
Data Availability
All relevant data are within the paper and its Supporting Information files.
Funding Statement
The authors received no specific funding for this work.
References
- 1.WHO. Global Tuberculosis reporT 2022. https://iriswhoint/bitstream/handle/10665/363752/9789240061729-engpdf?sequence=1. 2022. [Google Scholar]
- 2.WHO. Global tuberculosis report 2023. https://wwwwhoint/teams/global-tuberculosis-programme/tb-reports. 2023. [Google Scholar]
- 3.Kebede F, Kebede B, Kebede T, Agmasu M. Effect of Isoniazid Preventive Therapy on the Incidence of Tuberculosis among Seropositive Children Attending HIV/AIDS Care in Two General Hospitals, Northwest Ethiopia, 2021. J Trop Med. 2021. Aug 25;2021:9996953. doi: 10.1155/2021/9996953 ; [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Kebede F, Tarekegn H, Molla M, Jara D, Abate A, et al. Incidence and Predictors of Pulmonary Tuberculosis among Children Who Received Antiretroviral Therapy (ART), Northwest Ethiopia: A Multicenter Historical Cohorts Study 2009–2019. J Trop Med. 2022. Jan 29;2022:9925693. doi: 10.1155/2022/9925693 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Wondmeneh TG, Mekonnen AT. The incidence rate of tuberculosis and its associated factors among HIV-positive persons in Sub-Saharan Africa: a systematic review and meta-analysis. BMC Infect Dis. 2023. Sep 18;23(1):613. doi: 10.1186/s12879-023-08533-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Ford N, Matteelli A, Shubber Z, Hermans S, Meintjes G, Grinsztejn B et al.,TB as a cause of hospitalization and in-hospital mortality among people living with HIV worldwide: a systematic review and meta-analysis. J Int AIDS Soc. 2016. Jan 12;19(1):20714. doi: 10.7448/IAS.19.1.20714 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Dawit Z, Abebe S, Dessu S, Mesele M, Sahile S, Ajema D. Incidence and predictors of mortality among children co-infected with tuberculosis and human immunodeficiency virus at public hospitals in Southern Ethiopia. PLoS One. 2021. Jun 30;16(6):e0253449. doi: 10.1371/journal.pone.0253449 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Placeres AF, de Almeida Soares D, Delpino FM, Moura HSD, Scholze AR, et al. Epidemiology of TB in prisoners: a metanalysis of the prevalence of active and latent TB. BMC Infect Dis. 2023. Jan 11;23(1):20. doi: 10.1186/s12879-022-07961-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Bizuneh FK, Masresha SA, Yayeh BM, Bizuneh TK. Active tuberculosis incidence among treatment failure experienced patients in North Wollow Zone: A multicenter historical cohort. Health Sci Rep. 2024. Mar 31;7(4):e1997. doi: 10.1002/hsr2.1997 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Kiros T, Dejen E, Tiruneh M, Tiruneh T, Eyayu T, et al. Magnitude and Associated Factors of Pulmonary Tuberculosis Among HIV/AIDS Patients Attending Antiretroviral Therapy Clinic at Debre Tabor Specialized Hospital, Northwest Ethiopia, 2019. HIV AIDS (Auckl). 2020. Dec 3;12:849–858. doi: 10.2147/HIV.S282616 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Tiruneh MG, Kebede Bizuneh F. Determinates of anemia among Human Immune Deficiency Virus positive children on Anti-retro Viral Therapy in selected health facilities, Northwest Ethiopia: A Case-Control Study. J Nutr Sci. 2023. Aug 30;12:e95. doi: 10.1017/jns.2023.79 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Tsegaye D, Kebede T, Kebede F. Rate, risk factors and estimations of time to develop severe acute malnutrition after children receiving antiretroviral therapy at selected health facilities in northwest Ethiopia. J Nutr Sci. 2023. May 22;12:e60. doi: 10.1017/jns.2023.42 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Chanie ES, Gelaye GA, Tadesse TY, Feleke DG, Admas WT, Molla Alemu E, et al. Estimation of lifetime survival and predictors of mortality among TB with HIV co-infected children after test and treat strategies launched in Northwest, Ethiopia, 2021; a multicentre historical follow-up study. PLoS One. 2021. Dec 21;16(12):e0258964. doi: 10.1371/journal.pone.0258964 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Alene KA, Viney K, Moore HC, Wagaw M, Clements ACA. Spatial patterns of tuberculosis and HIV co-infection in Ethiopia. PLoS One. 2019. Dec 5;14(12):e0226127. doi: 10.1371/journal.pone.0226127 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Chanie ES, Bayih WA, Birhan BM, Belay DM, Asmare G, Tiruneh T, et al. Incidence of advanced opportunistic infection and its predictors among HIV infected children at Debre Tabor referral Hospital and University of Gondar Compressive specialized hospitals, Northwest Ethiopia, 2020: A multicenter retrospective follow-up study. Heliyon. 2021. Apr 9;7(4):e06745. doi: 10.1016/j.heliyon.2021.e06745 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Tiruneh F, Deyas Y. Effect of highly active antiretroviral treatment on TB incidence among HIV infected children and their clinical profile, retrospective cohort study, South West Ethiopia. Sci Rep. 2020. Dec 8;10(1):21468. doi: 10.1038/s41598-020-78466-0 ; [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Kebede F, Kebede T, Kebede B, Abate A, Jara D, Negese B, et al. Time to Develop and Predictors for Incidence of Tuberculosis among Children Receiving Antiretroviral Therapy. Tuberc Res Treat. 2021. Nov 13;2021:6686019. doi: 10.1155/2021/6686019 ; [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Eticha T, Berhane L. Caregiver-reported adherence to antiretroviral therapy among HIV infected children in Mekelle, Ethiopia. BMC Pediatr. 2014. Apr 27;14:114. doi: 10.1186/1471-2431-14-114 ; [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Wondifraw EB, Chanie ES, Gebreeyesus F, Biset G, Tefera BD, Zeleke M. Incidence and predictors of tuberculosis among children on antiretroviral therapy at northeast Ethiopia comprehensive specialized hospitals, 2022; A multicenter retrospective follow-up study. Heliyon. 2022. Nov 30;8(12):e12001. doi: 10.1016/j.heliyon.2022.e12001 ; [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Abuogi L, Noble L, Smith C; Committee On Pediatric And Adolescent Hiv; Section On Breastfeeding. Infant Feeding for Persons Living With and at Risk for HIV in the United States: Clinical Report. Pediatrics. 2024. Jun 1;153(6):e2024066843. doi: 10.1542/peds.2024-066843 . [DOI] [PubMed] [Google Scholar]
- 21.Kidie AA, Masresha SA, Bizuneh FK. Statistical analysis on the incidence and predictors of death among second-line ART patients in public hospitals of North Wollo and Waghemira Zones, Ethiopia, 2021. Sci Rep. 2024. May 13;14(1):10893. doi: 10.1038/s41598-024-60119-1 ; [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021. Mar 29;372:n71. doi: 10.1136/bmj.n71 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Ethiopia National Guidelines For Comprehensive Hiv Prevention, Care And Treatment. Guideline 2017;Art Management Gudeline Accessed 27 / 05/2024(https://www.childrenandaids.org/sites/default/files/2018-05/Ethiopia_Nat%20Guidelines%20ART_2017.pdf)
- 24.Professor Ga Wells. Newcastle-Ottawa Quality Assessment Scale Cohort Studiesf. J Educ Eval Health Prof 2016; 13: 40 • https://doiorg/103352/jeehp20161340. 2016.27838916 [Google Scholar]
- 25.Institute JB. JBI_Critical_Appraisal-Checklist_for_Analytical_Cross_Sectional_Studies, Checklist for Analytical Cross Sectional Studies. http://joannabriggsorg/research/critical-appraisal-toolshtml. 2017;www.joannabriggs.org. [Google Scholar]
- 26.Egger M, Davey Smith G, Schneider M, Minder C. Bias in meta-analysis detected by a simple, graphical test. BMJ. 1997. Sep 13;315(7109):629–34. doi: 10.1136/bmj.315.7109.629 ; [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Doi JJBSA. MetaXL User Guide Version Sunrise Beach, Queensland, Australia, 2011–2016. 2016; Version. 2016;4:2016.(file:///C:/Users/exite/OneDrive/Desktop/MetaXL%20User%20Guide.pdf). [Google Scholar]
- 28.Thompson SG, Higgins JP. How should meta-regression analyses be undertaken and interpreted? Stat Med. 2002. Jun 15;21(11):1559–73. doi: 10.1002/sim.1187 . [DOI] [PubMed] [Google Scholar]
- 29.Duval S, Tweedie R. Trim and fill: A simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics. 2000. Jun;56(2):455–63. doi: 10.1111/j.0006-341x.2000.00455.x . [DOI] [PubMed] [Google Scholar]
- 30.Endalamaw A, Engeda EH, Tezera N. Incidence of tuberculosis in children on antiretroviral therapy: a retrospective cohort study. BMC Res Notes. 2018. Oct 20;11(1):745. doi: 10.1186/s13104-018-3846-z [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Alemu YM, Andargie G, Gebeye E. High Incidence of Tuberculosis in the Absence of Isoniazid and Cotrimoxazole Preventive Therapy in Children Living with HIV in Northern Ethiopia: A Retrospective Follow-Up Study. PLoS One. 2016. Apr 12;11(4):e0152941. doi: 10.1371/journal.pone.0152941 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Ayalaw SG, Alene KA, Adane AA. Incidence and Predictors of Tuberculosis among HIV Positive Children at University of Gondar Referral Hospital, Northwest Ethiopia: A Retrospective Follow-Up Study. Int Sch Res Notices. 2015. May 26;2015:307810. doi: 10.1155/2015/307810 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Westerlund E, Jerene D, Mulissa Z, Hallström I, Lindtjørn B. Pre-ART retention in care and prevalence of tuberculosis among HIV-infected children at a district hospital in southern Ethiopia. BMC Pediatr. 2014. Oct 4;14:250. doi: 10.1186/1471-2431-14-250 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Wondifraw EB, Chanie ES, Gebreeyesus F, Biset G, Tefera BD, Zeleke M. Incidence and predictors of tuberculosis among children on antiretroviral therapy at northeast Ethiopia comprehensive specialized hospitals, 2022; A multicenter retrospective follow-up study. Heliyon. 2022. Nov 30;8(12):e12001. doi: 10.1016/j.heliyon.2022.e12001 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Tiruneh Firew, Deyas Yared and Abdisa Dinaol. Tuberculosis Incidence among HIV Infected Children on HAART and their Clinical Profile, Retrospective Cohort Study, South West Ethiopia". J AIDS Clin Res 11 (2020) doi: 10.37421/jar.2020.11.808 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Beshir MT, Beyene AH, Tlaye KG, Demelew TM. Incidence and predictors of tuberculosis among HIV-positive children at Adama Referral Hospital and Medical College, Oromia, Ethiopia: a retrospective follow-up study. Epidemiol Health. 2019;41:e2019028. doi: 10.4178/epih.e2019028 Epub 2019 Jun 22. ; [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Melkamu MW, Gebeyehu MT, Afenigus AD, and Hibstie YT Incidence of common opportunistic infections among HIV-infected children on ART at Debre Markos referral hospital, Northwest Ethiopia: a retrospective cohort study. BMC Infect Dis. 2020. Jan 16;20(1):50. doi: 10.1186/s12879-020-4772-y ; [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Mequanente DA, Srinivasan P, Mallika G, Thamimul Ansari PM, et al. Incidence of Opportunistic Infections among HIV-infected Children on ART at Gondar University Specialized Hospital, Ethiopia. Indian Journal of Science and Technology 15(34): 1675–1682. 10.17485/IJST/v15i34.1073 [DOI] [Google Scholar]
- 39.Abay SM, Deribe K, Reda AA, Biadgilign S, Datiko D, et al. The Effect of Early Initiation of Antiretroviral Therapy in TB/HIV-Coinfected Patients: A Systematic Review and Meta-Analysis. J Int Assoc Provid AIDS Care. 2015. Nov-Dec;14(6):560–70. doi: 10.1177/2325957415599210 Epub 2015 Aug 19. . [DOI] [PubMed] [Google Scholar]
- 40.Bizuneh FK, Bizuneh TK, Masresha SA, Kidie AA, Arage MW, Sirage N, et al. (2024) Tuberculosis-associated mortality and risk factors for HIV-infected population in Ethiopia: a systematic review and meta-analysis. Front. Public Health 12:1386113 Volume 12–2024, doi: 10.3389/fpubh.2024.1386113 [DOI] [Google Scholar]
- 41.Diriba G, Alemu A, Eshetu K, Yenew B, Gamtesa DF, Tola HH, et al. Bacteriologically confirmed extrapulmonary tuberculosis and the associated risk factors among extrapulmonary tuberculosis suspected patients in Ethiopia: A systematic review and meta-analysis. PLoS One. 2022. Nov 23;17(11):e0276701. doi: 10.1371/journal.pone.0276701 ; [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Tavares AM, Fronteira I, Couto I, Machado D, Viveiros M, Abecasis AB, et al. HIV and tuberculosis co-infection among migrants in Europe: A systematic review on the prevalence, incidence and mortality. PLoS One. 2017. Sep 28;12(9):e0185526. doi: 10.1371/journal.pone.0185526 ; [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Pimpin L, Drumright LN, Kruijshaar ME, Abubakar I, Rice B, et al. Tuberculosis and HIV co-infection in European Union and European Economic Area countries. Eur Respir J. 2011. Dec;38(6):1382–92. doi: 10.1183/09031936.00198410 Epub 2011 Jul 7. . [DOI] [PubMed] [Google Scholar]
- 44.B-Lajoie MR, Drouin O, Bartlett G, Nguyen Q, Low A, Gavriilidis G, et al. Incidence and Prevalence of Opportunistic and Other Infections and the Impact of Antiretroviral Therapy Among HIV-infected Children in Low- and Middle-income Countries: A Systematic Review and Meta-analysis. Clin Infect Dis. 2016. Jun 15;62(12):1586–1594. doi: 10.1093/cid/ciw139 Epub 2016 Mar 21. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Ebonyi AO, Oguche S, Ejeliogu EU, Agbaji OO, Shehu NY, Abah IO, et al. Prevalence of and risk factors for pulmonary tuberculosis among newly diagnosed HIV-1 infected Nigerian children. Germs. 2016. Mar 1;6(1):21–8. doi: 10.11599/germs.2016.1085 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Law I, Floyd K; African TB Prevalence Survey Group. National tuberculosis prevalence surveys in Africa, 2008–2016: an overview of results and lessons learned. Trop Med Int Health. 2020. Nov;25(11):1308–1327. doi: 10.1111/tmi.13485 Epub 2020 Oct 12. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Alebel A, Demant D, Petrucka P, Sibbritt D. Effects of undernutrition on mortality and morbidity among adults living with HIV in sub-Saharan Africa: a systematic review and meta-analysis. BMC Infect Dis. 2021. Jan 4;21(1):1. doi: 10.1186/s12879-020-05706-z [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Azanaw MM, Derseh NM, Yetemegn GS, Angaw DA. Incidence and predictors of tuberculosis among HIV patients after initiation of antiretroviral treatment in Ethiopia: a systematic review and meta-analysis. Trop Med Health. 2021. Feb 25;49(1):18. doi: 10.1186/s41182-021-00306-2 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Straetemans M, Glaziou P, Bierrenbach AL, Sismanidis C, et al. Assessing tuberculosis case fatality ratio: a meta-analysis. PLoS One. 2011;6(6):e20755. doi: 10.1371/journal.pone.0020755 Epub 2011 Jun 27. ; [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Nliwasa M, MacPherson P, Gupta-Wright A, Mwapasa M, et al. High HIV and active tuberculosis prevalence and increased mortality risk in adults with symptoms of TB: a systematic review and meta-analyses. J Int AIDS Soc. 2018. Jul;21(7):e25162. doi: 10.1002/jia2.25162 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Tsegaye D, Wude S, Kebede T, Adane S, Shumet T, Kebede F. Epidemiological survival pattern, risk factors, and estimated time to develop tuberculosis after test and treat strategies declared for children living with human immune deficiency virus. Indian J Tuberc. 2023;70 Suppl 1:S89–S99. doi: 10.1016/j.ijtb.2023.05.008 Epub 2023 May 18. . [DOI] [PubMed] [Google Scholar]
- 52.Tesfaye B, Alebel A, Gebrie A, Zegeye A, Tesema C, Kassie B. The twin epidemics: Prevalence of TB/HIV co-infection and its associated factors in Ethiopia; A systematic review and meta-analysis. PLoS One. 2018. Oct 3;13(10):e0203986. doi: 10.1371/journal.pone.0203986 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Belay GM, Wubneh CA. Childhood tuberculosis treatment outcome and its association with HIV co-infection in Ethiopia: a systematic review and meta-analysis. Trop Med Health. 2020. Feb 18;48:7. doi: 10.1186/s41182-020-00195-x ; [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Belay GM, Wubneh CA. Childhood tuberculosis treatment outcome and its association with HIV co-infection in Ethiopia: a systematic review and meta-analysis. Trop Med Health. 2020. Feb 18;48:7. doi: 10.1186/s41182-020-00195-x [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Azanaw MM, Derseh NM, Yetemegn GS, Angaw DA. Incidence and predictors of tuberculosis among HIV patients after initiation of antiretroviral treatment in Ethiopia: a systematic review and meta-analysis. Trop Med Health. 2021. Feb 25;49(1):18. doi: 10.1186/s41182-021-00306-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Kassa A, Teka A, Shewaamare A, Jerene D. Incidence of tuberculosis and early mortality in a large cohort of HIV infected patients receiving antiretroviral therapy in a tertiary hospital in Addis Ababa, Ethiopia. Trans R Soc Trop Med Hyg. 2012. Jun;106(6):363–70. doi: 10.1016/j.trstmh.2012.03.002 Epub 2012 Apr 20. . [DOI] [PubMed] [Google Scholar]
- 57.Beshir MT, Beyene AH, Tlaye KG, Demelew TM. Incidence and predictors of tuberculosis among HIV-positive children at Adama Referral Hospital and Medical College, Oromia, Ethiopia: a retrospective follow-up study. Epidemiol Health. 2019;41:e2019028. doi: 10.4178/epih.e2019028 Epub 2019 Jun 22. . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.Tiruneh F, Deyas Y. Effect of highly active antiretroviral treatment on TB incidence among HIV infected children and their clinical profile, retrospective cohort study, South West Ethiopia. Sci Rep. 2020. Dec 8;10(1):21468. doi: 10.1038/s41598-020-78466-0 ; [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.Wondifraw EB, Chanie ES, Gebreeyesus F, Biset G, Tefera B, et al. Incidence and predictors of tuberculosis among children on antiretroviral therapy at northeast Ethiopia comprehensive specialized hospitals, 2022; A multicenter retrospective follow-up study. Heliyon. 2022. Nov 30;8(12):e12001. doi: 10.1016/j.heliyon.2022.e12001 ; [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Molla M, Kebede F, Kebede T, Haile A. Effects of Undernutrition and Predictors on the Survival Status of HIV-Positive Children after Started Antiretroviral Therapy (ART) in Northwest Ethiopia. Int J Pediatr. 2022. Feb 17;2022:1046220. doi: 10.1155/2022/1046220 ; [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.Getaneh T, Negesse A, Dessie G, Desta M. The impact of tuberculosis co-infection on virological failure among adults living with HIV in Ethiopia: A systematic review and meta-analysis. J Clin Tuberc Other Mycobact Dis. 2022. Mar 4;27:100310. doi: 10.1016/j.jctube.2022.100310 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Assefa DG, Zeleke ED, Bekele D, Ejigu DA, Molla W, Woldesenbet TT, et al. Isoniazid Preventive Therapy for Prevention of Tuberculosis among People Living with HIV in Ethiopia: A Systematic Review of Implementation and Impacts. Int J Environ Res Public Health. 2022. Dec 29;20(1):621. doi: 10.3390/ijerph20010621 ; [DOI] [PMC free article] [PubMed] [Google Scholar]
- 63.Kumar AA, De Costa A, Das A, Srinivasa GA, D’Souza G, et al. Mobile Health for Tuberculosis Management in South India: Is Video-Based Directly Observed Treatment an Acceptable Alternative? JMIR Mhealth Uhealth. 2019. Apr 3;7(4):e11687. doi: 10.2196/11687 [DOI] [PMC free article] [PubMed] [Google Scholar]