Skip to main content
PLOS Digital Health logoLink to PLOS Digital Health
. 2023 Oct 6;2(10):e0000156. doi: 10.1371/journal.pdig.0000156

Healthcare provider-targeted mobile applications to diagnose, screen, or monitor communicable diseases of public health importance in low- and middle-income countries: A systematic review

Pascal Geldsetzer 1,2,3,#, Sergio Flores 4,#, Blanca Flores 5, Abu Bakarr Rogers 6, Andrew Y Chang 3,7,8,*
Editor: Ana Luísa Neves9
PMCID: PMC10558072  PMID: 37801442

Abstract

Communicable diseases remain a leading cause of death and disability in low- and middle-income countries (LMICs). mHealth technologies carry considerable promise for managing these disorders within resource-poor settings, but many existing applications exclusively represent digital versions of existing guidelines or clinical calculators, communication facilitators, or patient self-management tools. We thus systematically searched PubMed, Web of Science, and Cochrane Central for studies published between January 2007 and October 2019 involving technologies that were mobile phone- or tablet-based; able to screen for, diagnose, or monitor a communicable disease of importance in LMICs; and targeted health professionals as primary users. We excluded technologies that digitized existing paper-based tools or facilitated communication (i.e., knowledge-based algorithms). Extracted data included disease category, pathogen type, diagnostic method, intervention purpose, study/target population, sample size, study methodology, development stage, accessory requirement, country of development, operating system, and cost. Given the search timeline, studies involving COVID-19 were not included in the analysis. Of 13,262 studies identified by the screen, 33 met inclusion criteria. 12% were randomized clinical trials (RCTs), with 58% of publications representing technical descriptions. 62% of studies had 100 or fewer subjects. All studied technologies involved diagnosis or screening steps; none addressed the monitoring of infections. 52% focused on priority diseases (HIV, malaria, tuberculosis), but only 12% addressed a neglected tropical disease. Although most reported studies were priced under 20USD at time of publication, two thirds of the records did not yet specify a cost for the study technology. We conclude that there are only a small number of mHealth technologies focusing on innovative methods of screening and diagnosing communicable diseases potentially of use in LMICs. Rigorous RCTs, analyses with large sample size, and technologies assisting in the monitoring of diseases are needed.

Author summary

Although significant progress has been made in decreasing their worldwide impact, infectious diseases still represent a considerable burden of disease and death. This is especially the case in certain regions of low- and middle-income countries, where limited healthcare resources, personnel, and facilities can make it difficult to provide high quality care. Mobile health (mHealth) technologies are disruptive tools that hold considerable promise in these resource-constrained settings by circumventing some of the aforementioned obstacles. To better understand the availability and characteristics of mHealth technologies for use in low- and middle-income countries, we systematically searched for studies published in English between January 2007 through October 2019 to identify all existing mobile phone- or tablet-based innovations targeted at healthcare providers for use against infectious diseases in these settings and summarized their qualities and performance. We found that four times as many publications focused on tools that simply made data transfer more simple than there were on new tools for detecting or monitoring diseases. Few studies were tested under the most rigorous scientific methods. Many diagnostic technologies we identified require specialized attachments or additional laboratory equipment that connect to the smartphone or tablet, which could make their use in some settings more challenging.

Introduction

As of 2019, communicable diseases were still the main driver of disability-adjusted life years (DALYs) in children under ten years of age globally and were responsible for six out of the top ten global causes of DALYs [1]. In 2017, 35% of the years of life lost worldwide were from communicable, maternal, neonatal, and nutrition-related disorders [2]. Communicable diseases not only increase mortality and reduce life expectancy in LMICs, but they also cause significant disability, leading to loss of economic productivity in impacted communities [1]. Furthermore, nearly a tenth of the global burden of non-communicable diseases (NCDs) that year were attributed to an infectious cause, with the burden quantified to be 130 million DALYs [3]. Additionally, many LMICs continue to be afflicted by neglected tropical diseases such as dengue virus, Chagas disease, and schistosomiasis. These are not only unique to these regions but also endemic, remaining a major contributor to morbidity and mortality in those settings [46].

The persistence of communicable diseases in LMICs is thought to be due to a number of factors, including incomplete development of robust public health infrastructure, shortage of healthcare providers, and continuance of major health disparities [4]. New technologies could help overcome these obstacles to further accelerating the reduction in the communicable disease burden in LMICs. For one, such technologies could enable task shifting from physicians to nurses and community health workers (CHWs) with the goal of alleviating the shortage of more highly trained healthcare worker cadres in low-resource settings. One venue for doing so involves equipping such personnel with mobile health (mHealth) technologies, whose simplified user interfaces, integrated workflow protocols, and lower costs would be ideal for extending the practice capabilities of their users [7]. For example, incorporating mHealth apps in routine CHW activities has been shown to be beneficial in process improvement and technology development, standards and guidelines, education and training, and leadership and management [8]. mHealth devices have already been demonstrated to improve the management of infectious diseases in many instances in low-resource settings, [911] as they can serve as rapid and cheap diagnostic tools [12,13]. The wireless, portable aspects of many such technologies also increase the accessibility of healthcare services to patients by reducing travel time and expenses [8].

The current published literature contains many reports of applications that digitize existing knowledge-based algorithms or facilitate inter-provider or patient-provider communication. To the best of our knowledge, however, it does not offer a comprehensive, up-to-date systematic review of truly innovative, novel provider-facing mHealth technologies available for infectious disease care in LMIC settings. These include technologies such as simplified laboratory testing equipment with smart device interfaces and artificial intelligence-guided diagnostic tools. As such, we conducted a systematic review that aims to identify all existing novel mobile phone- or tablet-based innovations targeted at healthcare providers and summarize the performance of these technologies.

Methods

Inclusion and exclusion criteria

We searched the literature and screened titles and abstracts of articles (and if inconclusive, the full-text versions of articles) using the following inclusion criteria:

  1. The technology reported must be mobile phone or tablet-based for their clinical function—this excludes mobile devices and applications that solely use their internet connectivity to transmit data;

  2. The technology must target healthcare professionals specifically as users—tools used to educate patients, change patient behaviors as consumer products, or improve patient-provider communication were excluded;

  3. The technology reported must be able to screen, diagnose, or monitor a disease;

  4. The technology must represent an innovation—applications solely used to keep records, reproduce existing guidelines and clinical calculators in digital form, or facilitate communication between providers, or digitizing knowledge-based algorithms were excluded [14]. This criterion was no present in in our prespecified inclusion criteria outlines in the protocol, and was added during the screening process based on emerging patterns and the need to focus on innovative solutions for disease screening, diagnosis, and monitoring in LMICs;

  5. The disease the technology is designed to address must be a communicable disease of public health importance for LMICs. Such diseases were defined as infectious conditions that are estimated to cause more than 1% of deaths in any five-year age group in the general population or among neonates, or infectious diseases that have a prevalence of more than 0.1% in any five-year age group in the general population or among neonates. The Global Burden of Disease Project’s 2019 estimates were utilized for this appraisal [15].

  6. The articles should be published in English with full text available and not fall under the category of systematic reviews or study protocols.

Of note, given the timeline of the search, studies involving Coronavirus Disease 2019 (COVID-19) were not included in the present analysis.

Search strategy

We searched for all studies published in English from January 2007 through October 2019 in the following databases: Cochrane Central (searched on September 30th, 2019), PubMed (searched on October 7th, 2019), and Web of Science (searched on October 7th, 2019). The databases were queried using keywords and medical subject headings (MeSH) combining three major search concepts: namely, the concepts of “mobile/tablet”, AND “application/software” AND “diagnostics/monitoring”. Specific terms included those attributable to smartphones, tablets, mobile applications, diagnosis, screening, and monitoring. A full list of the search terms used for each database are shown in S1 Table. The database searches, examination of abstracts, and inspection of articles’ full-text versions were not conducted in duplicate. No restrictions were placed on study design, sample size, or publication type. Finally, the reference lists of all included studies, relevant review articles, and commentaries were screened for additional references. The search process is summarized in Fig 1. The review was registered in The International Prospective Register of Systematic Reviews (PROSPERO; Registration number: CRD42020193945) [16]. Of note, the protocol was amended following preliminary screening to narrow the search to communicable disease, to target healthcare providers, and only focus on innovative technologies. These changes were necessitated due to the infeasibly broad scope of the original question of mHealth in LMICs. As such, the entire screening process was rerun de novo following the protocol change. Ethical approval was not sought from the Stanford institutional review board as the study did not constitute human subjects research and consisted only of meta-research (which is exempt by definition).

Fig 1. This figure presents the systematic review flow PRISMA diagram of the screening and exclusion process for articles identified and ultimately included in the analysis.

Fig 1

Data extraction

The following data were extracted from each included article: author(s), title, disease or risk factor, clinical domain by MeSH [17], intervention name, intervention type, purpose and aim of the intervention, target population, type of diagnostic method, type of pathogen studied (by microbial class, LMIC priority disease (namely Human Immunodeficiency Virus (HIV), tuberculosis and malaria), as well as neglected tropical disease (NTD) status as defined by the World Health Organization [18], type of mobile device utilized, type of software, operating system used by intervention, study population and sample size, study methods, stage of development, cost in US dollars (USD) at the time of publication (all dollar figures are given as published in the manuscript and not adjusted for inflation, and in the case of articles reporting currencies other than dollars, were converted to 2021 US dollars [19]), country of development based on first authors’ institutional affiliations, location of testing based on the study population country of residence, institutional nation of all listed authors, year of publication, and a summary of the tool (S2 Table). These data were extracted qualitatively using Microsoft Excel (Redmond, WA).

Data analysis

Quantitative data were summarized with counts and proportions. The retrieved data were organized into three themes: epidemiology, technology, and methodology. The epidemiology theme described the disease of interest (and whether it is categorized as an LMIC priority disease by the Global Health National Academies of Science [20] or diseases that were among the top ten in terms of disability-adjusted life years caused globally in 2019 [21]), its characteristics, and the geographic location of the intervention’s development. The technology theme described the primary hardware platform of the innovation, necessary peripherals, as well as the operating system it utilized and its cost considerations. The methodology theme evaluated the phase of study and research design of each publication. S2 Table lists these themes, as well as the categories, subcategories, and definitions that accompany them. To elucidate trends among the studies, we created tables that crossed clinical categories and included all the subthemes. We decided against conducting a meta-analysis due to the substantial degree of heterogeneity in study designs, outcome measurements, and reporting of results. As such, we employed a qualitative measure of study quality on a three-tiered (-, +, and ++) system to characterize publication quality as unsound, suboptimal, or sound, based upon the British Medical Journal’s Evidence Based Medicine Best Practice Toolkit [22].

Results

Our initial search of all the above databases retrieved 13,262 results. After duplicates were removed, abstracts screened, full texts reviewed, and articles identified from reference lists of included articles were added, 33 studies met our inclusion criteria (Fig 1, S3 Table). Articles were excluded if they described or evaluated: i) non-mobile technology-based interventions (n = 85); ii) interventions targeting patients instead of health professionals as users (n = 43); iii) interventions not meant for diagnosis, screening and/or monitoring (n = 49); iv) interventions adapting extant/current technologies (n = 48); v) presented technology that digitalized knowledge based algorithms that could be done on paper (n = 103); vi) noncommunicable diseases (n = 317), or that vii) did not have a full text available (n = 41); viii) were not available in English (n = 14); ix) were systematic reviews (n = 36); or x) were study protocols or involved non-human testing (n = 8). An overview of the included studies’ characteristics is presented in Table 1 and the full list of identified studies is available in S3 Table.

Table 1. Characteristics of Studies.

Count Percentage of Total
Year of Publication
(Total N = 33)
2006–2008 0 0%
2009–2011 1 3%
2012–2014 6 18%
2015–2017 15 45%
2018–2020 11 33%
Location of Study
(Total N = 33)
United States 13 39%
Americas (excluding the United States) 3 9%
Europe 3 9%
Africa 9 27%
Asia 5 15%
Affiliation of Researchers United States 24 39%
(Total N = 61) Americas (excluding the United States) 7 11%
Europe 14 23%
Africa 9 15%
Asia 7 11%
Aim
(Total N = 35)
Diagnose 26 74%
Screen 9 26%
Monitor 0 0%
Diagnostic Method
(Total N = 35)
Direct Visualization 10 29%
Serology 11 31%
Antigen Detection 1 3%
Nucleic Acid Detection 10 29%
Others 3 9%
Type of Pathogen Studied
(Total N = 42)
Viral 18 43%
Bacterial 14 33%
Parasitic 10 24%
Type of Device
(Total N = 36)
Armband/ Smartwatch 0 0%
Smartphone 29 81%
Non-Smartphone Mobile Phone 1 3%
Tablet 4 11%
iPod Device 1 3%
Another wireless device 1 3%
Requires Use of Accessories (Total N = 33) Yes 26 79%
No 7 21%
Development Stage (Total N = 33) Proof of Concept/Principle 1 3%
In development 1 3%
Prototype 11 33%
Pilot 0 0%
Validation Trial/Test in Clinical Trial 2 6%
Available/Developed 17 52%
Not specified 1 3%
Operating System
(Total N = 34)
iOS 11 32%
Android 18 53%
Windows 1 3%
Not specified 4 12%
Cost at Time of Publication (Total N = 33) 0–20 USD 8 24%
21–100 USD 2 6%
Over 100 USD 1 3%
Not specified/no costing yet 22 67%
Study Population Sample Size (Total N = 33) 1–30 7 21%
31–100 6 18%
101–500 4 12%
501–1000 1 3%
>1000 3 9%
None/Not specified 12 36%
Study Design (Total N = 33) Randomized Clinical Trials 4 12%
Observational Cohort Studies / Case-Control Studies 9 27%
Qualitative Studies 1 3%
Product / Technical Description 19 58%
Study Quality (Total N = 33) - (unsound) 0 0%
+ (suboptimal) 8 24%
++ (sound) 25 76%
Evaluation Values Used (Total N = 39) Measures of Diagnostic Accuracy 22 56%
Variability Measures 5 13%
Correlation Values 3 8%
Intraobserver and interobserver values 1 3%
Measurement Error Analysis 0 0%
Diverse Measurement Results 5 13%
Bland Altman Analysis 1 3%
None/Not specified 2 5%

Epidemiology

Most studies described technologies tested predominantly in the United States (13/33), the rest of the Americas (3/33), followed by Africa (9/33), then Asian countries (5/33) and Europe (3/33). The affiliation of the first author’s institutions is located predominantly in the United States (24/61), with fewer based in the Americas (7/61), Europe (14/61), Africa (9/61) and Asia (7/61). A noteworthy observation is that all the studies except one (32/33) involved at least one researcher affiliated with a high-income country institution, even if the research was ultimately conducted in an LMIC.

Most of the identified technologies focus on the diagnosis of communicable diseases (26/35), while the rest aim to screen for (9/35) these diseases. No study expressed monitoring as the main aim of their technology. The diagnostic method of choice chosen by the researchers was most often serological methods (11/35), followed by direct visualization of the microorganisms (10/35) and nucleic acid detection (10/35) (Fig 2). Two manuscripts examined machine learning/artificial intelligence-based innovations. The technologies targeted viral (18/42), bacterial (14/42), and parasitic (10/42) infections.

Fig 2. This figure visually presents several examples of mHealth technologies identified in our screen by functionality.

Fig 2

Explicit written permission to reproduce innovation schematics was obtained from source manuscript corresponding authors.

Almost half (17/33) of the included studies addressed an LMIC priority disease. Only a small number of technologies (4/33) targeted a neglected tropical disease. Table 2 describes the 16 studies of technologies aimed at diseases that were among the top ten in terms of disability-adjusted life years (DALYs) caused globally in 2019. Specifically, these studies targeted drug-susceptible tuberculosis, malaria, diarrheal diseases, and lower respiratory infections.

Table 2. Studies of technologies addressing diseases among the top ten in disability-adjusted life years globally in 2019.

Title Authors Disease/ Risk factor Pathogen Name Pathogen Family/Category Mobile Device Type Operating System Diagnostic Method Clinical Domain Researchers’ Country (or countries) Country where Research was Conducted
App-based symptoms screening with Xpert MTB/RIF Ultra assay used for active tuberculosis detection in migrants at point of arrivals in Italy: The E-DETECT TB intervention analysis Barcellini, L. et al. Pulmonary tuberculosis Mycobacterium tuberculosis Mycobacteriaceae/ Opportunistic infection Smartphone Android Nucleic Acid Detection/ Organism visualization Infectious diseases specialists/ Pulmonology Italy/United Kingdom Italy
Evaluation of a Mobile Phone-Based Microscope for Screening of Schistosoma haematobium Infection in Rural Ghana. Bogoch, I. et al. Schistosomiasis Schistosoma haematobium Soil-transmitted helminthiasis Smartphone Windows Organism visualization Infectious diseases specialists/ Pediatrics/Family medicine United States/Canada/Ghana Ghana
Mobile phone based clinical microscopy for global health applications. Breslauer, D. et al. Malaria/ Pulmonary TB P. falciparum/ M. tuberculosis Vector Borne Diseases/ Mycobacteriaceae-Opportunistic infection Mobile Phone Symbian Organism visualization Infectious diseases specialists United States United States
Evaluation of Malaria Diagnoses Using a Handheld Light Microscope in a Community-Based Setting in Rural Cote d’Ivoire. Coulibaly, J. et al. Malaria Plasmodium falciparum Vector Borne Diseases Smartphone iOS Organism visualization Infectious diseases specialists Côte d’Ivoire/ Switzerland/ United States/ Canada Côte d’Ivoire
Diagnosis of Schistosoma haematobium infection with a mobile phone-mounted Foldscope and a reversed-lens CellScope in Ghana. Ephraim, R. et al. Schistosomiasis Schistosoma haematobium Soil-transmitted helminthiasis Smartphone iOS Organism visualization Infectious diseases specialists/ Pediatrics/Family medicine United States/Canada/Ghana/ Switzerland Ghana
mPneumonia: Development of an Innovative mHealth Application for Diagnosing and Treating Childhood Pneumonia and Other Childhood Illnesses in Low-Resource Settings. Ginsburg, A. et al. Pneumonia Not specified Not specified Tablet Android Mobile health (mHealth)-based applications (Integrated Management of Childhood Illness algorithm) Infectious diseases specialists/ Pediatrics/Family medicine United States/Ghana Ghana
A point-of-need enzyme linked aptamer assay for Mycobacterium tuberculosis detection using a smartphone L. Li, Z. Liu, H. Zhang et al Pulmonary tuberculosis Mycobacterium tuberculosis Mycobacteriaceae/ Opportunistic infection Smartphone Android Nucleic acid detection Infectious diseases specialists/ Pulmonology China China
Rapid electrochemical detection on a mobile phone Lillehoj, Peter B.; Ming-Chun Huang et al Malaria Plasmodium falciparum Vector Borne Diseases Smartphone Android Nucleic acid detection Infectious diseases specialists United States United States
Integrated rapid-diagnostic-test reader platform on a cellphone Mudanyali, Onur; Stoyan Dimitrov, Uzair Sikora, et al Malaria/ TB/ HIV P. falciparum, P. vivax, P. ovale and P. malariae/ M. tuberculosis/ HIV Vector Borne Diseases/ Mycobacteriaceae-Opportunistic infection/ STD Smartphone Android and iOS Serology Infectious diseases specialists/ Internal Medicine United States United States
Mobile phone-based evaluation of latent tuberculosis infection: proof of concept for an integrated image capture and analysis system Naraghi, Safa; Tinashe Mutsvangwa, René Goliath et al Latent TB Mycobacterium sp Mycobacteriaceae/ Opportunistic infection Smartphone Android Tuberculin skin test induration. Infectious diseases specialists/ Internal Medicine South Africa/ United Kingdom South Africa
The Malaria System MicroApp: A New, Mobile Device-Based Tool for Malaria Diagnosis Oliveira; Allisson Dantas, Clara Prats, Mateu Espasa, et al Malaria Plasmodium falciparum Vector Borne Diseases Tablet Android Organism visualization Infectious diseases specialists Brazil/ Spain Brazil
Malaria Diagnosis Using a Mobile Phone Polarized Microscope Pirnstill, C.W. & Coté, G.L. Malaria Plasmodium chabaudi Vector Borne Diseases Smartphone iOS Organism visualization Infectious diseases specialists United States United States
Artificial neural network models to support the diagnosis of pleural tuberculosis in adult patients Seixas, J.M. et al. Pleural Tb Mycobacterium tuberculosis Mycobacteriaceae/ Opportunistic infection Tablets Not specified Artificial neural net- works (ANN) Infectious diseases specialists Brazil/ Canada Brazil
A paper-based microfluidic Dot-ELISA system with smartphone for the detection of influenza A Wu, Di et al Influenza Influenza A virus Orthomyxoviridae Smartphone Android Serology Infectious diseases specialists/ Family medicine United States/ China China
Deep Learning for Smartphone-based Malaria Parasite Detection in Thick Blood Smears Yang, Feng et al Malaria Plasmodium falciparum Vector Borne Diseases Smartphone Android Organism visualization Infectious diseases specialists Unites States/ China/ Thailand Bangladesh/ Thailand
Smartphone-Based Fluorescent Diagnostic System for Highly Pathogenic H5N1 Viruses Yeo, Seon-Ju et al Avian influenza H5N1 virus Orthomyxoviridae Smartphone Android Serology Infectious diseases specialists/ Family medicine Republic of Korea/ Vietnam/ United States Vietnam/ Republic of Korea

Technology

The most popular device used in the studies was the smartphone (29/36), followed by tablets (4/36) and mobile phones without smartphone capabilities (1/36). Technologies were predominantly developed for the Android operating system (18/34) and Apple iOS (iPhone Operating System) operating system (11/34), with Windows use present in just one product (1/34). Four publications did not specify an operating system used by their application. Most (26/33) of the mobile technologies required the use of peripheral accessories attached to them such as additional optical components, 3D printed attachments, foldscopes, cradles, and dongles. Cost data were not available for most (22/33) technologies. For the technologies with costing information (11/33), most were priced at less than 20 USD (8/11), followed by between 20 and 100 USD (2/11) and one over 100 USD (1/11) at the time of study publication.

Methodology

Most studies focused on technologies in an advanced development stage, i.e., already developed and/or commercially available (17/33) followed by studies describing prototypes (11/33). Regarding research design, most studies focused on descriptions of the technology without a formal evaluation of its efficacy or effectiveness (19/33) or assessed the technology using an observational cohort design (9/33). Only a few technologies were evaluated using a randomized design (4/33). Most publications reported study population sizes of less than 30 participants (7/33), followed by study sizes between 31 and 100 participants (6/33), then by study sizes between 101 and 500 (4/33) and over 1,000 subjects (1/33). Twelve studies did not specify a study population size.

Discussion

Principal results

The aim of our study was to identify and describe mobile-based technologies targeted specifically at healthcare workers to screen, diagnose, and monitor communicable diseases of public health importance in LMICs. We focused on technologies that constituted a new tool rather than digitizing an existing paper-based tool (i.e., knowledge-based algorithm) or providing a means of communicating between healthcare providers. Our screening found that there were four to five times as many publications on tools that facilitated communication, transferred data, or digitized an existing paper-based algorithm than there were on truly new tools for screening, diagnosing, and monitoring diseases. Additionally, we found that most technologies described in our study were tested in high-income countries using predominantly smartphones as mobile device and Android as the operating system of choice. All but one of the included studies involved at least one author affiliated with a high-income country research institution, with 42% of first authors reporting institutional affiliations in the United States or Europe.

Although half of the technologies were already at an advanced stage of development, few were tested under the rigor of large-scale randomized controlled studies. In general, the sample size was small, with 62% of the studies reporting 100 or fewer subjects. Over half of the included publications were simply technical descriptions of a product. Though most reported studies are of relatively affordable innovations (most under 20 USD), two thirds of the records did not yet specify a price point for the study technology. Most importantly, all the technologies were involved in diagnosis or screening for diseases—none were found to address monitoring of infections. We were, however, encouraged to note that half of the identified technologies focused on LMIC priority communicable diseases such as HIV, malaria and tuberculosis, although only 12% addressed a neglected tropical disease.

Controlling communicable disorders requires prompt screening, diagnosis, and monitoring of the infectious agent, both to treat the disease in the individual and to prevent its further transmission. A plethora of diagnostic tests and procedures have been available to the medical community for decades, and yet, LMICs are still burdened with high levels of communicable diseases [23]. This has been partly explained by poor availability of timely, high-quality diagnostic testing. Diagnostic laboratories in LMICs are usually poorly equipped or sparsely distributed [24], limiting their ability to provide accurate and rapid information to clinicians [25]. Furthermore, the costs of building and maintaining laboratories tends to be prohibitive in resource-constrained settings [24], and training specialized technical personnel requires further financial and logistic investments that are often unavailable in these countries. Our findings seem to suggest that efforts in the development of mobile technologies have also identified laboratory- and imaging-based testing as key obstacles, with approximately four out of five of our included studies focusing on diagnosis rather than screening or monitoring.

Furthermore, many of the diagnostic technologies we identified require the use of structural appendices, optical components, or specialized laboratory equipment that connect to the smartphone/tablet and its inherent software and hardware specifications. Therefore, these devices are not intended to completely replace standard diagnostic/screening tests and procedures, but rather to make them more accessible to professionals in resource-constrained settings. We note their importance here over standalone point of care diagnostic devices that do not interface with mobile devices, as the former facilitate transfer of the diagnostic attachment’s results between users who may not share the device and allows for the manipulation of the results within the mHealth environment. That said, these innovations are also limited by their disproportionate reliance on Apple iOS operating systems (as LMIC mobile devices tend to run on Google Android operating systems [26,27]) and frequent lack of large-scale rigorous evaluation in LMIC settings [26].

The rather small number of innovations in this sphere reflects the likely limited public health impact of the presently available device marketplace. Nevertheless, testing of these technologies in LMICs, the wide range of diagnostic methods employed, and the approach to a variety of emerging infectious pathogens that are being diagnosed using these devices are encouraging findings. These would seem to indicate that not only are these technologies being developed, but some are also entering a diversification phase, which may hold promise for the field [28]. Such general findings are consistent with similar work focusing on the mHealth innovations available for use to managed noncommunicable diseases in LMICs [11]. Future work by mHealth researchers could focus on technologies that can be scaled in a way that allows for widespread and cost-effective implementation in resource-constrained health systems, while also expanding their use to screen and monitor diseases rather than solely diagnose them.

Limitations

Our present study has several limitations. The single most important of these is the timeframe of the search, which occurred immediately preceding the COVID-19 pandemic. We recognize that the pandemic triggered a surge of interest in remote monitoring and wearable technologies [29,30], and their exclusion paints an incomplete picture of the full breadth of devices and innovations available for use in the diagnosis and management of coronavirus-like communicable diseases. Nevertheless, we hope that the timing of the article search allows the reader to understand what the ecosystem of mHealth independent of COVID-19 looked like, as the pandemic was responsible for significant resource-shifting away from pre-existing infectious diseases of substantial importance in LMICs, particularly neglected tropical diseases [3133]. Future systematic reviews of this sphere taking into account mobile innovations for SARS-CoV-2-related disease will be instrumental in characterizing the full scope of the technological armamentarium available in the ongoing post-COVID-19 world.

Next, from a search strategy perspective, we employed a restrictive set of inclusion criteria, which excluded patient-facing devices and apps which digitized communication, algorithms/guidelines, and clinical calculators. Such technologies may have important impacts on health outcomes in resource-poor settings but were outside the scope of our review. Thus, their notable contribution to the overall ecosystem of mHealth interventions for communicable diseases in LMICs is not available here for context. In fact, the search strategy did not include specific terms alluding to these knowledge-based algorithms such as Clinical Decision Support System (CDSS), or Clinical Decision Support Algorithms (CDSA) or machine learning / artificial intelligence technologies. The decision to exclude these specific terms was made to prioritize mobile health innovations with clear applicability and practical usability in LMICs. Nevertheless, we acknowledge that this approach may have resulted in the exclusion of some relevant articles that specifically focused on these technologies and their interface with in the realm of mHealth.

Lastly, from a methodological standpoint, the heterogeneity of the included studies regarding their results and methodological approaches precluded us from performing a meta-analysis and systematic assessment of study quality, necessitating a qualitative grading system instead. Additionally, we did not conduct a duplicate database search, and while our single investigator system ensured consistency in the screening process, this approach could have resulted in the possibility of rejecting relevant reports. This issue is particularly highlighted by the fact that one of our study inclusion criteria was that the mHealth technology must represent an innovation (and not reproduce existing guidelines)—in this regard, there could have been subjectivity introduced into the screening process that may affect the reproducibility of our work.

Conclusions

This systematic review found that there are only a small number of mHealth technologies that constitute novel methods of screening, diagnosing, or monitoring communicable diseases of public health importance in LMICs. Randomized trials and evaluations with large sample sizes of these technologies are still lacking, as are applications meant to monitor diseases. Additionally, most identified products require accessories or peripheral devices, and a majority rely on operating systems not common in LMICs, thus likely precluding more widespread clinical use in these settings. Future studies should examine the impact of COVID-19 on the ecosystem of these devices as well, given rapid, sweeping changes in mHealth catalyzed by the pandemic.

Supporting information

S1 PRISMA Checklist. PRISMA checklist.

(DOCX)

S1 Table. This table presents the full literature search strategy, listing all of the search terms used for each database queried.

(DOCX)

S2 Table. This table lists our analytic themes, as well as the categories, subcategories, and definitions that accompany them.

(DOCX)

S3 Table. This table presents the full list of studies identified by our search and screen, which were ultimately analyzed in our synthesis.

(DOCX)

Acknowledgments

Innovation schematics in Fig 2 are reproduced from the cited publications and remain the property of their respective authors/publishers. Attribution links are provided for the image sources and licenses.

Data Availability

All included data were generated from the published literature, with individual manuscripts the property of their authors or stakeholders. In accordance with PLOS Digital Health data availability regulations, a full list of analyses which comprise our full dataset is provided in S3 Table with citations, DOIs for all manuscripts, and PMID numbers where available.

Funding Statement

The authors received no specific funding for this work.

References

PLOS Digit Health. doi: 10.1371/journal.pdig.0000156.r001

Decision Letter 0

Ana Luísa Neves, Hamish S Fraser

20 Apr 2023

PDIG-D-22-00325

Healthcare provider-targeted mobile applications to diagnose, screen, or monitor communicable diseases of public health importance in low- and middle-income countries: a systematic review

PLOS Digital Health

Dear Dr. Chang,

Thank you for submitting your manuscript to PLOS Digital Health. After careful consideration, we feel that it has merit but does not fully meet PLOS Digital Health's publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript within 60 days Jun 19 2023 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at digitalhealth@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pdig/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

* A rebuttal letter that responds to each point raised by the editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

* A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

* An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

We look forward to receiving your revised manuscript.

Kind regards,

Ana Luísa Neves

Academic Editor

PLOS Digital Health

Journal Requirements:

1. Please send a completed 'Competing Interests' statement, including any COIs declared by your co-authors. If you have no competing interests to declare, please state "The authors have declared that no competing interests exist". Otherwise please declare all competing interests beginning with the statement "I have read the journal's policy and the authors of this manuscript have the following competing interests:"

2. If you did not receive any funding for this study, please simply state: “The authors received no specific funding for this work.”

3. Please provide separate figure files in .tif or .eps format only and remove any figures embedded in your manuscript file. Please also ensure that all files are under our size limit of 10MB.

For more information about figure files please see our guidelines:

https://journals.plos.org/digitalhealth/s/figures

https://journals.plos.org/digitalhealth/s/figures#loc-file-requirements

Editor's comments:

The search was performed in October 2019, nearly 4 years from the date of expected publication. Would be recommended to update the results - if this is not possible this should be clearly outlined in the limitations.

--------------------

Reviewers' comments:

Reviewer #1: Amazing contribución as a physician in a country in developpment I consider accurate a review like the one you have developped. No other commentary, statically accurate, well designed and a very useful contribution

Reviewer #2: Thank you very much for inviting me to review this systematic review.

The authors performed a literature search for mHealth technologies aimed at use in low- and middle-income countries. Such technologies must be mobile-based and aimed at use by healthcare professionals. It is interesting to note that the majority of studies included in the review (48%) were performed in the United States or Europe.

My main comment relates to scope of the inclusion and exclusion criteria employed in the study which in turn limits the impact or the learnings which can be taken away from this systematic review. As a technical piece the review fulfils the criteria set out by the authors but I would argue that the utility of the review and interest is limited.

- The review excluded any interventions which were not considered an “innovation” in mHealth, but at the same time many of the diagnostics means required additional equipment or reagents to operate. For example, Li et al., 2018’s paper included presented an aptameric assay for Mtb which is read using a smartphone. Although fulfilling the authors’ criteria I would argue that this study represents the development of a point of care test which incidentally makes use of a mobile phone to display its results, rather than being a mHealth innovation in itself which I understand is the aim of the review.

- The authors specifically excluded interventions which were “merely” digitalised paper-based tools, or “simply” facilitated communication. Whilst this is important in their restricted definition of the systematic review intentions, the language used does bely the utility of truly mHealth innovations which aim to make use of simple interventions to translate to actual utility.

- The inclusion date of the studies included ended in 2019 which limits the relevance of this review, given that COVID-19 was a significant catalyst to the development of smartphone and wearable-based innovations in mHealth. As a result there were no wearables studies (Armband/Smartwatch) included e.g. https://doi.org/10.1016/S2589-7500(19)30222-5 and https://doi.org/10.1038/s41591-020-1123-x which is a shame. One could perform an update of the review to present date specifically excluding COVID-19 as a condition for example.

- The majority of studies were of product descriptions only which restricts the authors’ ability to perform a meta-analysis or examine impact.

The difficulty in maintaining this a narrow scope of review is appreciated but given the paucity of relevant studies which fit into the authors’ restrictive criteria, I would like to see this broadened to include more studies to current date, or a broader range of conditions which make use of innovative mHealth technologies which are extremely relevant to LMICs e.g. retinal screening and other non-communicable diseases interventions.

Reviewer #3: The authors performed a systematic review on mobile healthcare provider-targeted mobile applications to diagnose, screen or monitor communicable diseases in LMICs. With their search terms they identified 33 studies meeting their inclusion criteria from 13262 identified by the first screen. Interestingly, almost all mobile apps were of diagnostic nature and almost none was used for monitoring the diseases.

In general, it is an interesting approach to perform such an analysis. The work is well done and the paper well written.

What is missing is to give the reader a clearer idea, what these apps actually can do, respectively should do. It would be of great help, if the authors could maybe categorize the different apps into groups but then provide clear examples what was really done, respectively what this apps can do (maybe do a "visual" table with screen shots etc. of what these apps really provide. it is not clear what an app can do regarding a serological diagnosis, respectively how e.g. parasites are visualized??

Line 242: here the word "save" does not make sense. Sentence should be rewritten.

Reviewer #4: The authors perform a systematic review on a subtype of mobile technologies to support healthcare workers, outlining studies and tools that differ from knowledge based clinical decision support algorithms. This is indeed a category of digital health devices that have been less described in previous reviews, and so a helpful contribution to better understanding the landscape of mobile health digital tools for healthcare workers. There are however some significant deviations to the protocol that have not been described, and clarity is needed on some of the approaches. The search was performed nearly 3.5 years ago limiting its relevance in a field that is constantly changing. I would propose a major revision to the manuscript before considering publication.

Minor concerns/comments:

1. In order for the reader to understand the appropriateness of the search strategy it would be necessary to understand the eligibility criteria. Would consider moving the eligibility criteria before the search strategy. This also aligns with the order proposed by PRISMA.

2. The authors present the full search strategy in the appendix, but would be helpful to understand the simplified search strategy in the main text. i.e. Combining the following search terms “mobile/tablet” and “application/software” and “diagnostics/monitoring”

3. The authors clearly state that the database search was not conducted in duplicate which may result in the possibility of rejecting relevant reports. Nonetheless it can be justified if the selection process is quite clear-cut.

a. Please address this limitation in the discussion.

b. What is unclear is if the screening was performed by one person or multiple. If multiple people, describe limitations this could have resulted in this process.

4. Line 176: I would remove “and the extremely rapid turnover in the science surrounding the disease and its many novel variants”. The search was performed in October 2019, as such it is the only reason why COVID-19 was not included.

5. Figure 1:

a. 48 manuscripts were excluded because they describe “current technologies” This is not clear and I am unable to make the link with the inclusion/exclusion criteria. Can the authors please clarify?

6. The search strategy does not include names of digital health tools that are typically associated to the technologies being looked for: these include “mHealth”, “Clinical Decision Support System”, “CDSS”, “Clinical Decision Support Algorithm”, “CDSA”, “eHealth”. Would suggest looking at other mHealth systematic reviews for established examples. Can the authors explain why these were not included in the search strategy and comment on this in the limitations. Was there a reason for not also including approaches to the search (ex. Machine learning, artificial intelligence)?

Major:

1. Inclusion criteria:

1.1. The following inclusion criteria were not pre-specified in the protocol: Technology must target healthcare professionals (line 160) and Technology must represent an innovation (line 165)

1.1.1. I don’t consider the first modification to be a significant deviation to the protocol as it is in some way implied in the protocol, however the second modification is a much bigger modification to the protocol. The authors should clarify when this inclusion criteria was added (before or after the start of the search, before or during the screening process), and why this inclusion criteria was added. If added during the search process, please clarify if the screening process was restarted given the change in search strategy.

1.1.2. Furthermore the inclusion criteria definition of “must represent an innovation” “reproduce existing guidelines” is not straightforward and thus vulnerable to personal interpretation. This would hinder reproduction of such a systematic review. In reference to the minor issue highlighted in point 3, this would be a good justification for using at least two people to screen research articles. The search should either be done once again by a second person, or clearly outlined as a limitation in the discussion.

2.1.3. Line 228 the inclusion/exclusion criteria previously described in line 165 is different. Would suggest to use the most detailed description in the methods.

2.1.4. Based on the inclusion criteria, I am unclear why numerous electronic clinical decision support systems (IEDA/REC, eIMCI, Medsinc, ALMANACH, ePOCT, etc) were excluded. I assume it may be due to the “not reproduce existing guidelines” criteria. Of note IEDA has a respiratory count aid similar to that as mPneumonia (included in the authors’ review), however I am unsure this is described in the publications. Many of the other tools mentioned calculates drug doses, and z-scores, would this not meet inclusion criteria? Many were also not just digitization of paper guidelines, as many included significant changes to the clinical algorithms. While I think sensible that the authors concentrate on non-knowledge based mHealth tools, this is not quite clear in the inclusion criteria. Would consider clarifying this inclusion criteria by including the concept of “knowledge based algorithm” as described by Papadopoulos et al.: (https://link.springer.com/article/10.1007/s12553-022-00672-9) This of course would only to help reproduce such a review by other research groups.

PLOS Digit Health. doi: 10.1371/journal.pdig.0000156.r003

Decision Letter 1

Ana Luísa Neves, Hamish S Fraser

11 Aug 2023

Healthcare provider-targeted mobile applications to diagnose, screen, or monitor communicable diseases of public health importance in low- and middle-income countries: a systematic review

PDIG-D-22-00325R1

Dear Dr. Chang,

We are pleased to inform you that your manuscript 'Healthcare provider-targeted mobile applications to diagnose, screen, or monitor communicable diseases of public health importance in low- and middle-income countries: a systematic review' has been provisionally accepted for publication in PLOS Digital Health.

Before your manuscript can be formally accepted you will need to complete some formatting changes, which you will receive in a follow-up email from a member of our team. 

Please note that your manuscript will not be scheduled for publication until you have made the required changes, so a swift response is appreciated.

IMPORTANT: The editorial review process is now complete. PLOS will only permit corrections to spelling, formatting or significant scientific errors from this point onwards. Requests for major changes, or any which affect the scientific understanding of your work, will cause delays to the publication date of your manuscript.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they'll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact digitalhealth@plos.org.

Thank you again for supporting Open Access publishing; we are looking forward to publishing your work in PLOS Digital Health.

Best regards,

Ana Luísa Neves

Academic Editor

PLOS Digital Health

***********************************************************

Reviewer Comments (if any, and for reference):

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #3: All comments have been addressed

Reviewer #4: All comments have been addressed

**********

2. Does this manuscript meet PLOS Digital Health’s publication criteria? Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe methodologically and ethically rigorous research with conclusions that are appropriately drawn based on the data presented.

Reviewer #3: Yes

Reviewer #4: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #3: N/A

Reviewer #4: N/A

**********

4. Have the authors made all data underlying the findings in their manuscript fully available (please refer to the Data Availability Statement at the start of the manuscript PDF file)?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception. The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #3: Yes

Reviewer #4: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS Digital Health does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #3: Yes

Reviewer #4: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #3: The authors answered the questions of the reviewers at best.

Reviewer #4: I congratulate the authors again on this well written and important systematic review. In my opinion the revisions address all the concerns of the reviewers, and was clearly written.

Although not mandatory, one point to consider mentioning in regards to the scope of the paper is the fact that while "innovative methods" may be important to improving care, these "innovative methods" often translate to less "explainability", and worse "black box algorithms". Such approaches sometimes are indeed more accurate than more explainable models, but may hinder clinician understanding of the tools and decisions, which in turn may impact clinical and patient autonomy, continued learning, and fostering trust for a good physician-patient relationship.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

Do you want your identity to be public for this peer review? If you choose “no”, your identity will remain anonymous but your review may still be made public.

For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #3: No

Reviewer #4: Yes: Rainer Tan

**********

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 PRISMA Checklist. PRISMA checklist.

    (DOCX)

    S1 Table. This table presents the full literature search strategy, listing all of the search terms used for each database queried.

    (DOCX)

    S2 Table. This table lists our analytic themes, as well as the categories, subcategories, and definitions that accompany them.

    (DOCX)

    S3 Table. This table presents the full list of studies identified by our search and screen, which were ultimately analyzed in our synthesis.

    (DOCX)

    Attachment

    Submitted filename: Response to Reviewers.pdf

    Data Availability Statement

    All included data were generated from the published literature, with individual manuscripts the property of their authors or stakeholders. In accordance with PLOS Digital Health data availability regulations, a full list of analyses which comprise our full dataset is provided in S3 Table with citations, DOIs for all manuscripts, and PMID numbers where available.


    Articles from PLOS Digital Health are provided here courtesy of PLOS

    RESOURCES