Abstract
Introduction: Clinical research faces the challenge of declining physician participation in the pursuit of advancing evidence-based medicine. This secondary analysis focuses on the interactive mobile health (mHealth) application’s utility as a real-time data collection tool in clinical settings, specifically targeting cow's milk protein allergy (CMPA) management. The study assesses the mHealth application’s potential to alleviate data collection inefficiencies and improve physician engagement in clinical research.
Methods: The analysis utilized de-identified survey data from a prospective cohort of 61 physicians who employedan interactive mobile survey application over 12 weeks, documenting 808 patient visits.
Results: Of these physicians, 52 (85%) completed initial and follow-up surveys, with the predominant reason for exclusion being incomplete or non-submission of data. Of the 404 patient surveys collected, 75 (19%) were excluded primarily due to the absence of follow-up information.
Conclusion: These results underscore the application’s practicality in streamlining clinical data collection, evidenced by the high rate of survey completion and the efficiency of data management among participating physicians. The findings indicate that interactive mobile health applications aided in collecting and managing clinical data, with 85% of physicians completing surveys for initial and follow-up visits. This high completion rate suggests the potential for mobile applications to mitigate traditional barriers to physician participation, such as time constraints and complex data management. The study contributes empirical evidence to the potential of mobile technology in enhancing research efficiency and engagement among physicians in the context of CMPA management. While the results are insightful, further studies are encouraged to extend the utility of the interactive mobile survey application and similar technologies across diverse clinical research areas, reinforcing mobile technology’s role in transforming clinical research practices.
Keywords: barriers to research, clinical research, data collection software, mobile apps (mhealth), mobile phone application, technology
Introduction
Mobile devices have become integral to daily life, profoundly impacting healthcare through the development of mobile phone applications or mobile health (mHealth), defined by the WHO as “medical and public health practice supported by mobile devices, such as mobile phones, patient monitoring devices, personal digital assistants, and other wireless devices” [1,2]. These applications have demonstrated potential in various healthcare domains, including fitness, chronic diseases, mental health, and general health monitoring [2-4]. With the emergence of over 100,000 new health mobile phone applications in 2015 alone, the potential of mHealth to enhance medical and public health practice is becoming increasingly evident [2]. However, despite this promising trend, the field of clinical research, a vital component of evidence-based medicine, confronts significant challenges, particularly in engaging physicians
Clinical trials, the cornerstone of evidence-based medicine, are experiencing a concerning decline in physician participation [5-8]. Over the last 40 years, clinical research conducted by practicing physicians diminished from a peak of 4.7% in the 1980s to 1.5% in 2019 [9]. This decline is attributed to factors such as the cumbersome nature of clinical research, financial disincentives, and a lack of available mentors for emerging physician-scientists [9]. Moreover, traditional data collection methods in these trials often posed barriers, including time-intensive processes, complexity, and concerns over data privacy and accuracy [9,10]. The result of these challenges is seen in the low response rates of clinicians in different studies [11-14]. Therefore, there is a pressing need for efficient, user-friendly data collection methods that can help mitigate these barriers and facilitate physician engagement in clinical research.
This study evaluates a mobile health application as a tool for improving clinical data collection efficiency and physician participation in clinical research, addressing the critical barriers identified in previous research. We conducted a secondary analysis of a mobile application as a real-time data collection tool in clinical research settings within a prospective cohort study involving infants diagnosed or suspected of having cow's milk protein allergy (CMPA). These patients were managed with an extensively hydrolyzed formula (EHF) or an amino acid formula (AAF). The primary goal of this study is to assess the potential of mobile applications in collecting and managing patient data, with a particular focus on evaluating its potential to streamline data collection processes, thereby enhancing clinical research and addressing some of the traditional barriers impeding physician participation. We hypothesize that the use of mobile health applications will streamline the data collection process for clinicians engaged in office-based clinical research.
Materials and methods
Study objective
This secondary analysis of a primary prospective cohort study evaluated a mobile research application’s effectiveness in real-time data collection from U.S. physicians during patient interactions and its potential to boost physician engagement in clinical research. The initial study involved de-identified data collection at the start of hypoallergenic formula use (baseline) and three to six weeks later (follow-up) in infants six months old or less with suspected or diagnosed CMPA. The findings from the primary study are reported separately [15-18].
Johns Hopkins All Children's Hospital Institutional Review Board issued approval IRB00279920. This study utilized de-identified data and informed consent was obtained by the parents of all patients.
Study population and design
The ZS Moments™ application, developed by ZS Associates (Bellevue, WA, USA) and used in this prospective cohort study, facilitated real-time data capture in a clinical setting with an efficient interface and patient de-identification for privacy. Physicians involved in the study were required to install the application on their mobile devices and complete an initial demographic survey to confirm their eligibility for participation (Table 1). Physicians were recruited in the United States between July and October 2021. The overall study size was determined to be the total number of physicians who met all inclusion criteria by the end of the enrollment period.
Table 1. Physician inclusion and exclusion criteria.
Physician Inclusion Criteria | Physician Exclusion Criteria |
Two or more years of experience in a clinic-based setting | Did not treat at least 2 out of the last 10 CMPA patients with a hypoallergenic formula (EHF or AAF) |
General pediatrician or specialty in pediatric gastroenterology, pediatric allergy/immunology, or gastroenterology | Switched patient treatment before a subsequent follow-up visit |
Seen at least two newly diagnosed CMPA patients per week |
The survey asked physicians about their primary specialty, years in practice, practice setting, average weekly patient count, weekly CMPA patient count, and CMPA treatment plans. After the initial survey, physicians were notified of their study eligibility, and upon confirmation, de-identified data was collected during patient encounters. Each patient was assigned a unique animal identifier to maintain anonymity across visits and to reduce statistical bias. Patient eligibility criteria are detailed in Table 2.
Table 2. Patient inclusion and exclusion criteria.
Patient Inclusion Criteria | Patient Exclusion Criteria |
Diagnosed or suspected CMPA | Did not receive a hypoallergenic formula (EHF or AAF) as treatment |
Treated with a hypoallergenic formula (EHF or AAF) | >6 months of age at the time of treatment |
≤6 months of age at the time of treatment | Did not have survey data collected at the start of treatment and/or at the next follow-up visit |
Survey data was collected at the start of treatment and the subsequent follow-up visit (at least three weeks later) |
The initial survey collected details about the visit type (in-person or telemedicine), patient demographics (age, gender, height, and weight percentiles), family allergy history, and current symptom severity, rated from 0-3. The follow-up survey, after prescribing hypoallergenic formula, recorded changes in treatment, symptom scores, and physician’s satisfaction with the CMPA treatment, including its effectiveness and recommendation potential. A pictograph of the study timeline appears in Figure 1.
Statistical analysis
Statistical analysis was conducted to assess the differences in patient outcomes between those using EHF and AAF. Descriptive statistics were employed to summarize the physician and patient demographics, as well as the frequency of patient management by the participating physicians. Categorical variables, such as physician specialty and patient demographics, were presented as frequencies and percentages, and comparisons between groups were made using chi-square tests. For continuous variables, such as the duration between baseline and follow-up visits, mean values and standard deviations were calculated, and independent t-tests were used to compare the means between the EHF and AAF cohorts. All analyses were performed using SPSS® software (IBM®, Armonk, NY, USA), with a significance level set at p < 0.05.
Results
Physician demographics
Of the 61 physicians eligible and collecting data, 52 (85%) completed both baseline and follow-up surveys using the interactive mobile survey application and were included in the final dataset. Nine physicians were excluded primarily for not submitting follow-up data. Most were general pediatricians (87%), with smaller numbers in pediatric gastroenterology and allergy/immunology (6% each), and one in gastroenterology (1%) (Figure 2A). Patient management frequency varied: 22 physicians saw two to four CMPA patients weekly, 20 saw five to 10, nine managed 11-20, and one handled over 20 (Figure 2B). No significant differences were found among groups (p>0.05).
Patient demographics and data collected
Data from 404 patients across 808 visits were collected, with 339 patients included in the final primary analysis: 222 using EHF and 107 using AAF. Figure 3 shows the stratification of included patient charts. Charts were mainly excluded for incomplete data or non-submission. Patient chart inclusion, categorized by physician specialty and formula type, is detailed in Table 3. No significant differences were found among groups (p>0.05). Patient demographics are illustrated in Figures 4A, 4B, and the duration between baseline and follow-up visits for both EHF and AAF cohorts is depicted in Figure 4C.
Table 3. Number of patient charts created on the interactive mobile survey application (used on baseline and follow-up visits) per physician specialty for patients on EHF or AAF.
Number of charts collected using the interactive mobile survey application for patients using EHF (n) | Number of charts collected using the interactive mobile survey application for patients using AAF (n) | |
General Pediatrics | 194 | 88 |
Pediatric Gastroenterology | 12 | 8 |
Pediatric Allergy/Immunology | 11 | 6 |
Gastroenterology | 5 | 5 |
Total | 222 | 107 |
Discussion
Our secondary analysis highlights the effectiveness of the interactive mobile survey application in real-time data collection within clinical settings. We found that 85% of physicians completed both initial and follow-up surveys using the application, demonstrating its potential to improve engagement and address common challenges in clinical research, such as time constraints and complex data management.
The high completion rate observed in our study addresses the significant barriers identified in previous literature, such as the extensive time commitments and challenges in managing patient data that often deter physician participation. Previous studies utilizing mobile applications in clinical research have allowed for increased insight into clinical reasoning and patient preferences [19,20]. Our findings suggest that the interactive mobile health application's usability and integrated privacy features significantly reduce these barriers, promoting greater physician involvement in clinical trials. This advancement is crucial given the historical reluctance of physicians to engage in research due to time constraints, administrative burdens, and privacy concerns [21-23].
Moreover, our study indicates that the interactive mobile health application's ease of use and efficient data management lowers barriers to physician participation. The findings underscore the benefits of integrating mobile technology in clinical settings to enhance research efficiency and engagement. Specifically, features like real-time data capture and a user-friendly interface in the interactive mobile survey application play a crucial role in facilitating these improvements.
Our study offers insights into the use of a mobile application by physicians in clinical research, but it's important to note its limitations. The small number of physician participants may affect the external validity of our results. There's also a potential selection bias, as technologically adept physicians might be more likely to participate. Additionally, the study did not extensively explore user satisfaction or feedback on the application’s functionality, which limits our understanding of its pros and cons. Furthermore, as this was a secondary analysis of existing data, no formal data monitoring process was implemented, which could affect data integrity and reliability assessment. Finally, the brief study duration of three to six weeks constrains our ability to evaluate the application's impact on long-term physician retention.
Our study suggests that mobile technology, exemplified by the interactive mobile survey application, has broader applications in clinical research beyond CMPA management, significantly enhancing efficiency and data quality. The high completion rates observed in our study highlight the potential for such applications to streamline data collection, thereby boosting participation and improving future research outcomes. These results support the expanding integration of technology in healthcare and underscore the need for further exploration to maximize the benefits of mobile applications in clinical research settings.
Conclusions
In conclusion, our study highlights the potential of mobile software to improve clinical research by addressing longstanding participation challenges. Future studies should capitalize on our findings to explore innovative solutions and develop more effective clinical research tools.
Acknowledgments
We want to thank Heather Evans, MS, RDN, LDN, CNSC, CLC, and Jennifer Wampler, PhD., for their critical manuscript reviews.
Funding Statement
A grant (RB2073) from Reckitt supported article processing and presentation fees for this research. Additionally, Reckitt provided funding for data collection through ZS Associates.
Disclosures
Human subjects: Consent for treatment and open access publication was obtained or waived by all participants in this study. Johns Hopkins All Children's Hospital Institutional Review Board issued approval IRB00279920. This study utilized de-identified data and informed consent was obtained by the parents of all patients. No compensation was provided for participants.
Animal subjects: All authors have confirmed that this study did not involve animal subjects or tissue.
Conflicts of interest: In compliance with the ICMJE uniform disclosure form, all authors declare the following:
Payment/services info: A grant (RB2073) from Reckitt supported article processing and presentation fees for this research. Additionally, Reckitt provided funding for data collection through ZS Associates.
Financial relationships: Michael J. Wilsey declare(s) a grant and personal fees from Reckitt. Study funders had no role in developing the study protocol, collecting, analyzing, or interpreting data, writing the manuscript, or deciding to publish the results. Dr. Michael J. Wilsey has served as a consultant for Reckitt; the remaining authors have no conflicts of interest to disclose.
Other relationships: All authors have declared that there are no other relationships or activities that could appear to have influenced the submitted work.
Author Contributions
Acquisition, analysis, or interpretation of data: Jessica V. Baran, Jerry M. Brown, Luke Lamos, Jared Florio, Jesse Beacker, Lea V. Oliveros, Abigail L. Fabbrini, Andrew A. Farrar, Panida Sriaroon, Michael J. Wilsey
Drafting of the manuscript: Jessica V. Baran, Jerry M. Brown, Luke Lamos, Michael J. Wilsey
Critical review of the manuscript for important intellectual content: Jessica V. Baran, Jerry M. Brown, Luke Lamos, Jared Florio, Jesse Beacker, Lea V. Oliveros, Abigail L. Fabbrini, Andrew A. Farrar, Panida Sriaroon, Michael J. Wilsey
Concept and design: Michael J. Wilsey
References
- 1.Mobile apps in oncology: a survey on health care professionals’ attitude toward telemedicine, mHealth, and oncological apps. Kessel KA, Vogel MM, Schmidt-Graf F, Combs SE. J Med Internet Res. 2016;18:0. doi: 10.2196/jmir.6399. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Book review: mHealth: New Horizons for Health through Mobile Technologies: Based on the Findings of the Second Global Survey on eHealth (Global Observatory for eHealth Series, Volume 3) Ryu S. Healthc Inform Res. 2012;18:231–233. [Google Scholar]
- 3.mHealth: a strategic field without a solid scientific soul. A systematic review of pain-related apps. de la Vega R, Miró J. PLoS One. 2014;9:0. doi: 10.1371/journal.pone.0101312. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Mobile apps for weight management: a scoping review. Rivera J, McPherson A, Hamilton J, et al. JMIR Mhealth Uhealth. 2016;4:0. doi: 10.2196/mhealth.5115. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Time to research Australian physician-researchers. Traill CL, Januszewski AS, Larkins R, Keech AC, Jenkins AJ. Intern Med J. 2016;46:550–558. doi: 10.1111/imj.13043. [DOI] [PubMed] [Google Scholar]
- 6.The clinical investigator as an endangered species. Wyngaarden JB. N Engl J Med. 1979;301:1254–1259. doi: 10.1056/NEJM197912063012303. [DOI] [PubMed] [Google Scholar]
- 7.The physician-scientist workforce in the United States. Deligiannidis KM. Acta Psychiatr Scand. 2015;132:317–318. doi: 10.1111/acps.12435. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Clinician-scientists in Canada: barriers to career entry and progress. Lander B, Hanley GE, Atkinson-Grosjean J. https://doi.org/10.1371/journal.pone.0013168. PLoS One. 2010;5 doi: 10.1371/journal.pone.0013168. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Saving the endangered physician-scientist - a plan for accelerating medical breakthroughs. Jain MK, Cheung VG, Utz PJ, Kobilka BK, Yamada T, Lefkowitz R. N Engl J Med. 2019;381:399–402. doi: 10.1056/NEJMp1904482. [DOI] [PubMed] [Google Scholar]
- 10.Barriers to participation in therapeutic clinical trials as perceived by community oncologists. Wong AR, Sun V, George K, et al. JCO Oncol Pract. 2020;16:0–58. doi: 10.1200/JOP.19.00662. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Why are response rates in clinician surveys declining? Wiebe ER, Kaczorowski J, MacKay J. https://pubmed.ncbi.nlm.nih.gov/22611609. Can Fam Physician. 2012;58:0–8. [PMC free article] [PubMed] [Google Scholar]
- 12.Response rates in postal surveys of healthcare professionals between 1996 and 2005: an observational study. Cook JV, Dickinson HO, Eccles MP. BMC Health Serv Res. 2009;9:160. doi: 10.1186/1472-6963-9-160. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Health care provider surveys in the United States, 2000-2010: a review. McLeod CC, Klabunde CN, Willis GB, Stark D. Eval Health Prof. 2013;36:106–126. doi: 10.1177/0163278712474001. [DOI] [PubMed] [Google Scholar]
- 14.Reported response rates to mailed physician questionnaires. Cummings SM, Savitz LA, Konrad TR. https://pubmed.ncbi.nlm.nih.gov/11221823. Health Serv Res. 2001;35:1347–1355. [PMC free article] [PubMed] [Google Scholar]
- 15.Extensively hydrolyzed formula improves allergic symptoms in the short term in infants with suspected cow’s milk protein allergy. Wilsey MJ, Florio J, Beacker J, et al. Nutrients. 2023;15 doi: 10.3390/nu15071677. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Short-term symptom improvement in infants with suspected cow's milk protein allergy using amino acid formula: a prospective cohort analysis. Wilsey MJ, Baran JV, Lamos L, et al. Front Nutr. 2023;10:1208334. doi: 10.3389/fnut.2023.1208334. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Extensively hydrolyzed formula and infant colic symptoms: secondary analysis of a prospective cohort study. Brown JM, Baran JV, Lamos L, et al. Clin Pediatr (Phila) 2024;63:1579–1584. doi: 10.1177/00099228241236033. [DOI] [PubMed] [Google Scholar]
- 18.Clinician experience with using hypoallergenic formulas to treat infants with suspected cow’s milk protein allergy: a secondary analysis of a prospective survey cohort. Beacker J, Brown JM, Florio J, et al. Pediatr Gastroenterol Hepatol Nutr. 2023;26:277–283. doi: 10.5223/pghn.2023.26.5.277. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Navigating formula shortages: associations of parental perspectives on transitioning to alternative infant formulas for cow's milk protein allergy during the 2022 national formula shortage. Fabbrini AL, Farrar AA, Brown JM, et al. Front Allergy. 2023;4:1333570. doi: 10.3389/falgy.2023.1333570. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Impact of the 2022 national formula shortage on clinical decision-making of healthcare providers in switching amino acid formulas for infants with cow's milk protein allergy: a survey-based study. Baran JV, Brown JM, Farrar AA, et al. Front Pediatr. 2024;12:1328506. doi: 10.3389/fped.2024.1328506. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Simply no time? Barriers to GPs' participation in primary health care research. Hummers-Pradier E, Scheidt-Nave C, Martin H, Heinemann S, Kochen MM, Himmel W. Fam Pract. 2008;25:105–112. doi: 10.1093/fampra/cmn015. [DOI] [PubMed] [Google Scholar]
- 22.Barriers to participation in clinical trials: a physician survey. Mahmud A, Zalay O, Springer A, Arts K, Eisenhauer E. Curr Oncol. 2018;25:119–125. doi: 10.3747/co.25.3857. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Global health and emergency care: overcoming clinical research barriers. Levine AC, Barry MA, Agrawal P, Duber HC, Chang MP, Mackey JM, Hansoti B. Acad Emerg Med. 2017;24:484–493. doi: 10.1111/acem.13142. [DOI] [PubMed] [Google Scholar]