Skip to main content
Digital Health logoLink to Digital Health
. 2024 Nov 8;10:20552076241290405. doi: 10.1177/20552076241290405

‘Assessing patients’ perception of the potential utility of visual function home monitoring app among patients with diabetes in Saudi Arabia’

Hanan Khalid Mofty 1,2, Marwan A Abouammoh 3, Hala A Al-Muqbil 4, Khaled S AL-Zahrani 5, Talhah M AL-Ghasham 6, Abdullah A Assiri 7, Ahmad T AL-Mnaizel 8, Hayat S Mushcab 8, Kholoud A Bokhary 2, Ruth E Hogg 1,
PMCID: PMC11544648  PMID: 39525562

Abstract

Aims

To determine the acceptability and identify potential concerns and barriers of using a hypothetical smartphone application (app) for home monitoring (HM) of visual function among patients with diabetes.

Methods

Quantitative, cross-sectional study using a self-administered questionnaire. Patients diagnosed with diabetes aged between 20 and 70 years were included. The research was conducted across five regions in Saudi Arabia. The questions were adapted from a validated, published questionnaire and translated into Arabic. It focused on socio-demographic factors and barriers which associated with the acceptance of the hypothetical visual function HM app, using descriptive statistics.

Results

A total of 240 patients with diabetes participated in this study. About half of the participants (40.4%) ranged between 40 and 59 years; 42.5% were male, and most of the participants (93.8%) lived within 2 h of their healthcare facility. The rejection to the use of a hypothetical HM app was associated with increased age (p = 0.025), lower education level (p = 0.023), urbanicity (p = 0.011), residing closer to health centres (p = 0.021), and never experiencing telehealth services previously (p = 0.025). Logistic regression revealed that accepting a hybrid clinic approach was more likely to be acceptable by younger patients (20–39 years: OR, 5.01; 95% CI, 1.82–13.82; p < 0.001; and 40–59 years: OR, 2.28; 95% CI, 0.084–5.00; p = 0.48), as well as patients who attended primary healthcare or specialised governmental clinics (p = 0.038 and p = 0.019, respectively).

Conclusion

Factors that altered patients’ acceptance of the hypothetical app included their age, educational level, urbanicity, traveling distance, and telehealth experience. Therefore, careful consideration of acceptability and barriers is essential before implementing such an intervention.

Keywords: Diabetic retinopathy, visual function, home monitoring, patients’ acceptance, barriers

Introduction

Diabetes is a leading cause of sight loss internationally due to the development of diabetic retinopathy (DR) and/or diabetic macular oedema (DMO). The International Diabetes Federation reported that the prevalence of adults with diabetes worldwide is 537 million adults (age range, 20–79 years). 1 According to the Global Burden of Disease Study (2021), DR is now the fifth leading cause of blindness in adults aged 50 years and older. 2 The global prevalence of retinal complications among individuals with diabetes is 22.27% for DR, 6.17% for vision-threatening DR, and 4.07% for clinically significant macular oedema. 3

Studies indicate that diabetes disproportionately affects adult populations in countries such as the Middle East and North Africa (MENA) region. In this region, the prevalence of diabetes was 9.3% in 2021, and it is expected that the number of people with diabetes will rise to 11.3% by the year 2050. 4 In addition, the MENA population with visual impairment due to DR was estimated to be approximately 3.2 million by the year 2020. 5

Though the urbanised cities in Saudi Arabia have considerable healthcare services focused on diabetes, there has been a significant rise in the prevalence of diabetes by about 25.4% compared with rural areas.6,7 Further evaluation of the prevalence of DR in the Saudi National Diabetes Registry data showed an overall percentage of 19.7% due to the absence of fully structured screening programmes 7 and the shortage of healthcare infrastructure in rural areas.

Patients with diabetes require a regular comprehensive eye examination as DMO is considered a major cause of significant visual impairment. Therefore, carrying out a routine DR screening in primary eye care clinics according to established guidelines is important,8,9 as it enhances the ability to monitor the progression of retinopathy or instigate urgent referral if undertaken by well-trained specialists. 10 This can be delivered in most tertiary hospitals. However, tracking those patients regularly and effectively is challenging from the service delivery perspective.11,12 In addition, the high examination costs in the private sector and the difficulty reaching clinics from rural communities lead to patients dropping out of follow-up. This can lead to delayed or diminished outcomes and an increased risk of sight loss.

Thus, telehealth might offer a solution in primary care as several studies have shown its potential to reduce the burden on an already strained health system and solve delays in delivering healthcare services to patients with chronic diseases such as cardiovascular disease and diabetes. 13 In addition, it can provide a regular screening and monitoring examination for DR. 14

Before the COVID-19 pandemic, Alshammari et al. (2019) reported that 70% of 781 general beneficiaries in Saudi Arabia were satisfied and interested in using telehealth even with limited experience and knowledge about the app. 15

In addition, telehealth services have been developed with diverse implementation methods across several hospital departments in Saudi Arabia which were extensively adopted during the COVID-19 pandemic. About 19 digital applications (apps) or platforms were launched to provide healthcare services, education, and telecommunication.16,17 Government records have revealed that more than two million users had a general medical consultation during the pandemic, indicating the popularity of remote health services.18,19

Recently, various digital apps have been developed to measure visual function at home, such as DigiVis, 20 Smart Optometry, 21 and Peek Acuity. 22 Other digital apps apply gamification to increase the frequency of visual function measurements, such as Odysight 23 and OKKO health. 24

The roll out of digital health interventions requires an appreciation of local culture and traditions is essential to increase uptake. Factors such as patient's age, education level, economic situation, willingness to travel to clinics, and the costs associated with such a journey likely have a massive impact on the usability outcomes. Understanding these factors and other possible barriers to uptake will enable us to consider whether hypothetical home monitoring (HM) app is acceptable in this context. Therefore, this study aimed to assess the acceptability of a visual function HM app after the COVID-19 outbreak in Saudi Arabia.

Methodology

Study design and setting

This is a quantitative, analytical, cross-sectional study using a self-administered questionnaire under the supervision of optometrists. This study was approved by the research ethics committee under the deanship of scientific research at King Saud University (E-22-6647) and adheres to the Declaration of Helsinki; additional approvals were obtained from the collaborating institutions. Written consent was obtained from all participants. The study was undertaken from August 2022 to October 2023. The research was conducted in six centres in Saudi Arabia (see Table 1 for centre characteristics).

Table 1.

Study centres and their characteristics.

Centre Type Location
Diabetic Screening Clinic in King Khaled University Hospital (KKUH) Governmental hospital Central province
King Salman Social Centre (KSSC) Public centre Central province
Diabetic Screening Clinic in King Fahad Forces Armed Hospital (KFFAH) Governmental hospital Western province
Optometry Clinic in North Medical Tower Hospital/The Northern Borders Health Cluster Governmental hospital Northern province
Optometry Clinic in Vision World Center Private sector Southern province
Diabetic Screening Clinic in Johns Hopkins Aramco Healthcare (JHAH) Private sector Eastern province

The sample size was calculated using the G*Power online tool 25 with a confidence interval (CI) of 95%, a margin of error of 5%, and a critical Z (−1.64). Based on prior knowledge of estimates about the prevalence of diabetes in Saudi Arabia, 26 a population proportion of 20% was applied, leading to a calculated target sample size of 172.

Study participants and data collection procedures

Patients were recruited according to the information held within the hospitals/institutions in their medical records. Patients were aged between 20–70 years old, were diagnosed with either Type 1 or Type 2 diabetes, and were of Arabic ethnicity. Any patient below 20 years of age or with any evidence of cognitive decline was excluded. Their clinic presentation was mainly for a routine eye examination or screening due to a referral from another department. All cases were non-urgently referred after having a fundus examination test with either optical coherence tomography (OCT) or direct ophthalmoscope. The questionnaire was provided on a tablet directly after the examination or as a hyperlink to be sent to the patients through their WhatsApp or email to receive their responses within the examination day. The questionnaire was adapted from a validated questionnaire titled (Assessment of Patient Preferences for Telehealth in Post-COVID-19 Pandemic Health Care). 27 Further modifications were made regarding the average population size across cities and average total income. Additional questions focusing on visual performance and mobile phone proficiency were added. All questions were translated into Arabic to ensure accessibility for participants. The complete questionnaire in both English and Arabic is provided in Supplemental material. Each centre was provided with a target for sample responses ranging between n = 30–60 depending on each region's population distribution. A consecutive sampling strategy was employed.

The first section of the questionnaire contains 17 questions about patient socio-demographic characteristics, such as age, education level, total income, location to the nearest primary eye care clinic, and visual function status. Other questions included barriers to implementation, such as traveling time, whether technical assistance is required when using a mobile telephone, whether an escort was needed for attending visits, and the gender of the care provider. The responses to these questions were either numerical or short descriptive multiple-choice answers. Two ‘yes/no’ questions sought to determine whether the patients used telehealth options during the COVID-19 pandemic. Additional evaluation of a patient's acceptance of the visual function HM app was recorded in multiple-choice questions with further free-text short answer fields to enable them to insert their perspectives towards the selected option.

The second section contains five questions that gather information on the patient's preference for the following comparisons. Firstly, the respondents were asked about their baseline preference for an in-person or an HM app for a nonemergency ocular condition that could be handled either way. Then, the scope of the question was narrowed by specifying an HM app option. For those who preferred in-person, a second question was posed, offering the preferred modality for an out-of-pocket cost of 370 SR (98 USD) or an HM app. The fees were selected based on the average consultation fees in some private sector centres in Saudi Arabia. 28 For the respondents who expressed a preference for an app, we posed a second question: offering an in-person consultation for an out-of-pocket cost of 370 SR or the app for half of the consultation fees. Participants were asked about their willingness to download an HM app on their smartphone to track their visual status on a scale from 1 to 5, where 5 indicates the most willingness and 1 indicates firm refusal. Finally, participants were asked to evaluate the extent of their preference for an app rather than visiting a consultant, especially after the COVID-19 pandemic.

Piloting phase

Two senior researchers (K.S.A and A.A.A) reviewed each question in the questionnaire to ensure the clarity of the contents. Then, a pilot phase was performed by distributing the questionnaire to three optometrists from different regions to assist with the clarity of the text and determine the time required to complete the questionnaire until no further modifications were requested.

Statistical analysis

Statistical analysis was performed using SPSS version 28 (IBM Corp., Armonk, NY, USA). Data from closed-ended questions were converted to numerical data and entered into SPSS. Outcomes from descriptive statistics were presented as frequencies and percentages for categorical variables. We used the chi-square test for bivariate comparisons of in-person or HM app, age range, educational level, total incomes, and other barriers. Adjusted multinomial logistic regression was implemented across demographics and applied to identify preferences after the COVID-19 pandemic using demographic variables with less than 1% missing data. The odds ratio (OR) with a CI of 95% and a p-value less than (0.05) was applied to be considered statistically significant.

Results

Patients’ demographics

A total of 240 subjects agreed to participate in this study: Central Province (n = 62), Eastern Province (n = 65), Western Province (n = 30), Northern Province (n = 41), and Southern Province (n = 42). One participant was excluded for not having Arabic ethnicity and not completing the questionnaire, leaving (n = 239) available for analysis. The centre's location, type, and participant demographic responses are summarised in Table 2. Of the participants, 40.4% were in the average range between 40 and 59 years old, and nearly 36% of the participants either had a minimum degree of high school or a bachelor's degree. About half of the participants (47.9%) had a monthly income range between 10,000 SR and 19,000 SR, and 58.3% of participants resided in a city with more than one million residents. Most participants (93.8%; n = 225) were required to travel for 2 h to reach their healthcare appointment, while 60% of the participants could travel without the need for assistance or escort.

Table 2.

Patients’ demographics (n = 239).

Characteristics Frequency (n) % Missing (n) (%)
Province
Central Province – GS and PCa 62 25.8 0 (0)
Eastern Province – PSa 65 27.1
Western Province – GSa 29 12.1
Northern Province – GSa 41 17.1
Southern Province – PSa 42 17.5
Gender
Female 137 57.1 0 (0)
Male 102 42.5
Age group
20–39 55 22.9 2 (0.8)
40–59 97 40.4
>60 85 35.4
Educational level
HSa 88 36.7 2 (0.8)
Dipa 45 18.8
BSca 87 36.3
PGa 17 7.1
Total income
<10.000 SR 71 29.6 8 (3.3)
10,000–19,999 SR 115 47.9
20,000–29,999 SR 31 12.9
30,000–39,999 SR 11 4.6
Above 40,000 8 3.5
Urbanicity
Central (>1 M) 140 58.3 0 (0)
Neighbouring (>50.000) 63 26.3
Village (<50.000) 36 15.0
Regular appointment
Governmental – primary care 98 40.8 0 (0)
Private 49 20.4
Governmental (specialised) 46 19.2
All 46 19.2
Initial eye problem
Routine examination 113 47.1 8 (3.3)
Due to DM 71 29.6
Diabetic retinopathy 47 19.6
Travel distance (hours)
Within 1–2 h 3 1.3 2 (0.8)
Within 2 h 225 93.8
3–4 h 5 2.1
Travel (>5 h) 4 1.7
Travel requirement
Independent 144 60.0 2 (0.8)
Dependent 77 32.1
Need escort 16 6.7
Gender barriers
No preference 192 80.0 2 (0.8)
Preferred (same gender) 37 15.4
Must (same gender) 8 3.3
Visual performance
Yes – I wear reading glasses 131 54.6 2 (0.8)
I think I need 16 6.7
I do not need 67 27.9
I do not know 23 9.6
Visual impairment
Yes 20 8.3 3 (1.2)
No 196 81.7
Borderline 5 2.1
I do not know 15 6.3
Mobile phone proficiency
No help needed 135 56.3 2 (0.8)
Help needed just for technical issues 51 21.3
Rare 7 2.9
Always 44 18.3
Previous use of telehealth
No 212 88.3 4 (1.7)
Yes 23 9.6
HM app acceptance
Physical 78 32.5 0 (0)
I don't mind to try 117 48.8
Partially 25 10.4
As much as possible 19 7.9
Overall percentage of acceptanceb 161 67.1
Willingness 1–5
1 “very unwilling” 47 19.6 1 (0.4)
2 17 7.1
3 48 20.0
4 21 8.8
5 “very willing” 105 43.8
Preference of using HM app after COVID-19
In-person 98 40.8 0 (0)
Occasionally 80 33.3
As much as possible 39 16.3
No preference 22 9.2
a

GS: governmental sector; PS: private sector; PC: public centre; HS: high school; Dip: diploma; BSc: bachelor (undergraduate degree); PG: postgraduate degree. b Overall percentage (I don't mind + Partially + As much as possible)

Nearly 40% (n = 98) of the subjects attended primary eye care for regular follow-up visits, and 47% (n = 113) attended for a routine eye examination. Meanwhile, 19.6% (n = 47) reported that they had been diagnosed specifically with DR. Over half of the patients required reading glasses due to refractive error or presbyopia, 54.6% (n = 131). A smaller proportion (6.7%) believed that they needed glasses but were not currently using them. Of the respondents, 27.9% reported normal vision as they did not need any correction, and 9.6% were unsure about their need for glasses. Of the participants, 8.5% reported that they were visually impaired, while the vast majority (81.7%) indicated they were not. Additionally, 2.1% reported they were borderline for visual impairment, and 6.3% were unsure. However, more than half of them used their mobile phone independently.

Despite only 9.6% (n = 23) having previous experience with telehealth services, there was an overall acceptance of 67.1%, representing 48.8% who did not mind trying. Few subjects (10.4%) accepted using the app partially, and 7.9% of participants were happy to use the app as much as possible. In addition, 43.8% were very willing to download an app for visual function assessment, whereas nearly 20% showed ‘average’ and ‘very unwilling’ to download the app.

Most participants (40.8%) preferred in-person care after the COVID-19 pandemic; 33.3% were willing to use the app occasionally, and only 16.3% would be willing to use it as much as possible.

How do patient demographics impact the acceptability of the visual function HM app?

Regardless of the financial consequences, there was a significant trend towards in-person examinations due to age, education level, urbanicity, travel distance, and patients who never used telehealth before, as shown in Figure 1.

Figure 1.

Figure 1.

The impact of the most demographic factors that affect the acceptability of the visual function HM app.

There was a significant hesitation in using an HM app in older patients (p = 0.025). Explicitly, 54.1% of older patients (>60 years) preferred an in-person visit. The highest proportion of patients in our sample was aged between 40 and 59 years; most of them preferred an in-person visit (37.4%), while 33.3% preferred HM app occasionally, and 17.2% preferred as much as possible. In comparison, few participants had no preference for either option (12.1%). On the other hand, among younger patients between 20 and 39 years old, most of them (47.3%) preferred the app occasionally or as much as possible (20%).

Patients with lower educational levels preferred in-person visits compared with those with higher academic levels. Specifically, 47.6% of high school graduates and 48.9% of diploma graduates preferred physical visits (p = 0.023).

Furthermore, the results indicated that the most influential barriers to patients’ preferences were urbanicity (p = 0.011) and travelling distance (p = 0.021) compared with the other barriers addressed in this questionnaire. Consequently, 54.7% of patients who lived in central cities and 42.2% who resided more than 2 h from their nearest healthcare centre tended to prefer physical visits. However, patients who lived less than 2 h away showed the highest willingness to use the app as much as possible (80%), and patients who lived 3 to 5 h away showed the highest willingness to use HM app occasionally (75%).

Ultimately, among the few patients who experienced previous telehealth services, 52.2% of them preferred to use HM app occasionally. Others preferred using it as much as possible or had no preference 17.4% (p = 0.025) (Table 3).

Table 3.

The preference for using HM app after COVID-19.

Characteristics In-person (%) Occasionally (%) As much as possible (%) No preference (%) p-value (two-tail)
Gender
Female 65 (47.4) 40 (29.2) 19 (13.9) 13 (9.5) 0.102
Male 33 (32.4) 40 (39.2) 20 (19.6) 9 (8.8)
Age group
20–39 15 (27.3) 26 (47.3) 11 (20) 3 (5.5) 0.025
40–59 37 (37.4) 33 (33.3) 17 (17.2) 12 (12.1)
>60 46 (54.1) 21 (24.7) 11 (12.9) 7 (8.2)
Educational level
HSa 42 (47.2) 30 (33.7) 9 (10.1) 8 (9) 0.023
Dipa 22 (48.9) 15 (33.3) 2 (4.4) 6 (13.3)
BSca 28 (31.8) 28 (31.8) 24 (27.3) 8 (9.1)
PGa 6 (35.3) 7(41.2) 4 (23.5) 0 (0)
Total income
<10.000 SR 34 (47.9) 22 (31) 8 (11.3) 7 (9.9) 0.144
10,000–19,999 SR 46 (39) 43 (36.4) 19 (16.1) 10 (8.5)
20,000–29,999 SR 15 (48.4) 6 (19.4) 7 (22.6) 3 (9.7)
30,000–39,999 SR 2 (18.2) 7 (63.6) 2 (18.2) 0 (0)
> 40,000 1 (12.5) 2 (25) 3 (37.5) 2 (25)
Urbanicity
Central (>1 M) 64 (45.7) 39 (27.9) 29 (20.7) 8 (5.7) 0.011
Neighboring (>50.000) 18 (28.6) 29 (46) 6 (9.5) 10 (15.9)
Village (<50.000) 16 (44.4) 12 (33.3) 4 (11.1) 4 (11.1)
Regular appointment
Governmental – primary care 33 (33.7) 38 (38.8) 18 (18.4) 9 (9.2) 0.214
Private 22 (44.9) 14 (28.6) 7 (14.3) 6 (12.2)
Governmental (specialised) 18 (39.1) 20 (43.5) 5 (10.9) 3 (6.5)
All 25 (54.3) 8 (17.4) 9 (19.6) 4 (8.7)
Initial eye problem
Routine examination 46 (40.7) 38 (33.6) 18 (15.9) 11 (9.7) 0.997
Due to DM 32 (40.5) 26 (32.9) 13 (16.5) 8 (10.1)
Diabetic retinopathy 20 (42.6) 16 (34) 8 (17) 3 (6.4)
Travel distance (hour)
Within 1–2 h 0 (0) 1 (20) 4 (80) 0 (0) 0.021
Within 2 h 95 (42.2) 74 (32.9) 34 (15.1) 22 (9.8)
3–4 h 2 (40) 2 (40) 1 (20) 0 (0)
Travel (>5 h ) 1 (25) 3 (75) 0 (0) 0 (0)
Travel requirement
Independent 51 (34.9) 50 (34.2) 27 (18.5) 18 (12.3) 0.115
Dependent 39 (50.6) 26 (33.8) 10 (13) 2 (2.6)
Need escort 8 (50) 4 (25) 2 (12.5) 2 (12.5)
Gender barriers
No preference 72 (37.1) 69 (35.6) 35 (18) 18 (9.3) 0.259
Preferred (same gender) 21 (56.8) 10 (27) 3 (8.1) 3 (8.1)
Must (same gender) 5 (62.5) 1 (12.5) 1 (12.5) 1 (12.5)
Reading glasses
Yes – I wear reading glasses 55 (42) 42 (32.1) 23 (17.6) 11 (8.4) 0.848
I think I need 8 (44.4) 5 (27.8) 2 (11.1) 3 (16.7)
I do not need 23 (34.3) 27 (40.3) 11 (16.4) 6 (9)
I do not know 12 (52.2) 6 (26.1) 3 (13) 2 (8.7)
Visual impairment
Yes 10 (50) 5 (25) 3 (15) 2 (10) 0.920
No 80 (40.4) 66 (33.3) 33 (16.7) 19 (9.6)
Borderline 2 (40) 3 (60) 0 (0) 0 (0)
I do not know 5 (33.3) 6 (40) 3 (20) 1 (6.7)
Mobile phone proficiency
No help needed 49 (36.3) 50 (37) 24 (17.8) 12 (8.9) 0.651
Help is needed just for technical issues 21 (41.2) 16 (31.4) 8 (15.7) 6 (11.8)
Rare 4 (50) 2 (25) 2 (25) 0 (0)
Always 24 (54.5) 11 (25) 5 (11.4) 4 (9.1)
Previous use of telehealth 0.025
No 95 (44) 68 (31.5) 35 (16.2) 18 (8.3)
Yes 3 (13) 12 (52.2) 4 (17.4) 4 (17.4)
a

HS: high school, Dip: diploma, BSc: bachelor (undergraduate degree), PG: postgraduate degree.

How does cost impact acceptance of HM app?

Whether cost contributed to their preference for a nonurgent eye examination is described in Table 4. Out of 124 patients who preferred an in-person appointment for a nonurgent condition, 71.6% still insisted on this preference despite the extra cost of paying for a private clinic; in this scenario, only 14.7% switched to preferring HM app. In contrast, out of 31 patients who preferred HM app, 20% switched to a governmental or private sector clinic to be seen in-person if the app was going to cost half of the physical consultation. However, 63% were still keen to manage remotely despite the additional cost of using an HM app. Patients who preferred either option of care services or those who were uncertain which visit modality they preferred were not questioned on the impact of cost (Table 4).

Table 4.

Visit modality preference for an unurgent eye examination.

Preference with cost factor No. %
Frequency across (n = 240) No. % Governmental or private with (370 SR)a,b Use an HM app a Use HM app with (180 SR) b No preferencea,b Missing data
In person a 124 (51.7%) 78(71.6%) 16 (14.7%) NA 15 (13.5%) 13 (0.2%)
HM app. b 31 (12.9%) 6 (20%) NA 17 (63%) 4 (14.8%) 4 (2.2%)
Both 70 (70%) NA NA NA NA NA
I don’t know 14 (5.8%) NA NA NA NA NA
a

Subsection questions for the first option.

b

Subsection questions for the second option.

Further perspectives gained from free-text short answers

To provide further perspective from responses of participants, (n = 54) short answers were categorised into two sections based on whether they were willing to accept an HM app or not. The quotes of their words were translated and summarised in Table 5.

Table 5.

Perspectives of patients on the acceptability of visual function HM app.

Opinion of HM app Quote from participant
Accept HM app (i.e., Don’t mind trying or willing for HM partially or HM as much as possible) ‘To prevent any deterioration and preserve my vision’ Male, above 60, #60.
‘It keeps a direct interaction to any medical health services’ Female, 40–59 years, #62
‘It ensures a better visual quality’ Male, above 60, #73
‘To reduce the number of appointments’ Male, 40–59 yrs., #110
‘Because I might miss some appointments or faced some circumstances that prevent me to attend the hospital’ Female, 20–39 years, #123
Do not accept HM app (prefer an in-person appointment) ‘Being examined physically will be much more accurate because the clinics contain advanced machines’ Female, 40–59 yrs., #84
‘I have no experience, and the consultant will have better management whereas the app will be useless’ Female, 20–39 years, #91
‘In person makes me worry less’ Female, above 60 years, #158
‘Physical examination will provide better assessment and will be combined with receiving medication if required’ Male, above 60 years, #222

Combinations of factors associated with patients’ preferences towards visual function HM app

An adjusted multinomial logistic regression was applied to find which factors were associated with HM app usage preferences. The OR and CI of the adjusted predictors are found in Table 6. Females (OR, 0.453; 95% CI, 0.21–0.92; p = 0.029), younger patients (20–39 years: OR, 5.01; 95% CI, 1.82–13.82; p < 0.001; and 40–59 years: OR, 2.28; 95% CI, 0.084–5.00; p = 0.48), and patients with diploma certificates (OR: 0.13; 95% CI, 0.03–0.60; p = 0.007) were more likely to accept usage of an HM app. Patients with a total income below 30,000 SR (8000 USD) were more likely to consider using HM app occasionally. Both collinearity and the potential interaction effect between education and income were evaluated. Collinearity did not appear to be an issue, as all Variance Inflation Factor values were well below the commonly accepted threshold of 5. Furthermore, patients who regularly visited primary care clinics or specialised governmental clinics were strongly associated with the preference of using HM app occasionally (p = 0.038 vs p = 0.019). Patients with no previous experience with telehealth services were also more likely to accept using an HM app occasionally (p = 0.01) (Table 6).

Table 6.

Predictors of preference for HM app after COVID-19.

Characteristics Occasionallya As much as possiblea
Gender
Female 0.453(0.21–0.92)* 0.55 (0.23–1.33)
Male (reference group) 1.00 1.00
Age group
20–39 5.01(1.82–13.82)* 2.15 (0.62–7.41)
40–59 2.28(0.84–5.00)* 1.37 (0.50–3.80)
>60 (reference group) 1.00 1.00
Educational level
HSb 1.43 (0.66–5.75) 0.41 (0.13–1.27)
Dipb 0.726 (0.34–2.67) 0.13 (0.03–0.60)*
BSc + PGb (reference group) 1.00 1.00
Total income
<10.000 SR 0.12 (0.02–0.60)* 0.26 (0.04–1.58)
10,000–19,999 SR 0.21 (0.05–0.94)* 0.31 (0.06–1.70)
20,000–29,999 SR 0.07 (0.01–0.413)* 0.29 (0.05–1.85)
30,000 and above (reference group) 1.00 1.00
Urbanicity
Central (>1 M) 0.55 (0.20–1.51) 1.22 (0.32–4.62)
Neighbouring (>50.000) 2.60 (0.86–7.97) 1.45 (0.30–7.07)
Village (<50.000) (reference group) 1.00 1.00
Regular appointment
Governmental – primary care 4.23 (1.47–12.12)* 2.17 (0.73–6.49)
Private 2.59 (0.818–8.21) 0.98 (0.30–3.40)
Governmental (specialised) 3.56 (1.16–10.98)* 1.03 (0.27–3.97)
All (reference group) 1.00 1.00
Travel distance (hour)
Within 2 h 0.48 (0.10–2.26) 1.19 (0.10–13.52)
3–5 h. (reference group) 1.00 1.00
Previous use of telehealth
No 0.179 (0.49–0.66)* 0.27 (0.06–1.30)
Yes (reference group) 1.00 1.00
a

Multinomial logistic regression (in person) was indicated as a reference. b HS: high school, Dip: Diploma, BSc: bachelor (undergraduate) degree; PG: Postgraduate degree. * p-value <0.05

Discussion

This study explored the acceptance of a hypothetical HM app for assessing visual function remotely in patients with diabetes in Saudi Arabia. The study found that the reluctance to use a HM app was associated with increased age, lower levels of education, urbanicity, short traveling distance to healthcare facilities, and those who had never experienced telehealth services. Surprisingly, the consideration of cost did not play a significant role. The study also showed that females, younger patients, and those who regularly attended primary eye clinics or specialised governmental clinics for routine eye examinations and who never used telehealth services were more likely to accept a hybrid clinic.

The potential for acceptance

In this study, there was generally a positive response to the prospect of using an HM app. The overall satisfaction with telehealth services in Saudi Arabia was studied by Eddine et al. (2021). The study found that half of the patients were satisfied with the virtual clinic within the ambulatory care centre in Saudi Arabia during the pandemic. 29 Dawood et al. (2022) indicated a similar level of satisfaction (76.36%) using (Sehhaty) app provided by the Saudi government to provide general consultations remotely during the pandemic. 30

Further studies showed a strong acceptability and feasibility of adopting HM devices. For instance, a recent study evaluated the acceptance and feasibility of using a visual field HM device and home tonometer for glaucoma patients. Interesting acceptability has been indicated in all patients with glaucoma using the iCare HOME tonometer and Virtual Field (VF) devices at home multiple times daily for a week. The study was combined with a semi-structured interview. The thematic analysis emphasised the benefits of using VF as many patients believed that HM devices could reduce the traumatic experience due to glaucoma and the anxiety expression for visual loss, and it would also encourage independence by allowing more control when they use the device. 31 Differences in the level of satisfaction could be due to differences in literacy rates, economic status, network coverage, and logistical restrictions on implementing new technologies. However, the overall positive satisfaction with telehealth services provided in Saudi Arabia may imply the potential of accepting to track visual function for patients with diabetes with stable conditions. Consequently, it could reduce the load of the routine eye screening setting and promote early intervention.

Barriers to accepting visual function HM app

This study showed that age, educational level, and previous telehealth experience were the most common mitigations perceived by our participants. Addressing these barriers before implementation may improve the acceptance of an HM app.

Age and educational level

This study had limited participants with a previous diagnosis of DR or visual impairment (VI), and we could not find any significant correlation between visual performance, level of impairment, independence, and confidence in handling a mobile phone, as most of the patients with diabetes who attended the diabetic screening clinics were in a stable condition. However, it was evident that those over 60 years of age and those with less than a diploma level of education were very reluctant to use an HM app. Our results were similar to Thirunavukkarasu et al. findings (2021), which indicated a reduction in the satisfaction rate of patients >40 years old who used telehealth features and those with less than undergraduate certificates. They also showed diversity across different specialised clinics. They reported the lowest percentage of telehealth consultations in ophthalmology clinics compared with all other clinical specialities, which could be correlated with inadequate competency due to visual and hearing difficulties in older patients. 32 In our multinomial regression model, we predicted that younger patients (<60 years) were more likely to accept HM app occasionally. The demographic of the participants who accepted an HM app in our study were older (40–59) compared with the subjects in the study by Thirunavukkarasu et al., who were predominantly under 40 years of age. In our study, younger patients showed higher acceptance of the hybrid model compared with the older group. Differences in the level of acceptance among participants’ age groups could be related to inclusion criteria, patients’ medical conditions, the department involved, or differences between healthcare technologies.

Several studies have also highlighted factors that could increase acceptance of telemedicine and HM devices in patients with common ocular diseases. For instance, Liu et al. (2022) investigated a health information technology (HIT) acceptance model in patients with hypertension and diabetes. Perceived visual function (PVF) was tested on a tablet every 8 weeks up to 24 weeks, and they reported that it indirectly influenced behavioural intention (BI), which changed their acceptance over a longer period. This could be associated with the limitation of visual perceptions among older people and make monitoring patients with patient-focused HIT systems very challenging. 33 Furthermore, the MONARCH study implemented three tests (paper-based KeepSight Journal, the MyVisionTrack®, and the MultiBit App) for age-related macular degeneration (AMD) patients and evaluated their acceptability and adherence to weekly HM. The study highlighted that feasibility could be improved if the apps were quick and easy to use for older participants. 34

Previous experience with healthcare technology

The present study showed that more than half of the participants (56.3%) were using their mobiles independently and 21.3% of participants required assistance for some technical issues. However, the acceptance of adopting an HM app was mainly influenced by previous experiences with telehealth services in our patients. Few subjects (9.6%) used telehealth features provided in our study; half of those patients preferred to use an HM app occasionally. The acceptability of HM in the MONARCH study was also influenced by a patient's understanding of its purpose. Unfamiliarity in digital technology use was found to be due to the lack of initial training and ongoing support. Both of which were considered essential to the successful implementation of telehealth monitoring. 34

Another modality of HM app in glaucoma has been investigated and provided great diagnostic power when using a tablet-based visual field test compared with in-clinical testing. However, the biggest barriers that affected the uptake and compliance of this technology were the lack of motivation and technical experience to perform the test without assistance, which could also be related to health deterioration. 35 This study showed that less than half of the participants (43.8%) were very willing to use visual function HM app. It has also been predicted that participants who have never experienced telehealth options were more likely to accept an HM app occasionally, and this might reflect their willingness to involve digital technology in healthcare services for older people and their awareness of the advantages of similar apps in early intervention. A similar modality of telemedicine's advantages and disadvantages has been conducted among physicians in Taif. The study showed that almost a third of physicians believed that telemedicine increased the effectiveness of therapeutic intervention due to the enhancement of the care quality. 36

Accepting HM app and its impact on travel distance and cost

In general, most patients with diabetes who participated in our study were persistent in preferring a physical examination regardless of the incurred costs, which may reflect their priority of saving their sight. Few studies have evaluated the impact of the cost on patients’ acceptance of adopting HM apps. Peek et al. (2014) showed that the most crucial aspect concerning telemedicine services in the pre-implementation stage was the high cost, especially for older people. A recent systematic review showed that cost was the most concerning aspect of using technology (p < 0.05). 37

On the other hand, the present study depicted that patients who attended primary eye care and governmental hospitals could accept hybrid. The economic benefits of telemedicine in DR have been addressed in previous studies.38,39 The cost-effectiveness of DR screening programmes using telemedicine was reviewed and highlighted ultimate cost-saving benefits for the patients in terms of increasing their independence and reducing the need to travel to the nearest hospital. 40 This finding might emphasise the utility of implementing similar apps in our communities and reduce the economic burden of diabetes. It would enhance the role of health services in screening patients with DR, aligning with the Vision 2030 goal of fostering a healthy society with fulfilling lives in Saudi Arabia. 41

Limitations

Our sample size exceeded the targeted number, providing a better dataset than initially planned. However, limitations were related to the potential of selection bias in terms of subjects who were willing to take part in the survey to adopt new healthcare services than those who refused to take part. In addition, this study relied on self-report and had no accompanying clinical information to verify diagnoses. While this survey provided insight into patient intentions, real-world longitudinal tracking usage of an HM app would be a more accurate means of assessing feasibility.

Conclusion

While an HM app may offer efficiency for health service delivery and patient convenience, this study demonstrated that careful consideration of acceptability and barriers to uptake are essential before implementation. In this population, there is considerable hesitation in accepting HM of visual function via an app related to older individuals, low educational level, urbanicity, and those living close to healthcare services. Therefore, considerable mitigation may be required to achieve successful implementation. Those wishing to implement such a device must address the barriers highlighted by this study and develop better features within the app, increasing patients’ engagement, especially for old adults. Despite the challenges, smartphone app could be transformative in healthcare delivery in addressing the lack of equipment and skilled specialists in rural areas.

Supplemental Material

sj-docx-1-dhj-10.1177_20552076241290405 - Supplemental material for ‘Assessing patients’ perception of the potential utility of visual function home monitoring app among patients with diabetes in Saudi Arabia’

Supplemental material, sj-docx-1-dhj-10.1177_20552076241290405 for ‘Assessing patients’ perception of the potential utility of visual function home monitoring app among patients with diabetes in Saudi Arabia’ by Hanan Khalid Mofty, Marwan A Abouammoh, Hala A Al-Muqbil, Khaled S AL-Zahrani, Talhah M AL-Ghasham, Abdullah A Assiri, Ahmad T AL-Mnaizel, Hayat S Mushcab, Kholoud A Bokhary and Ruth E Hogg in DIGITAL HEALTH

Acknowledgements

The study is sponsored by the External Joint Supervision Programme (EJSP) at King Saud University. It was designed in collaboration with the Saudi Society of Optometry (SSO). The first author would like to acknowledge all clusters, governmental hospitals, private centres, and social centres mentioned for their collaboration in collecting the data. Diabetic Screening Clinic in King Khaled University Hospital (KKUH), King Salman Social Centre (KSSC), Diabetic Screening Clinic in King Fahad Forces Armed Hospital (KFFAH), Optometry Clinic in North Medical Tower Hospital/The Northern Borders Health Cluster, Vision World Center, and Diabetic Screening Clinic in Johns Hopkins Aramco Healthcare (JHAH).

Footnotes

Contributorship: HKM and REH conceptualised and designed the study. HKM investigated, analysed, and wrote the initial draft of the manuscript. KSA and AAA were involved in the pilot phase of the methodology. HAA, KSA, TMA, AAA, ATA, and HSM were involved in data collection. MAA, KAB, and REH reviewed and edited the manuscript and approved the final version. All co-authors have reviewed the manuscript and approved it for submission.

The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Ethical approval: This study was approved by the research ethics committee under the deanship of scientific research at King Saud University (E-22-6647) and adheres to the Declaration of Helsinki; additional approvals were obtained from the collaborating institutions.

Funding: The authors disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This work is part of the PhD project. The scholarship of the first author is financially funded by External Jount Supervision programme (EJSP) at King Saud University, Riyadh, Saudi Arabia.

Guarantor: HKM and REH.

ORCID iD: Hanan Khalid Mofty https://orcid.org/0000-0002-3614-7990

Supplemental material: Supplemental material for this article is available online.

References

  • 1.Sun H, Saeedi P, Karuranga S, et al. IDF diabetes atlas: global, regional and country-level diabetes prevalence estimates for 2021 and projections for 2045. Diabetes Res Clin Pract 2022; 183: 109119. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Steinmetz JD Bourne RR , Briant PS. , et al. Causes of blindness and vision impairment in 2020 and trends over 30 years, and prevalence of avoidable blindness in relation to VISION 2020: the right to sight: an analysis for the global burden of disease study. Lancet Glob Health 2021; 9: e144–e160. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Teo ZL, Tham YC, Yu M, et al. Global prevalence of diabetic retinopathy and projection of burden through 2045: systematic review and meta-analysis. Ophthalmology 2021; 128: 1580–1591. 20210501. [DOI] [PubMed] [Google Scholar]
  • 4.Collaborators GBDD. Global, regional, and national burden of diabetes from 1990 to 2021, with projections of prevalence to 2050: a systematic analysis for the global burden of disease study 2021. Lancet 2023; 402: 203–234. 20230622. doi: 10.1016/S0140-6736(23)01301-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Flaxman SR, Bourne RRA, Resnikoff S, et al. Global causes of blindness and distance vision impairment 1990–2020: a systematic review and meta-analysis. Lancet Glob Health 2017; 5: e1221–e1234. 20171011. [DOI] [PubMed] [Google Scholar]
  • 6.El-Kebbi IM, Bidikian NH, Hneiny L, et al. Epidemiology of type 2 diabetes in the Middle East and North Africa: challenges and call for action. World J Diabetes 2021; 12: 1401–1425. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Al-Rubeaan K, Abu El-Asrar AM, Youssef AM, et al. Diabetic retinopathy and its risk factors in a society with a type 2 diabetes epidemic: a Saudi national diabetes registry-based study. Acta Ophthalmol 2015; 93: e140–e147. 20141001. [DOI] [PubMed] [Google Scholar]
  • 8.Ting DS, Ng JQ, Morlet N, et al. Diabetic retinopathy management by Australian optometrists. Clin Exp Ophthalmol 2011; 39: 230–235. [DOI] [PubMed] [Google Scholar]
  • 9.Waugh N, Shyangdan D, Taylor-Phillips S, et al. Screening for type 2 diabetes: a short report for the National Screening Committee. Health Technology Assessment, No. 17.35. Southampton, UK: NIHR Journals Library, 2013. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Aldebasi YH, Reddy PR, Nair VG, et al. Screening for diabetic retinopathy: the optometrist’s perspective. Clin Optom 2015; 7: 1–14. [Google Scholar]
  • 11.DeBuc DC. The role of retinal imaging and portable screening devices in tele-ophthalmology applications for diabetic retinopathy management. Curr Diab Rep 2016; 16: 132. [DOI] [PubMed] [Google Scholar]
  • 12.Armstrong GW, Miller JB. Telemedicine for the diagnosis and management of age-related macular degeneration: A review. J Clin Med 2022; 11(3): 835. DOI: https://doi.org/10.3390/jcm11030835. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Bitar H, Alismail S. The role of eHealth, telehealth, and telemedicine for chronic disease patients during COVID-19 pandemic: a rapid systematic review. Digit Health 2021; 7: 20552076211009396. 20210419. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Mansberger SL, Sheppler C, Barker G, et al. Long-term comparative effectiveness of telemedicine in providing diabetic retinopathy screening examinations: a randomized clinical trial. JAMA Ophthalmol 2015; 133: 518–525. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Alshammari F. Perceptions, preferences and experiences of telemedicine among users of information and communication technology in Saudi Arabia. J Health Inform Dev Ctries 2019; 13(1). [Google Scholar]
  • 16.Hassounah M, Raheel H, Alhefzi M. Digital response during the COVID-19 pandemic in Saudi Arabia. J Med Internet Res 2020; 22: e19338. 20200901. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.MOH. Telemedicine, https://www.moh.gov.sa/en/Ministry/Information-and-services/Pages/Telemedicine.aspx (2022, accessed 17 August 2022).
  • 18.Alsyouf A. Mobile health for COVID-19 pandemic surveillance in developing countries: the case of Saudi Arabia. Solid State Technol 2020; 63: 2474–2485. [Google Scholar]
  • 19.Alghamdi SM, Alqahtani JS, Aldhahir AM. Current status of telehealth in Saudi Arabia during COVID-19. J Family Community Med 2020; 27: 208–211. 20200925. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Thirunavukarasu AJ, Hassan R, Limonard A, et al. Accuracy and reliability of self-administered visual acuity tests: systematic review of pragmatic trials. Plos one 2023; 18: e0281847. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Raffa LH, Balbaid NT, Ageel MM. “Smart optometry” phone-based application as a visual acuity testing tool among pediatric population. Saudi Med J 2022; 43: 946–953. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Zhao L, Stinnett SS, Prakalapakorn SG. Visual acuity assessment and vision screening using a novel smartphone application. J Pediatr 2019; 213: 203–210.e201. 20190718. [DOI] [PubMed] [Google Scholar]
  • 23.Brucker J, Bhatia V, Sahel JA, et al. Odysight: a mobile medical application designed for remote monitoring-A prospective study comparison with standard clinical eye tests. Ophthalmol Ther 2019; 8: 461–476. 20190725. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.OKKO Health. Home (UK) United Kingdom (okkohealth.com) (2023, accessed 25 January 2023).
  • 25.Faul F, Erdfelder E, Buchner A, et al. Statistical power analyses using G*Power 3.1: tests for correlation and regression analyses. Behav Res Methods 2009; 41: 1149–1160. [DOI] [PubMed] [Google Scholar]
  • 26.Robert AA, Al Dawish MA, Braham R, et al. Type 2 diabetes mellitus in Saudi Arabia: major challenges and possible solutions. Curr Diabetes Rev 2017; 13: 59–64. [DOI] [PubMed] [Google Scholar]
  • 27.Predmore ZS, Roth E, Breslau J, et al. Assessment of patient preferences for telehealth in post-COVID-19 pandemic health care. JAMA Netw Open 2021; 4: e2136405. 20211201. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Bubshait D, Sadat-Ali M. Economic implications of osteoporosis-related femoral fractures in Saudi Arabian society. Calcif Tissue Int 2007; 81: 455–458. 20071204. [DOI] [PubMed] [Google Scholar]
  • 29.Eddine IS, Zedan HS. Telehealth role during the COVID-19 pandemic: lessons learned from health care providers in Saudi Arabia. Telemed J E Health 2021; 27: 1249–1259. 20210113. [DOI] [PubMed] [Google Scholar]
  • 30.Dawood AM, Alkadi KS. Evaluating usability of telehealth Sehhaty application used in Saudi Arabia during COVID-19. Stud Health Technol Inform 2022; 295: 285–288. [DOI] [PubMed] [Google Scholar]
  • 31.Hu GY, Prasad J, Chen DK, et al. Home monitoring of glaucoma using a home tonometer and a novel virtual reality visual field device: acceptability and feasibility. Ophthalmol Glaucoma 2023; 6: 121–128. [DOI] [PubMed] [Google Scholar]
  • 32.Thirunavukkarasu A, Alotaibi NH, Al-Hazmi AH, et al. Patients’ perceptions and satisfaction with the outpatient telemedicine clinics during COVID-19 era in Saudi Arabia: a cross-sectional study. Healthcare (Basel) 2021; 9: 20211216. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Liu K, Or CK, So M, et al. A longitudinal examination of tablet self-management technology acceptance by patients with chronic diseases: integrating perceived hand function, perceived visual function, and perceived home space adequacy with the TAM and TPB. Appl Ergon 2022; 100: 103667. 20211214. [DOI] [PubMed] [Google Scholar]
  • 34.O'Connor SR, Treanor C, Ward E, et al. Patient acceptability of home monitoring for neovascular age-related macular degeneration reactivation: a qualitative study. Int J Environ Res Public Health 2022; 19(20): 13714. DOI: 10.3390/ijerph192013714. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Prea SM, Kong GYX, Guymer RH, et al. Uptake, persistence, and performance of weekly home monitoring of visual field in a large cohort of patients with glaucoma. Am J Ophthalmol 2021; 223: 286–295. 20201119. [DOI] [PubMed] [Google Scholar]
  • 36.Mubaraki AA, Alrabie AD, Sibyani AK, et al. Advantages and disadvantages of telemedicine during the COVID-19 pandemic era among physicians in Taif, Saudi Arabia. Saudi Med J 2021; 42: 110. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Peek ST, Wouters EJ, van Hoof J, et al. Factors influencing acceptance of technology for aging in place: a systematic review. Int J Med Inform 2014; 83: 235–248. 20140119. [DOI] [PubMed] [Google Scholar]
  • 38.Vijan S, Hofer TP, Hayward RA. Cost-utility analysis of screening intervals for diabetic retinopathy in patients with type 2 diabetes mellitus. JAMA 2000; 283: 889–896. [DOI] [PubMed] [Google Scholar]
  • 39.Jones S, Edwards R. Diabetic retinopathy screening: a systematic review of the economic evidence. Diabetic Med 2010; 27: 249–256. [DOI] [PubMed] [Google Scholar]
  • 40.Avidor D, Loewenstein A, Waisbourd M, et al. Cost-effectiveness of diabetic retinopathy screening programs using telemedicine: a systematic review. Cost Eff Resour Alloc 2020; 18: 1–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Vision2030. https://www.vision2030.org.sa, 2024.

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

sj-docx-1-dhj-10.1177_20552076241290405 - Supplemental material for ‘Assessing patients’ perception of the potential utility of visual function home monitoring app among patients with diabetes in Saudi Arabia’

Supplemental material, sj-docx-1-dhj-10.1177_20552076241290405 for ‘Assessing patients’ perception of the potential utility of visual function home monitoring app among patients with diabetes in Saudi Arabia’ by Hanan Khalid Mofty, Marwan A Abouammoh, Hala A Al-Muqbil, Khaled S AL-Zahrani, Talhah M AL-Ghasham, Abdullah A Assiri, Ahmad T AL-Mnaizel, Hayat S Mushcab, Kholoud A Bokhary and Ruth E Hogg in DIGITAL HEALTH


Articles from Digital Health are provided here courtesy of SAGE Publications

RESOURCES