Abstract
The use of information and communication technologies in the health field is known as eHealth. Nowadays, the application of technological and digital tools for maintaining/improving physical and mental health is experiencing an exponential boom. These tools have been perceived as a powerful support for face-to-face therapies and lifestyle changes. Nevertheless, there is not enough scientific research that analyses the impact and consequences of eHealth interventions. More studies are needed to validate its application. Therefore, the aim of this study was to evaluate the impact of eHealth tools in a programme called ePSICONUT. This programme was created to promote healthy lifestyle habits in university students. The sample consisted of 16 university students from the Dominican Republic aged 18–24 years ( = 20.69; s = 1.74). ePSICONUT was developed in 12 weeks and its impact was analyzed by comparing the initial and the final psychological and lifestyle tests results, which were completed online by the participants. Results reported that the professionally supervised use of eHealth tools was associated with better psychological well-being, lees anxiety and depression, and better lifestyle habits (such as diet quality), even in stressful and changing situations such as the COVID-19 pandemic circumstances. However, more studies are needed to validate and promote the use of eHealth-based intervention programmes.
Keywords: eHealth, mHealth, lifestyle, subjective well-being, healthy lifestyle habits
1. Introduction
A chronic unhealthy lifestyle and a poor use of emotional regulation techniques could damage mental and physical health [1]. Research has identified that this situation is more perceived in societies where people have to dedicate long hours to work and family care, making it difficult to maintain proper lifestyle and self-care activities [2]. Epidemiological evidence suggests that the integration of the use of technological and digital tools could significantly improve healthcare services. Results from different studies reported how this is a potential alternative for health promotion, cost reduction, and prevention of physical and mental illnesses [3,4]. The use of information and communication technologies (ICT) in health field is called eHealth [3].
After the COVID-19 pandemic, the world turned its focus even more towards three aspects that have been in the spotlight for years: lifestyle (healthy eating and physical exercise), emotional well-being, and the use of technology and digital tools to improve them [5,6]. Health professionals, as well as health service users and the general population, have been using emails, SMS, electronic records, educational videos, telemedicine, online therapies, and mobile applications to promote mental health and a healthy lifestyle [4,5,7,8].
Among the digital resources most commonly used in physical activity and healthy eating fields are: mobile applications, self-reporting of behaviours in favour of a healthy lifestyle through digital tools, mobile devices such as podometers, online platforms that facilitates the communication between patients and health professionals (via smartphones or computers), and reminders and reinforcements through text messages or social networks to promote a healthy lifestyle or to improve the adherence to a nutritional treatment [8,9,10,11,12,13,14].
Moreover, there are apps that has been designed to reduce stress and anxiety [15]. Less studied but also promising is the use of eHealth to increase psychological well-being by tools related to positive psychology and third-generation therapies, such as mindfulness, specifically in the population with unhealthy lifestyle habits [16]. However, to effectively apply eHealth, the scientific validation of the different available digital tools must be carefully tested and evaluated. Nowadays, there are very few scientific studies that support its validity [12,15]. Moreover, some studies state that the use of eHealth tools should be supervised by a facilitator or health professional that generates social interaction and support [14]. It could be counterproductive for people’s health, as well as ineffective, to access and use these digital platforms without an expert supervision [9].
Unfortunately, most of the mobile and digital applications available in the market, promoted as alternatives to optimise lifestyle and mental health, have not been properly studied, especially those available for the Spanish-speaking population [17]. Because of the lack of scientific evidence and professional support, many of the ones related to lifestyle promote obsessions, pressures, and discomfort in subjects, such as calorie counting applications [17]. This limitation and the lack of standardised protocols and guidelines on how to use them properly do not allow health professionals to recommend their use [18,19,20].
The main objective of the present study was to evaluate the impact of the eHealth tools to improve lifestyle (physical activity and diet), as well as emotional well-being. To do so, a digital programme called ePSICONUT was designed by researchers and health professionals. It was applied in a group of university students from Dominican Republic. The hypothesis is that this online programme would improve the diet quality, physical exercise, and emotional state of the participants.
2. Materials and Methods
2.1. Study Design
ePSICONUT was based on a quasi-experimental study, with a pre-post design. It used a quantitative methodology. Conclusions of the programme’s impact come from intrasubject measures: a comparison between the answers that they give to a group of questionnaires before and after the intervention [21]. These questionnaires evaluated the variables under study: lifestyle (e.g., overall lifestyle, diet quality and physical exercise) and the ones related to the psychological status of the participants (e.g., subjective psychological well-being, anxiety, and depression).
2.2. Participants
The final sample of the study consisted of 16 Psychology and Nutrition and Dietetics students from Pontificia Universidad Católica Madre y Maestra (Santiago, Dominican Republic) aged between 18 and 24 years ( = 20.69; s = 1.74). The sample selection was made through considering the age range of undergraduate students who best use digital tools according to the literature, which is from 18 to 45 [22,23]. The sampling technique employed was a non-probability sampling by convenience and accessibility [24]. Participants were volunteers and met the inclusion criteria (Table 1). Figure 1 shows how the sample evolved from the beginning to the end of the study because of the criteria described in Table 1. It is important to highlight that the 16 participants that completed all the steps of the programme were women, though it was not exclusive for a female population.
Table 1.
Inclusion Criteria | Exclusion Criteria |
---|---|
Students of Nutrition and Dietetics or Psychology from PUCMM, Santiago, D.R., between 18 and 45 years old, who agree to participate in ePSICONUT. | Dropout from the psychonutritional intervention programme. |
Have Dominican nationality. | People with an eating disorder. |
Speak Spanish. | People undergoing bariatric surgery. |
Have mobile devices with Internet services. | People taking drugs related to weight control. |
This study has been designed and applied considering all the bioethical principles established by the Belmont Report [25] and the Declaration of Helsinki [26]: principles of autonomy beneficence, justice, and non-maleficence. This research was approved by the Research Ethics Committee of the European University of Madrid and, subsequently, ratified by the Bioethics Committee of the Faculty of Health Sciences (COBE-FACS) of the PUCMM, Santiago, Dominican Republic (ID for both institutions: CIPI/19/148).
2.3. Instruments
Digital instruments and psychometric questionnaires were used to determine the impact of the ePSICONUT programme, being classified as: (a) promotion of the programme tools; (b) test batteries applied at the beginning and at the end of the programme; (c) assessment of psychological state and lifestyle.
2.3.1. Promotion of ePSICONUT Tools
For the recruitment of participants, the program was promoted though: “stories” published via Instagram, the institutional email of PUCMM, and WhatsApp groups of Nutrition and Dietetics and Psychology students from PUCMM. Participants had to complete the initial tests battery sent on 19 November 2020. To choose who was eligible to participate in the ePSICONUT programme, the responses of the subjects were reviewed by the researchers and were compared with the criteria listed in Table 1.
Test Batteries Applied at the Beginning and at the End of ePSICONUT
At the beginning, two questionnaires were created ad hoc in Google Forms to test the sample before the intervention. The questionnaires were:
A General Health Questionnaire. Consisting of 13 questions, aimed to evaluate the presence/diagnosis of physical and/or mental pathologies, present or past, as well as risk and protective factors for health (such as sleep, smoking, coffee intake, and meditation).
A Digital Health Questionnaire. It assesses the use and perception of participants about digital tools for the improvement of lifestyle and psychological well-being. Many questions of this instrument were based on a survey called Encuesta de usuarios 2018 sobre sanidad digital de España [2018 Spanish eHealth User survey] [27]. In the initial questionnaires’ battery, this section had just 11 questions to evaluate these topics in general. In the final questionnaires’ battery, this part consisted of 24 questions: on the one hand, the same questions that included the initial test; on the other hand, questions that were focused on evaluating the subjects’ perception about the digital tools specifically used in ePSICONUT (Headspace, Insight Timer, Fabulous, YouTube channel, WhatsApp group, e-mail, and Excel sheets to perform some of the programme’s tasks/activities). Furthermore, this last questionnaire included an ad hoc Satisfaction Survey to evaluate the participants’ appreciation about the following aspects of the programme: organisation, quality of the follow-up offered, quality of the information provided, self-perception of the ePSICONUT impact on the improvement of their eating habits, physical exercise, and psychological well-being.
Instruments Used to Evaluate the Psychological State and Lifestyle of the Participants
Beck Depression Inventory-II (BDI-II). A 21-item multiple-choice questionnaire that measures the severity of current depression level in adults and adolescents [28]. It describes the emotional, physiological, and cognitive symptoms of depression. The total score ranges from 0 to 63 as follows: minimal depression from 0 to 13, mild from 14 to 19, moderate from 20 to 28, and severe from 29 or more. Its subscales and the general scale show moderate and high reliability when evaluated in the Dominican population, ω = 0.89. Similarly, adequate external validity was demonstrated by observing the adequate discrimination of the scale between the Dominican clinical population (with depression) and the general population (without depression) [29,30].
State-Trait Anxiety Inventory (STAI). A self-report used to assess the level of trait and state anxiety in the subject [31]. It has been validated in the Dominican population [32]. Each subscale consists of 20 items. The trait subscale is answered with one of the following options: never (0), almost never (1), sometimes (2), or often (3). The state item is answered with: not at all (0), somewhat (1), quite a lot (2), or very much (3). The scores that the subject can obtain in each subscale range from 0 to 60, and can be categorised as low or none, moderate, or high anxiety. This questionnaire has shown good internal consistency, α = 0.90 and 0.93, ω = 0.71 and 0.65, for state and trait anxiety, respectively.
Dimension of Subjective Psychological Well-Being Subscale of the Psychological Well-Being Scale (EBP). The EBP is a psychometric test created by Sánchez-Cánovas [33], which consists of 65 items that are scored on a Likert-type scale ranging from 1 to 5. This scale is composed of four subscales: subjective psychological well-being (SPWB), material well-being, occupational well-being, and relationships with partners. In ePSICONUT, only the first subscale was applied. The SPWB is related to the subjects’ perception of happiness in their lives, as well as their positive and negative feelings. It also assesses the individual’s ability to overcome the different stages of the life cycle, asking questions related to adolescence, youth, middle age, and old age. It is made up of 30 items that those evaluated must score with the following options: 1 = never or almost never; 2 = sometimes; 3 = quite often; 4 = almost always; 5 = always. The maximum score that can be obtained on the EBPS is 150 The reliability presented was ω = 0.96.
University of Rhode Island Change Assessment Scale (URICA). This scale measures the stage of the change process in which a person is in: precontemplation, contemplation, preparation/action. It was originally created by McConnaughy in 1983 [34]. The version adapted to the Spanish context by Gómez-Peña et al. was used [35]. This scale consists of 32 items that evaluate the stage of motivation to change and commitment to treatment in which the patient is in. Each of the items is scored on a 5-point Likert-type scale: 1 = strongly disagree; 2 = disagree; 3 = undecided; 4 = agree; 5 = strongly agree.
Healthy Lifestyle Scale for College Students. This brief scale is a Mexican adaptation of the Healthy Lifestyle Scale for University Students [36]. This instrument basically evaluates four lifestyle dimensions that have been positively or negatively related to chronic noncommunicable diseases: substance use; appreciation for life; interpersonal relationships; and eating, studying, and sleeping patterns. In total, it consists of 14 items scored on a 5-point Likert scale (1 = never; 2 = rarely; 3 = sometimes; 4 = usually; 5 = always). The internal consistency was ω = 0.81.
Overall diet quality index. The index used during ePSICONUT was created by Ratner et al. [37] on the basis of recommendations provided by the dietary guidelines of Latin American countries, such as the Dominican Republic. It evaluates how often people consume: (1) “healthy foods”; (2) “unhealthy foods”, including cakes, cookies, sweets (as a group), sugar, sugar-containing drinks, and fried foods; (3) “meals”, indicating whether breakfast, lunch/lunch and dinner are consumed. Participants are asked to rank how often they consume each of the above items using a 6-choice Likert scale. The quality of the diet is classified as follows: 90–120 points = healthy; 60–89 points = needs changes; <60 points = unhealthy.
International Physical Activity Questionnaire (IPAQ). The short version of the self-administered validated questionnaire in the Hispanic context by Mantilla Toloza and Gómez-Conesa [38] was used. It allows for the observation and monitoring of the physical activity of the population aged 18 to 65 years. The internal consistency was ω = 0.88.
2.4. Procedure and Design of the Intervention
All those participants who answered the initial test battery received either a welcome email or an email with the reasons why they could not participate in the programme. In the email of those admitted, a link was sent with the survey “Welcome to ePSICONUT: change your habits, improve your life!”. In this survey, their WhatsApp number was asked to create a group with all the participants of ePSICONUT. The programme took place for 12 weeks. The intervention programme is described in Table 2 and represented in Figure 2.
Table 2.
Weeks | Activities |
---|---|
Week 1 | Creation of WhatsApp group and welcome and sending mail with video on YouTube channel. |
Week 2 | Reminders of commitments and clarification of doubts by mail and WhatsApp. |
Week 3 | Reminders of commitments and challenges via WhatsApp. |
Week 4 | Continuation of messages by WhatsApp to take care of food and follow the exercise to strengthen the psychological well-being. |
Week 5 | Meeting via Zoom to address the balance between self-care and study habits. Fabulous was introduced as the mobile application to create, strengthen, and track healthy habits. |
Week 6 | Informative capsule posted on the YouTube channel to promote the organisation and optimisation of food quality; provide recipes/options for healthy breakfasts, lunches, dinners, and snacks; introduce the Nestlé Nutriplato. |
Week 7 | Videos posted on YouTube channel to promote physical exercise at home and in nature (according to the limitations by COVID-19 pandemia situation). |
Week 8 | Meeting via Zoom to introduce mindfulness practice (led by the principal investigator and a certified mindfulness practitioner). The use of Headspace was encouraged to practice mindfulness on a daily basis thereafter. |
Week 9 | Video via YouTube channel to introduce mindful eating. Insight Timer is presented as a mobile application to support the practice of mindful eating. |
Week 10 | Sending an informative document: what it is, how to exercise, and optimising acceptance. |
Week 11 |
Constant communication via WhatsApp, stimulating: conscious eating, physical exercise, body image acceptance.
Meeting via Zoom to practice conscious eating at lunchtime. |
Week 12 |
Sending of final test battery.
Closing meeting via Zoom with a focus group of eight people, in order to make a qualitative analysis of the effectiveness, limitations, and areas for improvement of the ePSICONUT programme. |
2.5. Data Analysis
Descriptive statistics and pre-post statistically differences were calculated for the variables under study: the ones related to lifestyle (e.g., diet quality and physical exercise) and the ones related to the psychological status of the participants (e.g., subjective psychological well-being, anxiety, and depression). The normality test was applied to the variables using the Shapiro–Wilk statistics [39]. On the basis of a confidence level of 95% and an α error of 5% (0.05), the null hypothesis (that the distribution was normal) was rejected, p-value ≤ 0.05. The reliability of the psychometric questionnaires was calculated through Cronbach’s Alpha and McDonald’s Omega statistic [40].
To assess the impact of PSICONUT pre-intervention and post-intervention, the Wilcoxon signed-rank test and Student’s t-test for related samples were applied. The Wilcoxon non-parametric test was used to compare data that did not meet the normality criterion [41]. In the case of variables that presented a normal distribution, Student’s t-test was used, which works very well for n ≤ 30 (as in this study) [42]. Effect sizes were calculated to quantify the magnitude of the differences between the pre- and post-intervention phase of the ePSCONUT programme. Cohen suggests that d ± 0.2–0.5 represents a “small” effect size, ±0.5–0.8 a “medium” effect size, and >±0.80 a “large” effect size [43]. Finally, statistical power was calculated using post hoc analysis difference between two means and assuming the minimum power level of 0.80 following Ellis [44]. In the case of effect size in variables where the Wicolxon rank test is applied, biserial rank correlation (rbis) is used [45]. Statistically significant differences were considered as p ≤ 0.05. Analyses were run with the statistical package SPSS 25.0 (Statistical Package for Social Sciences. New York, NY, USA), Jamovi 2.5, and G*Power 3.1 (Axel Buchner, Düsseldorf, Germany) (the last one for the calculation of statistical power).
3. Results
3.1. Impact of ePSICONUT on Global Diet Quality Index
The differences before and after ePSICONUT in intake of certain foods, breakfasts, lunches, and dinners, as well as the overall quality of the diet, will be presented below. Differences between variables with normal distribution were evaluated with Student’s t-test (see Table 3), while the rest were evaluated with the Wilcoxon test (see Table 4). To interpret the results, it is necessary to remember that the mean and median values presented, correspondingly, are based on the scores obtained by the participants when answering the Global Diet Quality Index. This means that the higher the score (hence, the mean or median) obtained after the sum of the three areas evaluated by this index, the better the diet. Consequently, on the one hand, the higher the score for “healthy foods” (vegetables, fruits, milk or dairy products, legumes, and fish) and “meals”, better the diet; on the other hand, the higher the score for “unhealthy foods” (cakes, cookies and sweets, sugary drinks, sugar, and fried foods), the poorer the diet quality.
Table 3.
Variables | 2 | Sig. t Student | d | 1 − ß | |
---|---|---|---|---|---|
Healthy food | |||||
Dairy products | 5.44 | 6.31 | 0.371 | ||
Total ICGD score | 74.31 | 87.38 | 0.002 * | −0.92 | 0.93 |
Note. 1 = mean before starting the ePSICONUT programme; 2 = mean at the end of the ePSICONUT programme. GDI = Global Diet Quality Index. * p ≤ 0.05.
Table 4.
Variables | 1 | 2 | Sig. Wilcoxon | rbis | 1 − ß |
---|---|---|---|---|---|
Healthy foods | |||||
Vegetables | 3.75 | 7.50 | 0.005 * | −0.91 | 0.96 |
Fruits | 1.75 | 7.50 | 0.063 | ||
Legumes | 10.00 | 10.00 | 0.317 | ||
Fish | 4.25 | 7.50 | 0.114 | ||
“Unhealthy” foods | |||||
Cakes, cookies, and sweets | 5.00 | 6.25 | 0.258 | ||
Sugary drinks | 3.75 | 7.50 | 0.042 * | −0.64 | 0.58 |
Sugar | 7.50 | 1.00 | 0.064 | ||
Fried foods | 7.50 | 7.50 | 0.885 | ||
Meals | |||||
Breakfasts | 10.00 | 10.00 | 1.000 | ||
Lunches | 10.00 | 10.00 | 0.317 | ||
Dinners | 10.00 | 10.00 | 0.655 |
Note. 1 = median before starting the ePSICONUT programme; 2 = median at the end of the ePSICONUT programme. * p ≤ 0.05
As can be seen in Table 3 and Table 4, the overall diet quality of the participants improved significantly (p < 0.05) after participating in the ePSICONUT programme. In general, there was a greater increase in the consumption of “healthy foods”, as well as a decrease in “unhealthy foods”. Specifically, there was a statistically significant increase in the consumption of vegetables (recall that such increase is evidenced by a higher score on this index), as well as a statistically significant decrease in the consumption of sugar-sweetened beverages (recall that such decrease is evidenced by a higher score on this index).
3.2. Impact of ePSICONUT on Physical Exercise
To evaluate the impact of ePSICONUT on physical exercise, the difference in the responses given in the IPAQ before and after participating in the programme was evaluated. There was a slight increase in the level of physical activity after participating in the ePSICONUT programme (see Table 5). However, this was not statistically significant (p > 0.05).
Table 5.
Variables | 1 | 2 | Sig. Wilcoxon |
---|---|---|---|
MET | 214.50 | 394.50 | 0.221 |
Weekly physical activity time | 65.00 | 80.00 | 0.363 |
Note. 1 = median before starting the ePSICONUT programme; 2 = median at the end of the ePSICONUT programme; MET = metabolic equivalents.
3.3. Impact of ePSICONUT on Overall Lifestyle
In addition, to evaluate the participants’ diet and physical exercise, ePSICONUT examined other lifestyle habits of the students, such as rest, leisure, relationships with their peers and with themselves, and their organisation in their studies, among other aspects included in the Healthy Lifestyle Scale for University Students.
When comparing, through a Student’s t-test, the means of the scores obtained before ( = 52.69) and after ( = 57.13) the ePSICONUT programme, a statistically significant difference was observed (t [gl = 123] = 3.02, p = 0.009). The effect size value was d = 0.076 and statistical power of 1 − ß = 0.95. This is evidence that the overall lifestyle of the students improved after the programme.
3.4. Impact of ePSICONUT on Subjective Well-Being and Motivation to Change
Table 6 presents the comparisons, using the Wilcoxon signed-rank test, of before and after ePSICONUT in the following aspects: subjective well-being and levels of depression. Subjective well-being increased and depression levels decreased, in a statistically significant way, after applying the programme (p < 0.05). On the other hand, the differences between the means of the levels of anxiety and motivation for change, before and after ePSICONUT, were evaluated by means of a Student’s t-test (see Table 7). It was observed that anxiety decreased significantly, including trait anxiety (p < 0.05). As for motivation to change, no statistically significant differences were found between before and after the programme (p > 0.05).
Table 6.
Variables | 1 | 2 | Sig. Wilcoxon | rbis | 1 − ß |
---|---|---|---|---|---|
BDI-II | 13.00 | 3.50 | 0.001 * | 0.97 | 0.99 |
EBPS | 104.50 | 120.00 | 0.021 * | 0.65 | 0.73 |
Note. 1 = median before starting the ePSICONUT programme; 2 = median at the end of the ePSICONUT programme. BDI-II = Beck Depression Inventory-II; EBPS = Subjective Psychological Well-Being Subscale of the Psychological Well-Being Scale. * p ≤ 0.05.
Table 7.
Variables | 1 | 2 | Sig. t Student | d | 1 − ß |
---|---|---|---|---|---|
STAI-S | 24.63 | 15.56 | 0.002 * | 0.94 | 0.93 |
STAI-T | 25.00 | 18.44 | 0.017 * | 0.67 | 0.71 |
Note. 1 = mean before starting the ePSICONUT programme; 2 = mean at the end of the ePSICONUT programme. STAI-S = State Anxiety; STAI-T = Trait Anxiety. * p ≤ 0.05.
3.5. Program Impact
Table 8 shows descriptive statistics of the evaluation made by the participants on the quality criteria of the programme. It is observed that the majority of the participants rated the ePSICONUT programme as excellent. Likewise, the majority stated that the programme had a very high impact on their eating habits and subjective well-being. The aspect they rated as having the least impact (although tending to have a high impact) was physical exercise.
Table 8.
Criteria for Satisfaction with ePSICONUT | s | ||
---|---|---|---|
Quality criteria | |||
Quality of the follow-up provided | 4.88 | 5.00 | 0.34 |
Level of organisation | 4.94 | 5.00 | 0.25 |
Quality of information provided | 5.00 | 5.00 | 0.00 |
Evaluation of subjective impact | |||
Impact on physical exercise | 3.94 | 4.00 | 1.24 |
Impact on psychological well-being | 4.38 | 4.50 | 0.72 |
Impact on diet | 4.50 | 5.00 | 0.73 |
Note. = mean; = median; s = standard deviation.
4. Discussion
ePSICONUT is an online interventional programme specifically designed for this research. The main objective of the study was to assess the impact of eHealth on the lifestyle and psychological well-being of a group of university students. It also tried to be a support to fill the gap that exists today around the validity and effectiveness of the use of ICT interventions in the health field, specifically in healthy lifestyle and mental health promotion [12,15,20]. We included digital tools that had demonstrated good quality and effectiveness in optimising life habits and emotional well-being. Among these, we can point out: Headspace (Santa Monica, CA, USA) [46,47], Insight Timer (San Francisco, CA, USA), Fabulous (Paris, France), WhatsApp (Meta Platforms, Cambridge, MA, USA) [48], YouTube (San Mateo, CA, USA) [49], Zoom (San Jose, CA, USA) [50], and email [51].
The results derived from this intervention indicate that students significantly improved their eating habits at the end of the programme. Throughout the implementation of the programme, an online nutritional education strategy was used to improve the diet quality: nutritional recommendations through informative capsules posted on YouTube and sent by email; encouraging the use of “El Nutriplato” [52] as a guiding tool to organise lunches and dinners; promoting the use of some techniques from the app called Fabulous (such as goals of drinking water, eating a large breakfast, and eating more fruits and vegetables). As a result, students tended to increase healthy foods intake (e.g., vegetables and greens) and to decrease the consumption of low nutritional quality food, such as sugary drinks. This result supports the promotion of the use of eHealth tools to optimise dietary quality, as well as the findings of other eHealth nutrition programmes that observed a significant improvement in diet and overall lifestyle in clinical [49] and non-clinical populations [53,54] after participating in programmes that facilitated the communication and education process between patient and health professional via WhatsApp, Facebook, or SMS. ePSICONUT also used WhatsApp as one of its main working tools.
ePSICONUT was designed and developed under a group modality, as well as online. It has been shown that focus-group interventions can be highly beneficial in promoting motivation and engagement in habit consolidation and changes, as well as in general self-care and decreasing negative emotions [48,55,56,57]. This same need for closeness, support, and modelling may also have had an impact on why all synchronous media used in the programme tended to be the most preferred and used by participants. Although authors such as Lie et al. [58] have found high efficacy in asynchronous eHealth media, this kind of telehealth may also represent a challenge in communication between healthcare professionals and service users [59].
In terms of the exercise practice, although constant reminders were given and motivation to exercise was promoted via WhatsApp, no statistically significant differences were evident between the level and frequency of physical exercise performed before and after the programme. This information on how to practice physical exercise properly was given by an asynchronous means (videos posted on YouTube). It is likely that synchronous sessions could be implemented to have better results.
Furthermore, in the psychological aspects, a statistically significant increase in subjective well-being was observed, as well as a statistically significant decrease in anxiety and depressive symptoms. On the basis of what has been explained and observed by other authors [51,60,61,62,63,64], as well as by the ePSICONUT participants themselves, psychological techniques and strategies, such as mindful eating, mindfulness, gratitude tasks, body acceptance exercises, and the same group support (all supported by the use of eHealth media), developed and practiced during the programme, could play an important role in the improvement of the psychological status that was observed after applying ePSICONUT in the participants.
Despite all these positive findings, it is important to clarify that this study has a limitation: the sample size. As can be seen in Table 1, 40 was the number of students that accepted to participate in this online programme. Only 10 dropped out of the study at some point. This means that 75% of the participants who started the program remained active, in one way or another, until its end. Thus, the dropout rate was not as large when compared to other intervention studies of 2 months or more [54]. However, this study was a pre–post intervention whose impact on lifestyle and psychological well-being pretended to be measured by intrasubject answers. Only 16 participants completed the final test battery, which was needed in order to be compared with the initial test battery because of the nature of this study. Although online questionnaires and surveys tend to be resources that are easy to manage and broadcast, Nayak and Narayan [65] confirmed, on the basis of their own studies and on other researchers’ experience, that this class of methods has a great disadvantage: the response rates by the subjects are usually much lower than those of offline and face-to-face questionnaires. This disadvantage and the fact that the online questionnaire for this program was quite long could have been key factors in our obtaining of only 16 complete responses. Although Hernández Sampieri et al. [66] state that 15 participants are the minimum for quasi-experimental studies, one potential purpose for the future is to conduct further studies based on ePSICONUT preliminary results but with larger samples and a control group. They could reinforce more the use of eHealth to promote a better lifestyle and psychological status.
Another limitation of this research is that no control group was used. In this sense, in quasi-experimental design studies, there is no randomisation of subjects to treatment and control groups, or there is no control group per se [67]. In the same line of research, García-Solano et al. [68] carried out a similar study in working adult population, without a control group, in which participants showed a behaviour change towards a healthy lifestyle.
5. Conclusions
University students who completed ePSICONUT (a psychonutritional programme fully supported by eHealth tools) showed a significant improvement in their lifestyle at the end of the programme. Although there was no statistically significant difference in exercise before and after the programme, other habits, such as healthy eating, were optimised. Consumption of high nutritional quality foods increased, and consumption of lower nutritional quality foods decreased. There was a significant and favourable change in the consumption of vegetables and greens, as well as a significant decrease in sugary drinks.
The mental health of the ePSICONUT participants also increased significantly at the end of the programme. Students showed an increase in their subjective well-being, as well as a decrease in negative emotions such as anxiety and depressive symptoms.
Acknowledgments
The author acknowledge the students of PUMMC their altruist participation in the study.
Author Contributions
Conceptualisation, L.M.C., A.B.-F., R.G.-S. and N.B.-P.; methodology, L.M.C. and N.B.-P., formal analysis, L.M.C. and N.B.-P.; investigation, L.M.C., R.G.-S. and N.B.-P.; writing—original draft preparation, L.M.C., N.B.-P., A.B.-F. and R.G.-S.; writing—review and editing, N.B.-P. and R.G.-S. All authors have read and agreed to the published version of the manuscript.
Institutional Review Board Statement
The study was approved by the ethics board from the Universidad Europea de Madrid (code CIPI/19/148) and by the COBE-FACS of the PUMMC (República Dominicana).
Informed Consent Statement
Informed consent was obtained from all subjects involved in the study.
Data Availability Statement
Data will be available upon request. Data are not deposited in any public available database.
Conflicts of Interest
The authors declare no conflict of interest.
Funding Statement
This research received no external funding.
Footnotes
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Rehman H., Ahmad M.I. COVID-19: Quarantine, Isolation, and Lifestyle Diseases. Arch. Physiol. Biochem. 2020:1–5. doi: 10.1080/13813455.2020.1833346. [DOI] [PubMed] [Google Scholar]
- 2.Idrovo Carlier S., Leon Llorente C., Grau Grau M. Comparing Work—Life Balance in Spanish and Latin—American Countries. Eur. J. Train. Dev. 2012;36:286–307. doi: 10.1108/03090591211204751. [DOI] [Google Scholar]
- 3.Global Diffusion of EHealth: Making Universal Health Coverage Achievable: Report of the Third Global Survey on EHealth. [(accessed on 3 June 2022)]. Available online: https://apps.who.int/iris/handle/10665/252529.
- 4.Ratheeswari K. Information Communication Technology in Education. J. Appl. Adv. Res. 2018;3:45–47. doi: 10.21839/jaar.2018.v3iS1.169. [DOI] [Google Scholar]
- 5.Yang X., Song B., Wu A., Mo P.K.H., Di J., Wang Q., Lau J.T.F., Wang L. Social, Cognitive, and eHealth Mechanisms of COVID-19-Related Lockdown and Mandatory Quarantine That Potentially Affect the Mental Health of Pregnant Women in China: Cross-Sectional Survey Study. J. Med. Internet Res. 2021;23:e24495. doi: 10.2196/24495. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Cantisano L.M., Belando Pedreño N., Ballester Sánchez Á., Blanco Fernández A., González Soltero R. Changes in lifestyle and emotions during the COVID-19 lockdown. Int. J. Dev. Educ. Psychol. 2021;1:413–424. doi: 10.17060/ijodaep.2021.n1.v1.2078. [DOI] [Google Scholar]
- 7.Téllez-Carvajal E. Reflexiones En Torno a La “Ciudadanía Digital”. Rev. Doxa Dig. 2017;7:47–65. doi: 10.52191/rdojs.2017.34. [DOI] [Google Scholar]
- 8.Bhardwaj N.N., Wodajo B., Gochipathala K., Paul D.P., Coustasse A. Can mHealth Revolutionize the Way We Manage Adult Obesity? Perspect. Health Inf. Manag. 2017;14:1a. [PMC free article] [PubMed] [Google Scholar]
- 9.Burke L.E., Styn M.A., Sereika S.M., Conroy M.B., Ye L., Glanz K., Sevick M.A., Ewing L.J. Using MHealth Technology to Enhance Self-Monitoring for Weight Loss: A Randomized Trial. Am. J. Prev. Medic. 2012;43:20–26. doi: 10.1016/j.amepre.2012.03.016. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Castelnuovo G., Manzoni G.M., Pietrabissa G., Corti S., Giusti E.M., Molinari E., Simpson S. Obesity and Outpatient Rehabilitation Using Mobile Technologies: The Potential MHealth Approach. Front. Psych. 2014;5:559. doi: 10.3389/fpsyg.2014.00559. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Gilliland J., Sadler R., Clark A., O’Connor C., Milczarek M., Doherty S. Using a Smartphone Application to Promote Healthy Dietary Behaviours and Local Food Consumption. Biomed. Res. Int. 2015;2015:841368. doi: 10.1155/2015/841368. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.San Mauro Martín I., González Fernández M., Collado Yurrita L. Aplicaciones móviles en nutrición, dietética y hábitos saludables: Análisis y consecuencia de una tendencia al alza. Nutr. Hosp. 2014;30:15–24. doi: 10.3305/nh.2014.30.1.7398. [DOI] [PubMed] [Google Scholar]
- 13.Santos-Miranda E., Rico-Díaz J., Carballo-Fazanes A., Abelairas-Gómez C. Cambios En Hábitos Saludables Relacionados Con Actividad Física y Sedentarismo Durante Un Confinamiento Nacional Por COVID-19 (Changes in Healthy Habits Regarding Physical Activity and Sedentary Lifestyle during a National Lockdown Due to COVID-19) Retos. 2021;43:415–421. doi: 10.47197/retos.v43i0.89425. [DOI] [Google Scholar]
- 14.Kanstrup A.M., Bertelsen P.S., Knudsen C. Changing Health Behavior with Social Technology? A Pilot Test of a Mobile App Designed for Social Support of Physical Activity. Int. J. Environ. Res. Public Health. 2020;17:8383. doi: 10.3390/ijerph17228383. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Sucala M., Cuijpers P., Muench F., Cardoș R., Soflau R., Dobrean A., Achimas-Cadariu P., David D. Anxiety: There Is an App for That. A Systematic Review of Anxiety Apps. Depress. Anxiety. 2017;34:518–525. doi: 10.1002/da.22654. [DOI] [PubMed] [Google Scholar]
- 16.Turner T., Hingle M. Evaluation of a Mindfulness-Based Mobile App Aimed at Promoting Awareness of Weight-Related Behaviors in Adolescents: A Pilot Study. JMIR Res. Protoc. 2017;6:e6695. doi: 10.2196/resprot.6695. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Muñoz A.O., Camacho E., Torous J. Marketplace and Literature Review of Spanish Language Mental Health Apps. Front. Digit. Health. 2021;3:615366. doi: 10.3389/fdgth.2021.615366. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Feldman D.I., Theodore Robison W., Pacor J.M., Caddell L.C., Feldman E.B., Deitz R.L., Feldman T., Martin S.S., Nasir K., Blaha M.J. Harnessing MHealth Technologies to Increase Physical Activity and Prevent Cardiovascular Disease. Clin. Cardiol. 2018;41:985–991. doi: 10.1002/clc.22968. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Sarwar C.M.S., Vaduganathan M., Butler J. Impact of Site Selection and Study Conduct on Outcomes in Global Clinical Trials. Curr. Heart Fail. Rep. 2017;14:203–209. doi: 10.1007/s11897-017-0335-y. [DOI] [PubMed] [Google Scholar]
- 20.Alyami M., Melyani Z., Johani A.A., Ullah E., Alyami H., Sundram F., Hill A., Henning M. The Impact of Self-Esteem, Academic Self-Efficacy and Perceived Stress on Academic Performance: A Cross-Sectional Study of Saudi Psychology Students. Eur. J. Educ. Sci. 2017;4:51–63. doi: 10.19044/ejes.v4no3a5. [DOI] [Google Scholar]
- 21.Manterola C., Otzen T. Estudios Experimentales 2 Parte. Estudios cuasi-experimentales. Int. J. Morphol. 2015;33:382–387. doi: 10.4067/S0717-95022015000100060. [DOI] [Google Scholar]
- 22.Caroll J., Moorhead A., Bond R., LeBlanc W., Petrella R., Fiscella K. Who Uses Mobile Phone Health Apps and Does Use Matter? A Secondary Data Analytics Approach. J. Med. Internet Res. 2017;19:e125. doi: 10.2196/jmir.5604. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Younes N., Chollet A., Menard E., Melchior M. E-Mental Health Care among Young Adults and Help-Seeking Behaviors: A Transversal Study in a Community Sample. J. Med. Internet Res. 2015;17:e123. doi: 10.2196/jmir.4254. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Otzen T., Manterola C. Técnicas de Muestreo Sobre Una Población a Estudio. Int. J. Morphol. 2017;35:227–232. doi: 10.4067/S0717-95022017000100037. [DOI] [Google Scholar]
- 25.Belmont I. Informe Belmont. National Commission for the Protection of Human Subjects of Biomedical and Behavioral Research; Berkeley, CA, USA: 1978. Principios Éticos & Directrices Para La Protección de Sujetos Humanos de Investigación. Estados Unidos de Norteamérica: Reporte de la Comisión Nacional para la Protección de Sujetos Humanos de Investigación Biomédica y de Comportamiento. [Google Scholar]
- 26.Gilder S. World Medical Association Meets in Helsinki. Br. Med. J. 1964;2:299–300. doi: 10.1136/bmj.2.5404.299. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Accenture Consulting Encuesta de Usuarios 2018 Sobre Sanidad Digital-España. 2018. [(accessed on 1 October 2020)]. Available online: https://www.accenture.com/_acnmedia/pdf-83/accenture-health-meet-todays-healthcare-spain.pdf.
- 28.Beck A., Steer R., Brown G. Beck Depression Inventory. 2nd ed. Psychological Corporation; San Antonio, TX, USA: 1996. [Google Scholar]
- 29.García-Batista Z.E., Guerra-Peña K., Cano-Vindel A., Herrera-Martínez S.X., Medrano L.A. Validity and Reliability of the Beck Depression Inventory (BDI-II) in General and Hospital Population of Dominican Republic. PLoS ONE. 2018;13:e0199750. doi: 10.1371/journal.pone.0199750. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.García-Batista Z.E., Guerra-Peña K., Cano-Vindel A., Cantisano-Guzmán L.M., Flores-Kanter P.E., Medrano L.A. Medición de la comorbilidad depresiva en drogodependientes: Validez y eficacia diagnóstica del Inventario de Depresión de Beck (BDI-II) en dominicanos con múltiple consumo de sustancias. Rev. Psicop. Y Psic. Clín. 2019;24:163–171. doi: 10.5944/rppc.24111. [DOI] [Google Scholar]
- 31.Spielberger C.D., Gorsuch R., Lushene R. Manual for the State-Trait Anxiety Inventory. Consulting Psychologist; Palo Alto, CA, USA: 1970. [Google Scholar]
- 32.García-Batista Z.E., Guerra-Peña K., Cano-Vindel A., Herrera-Martínez S.X., Flores-Kanter P.E., Medrano L.A. Propiedades psicométricas del Inventario de Ansiedad Estado-Rasgo en población general y hospitalaria de República Dominicana. Ansiedad Estré S. 2017;23:53–58. doi: 10.1016/j.anyes.2017.09.004. [DOI] [Google Scholar]
- 33.Cánovas-Sánchez J. EBP: Escala de Bienestar Psicológico. TEA Ediciones. 2013. [(accessed on 1 September 2020)]. Available online: https://pdfcoffee.com/escala-de-bienestar-psicologico-ebp-jose-sanchez-canovas-2-pdf-free.html.
- 34.McConnaughy E.A., Prochaska J.O., Velicer W.F. Stages of Change in Psychotherapy: Measurement and Sample Profiles. Psychother. Theory Res. Pract. 1983;20:368–375. doi: 10.1037/h0090198. [DOI] [Google Scholar]
- 35.Gómez-Peña M., Penelo E., Granero R., Fernández-Aranda F., Álvarez-Moya E., Santamaría J.J., Moragas L., Aymamí M.-N., Bueno B., Gunnard K., et al. Motivation to Change and Pathological Gambling: Analysis of the Relationship with Clinical and Psychopathological Variables. Br. J. Clin. Psych. 2011;50:196–210. doi: 10.1348/014466510X511006. [DOI] [PubMed] [Google Scholar]
- 36.Wang D., Xing X.-H., Wu X.-B. The Healthy Lifestyle Scale for University Students: Development and Psychometric Testing. Aust. J. Prim. Health. 2012;18:339–345. doi: 10.1071/PY11107. [DOI] [PubMed] [Google Scholar]
- 37.Domínguez Lara S., Martín-Díaz A., Ramírez-Colina S., Campos-Uscanga Y. Análisis Estructural de Una Escala de Estilos de Vida Saludables en Estudiantes Universitarias Mexicanas. [(accessed on 1 October 2020)];Rev. Cub. Enfer. 2019 35 Available online: http://www.revenfermeria.sld.cu/index.php/enf/article/view/2221. [Google Scholar]
- 38.Mantilla Toloza S.C., Gómez-Conesa A. El Cuestionario Internacional de Actividad Física. Un instrumento adecuado en el seguimiento de la actividad física poblacional. Rev. Iber. Fisiot. Y Kines. 2007;10:48–52. doi: 10.1016/S1138-6045(07)73665-1. [DOI] [Google Scholar]
- 39.Ghasemi A., Zahediasl S. Normality Tests for Statistical Analysis: A Guide for Non-Statisticians. Int. J. End. Y Metab. 2012;10:486–489. doi: 10.5812/ijem.3505. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Caycho-Rodríguez T., Ventura-León J.L. El coeficiente Omega: Un método alternativo para la estimación de la confiabilidad. Rev. A Lat. Cien. Soc. Niñ. Y Juv. 2017;15:625–627. [Google Scholar]
- 41.Molina J.G., Rodrigo M.F. T.5—Pruebas no Paramétricas. Universitat de València; Valencia, Spain: 2014. [Google Scholar]
- 42.Sánchez Turcios R.A. t-Student: Usos y abusos. Rev. Mex. Card. 2015;26:59–61. [Google Scholar]
- 43.Cohen J. The Effect Size Index: D. Statistical Power Analysis for the Behavioral Sciences. Routhledge Academic; Abingdon-on-Thames, UK: 1988. [Google Scholar]
- 44.Ellis J.G. Cognitive Behavioral Therapy for Insomnia and Acute Insomnia: Considerations and Controversies. Sleep Med. Clin. 2019;14:267–274. doi: 10.1016/j.jsmc.2019.01.007. [DOI] [PubMed] [Google Scholar]
- 45.Dominguez-Lara S. Magnitud del Efecto, una Guía Rápida. Educ. Méd. 2018;19:251–254. doi: 10.1016/j.edumed.2017.07.002. [DOI] [Google Scholar]
- 46.Economides M., Martman J., Bell M.J., Sanderson B. Improvements in Stress, Affect, and Irritability Following Brief Use of a Mindfulness-Based Smartphone App: A Randomized Controlled Trial. Mindfulness. 2018;9:1584–1593. doi: 10.1007/s12671-018-0905-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Mani M., Kavanagh D.J., Hides L., Stoyanov S.R. Review and Evaluation of Mindfulness-Based IPhone Apps. JMIR Mhealth Uhealth. 2015;3:e82. doi: 10.2196/mhealth.4328. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Simons L.P.A., Heuvel W.A.C.V.D., Jonker C.M. EHealth WhatsApp for Social Support: Design Lessons. Int. J. Netw. Virtual Organ. 2020;23:112–127. doi: 10.1504/IJNVO.2020.108857. [DOI] [Google Scholar]
- 49.Pot G.K., Battjes-Fries M.C., Patijn O.N., Pijl H., Witkamp R.F., de Visser M., van der Zijl N., de Vries M., Voshol P.J. Nutrition and Lifestyle Intervention in Type 2 Diabetes: Pilot Study in the Netherlands Showing Improved Glucose Control and Reduction in Glucose Lowering Medication. BMJ Nutr. Prev. Health. 2019;2:1–8. doi: 10.1136/bmjnph-2018-000012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Borrega-Mouquinho Y., Sánchez-Gómez J., Fuentes-García J.P., Collado-Mateo D., Villafaina S. Effects of High-Intensity Interval Training and Moderate-Intensity Training on Stress, Depression, Anxiety, and Resilience in Healthy Adults During Coronavirus Disease 2019 Confinement: A Randomized Controlled Trial. Front. Psychol. 2021;12:643069. doi: 10.3389/fpsyg.2021.643069. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Rajgopal A., Li C.R., Shah S., Budhathoki S.S. The use of telehealth to overcome barriers to mental health services faced by young people from Afro-Caribbean back-grounds in England during the COVID-19 pandemic. J. Glob. Health. 2021;11:03040. doi: 10.7189/jogh.11.03040. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Termes Escalé M., Martínez Chicano D., Egea Castillo N., Gutiérrez Sánchez A., García Arenas D., Llata Vidal N., Martín de Carpi J. Educación nutricional en niños en edad escolar a través del Programa Nutriplato(r) Nutr. Hosp. 2020;37:47–51. doi: 10.20960/nh.03357. [DOI] [PubMed] [Google Scholar]
- 53.Pedersen S., Grønhøj A., Thøgersen J. Following Family or Friends. Social Norms in Adolescent Healthy Eating. Appetite. 2015;86:54–60. doi: 10.1016/j.appet.2014.07.030. [DOI] [PubMed] [Google Scholar]
- 54.Torniainen-Holm M., Pankakoski M., Lehto T., Saarelma O., Mustonen P., Joutsenniemi K., Suvisaari J. The Effectiveness of Email-Based Exercises in Promoting Psychological Wellbeing and Healthy Lifestyle: A Two-Year Follow-up Study. BMC Psychol. 2016;4:21. doi: 10.1186/s40359-016-0125-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Tang Y.H., Chong M.C., Chua Y.P., Chui P.L., Tang L.Y., Rahmat N. The Effect of Mobile Messaging Apps on Cardiac Patient Knowledge of Coronary Artery Disease Risk Factors and Adherence to a Healthy Lifestyle. J. Clin. Nurs. 2018;27:4311–4320. doi: 10.1111/jocn.14538. [DOI] [PubMed] [Google Scholar]
- 56.Breuer L., Barker C. Online Support Groups for Depression: Benefits and Barriers. SAGE Open. 2015;5 doi: 10.1177/2158244015574936. [DOI] [Google Scholar]
- 57.Swancutt D., Tarrant M., Pinkney J. How Group-Based Interventions Can Improve Services for People with Severe Obesity. Curr. Obes. Rep. 2019;8:333–339. doi: 10.1007/s13679-019-00348-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.Lie S.S., Karlsen B., Graue M., Oftedal B. The Influence of an EHealth Intervention for Adults with Type 2 Diabetes on the Patient-Nurse Relationship: A Qualitative Study. Scand. J. Caring Sci. 2019;33:741–749. doi: 10.1111/scs.12671. [DOI] [PubMed] [Google Scholar]
- 59.Brandt C.J., Søgaard G.I., Clemensen J., Søndergaard J., Nielsen J.B. Determinants of Successful EHealth Coaching for Consumer Lifestyle Changes: Qualitative Interview Study Among Health Care Professionals. J. Med. Internet Res. 2018;20:e237. doi: 10.2196/jmir.9791. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Fuller-Tyszkiewicz M., Richardson B., Lewis V., Linardon J., Mills J., Juknaitis K., Lewis C., Coulson K., O’Donnell R., Arulkadacham L., et al. A Randomized Trial Exploring Mindfulness and Gratitude Exercises as EHealth-Based Micro-Interventions for Improving Body Satisfaction. Comp. Hum. Behav. 2019;95:58–65. doi: 10.1016/j.chb.2019.01.028. [DOI] [Google Scholar]
- 61.Lahtinen O., Aaltonen J., Kaakinen J., Franklin L., Hyönä J. The Effects of App-Based Mindfulness Practice on the Well-Being of University Students and Staff. Curr. Psychol. 2021 doi: 10.1007/s12144-021-01762-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Reyes A.T. A Mindfulness Mobile App for Traumatized COVID-19 Healthcare Workers and Recovered Patients: A Response to “The Use of Digital Applications and COVID-19”. Community Ment. Health J. 2020;56:1204–1205. doi: 10.1007/s10597-020-00690-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 63.Sort A. The Role of MHealth in Mental Health. Mhealth. 2017;3:1. doi: 10.21037/mhealth.2017.01.02. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 64.Villani D., Cognetta C., Repetto C., Serino S., Toniolo D., Scanzi F., Riva G. Promoting Emotional Well-Being in Older Breast Cancer Patients: Results from an EHealth Intervention. Front. Psych. 2018;9:2279. doi: 10.3389/fpsyg.2018.02279. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65.Nayak M.S.D.P., Narayan K.A. Strengths and weakness of online surveys. J. Hum. Soc. Sci. 2019;24:31–38. doi: 10.9790/0837-2405053138. [DOI] [Google Scholar]
- 66.Hernández Sampieri R., Fernández Collado C., Baptista Lucio M.d.P. Metodología de la Investigación. 6th ed. McGraw-Hill/Interamericana Editores, S.A. de C.V; México, Mexico: 2014. [Google Scholar]
- 67.Levy Y., Ellis T.J. A guide for novice researchers on experimental and quasi-experimental studies in information systems research. Interdiscip. J. Inf. Knowl. Manag. 2011;6:151. doi: 10.28945/1373. [DOI] [Google Scholar]
- 68.García-Solano M., Gutiérrez-González E., Santos-Sanz S., Yusta-Boyo M.J., Villar-Villalba C., Dal Re-Saavedra M.A. Intervención grupal de promoción de hábitos saludables en el ámbito laboral: Programa IPHASAL. Med. Y Seg. Trab. 2021;67:24–36. doi: 10.4321/S0465-546X2021000100003. [DOI] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
Data will be available upon request. Data are not deposited in any public available database.