Skip to main content
BMC Medical Informatics and Decision Making logoLink to BMC Medical Informatics and Decision Making
. 2022 Apr 27;22:112. doi: 10.1186/s12911-022-01851-4

Adopting wearables to customize health insurance contributions: a ranking-type Delphi

Daniel Neumann 1, Victor Tiberius 1,, Florin Biendarra 2
PMCID: PMC9044726  PMID: 35477495

Abstract

Background

Wearables, as small portable computer systems worn on the body, can track user fitness and health data, which can be used to customize health insurance contributions individually. In particular, insured individuals with a healthy lifestyle can receive a reduction of their contributions to be paid. However, this potential is hardly used in practice.

Objective

This study aims to identify which barrier factors impede the usage of wearables for assessing individual risk scores for health insurances, despite its technological feasibility, and to rank these barriers according to their relevance.

Methods

To reach these goals, we conduct a ranking-type Delphi study with the following three stages. First, we collected possible barrier factors from a panel of 16 experts and consolidated them to a list of 11 barrier categories. Second, the panel was asked to rank them regarding their relevance. Third, to enhance the panel consensus, the ranking was revealed to the experts, who were then asked to re-rank the barriers.

Results

The results suggest that regulation is the most important barrier. Other relevant barriers are false or inaccurate measurements and application errors caused by the users. Additionally, insurers could lack the required technological competence to use the wearable data appropriately.

Conclusion

A wider use of wearables and health apps could be achieved through regulatory modifications, especially regarding privacy issues. Even after assuring stricter regulations, users’ privacy concerns could partly remain, if the data exchange between wearables manufacturers, health app providers, and health insurers does not become more transparent.

Keywords: Delphi study, Health insurance, Wearable electronic device, Wearable technology, Internet of Things, Barriers

Introduction

The basic idea of health insurance is to collect contributions from insured individuals and to cover their medical expenses, based on the principle of solidarity [1]. When individual health risks differ significantly, insurance contributions can be customized based on individual risk assessment and a healthy lifestyle. Individuals with higher health risks, such as pre-existing conditions or unhealthy behaviors, pay a premium, while participants with healthy behavior are rewarded with contribution reductions.

Cost-effective healthcare solutions using (smart) wearables have the potential to lower the insurance contribution for individual users by fostering healthy behavior and offering the possibility to collect health-related data used to assess individual health risks [2]. As part of the Internet of Things (IoT) [37], wearables are small portable computer systems, such as smart watches, that are worn on the body or clothing [810] and that monitor various health measures using biosensors [11]. They have become increasingly popular in recent years [1214] and are developing into an integral part of personal analytics, measuring physical condition, recording physiological parameters or information about medication plans [15]. Combined with health apps, wearables are considered beneficial in areas such as increased fitness, preventive healthcare (prophylaxis) and chronic disease monitoring [16, 17], which leads to both health benefits and cost savings [1820]. Furthermore, telemedicine services through wearable-based health monitoring can lead to improved access to healthcare for an ageing society like Germany by reducing in-person clinic appointments [3, 4, 21]. Additionally, data could be tracked continuously rather than with long breaks. Therefore, wearables and health apps can be cost-effective digital solutions for the wider sector of the health system [22, 23], representing a radical innovation [24] partly disrupting traditional health monitoring. The recent COVID-19 pandemic, with personal contact restrictions, has particularly shown the benefits of such telemedicine approaches. Patients can be informed about their health status by voice-controlled intelligent assistants (VIPAs) [25] or by doctors using social media channels [26], based on data from their wearables.

Despite these advantages, the actual usage of wearables for assessing individual risk scores for health insurance currently remains limited. The objective of this study is to identify and rank the barrier factors influencing wearable usage for assessing individual risk scores for health insurances in Germany. The conclusions from this study may be applicable for other countries as well.

Some previous research provides hints for several barriers of using wearables for insurance contribution customization. The acceptance of wearables and the collection of individual health data is key to their effectiveness [4]. A significant share of patients may dislike or refuse to be monitored by third parties. In a survey, it was found that 33% of respondents from 16 different countries used wearables and health apps to record their fitness or health [27]. Considering the novelty of this technology, this share is already relatively high. However, the majority still lacks interest or may find the technology too expensive [28]. Among the users of wearables, only 1% used devices sponsored by their health insurers [29]. This suggests that there is a high customer acceptance to use wearables and to track health data for personal use, whereas sharing this data with health insurers is less accepted.

The reason for this restraint might be data security and privacy concerns [28]. Such concerns are not unfounded as the majority of free health apps, according to their data protection guidelines or general terms, share the data with third parties [3032]. The users’ major concern is that, due to the lack of privacy, their shared health data may lead to discrimination because of possible illnesses or a lifestyle considered unhealthy [3336]. These concerns could only be reduced by assuring stricter state regulations for health data processing using health apps [6]. Another problem could be the users’ lack of knowledge when interpreting the collected health data correctly [37]. Additionally, wrong or imprecise collected health data due to the low quality of the devices’ sensors could lead to falsely calculated customized insurance contributions [37].

Apart from barriers on the users’ side, also barriers on the healthcare providers’ side might challenge the use of wearables to customize health insurance contributions, such as the integration of wearable-tracked health data into the healthcare organization, micropolitics, and missing incentives [38].

The aforementioned research focuses on single barrier factors. To the best of our knowledge, no study with a holistic view on barrier factors exists, and none used a ranking-type Delphi study design. With this study, we contribute to both research on fair health insurance contributions and research on wearables by exploring barrier factors relating to their use to customize insurance contributions. The findings can help insurers, wearable manufacturers, and health app developers to avoid shortcomings that impede customized health insurance contributions and adverse properties of wearables and health apps. The results of the study imply that regulation is the most pressing barrier factor. Another major problem are false or inaccurate measurements and application errors caused by the users.

The remainder of the paper is structured as follows: First, we explain the Delphi study design as the applied methodology of our research. Second, we present the results of the empirical study. Third, we discuss the findings, their implications, and the limitations of the study. Fourth, in the conclusion, we sum up the gained insights.

Methodology

To achieve our research goal, we employ a ranking-type Delphi study. Delphi studies are a widely accepted and well-established research method [3941]. Delphi studies are expert group surveys, which are considered to be more accurate and valid than both single expert interviews and layperson group surveys [42, 43]. Cognitive biases are reduced and allow for higher objectivity [4345]. Among the different types of Delphi methods, we chose the ranking-type, which allows for the identification and ranking of influencing factors [41, 46], such as barriers.

The Delphi study consists of three stages: collecting and consolidating the barriers, ranking them, and re-ranking them [40, 46]. In the first phase, the brainstorming phase, the experts were asked to list possible barriers to the use of wearables to customize health insurance contributions. The experts were asked to indicate as many perceived barriers as possible. The minimum requirement was to specify three possible barriers. A total of 58 barriers were mentioned by the experts. Consolidating the list of barriers was carried out in three steps. First, each statement was copied onto a table. Second, the statements that had the same meaning were then grouped to barrier categories. Third, duplicates and statements belonging to the same category were removed. As a result, a total of eleven barrier categories remained. Narrowing down the list was unnecessary due to the manageable number of entries [47].

In the second stage, the experts were asked to arrange the randomly sorted barriers according to their relevance, with first place being the most relevant. The third stage, the re-ranking stage, aimed to increase the group consensus, as a constitutive characteristic of the Delphi study design, by giving structured feedback about the results from the second round [43, 46, 4852]. Therefore, the ranked list from the second round was provided to the panel, and the experts were asked to make adjustments if necessary. The survey was conducted anonymously.

Delphi studies use a purposive sampling method [53], based on the respondents’ thematic expertise [41, 43, 45, 5457]. The number of respondents is usually rather small [40, 55], with seven considered as the minimum [48] and usually comprising 15 to 35 experts [54]. To select our sample, we searched for professionals working with health insurance organizations and manufacturers of wearables. For our study, it would potentially also have been reasonable to include wearable users as survey participants. However, we followed the conventional Delphi study protocol, which prescribes to exclude laypersons [42, 43]. We address this further in the limitations.

Potential experts were contacted by telephone. A total of 20 participants agreed to take part in the survey. Of them, 18 participated in the survey, marking a response rate of 90%. Two respondents did not fill in the survey completely. As a consequence, 16 surveys were used for the analysis. Between the rounds, the dropout rate was 0%. The first survey was carried out from November 2nd, 2020 to November 15th, 2020, the second survey from November 16th, 2020 to November 24th, 2020, And the third round started on November 25, 2020 and was completed on November 30th, 2020.

Table 1 depicts the panel profile. Seven experts were female (43.75%) and 9 were male (56.25%). The experts were 38.69 years old on average and had an average work experience of 9.72 years. Twelve respondents (75%) worked for health insurance companies and four (25%) worked for wearable manufacturers, all in the software department. The proportion of experts with a wearable background was deliberately kept low because we assumed that they may be subject to a desirability bias [44, 45], seeing more opportunities rather than barriers for wearables as working for a producer usually involves a high level of identification with the product [58].

Table 1.

Panel description

Gender Female 7 (43.75%)
Male 9 (56.25%)
Age (years) < 30 7 (43.75%)
30–39 2 (12.50%)
40–49 2 (12.50%)
50–59 4 (25.00%)
> 60 1 (6.25%)
Mean 38.69
Work experience (years) < 6 7 (43.75%)
6–10 4 (25.00%)
> 10 5 (31.25%)
Mean 9.72
Occupation Health insurer 12 (75.00%)
Wearable manufacturer 4 (25.00%)

The ranking and the re-ranking were analyzed as follows: The average ranking place for each barrier b was calculated as the arithmetic mean r¯b of the ranks of this barrier provided by all respondents (N = 16):

r¯b=1Ni=1Nrb,i.

We also calculated the standard deviation σ as a measure of the panel disagreement:

σ=1N-1i=1N(rb,i-r¯b)2.

The Delphi study was conducted in accordance to the voluntary “Research guidelines for the Delphi survey technique” [55]. As the survey did not include any medical or clinical experimentation or ethically relevant human research, the ethics commission of our university was not competent for this kind of research and an approval was neither needed nor possible.

Results

The results from the ranking and re-ranking are depicted in Table 2. The final results from the third-round show that regulation barriers (i.e., privacy issues and data protection as well as other legal requirements) are the most important ones. In the third and fourth places follow inaccurate measurements and application errors as issues the users are responsible for. The fifth most relevant barrier addresses the insurers, particularly their lack of technological competence to use the wearable data appropriately. Barriers six and seven are principal considerations, namely that data from wearables is generally not suitable to calculate individual contributions and that a contributions customization is not compatible with the solidary principle of insurances. Less relevant barriers are a lack of people’s acceptance of wearing wearables in public, a bad cost–benefit ratio of individual contributions, a lack of access to wearables, and fear of higher insurance contributions as a consequence of suggested unhealthy behavior.

Table 2.

Ranked barriers in the second and third survey round

Second round Third round
Place Barrier r¯ σ Place Barrier r¯ σ
1 Privacy issues/data protection 2.88 2.34 1 Privacy issues/data protection 1.50 0.87
2 Legal requirements 3.81 2.94 2 Legal requirements 2.94 2.08
3 Lack of data validity/inaccurate measurements 4.38 3.06 3 Lack of data validity/inaccurate measurements 4.63 2.37
4 Application errors 5.25 2.08 4 Application errors 4.69 2.05
4 Solidarity principle of insurance 5.25 3.54 5 Lack of technological competencies at health insurers 6.13 2.57
5 Lack of technological competencies at health insurers 6.50 2.81 6 Wearable data not suitable for contribution adjustments 6.25 2.14
6 Wearable data not suitable for contribution adjustments 7.00 2.94 7 Solidarity principle of insurance 6.63 2.03
7 Lack of public acceptance of wearing wearables 7.56 2.45 8 Lack of public acceptance of wearing wearables 7.00 2.62
8 Bad cost–benefit ratio of individual contributions 7.63 2.47 9 Bad cost–benefit ratio of individual contributions 8.38 2.74
9 Lack of access to wearables 7.88 2.29 10 Lack of access to wearables 8.69 2.05
9 Fear of sanctions 7.88 2.03 11 Fear of sanctions 9.19 1.88

r¯: average rank; σ: standard deviation. Shifts in italics

Whereas in the second round, several barriers were seen as equally relevant, the third round led to clearer differentiations. The order of the barriers hardly changed. Only the three barriers on places five to seven, i.e., the medium-relevant barriers, saw slight shifts. A possible lack of technological competence at health insurers and the missing suitability of data from wearables for contributions adjustments were seen as slightly more relevant in the third round, whereas the violation of the solidarity principle was rated as less relevant. These only slight changes suggested that a fourth survey round was not necessary. This is further suggested by an increased consensus in the group, which can be measured by a reduction of the average standard deviation. The average standard deviation was 2.63 in the second round, whereas it was 2.13 in the third round.

Discussion

Interpretation of the results and future research

In both surveys, the two most important barriers (privacy/data protection and other legal requirements) address regulatory issues. These issues correspond with the findings in previous research [6, 7, 28, 34, 59, 60]. As both the health care sector and the health insurance sector are highly regulated, it is not surprising that the respondents pay special attention to such issues. However, these barriers are the responsibility of neither health insurers nor users and cannot be overcome by them directly. Health insurers could try to exert influence by lobbying. Similarly, users could start petitions. If states handle the regulatory issues in a manner that creates legal certainty and is considered satisfactory by health insurers and especially by users, the main barriers could be overcome.

Inaccurate measurements and application errors are within the users’ responsibility and are also mentioned by previous research [37]. These issues are particularly important for health insurers, as data generated by wearables must have a minimum level of reliability and have to be free from manipulation. If this is not the case, there is a risk that contributors manipulate their transmitted data to their advantage and thereby reduce the contributions to be paid, although the actual health data would not allow this. However, it is not clear if these barriers really exist or are just the insurers’ concerns. Empirical observations could clarify this. We call on future research to investigate this. If the assumption is confirmed, periodical or random measurements in medical practices could be executed. Handling errors, without the intention to manipulate data, could be diminished by (online) trainings and tutorials.

It is unclear if health insurers really show a lack of technological competence to use wearable data. This also should be found out by future studies. However, it is questionable if insurers really need that competence or, more likely, IT service providers will be used to handle data management. In either case, it appears to be less of a problem to overcome the potential lack of technological competence.

Overall, other less relevant barriers, such as a lack of acceptance for wearing wearables in public [4, 28] or the potential fear of sanctions [3336], confirm considerations in previous research, whereas new barriers could be identified and rated.

As a consequence of the results of the present study, it can be stated that a legally certain framework for the use of data generated by wearables is the major barrier for the individual adjustment of health insurance contributions [7, 29, 59, 60]. A wider use of wearables and health apps could be achieved if some regulatory modifications were implemented. They could create transparency and trust. However, even if data protection laws become stricter, the users’ privacy concerns could partly remain. More transparency regarding the collaboration between wearables manufacturers, health app providers, and health insurers could lead to an increased trust among users. For example, health insurers could test and certify both wearable devices and health apps or develop their own health apps to ensure that the sensitive generated health data is only forwarded to the health insurer and its legitimate IT service providers but no other parties. Apart from the privacy issues, barriers within the users’ and health insurers’ responsibility appear comparably easy to overcome.

Beyond a strict focus on barrier factors impeding the use of wearables for the customization of insurance contributions, we encourage future research to examine other potential benefits of wearables. In particular, for which specific disease states can wearables be used to improve the patients’ situation? For example, current research exists on chronic obstructive pulmonary disease (COPD) [61], depression [62], distress [63], multiple sclerosis [64], Parkinson's disease [65], post-surgery complications [66], and sleep apnea [67]. We believe that many further application fields exist.

Limitations

Our study comes with several limitations. First, even if the sample size meets the requirements of Delphi studies, future studies could consider larger or differently structured panels. In particular, the number of wearables manufacturers could be increased, and developers of health apps could be included. As mentioned before, this could potentially increase the risk of a desirability bias [44, 45], on the one side. On the other side, wearables manufacturers and health app developers could also see further barrier factors in the first survey round. Additionally, even if this leads to a higher standard deviation, this would represent an interesting insight.

Also insured individuals as (potential) users of wearables could be included. On the one side, this would violate the requirement of Delphi studies, which only allows the participation of experts. On the other side, as the most relevant stakeholder group, insured individuals could possibly identify further barrier factors wearables manufacturers and health app developers do not have in mind.

Second, interpreting the sorted list of obstacles, it has to be kept in mind that these are only ranked in order of their relevance, whereas the exact distances between the barriers remain unclear. For example, the first barrier could impede the use of wearables for the adaption of health insurance contributions ten times as much as the second barrier and 25 times as much as the third barrier. A ranking-type Delphi cannot provide such insights. Other survey formats could expand on our findings.

Conclusion

In the present study, the barriers to the use of wearables and health apps for the adjustment of health insurance contributions were identified and ranked. For this purpose, a three-stage ranking-type Delphi study with 16 experts was carried out. The results suggest a total of eleven barrier categories, with a focus on legal and technological barriers. A regulatory framework for the use of wearables for health insurance matters has to be ensured before barriers within the direct responsibility of users, health insurers, wearables manufacturers, and health app providers could be overcome.

Acknowledgements

We thank the participants in the survey. We are also grateful to the Deutsche Forschungsgemeinschaft for covering the article processing fee.

Author contributions

Conceptualization: VT; methodology: DN, VT; validation: FB; formal analysis: DN, FB; investigation: DN, VT; resources: DN; writing—original draft: DN, VT; writing—revision: VT. All authors read and approved the final manuscript.

Funding

Open Access funding enabled and organized by Projekt DEAL. The article processing fee was funded by the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation)—Project No. 491466077.

Availability of data and materials

All data generated or analyzed during this study are included in this published article.

Declarations

Ethics approval and consent to participate

The Delphi study was conducted in accordance to the voluntary “Research guidelines for the Delphi survey technique [55]. The survey did not include any medical or clinical experimentation or ethically relevant human research. According to §1 (3) Verfahrensordnung der Ethik-Kommission der Universität Potsdam dated July 13th, 2016, the ethics commission of our university was not competent for this kind of research and an approval was neither needed nor possible.

Consent for publication

Not applicable as the manuscript does not include details relating to an individual person.

Competing interests

The authors declare no competing interests.

Footnotes

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  • 1.Lagomarsino G, Garabrant A, Adyas A, Muga R, Otoo N. Moving towards universal health coverage: health insurance reforms in nine developing countries in Africa and Asia. Lancet. 2012;380(9845):933–943. doi: 10.1016/S0140-6736(12)61147-7. [DOI] [PubMed] [Google Scholar]
  • 2.McCrea M, Farrell M. A conceptual model for pricing health and life insurance using wearable technology. Risk Manag Insur Rev. 2018;21(3):389–411. doi: 10.1111/rmir.12112. [DOI] [Google Scholar]
  • 3.Dimitrov DV. Medical internet of things and big data in healthcare. Healthc Inform Res. 2016;22(3):156–163. doi: 10.4258/hir.2016.22.3.156. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Haghi M, Thurow K, Stoll R. Wearable devices in medical internet of things: scientific research and commercially available devices. Healthc Inform Res. 2017;23(1):4–15. doi: 10.4258/hir.2017.23.1.4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Korte A, Tiberius V, Brem A. Internet of Things (IoT) technology research in business and management literature: results from a co-citation analysis. J Theor Appl Electron Commerce Res. 2021;16(6):2073–2090. doi: 10.3390/jtaer16060116. [DOI] [Google Scholar]
  • 6.Montgomery K, Chester J, Kopp K. Health wearables: ensuring fairness, preventing discrimination, and promoting equity in an emerging Internet-of-Things environment. J Inf Policy. 2018;8:34–77. doi: 10.5325/jinfopoli.8.1.0034. [DOI] [Google Scholar]
  • 7.Psychoula I, Chen L, Amft O. Privacy risk awareness in wearables and the internet of things. IEEE Pervasive Comput. 2020;19(3):60–66. doi: 10.1109/MPRV.2020.2997616. [DOI] [Google Scholar]
  • 8.Dunn J, Runge R, Snyder M. Wearables and the medical revolution. Pers Med. 2018;15(5):429–448. doi: 10.2217/pme-2018-0044. [DOI] [PubMed] [Google Scholar]
  • 9.Li Z, Zhang S, Chen Y, Ling H, Zhao L, Luo G, Wang X, Hartel MC, Liu H, Xue Y, Haghniaz R. Gelatin methacryloyl-based tactile sensors for medical wearables. Adv Funct Mater. 2020;30:2003601. doi: 10.1002/adfm.202003601. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Wright R, Keith L. Wearable technology: if the tech fits, wear it. J Electron Resour Med Libr. 2014;11(4):204–216. doi: 10.1080/15424065.2014.969051. [DOI] [Google Scholar]
  • 11.Kim J, Campbell AS, de Ávila BEF, Wang J. Wearable biosensors for healthcare monitoring. Nat Biotechnol. 2019;37(4):389–406. doi: 10.1038/s41587-019-0045-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Jayathilaka WADM, Qi K, Qin Y, Chinnappan A, Serrano-García W, Baskar C, Wang H, He J, Cui S, Thomas SW, Ramakrishna S. Significance of nanomaterials in wearables: a review on wearable actuators and sensors. Adv Mater. 2019;31(7):1805921. doi: 10.1002/adma.201805921. [DOI] [PubMed] [Google Scholar]
  • 13.Lobelo F, Kelli HM, Tejedor SC, Pratt M, McConnell MV, Martin SS, Welk GJ. The wild wild west: a framework to integrate mHealth software applications and wearables to support physical activity assessment, counseling and interventions for cardiovascular disease risk reduction. Prog Cardiovasc Dis. 2016;58(6):584–594. doi: 10.1016/j.pcad.2016.02.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Lutz J, Memmert D, Raabe D, Dornberger R, Donath L. Wearables for integrative performance and tactic analyses: opportunities, challenges, and future directions. Int J Environ Res Public Health. 2020;17(1):59. doi: 10.3390/ijerph17010059. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Yetisen AK, Martinez-Hurtado JL, Ünal B, Khademhosseini A, Butt H. Wearables in medicine. Adv Mater. 2018;30(33):1706910. doi: 10.1002/adma.201706910. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Kerner C, Burrows A, McGrane B. Health wearables in adolescents: implications for body satisfaction, motivation and physical activity. Int J Health Promot Educ. 2019;57(4):191–202. doi: 10.1080/14635240.2019.1581641. [DOI] [Google Scholar]
  • 17.Canhoto AI, Arp S. Exploring the factors that support adoption and sustained use of health and fitness wearables. J Mark Manag. 2017;33(1-2):32–60. doi: 10.1080/0267257X.2016.1234505. [DOI] [Google Scholar]
  • 18.Braegger U. Cost–benefit, cost-effectiveness and cost–utility analyses of periodontitis prevention. J Clin Periodontol. 2005;32(s6):301–313. doi: 10.1111/j.1600-051X.2005.00802.x. [DOI] [PubMed] [Google Scholar]
  • 19.Rajgopal R, Cox RH, Lambur M, Lewis EC. Cost-benefit analysis indicates the positive economic benefits of the expanded food and nutrition education program related to chronic disease prevention. J Nutr Educ Behav. 2002;34(1):26–37. doi: 10.1016/S1499-4046(06)60225-X. [DOI] [PubMed] [Google Scholar]
  • 20.Shi L. A cost-benefit analysis of a California county's back injury prevention program. Public Health Rep. 1993;108(2):204–211. [PMC free article] [PubMed] [Google Scholar]
  • 21.Turakhia MP, Kaiser DW. Transforming the care of atrial fibrillation with mobile health. J Interv Card Electrophysiol. 2016;47(1):45–50. doi: 10.1007/s10840-016-0136-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Collier R, Randolph AB. Wearable technologies for healthcare innovation. In: Proceedings of the Southern Association for information systems conference. Hilton Head Island. 2015.
  • 23.Liu C, Liu F, Zhang L, Su Y, Murray A. Smart wearables in healthcare: signal processing, device development, and clinical applications. J Healthc Eng. 2018;2018:1696924. doi: 10.1155/2018/1696924. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Tiberius V, Schwarzer H, Roig-Dobón S. Radical innovations: between established knowledge and future research opportunities. J Innov Knowl. 2021;6(3):145–153. doi: 10.1016/j.jik.2020.09.001. [DOI] [Google Scholar]
  • 25.Ermolina A, Tiberius V. Voice-controlled intelligent assistants (VIPA) in healthcare: an international Delphi study”. J Med Internet Res. 2021;23(4):e25312. doi: 10.2196/25312. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Studen L, Tiberius V. Social media, quo vadis? Prospective development and implications. Future Internet. 2020;12(9):146. doi: 10.3390/fi12090146. [DOI] [Google Scholar]
  • 27.GfK. Health and Fitness Tracking: Global GfK Survey. 2016 Sept. https://cdn2.hubspot.net/hubfs/2405078/cms-pdfs/fileadmin/user_upload/country_one_pager/nl/documents/global-gfk-survey_health-fitness-monitoring_2016.pdf. Accessed 23 Oct 2020.
  • 28.Krebs P, Duncan DT. Health app use among US mobile phone owners: a national survey. JMIR mHealth uHealth. 2015;3(4):e101. doi: 10.2196/mhealth.4924. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Wiesner M, Zowalla R, Suleder J, Westers M, Pobiruchin M. Technology adoption, motivational aspects, and privacy concerns of wearables in the German running community: field study. JMIR mHealth uHealth. 2018;6(12):e201. doi: 10.2196/mhealth.9623. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Armstrong S. What happens to data gathered by health and wellness apps? BMJ. 2016;353:i3406. doi: 10.1136/bmj.i3406. [DOI] [PubMed] [Google Scholar]
  • 31.Huckvale K, Prieto JT, Tilney M, Benghozi PJ, Car J. Unaddressed privacy risks in accredited health and wellness apps: a cross-sectional systematic assessment. BMC Med. 2015;13(1):214. doi: 10.1186/s12916-015-0444-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Tabi K, Randhawa AS, Choi F, Mithani Z, Albers F, Schnieder M, Nikoo M, Vigo D, Jang K, Demlova R, Krausz M. Mobile apps for medication management: review and analysis. JMIR mHealth uHealth. 2019;7(9):e13608. doi: 10.2196/13608. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Banerjee S, Hemphill T, Longstreet P. Wearable devices and healthcare: data sharing and privacy. Inf Soc. 2018;34(1):49–57. doi: 10.1080/01972243.2017.1391912. [DOI] [Google Scholar]
  • 34.McCallum C, Rooksby J, Gray CM. Evaluating the impact of physical activity apps and wearables: interdisciplinary review. JMIR mHealth uHealth. 2018;6(3):e58. doi: 10.2196/mhealth.9054. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Somers C, Grieve E, Lennon M, Bouamrane MM, Mair FS, McIntosh E. Valuing mobile health: an open-ended contingent valuation survey of a National Digital Health Program. JMIR mHealth uHealth. 2019;7(1):e3. doi: 10.2196/mhealth.9990. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Wathieu L, Friedman AA. An empirical approach to understanding privacy valuation. HBS Marketing Research Paper 07-075 (2007).
  • 37.Groß D, Schmidt M. Ethical perspectives on E-health and health apps: Is all that is achievable desirable? Bundesgesundheitsblatt Gesundheitsforschung Gesundheitsschutz. 2018;61(3):349–357. doi: 10.1007/s00103-018-2697-z. [DOI] [PubMed] [Google Scholar]
  • 38.Lluch M. Healthcare professionals’ organisational barriers to health information technologies—a literature review. Int J Med Inform. 2011;80(12):849–862. doi: 10.1016/j.ijmedinf.2011.09.005. [DOI] [PubMed] [Google Scholar]
  • 39.Flostrand A, Pitt L, Bridson S. The Delphi technique in forecasting—a 42-year bibliographic analysis (1975–2017) Technol Forecast Soc Chang. 2020;150:119773. doi: 10.1016/j.techfore.2019.119773. [DOI] [Google Scholar]
  • 40.Okoli C, Pawlowski SD. The Delphi method as a research tool: an example, design considerations and applications. Inf Manag. 2004;42(1):15–29. doi: 10.1016/j.im.2003.11.002. [DOI] [Google Scholar]
  • 41.Paré G, Cameron AF, Poba-Nzaou P, Templier M. A systematic assessment of rigor in information systems ranking-type Delphi studies. Inf Manag. 2013;50(5):207–217. doi: 10.1016/j.im.2013.03.003. [DOI] [Google Scholar]
  • 42.Graefe A, Armstrong JS. Comparing face-to-face meetings, nominal groups, delphi and prediction markets on an estimation task. Int J Forecast. 2011;27(1):183–195. doi: 10.1016/j.ijforecast.2010.05.004. [DOI] [Google Scholar]
  • 43.Rowe G, Wright G. Expert opinions in forecasting: the role of the Delphi technique. In: Armstrong JS, editor. Principles of forecasting: a handbook for researchers and practitioners. Boston: Kluwer Academic Publishers; 2001. pp. 125–144. [Google Scholar]
  • 44.Ecken P, Gnatzy T, von der Gracht HA. Desirability bias in foresight: consequences for decision quality based on Delphi results. Technol Forecast Soc Chang. 2011;78(9):1654–1670. doi: 10.1016/j.techfore.2011.05.006. [DOI] [Google Scholar]
  • 45.Winkler J, Moser R. Biases in future-oriented Delphi studies: a cognitive perspective. Technol Forecast Soc Chang. 2016;105:63–76. doi: 10.1016/j.techfore.2016.01.021. [DOI] [Google Scholar]
  • 46.Poba-Nzaou P, Lemieux N, Beaupré D, Uwizeyemungu S. Critical challenges associated with the adoption of social media: a Delphi of a panel of Canadian human resources managers. J Bus Res. 2016;69(10):4011–4019. doi: 10.1016/j.jbusres.2016.06.006. [DOI] [Google Scholar]
  • 47.Schmidt RC. Managing Delphi surveys using nonparametric statistical techniques. Decis Sci. 1997;28(3):763–774. doi: 10.1111/j.1540-5915.1997.tb01330.x. [DOI] [Google Scholar]
  • 48.Dalkey N, Helmer O. An experimental application of the Delphi method to the use of experts. Manag Sci. 1963;9(3):458–467. doi: 10.1287/mnsc.9.3.458. [DOI] [Google Scholar]
  • 49.Skulmoski GJ, Hartman FT, Krahn J. The Delphi method for graduate research. J Inf Technol Educ. 2007;6:1–21. [Google Scholar]
  • 50.Tiberius V, Hauptmeijer R. Equity crowdfunding: forecasting market development, platform evolution, and regulation. J Small Bus Manag. 2021;59(2):337–369. doi: 10.1080/00472778.2020.1849714. [DOI] [Google Scholar]
  • 51.Tiberius V, Hirth S. Impacts of digitization on auditing: a Delphi study for Germany. J Int Account Audit Tax. 2019;37:100288. doi: 10.1016/j.intaccaudtax.2019.100288. [DOI] [Google Scholar]
  • 52.Woudenberg F. An evaluation of Delphi. Technol Forecast Soc Chang. 1991;40(2):131–150. doi: 10.1016/0040-1625(91)90002-W. [DOI] [Google Scholar]
  • 53.Guest G, Bunce A, Johnson L. How many interviews are enough? An experiment with data saturation and variability. Field Methods. 2006;18(1):59–82. doi: 10.1177/1525822X05279903. [DOI] [Google Scholar]
  • 54.Gordon TJ. The Delphi method. Futures Res Methodol. 1994;2(3):1–30. [Google Scholar]
  • 55.Hasson F, Keeney S, McKenna H. Research guidelines for the Delphi survey technique. J Adv Nurs. 2000;32(4):1008–1015. [PubMed] [Google Scholar]
  • 56.Mauksch S, von der Gracht HA, Gordon TJ. Who is an expert for foresight? A review of identification methods. Technol Forecast Soc Change. 2020;154:119982. doi: 10.1016/j.techfore.2020.119982. [DOI] [Google Scholar]
  • 57.Welty G. Problems of selecting experts for Delphi exercises. Acad Manag J. 1972;15(1):121–124. [Google Scholar]
  • 58.Edwards MR. Organizational identification: a conceptual and operational review. Int J Manag Rev. 2005;7(4):207–230. doi: 10.1111/j.1468-2370.2005.00114.x. [DOI] [Google Scholar]
  • 59.Perez AJ, Zeadally S. Privacy issues and solutions for consumer wearables. IT Prof. 2017;20(4):46–56. doi: 10.1109/MITP.2017.265105905. [DOI] [Google Scholar]
  • 60.Van Dick R, Wagner U, Stellmacher J, Christ O. The utility of a broader conceptualization of organizational identification: which aspects really matter? J Occup Organ Psychol. 2004;77(2):171–191. doi: 10.1348/096317904774202135. [DOI] [Google Scholar]
  • 61.Wu CT, Li GH, Huang CT, Cheng YC, Chen CH, Chien JY, Kuo PH, Kuo L-C, Lai F. Acute exacerbation of a chronic obstructive pulmonary disease prediction system using wearable device data, machine learning, and deep learning: development and cohort study. JMIR mHealth uHealth. 2021;9(5):e22591. doi: 10.2196/22591. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62.Rykov Y, Thach TQ, Bojic I, Christopoulos G, Car J. Digital biomarkers for depression screening with wearable devices: cross-sectional study with machine learning modeling. JMIR mHealth uHealth. 2021;9(10):e24872. doi: 10.2196/24872. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 63.Choudhury A, Asan O. Impact of using wearable devices on psychological distress: analysis of the health information national trends survey. Int J Med Inform. 2021;156(221):104612. doi: 10.1016/j.ijmedinf.2021.104612. [DOI] [PubMed] [Google Scholar]
  • 64.Meyer BM, Tulipani LJ, Gurchiek RD, Allen DA, Adamowicz L, Larie D, Solomon AJ, Cheney N, McGinnis RS. Wearables and deep learning classify fall risk from gait in multiple sclerosis. IEEE J Biomed Health Inform. 2020;25(5):1824–1831. doi: 10.1109/JBHI.2020.3025049. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 65.Metta V, Batzu L, Leta V, Trivedi D, Powdleska A, Mridula KR, Kukle P, Goyal V, Borgohain R, Chung-Faye G, Chaudhuri K. Parkinson’s disease: personalized pathway of care for device-aided therapies (DAT) and the role of continuous objective monitoring (COM) using wearable sensors. J Pers Med. 2021;11(7):680. doi: 10.3390/jpm11070680. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 66.Knight SR, Ng N, Tsanas A, Mclean K, Pagliari C, Harrison EM. Mobile devices and wearable technology for measuring patient outcomes after surgery: a systematic review. npj Digit Med. 2021;4(1):1–14. doi: 10.1038/s41746-021-00525-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 67.Wu S, Chen M, Wei K, Liu G. Sleep apnea screening based on Photoplethysmography data from wearable bracelets using an information-based similarity approach. Comput Methods Programs Biomed. 2021;211:106442. doi: 10.1016/j.cmpb.2021.106442. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

All data generated or analyzed during this study are included in this published article.


Articles from BMC Medical Informatics and Decision Making are provided here courtesy of BMC

RESOURCES