Skip to main content
PMC home page
Medline Book to support NIHPA logoLink to Medline Book to support NIHPA
. 2022 Jan;26(1):1–182. doi: 10.3310/RCTI6942

Digital interventions in mental health: evidence syntheses and economic modelling.

Lina Gega, Dina Jankovic, Pedro Saramago, David Marshall, Sarah Dawson, Sally Brabyn, Georgios F Nikolaidis, Hollie Melton, Rachel Churchill, Laura Bojke
PMCID: PMC8958412  PMID: 35048909

Abstract

BACKGROUND

Economic evaluations provide evidence on whether or not digital interventions offer value for money, based on their costs and outcomes relative to the costs and outcomes of alternatives.

OBJECTIVES

(1) Evaluate and summarise published economic studies about digital interventions across different technologies, therapies, comparators and mental health conditions; (2) synthesise clinical evidence about digital interventions for an exemplar mental health condition; (3) construct an economic model for the same exemplar mental health condition using the previously synthesised clinical evidence; and (4) consult with stakeholders about how they understand and assess the value of digital interventions.

METHODS

We completed four work packages: (1) a systematic review and quality assessment of economic studies about digital interventions; (2) a systematic review and network meta-analysis of randomised controlled trials on digital interventions for generalised anxiety disorder; (3) an economic model and value-of-information analysis on digital interventions for generalised anxiety disorder; and (4) a series of knowledge exchange face-to-face and digital seminars with stakeholders.

RESULTS

In work package 1, we reviewed 76 economic evaluations: 11 economic models and 65 within-trial analyses. Although the results of the studies are not directly comparable because they used different methods, the overall picture suggests that digital interventions are likely to be cost-effective, compared with no intervention and non-therapeutic controls, whereas the value of digital interventions compared with face-to-face therapy or printed manuals is unclear. In work package 2, we carried out two network meta-analyses of 20 randomised controlled trials of digital interventions for generalised anxiety disorder with a total of 2350 participants. The results were used to inform our economic model, but when considered on their own they were inconclusive because of the very wide confidence intervals. In work package 3, our decision-analytic model found that digital interventions for generalised anxiety disorder were associated with lower net monetary benefit than medication and face-to-face therapy, but greater net monetary benefit than non-therapeutic controls and no intervention. Value for money was driven by clinical outcomes rather than by intervention costs, and a value-of-information analysis suggested that uncertainty in the treatment effect had the greatest value (£12.9B). In work package 4, stakeholders identified several areas of benefits and costs of digital interventions that are important to them, including safety, sustainability and reducing waiting times. Four factors may influence their decisions to use digital interventions, other than costs and outcomes: increasing patient choice, reaching underserved populations, enabling continuous care and accepting the 'inevitability of going digital'.

LIMITATIONS

There was substantial uncertainty around effect estimates of digital interventions compared with alternatives. This uncertainty was driven by the small number of studies informing most comparisons, the small samples in some of these studies and the studies' high risk of bias.

CONCLUSIONS

Digital interventions may offer good value for money as an alternative to 'doing nothing' or 'doing something non-therapeutic' (e.g. monitoring or having a general discussion), but their added value compared with medication, face-to-face therapy and printed manuals is uncertain. Clinical outcomes rather than intervention costs drive 'value for money'.

FUTURE WORK

There is a need to develop digital interventions that are more effective, rather than just cheaper, than their alternatives.

STUDY REGISTRATION

This study is registered as PROSPERO CRD42018105837.

FUNDING

This project was funded by the National Institute for Health Research (NIHR) Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 26, No. 1. See the NIHR Journals Library website for further project information.

Plain language summary

Digital interventions are activities accessed via technology platforms (e.g. computers, smartphones and virtual reality) that can improve users’ mental health and reduce addiction problems. To assess whether or not digital interventions offer ‘value for money’, we needed to compare their costs and outcomes with the costs and outcomes of alternatives, such as face-to-face therapy and medication. This was done through economic evaluations. This project consisted of four work packages. In work package 1, we reviewed 76 published economic evaluations of digital interventions for different mental health and addiction problems. We could not directly compare their results because of differences in the methods that were used, but the overall picture suggested that digital interventions could offer good value for money as an alternative to ‘doing nothing’ or simply monitoring someone or giving them general information. The picture was unclear when digital interventions were compared with face-to-face therapy. In work package 2, we pooled research studies that evaluated the outcomes of digital interventions in reducing anxiety and worry; the results were inconclusive because we were uncertain about the differences in outcomes between digital interventions and alternatives. In work package 3, an economic model suggested that value for money in digital interventions is driven by how good they are and not by how much they cost. In work package 4, we presented our methods and results to service users, mental health professionals and researchers who wanted to know more about the value of digital interventions for specific groups (e.g. children and older adults) and for outcomes other than reducing symptoms (e.g. reducing waiting times for treatment and improving attendance for therapy). Finally, the stakeholders highlighted four factors that may influence their decisions to use digital interventions, other than costs and outcomes: increasing choice, reaching underserved populations, enabling continuous care and accepting the ‘inevitability of going digital’.

Full text of this article can be found in Bookshelf.

References

  1. World Health Organization. International Classification of Diseases, Eleventh Revision (ICD-11). Geneva: World Health Organization; 2018.
  2. National Institute for Health and Care Excellence (NICE). Generalised Anxiety Disorder and Panic Disorder in Adults: Management. Clinical Guideline 113. London: NICE; 2011. [PubMed]
  3. Gega L, Gilbody S. Software-based Psychotherapy: The Example of Computerized Cognitive–Behavioral Therapy. In Aboujaoude E, Starcevic V, editors. Mental Health in the Digital Age: Grave Dangers, Great Promise. Oxford: Oxford University Press; 2015. pp. 196–219. https://doi.org/10.1093/med/9780199380183.003.0011 doi: 10.1093/med/9780199380183.003.0011. [DOI]
  4. Christensen H, Batterham P, Mackinnon A, Griffiths KM, Kalia Hehir K, Kenardy J, et al. Prevention of generalized anxiety disorder using a web intervention, iChill: randomized controlled trial. J Med Internet Res 2014;16:e199. https://doi.org/10.2196/jmir.3507 doi: 10.2196/jmir.3507. [DOI] [PMC free article] [PubMed]
  5. Pham Q, Khatib Y, Stansfeld S, Fox S, Green T. Feasibility and efficacy of an mHealth game for managing anxiety: ‘Flowy’ randomized controlled pilot trial and design evaluation. Games Health J 2016;5:50–67. https://doi.org/10.1089/g4h.2015.0033 doi: 10.1089/g4h.2015.0033. [DOI] [PubMed]
  6. Briggs AH, O’Brien BJ. The death of cost-minimization analysis? Health Econ 2001;10:179–84. https://doi.org/10.1002/hec.584 doi: 10.1002/hec.584. [DOI] [PubMed]
  7. National Institute for Health and Care Excellence (NICE). Guide to the Methods of Technology Appraisal. London: NICE; 2008. [PubMed]
  8. Karlsson G, Johannesson M. The decision rules of cost-effectiveness analysis. PharmacoEconomics 1996;9:113–20. https://doi.org/10.2165/00019053-199609020-00003 doi: 10.2165/00019053-199609020-00003. [DOI] [PubMed]
  9. Lomas J, Martin S, Claxton K. Estimating the marginal productivity of the English National Health Service from 2003 to 2012. Value Health 2019;22:995–1002. https://doi.org/10.1016/j.jval.2019.04.1926 doi: 10.1016/j.jval.2019.04.1926. [DOI] [PubMed]
  10. Grosse SD. Assessing cost-effectiveness in healthcare: history of the $50,000 per QALY threshold. Expert Rev Pharmacoecon Outcomes Res 2008;8:165–78. https://doi.org/10.1586/14737167.8.2.165 doi: 10.1586/14737167.8.2.165. [DOI] [PubMed]
  11. National Institute for Health and Care Excellence (NICE). Guide to the Methods of Technology Appraisal. London: NICE; 2013. [PubMed]
  12. Aboujaoude E, Gega L. From digital mental health interventions to digital ‘addiction’: where the two fields converge. Front Psychiatry 2019;10:1017. https://doi.org/10.3389/fpsyt.2019.01017 doi: 10.3389/fpsyt.2019.01017. [DOI] [PMC free article] [PubMed]
  13. Claxton K. The irrelevance of inference: a decision-making approach to the stochastic evaluation of health care technologies. J Health Econ 1999;18:341–64. https://doi.org/10.1016/S0167-6296(98)00039-3 doi: 10.1016/S0167-6296(98)00039-3. [DOI] [PubMed]
  14. Kaltenthaler E, Brazier J, De Nigris E, Tumur I, Ferriter M, Beverly C, et al. Computerized cognitive behavior therapy for depression and anxiety update: a systematic review and economic evaluation. Health Technol Assess 2006;10(33). https://doi.org/10.3310/hta10330 doi: 10.3310/hta10330. [DOI] [PubMed]
  15. McCrone P, Knapp M, Proudfoot J, Ryden C, Cavanagh K, Shapiro DA, et al. Cost-effectiveness of computerised cognitive-behavioural therapy for anxiety and depression in primary care: randomised controlled trial. Br J Psychiatry 2004;185:55–62. https://doi.org/10.1192/bjp.185.1.55 doi: 10.1192/bjp.185.1.55. [DOI] [PubMed]
  16. Arnberg FK, Linton SJ, Hultcrantz M, Heintz E, Jonsson U. Internet-delivered psychological treatments for mood and anxiety disorders: a systematic review of their efficacy, safety, and cost-effectiveness. PLOS ONE 2014;9:e98118. https://doi.org/10.1371/journal.pone.0098118 doi: 10.1371/journal.pone.0098118. [DOI] [PMC free article] [PubMed]
  17. Donker T, Blankers M, Hedman E, Ljótsson B, Petrie K, Christensen H. Economic evaluations of internet interventions for mental health: a systematic review. Psychol Med 2015;45:3357–76. https://doi.org/10.1017/S0033291715001427 doi: 10.1017/S0033291715001427. [DOI] [PubMed]
  18. Hedman E, Ljótsson B, Lindefors N. Cognitive behavior therapy via the internet: a systematic review of applications, clinical efficacy and cost-effectiveness. Expert Rev Pharmacoecon Outcomes Res 2012;12:745–64. https://doi.org/10.1586/erp.12.67 doi: 10.1586/erp.12.67. [DOI] [PubMed]
  19. Ahern E, Kinsella S, Semkovska M. Clinical efficacy and economic evaluation of online cognitive behavioral therapy for major depressive disorder: a systematic review and meta-analysis. Expert Rev Pharmacoecon Outcomes Res 2018;18:25–41. https://doi.org/10.1080/14737167.2018.1407245 doi: 10.1080/14737167.2018.1407245. [DOI] [PubMed]
  20. Massoudi B, Holvast F, Bockting CLH, Burger H, Blanker MH. The effectiveness and cost-effectiveness of e-health interventions for depression and anxiety in primary care: a systematic review and meta-analysis. J Affect Disord 2019;245:728–43. https://doi.org/10.1016/j.jad.2018.11.050 doi: 10.1016/j.jad.2018.11.050. [DOI] [PubMed]
  21. Naidu VV, Giblin E, Burke KM, Madan I. Delivery of cognitive behavioural therapy to workers: a systematic review. Occup Med 2016;66:112–17. https://doi.org/10.1093/occmed/kqv141 doi: 10.1093/occmed/kqv141. [DOI] [PubMed]
  22. Kolovos S, van Dongen JM, Riper H, Buntrock C, Cuijpers P, Ebert DD, et al. Cost effectiveness of guided internet-based interventions for depression in comparison with control conditions: an individual-participant data meta-analysis. Depress Anxiety 2018;35:209–19. https://doi.org/10.1002/da.22714 doi: 10.1002/da.22714. [DOI] [PMC free article] [PubMed]
  23. Paganini S, Teigelkötter W, Buntrock C, Baumeister H. Economic evaluations of internet- and mobile-based interventions for the treatment and prevention of depression: a systematic review. J Affect Disord 2018;225:733–55. https://doi.org/10.1016/j.jad.2017.07.018 doi: 10.1016/j.jad.2017.07.018. [DOI] [PubMed]
  24. Chen YF, Madan J, Welton N, Yahaya I, Aveyard P, Bauld L, et al. Effectiveness and cost-effectiveness of computer and other electronic aids for smoking cessation: a systematic review and network meta-analysis. Health Technol Assess 2012;16(38). https://doi.org/10.3310/hta16380 doi: 10.3310/hta16380. [DOI] [PubMed]
  25. Badawy SM, Kuhns LM. Texting and mobile phone app interventions for improving adherence to preventive behavior in adolescents: a systematic review. JMIR Mhealth Uhealth 2017;5:e50. https://doi.org/10.2196/mhealth.6837 doi: 10.2196/mhealth.6837. [DOI] [PMC free article] [PubMed]
  26. de la Torre-Díez I, López-Coronado M, Vaca C, Aguado JS, de Castro C. Cost–utility and cost-effectiveness studies of telemedicine, electronic, and mobile health systems in the literature: a systematic review. Telemed J E Health 2015;21:81–5. https://doi.org/10.1089/tmj.2014.0053 doi: 10.1089/tmj.2014.0053. [DOI] [PMC free article] [PubMed]
  27. McNamee P, Murray E, Kelly MP, Bojke L, Chilcott J, Fischer A, et al. Designing and undertaking a health economics study of digital health interventions. Am J Prev Med 2016;51:852–60. https://doi.org/10.1016/j.amepre.2016.05.007 doi: 10.1016/j.amepre.2016.05.007. [DOI] [PubMed]
  28. Moher D, Liberati A, Tetzlaff J, Altman DG, PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med 2009;151:264–9, W64. https://doi.org/10.7326/0003-4819-151-4-200908180-00135 doi: 10.7326/0003-4819-151-4-200908180-00135. [DOI] [PubMed]
  29. Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev 2015;4:1. https://doi.org/10.1186/2046-4053-4-1 doi: 10.1186/2046-4053-4-1. [DOI] [PMC free article] [PubMed]
  30. Husereau D, Drummond M, Petrou S, Carswell C, Moher D, Greenberg D, et al. Consolidated Health Economic Evaluation Reporting Standards (CHEERS) statement. Int J Technol Assess Health Care 2013;29:117–22. https://doi.org/10.1017/S0266462313000160 doi: 10.1017/S0266462313000160. [DOI] [PubMed]
  31. Barak A, Hen L, Boniel-Nissim M, Shapira N. A comprehensive review and a meta-analysis of the effectiveness of internet-based psychotherapeutic interventions. J Technol Hum Serv 2008;26:109–60. https://doi.org/10.1080/15228830802094429 doi: 10.1080/15228830802094429. [DOI]
  32. Cuijpers P, van Straten A, Andersson G. Internet-administered cognitive behavior therapy for health problems: a systematic review. J Behav Med 2008;31:169–77. https://doi.org/10.1007/s10865-007-9144-1 doi: 10.1007/s10865-007-9144-1. [DOI] [PMC free article] [PubMed]
  33. Hollis C, Falconer CJ, Martin JL, Whittington C, Stockton S, Glazebrook C, Davies EB. Annual research review: digital health interventions for children and young people with mental health problems – a systematic and meta-review. J Child Psychol Psychiatry 2017;58:474–503. https://doi.org/10.1111/jcpp.12663 doi: 10.1111/jcpp.12663. [DOI] [PubMed]
  34. Marks I, Cavanagh K, Gega L. Hands-on Help: Computer-aided Psychotherapy. London: Psychology Press; 2007. https://doi.org/10.4324/9780203962152 doi: 10.4324/9780203962152. [DOI]
  35. Mayo-Wilson E, Montgomery P. Media-delivered cognitive behavioural therapy and behavioural therapy (self-help) for anxiety disorders in adults. Cochrane Database Syst Rev 2013;9:CD005330. https://doi.org/10.1002/14651858.CD005330.pub4 doi: 10.1002/14651858.CD005330.pub4. [DOI] [PubMed]
  36. Schulz R, Czaja SJ, McKay JR, Ory MG, Belle SH. Intervention taxonomy (ITAX): describing essential features of interventions. Am J Health Behav 2010;34:811–21. https://doi.org/10.5993/AJHB.34.6.15 doi: 10.5993/AJHB.34.6.15. [DOI] [PMC free article] [PubMed]
  37. Johansson R, Björklund M, Hornborg C, Karlsson S, Hesser H, Ljótsson B, et al. Affect-focused psychodynamic psychotherapy for depression and anxiety through the internet: a randomized controlled trial. Peer J 2013;1:e102. https://doi.org/10.7717/peerj.102 doi: 10.7717/peerj.102. [DOI] [PMC free article] [PubMed]
  38. Teng MH, Hou YM, Chang SH, Cheng HJ. Home-delivered attention bias modification training via smartphone to improve attention control in sub-clinical generalized anxiety disorder: a randomized, controlled multi-session experiment. J Affect Disord 2019;246:444–51. https://doi.org/10.1016/j.jad.2018.12.118 doi: 10.1016/j.jad.2018.12.118. [DOI] [PubMed]
  39. Lovell K, Bower P, Gellatly J, Byford S, Bee P, McMillan D, et al. Clinical effectiveness, cost-effectiveness and acceptability of low-intensity interventions in the management of obsessive-compulsive disorder: the Obsessive-Compulsive Treatment Efficacy randomised controlled Trial (OCTET). Health Technol Assess 2017;21(37). https://doi.org/10.3310/hta21370 doi: 10.3310/hta21370. [DOI] [PMC free article] [PubMed]
  40. Andersson E, Hedman E, Wadström O, Boberg J, Andersson EY, Axelsson E, et al. Internet-based extinction therapy for worry: a randomized controlled trial. Behav Ther 2017;48:391–402. https://doi.org/10.1016/j.beth.2016.07.003 doi: 10.1016/j.beth.2016.07.003. [DOI] [PubMed]
  41. Dahlin M, Andersson G, Magnusson K, Johansson T, Sjögren J, Håkansson A, et al. Internet-delivered acceptance-based behaviour therapy for generalized anxiety disorder: a randomized controlled trial. Behav Res Ther 2016;77:86–95. https://doi.org/10.1016/j.brat.2015.12.007 doi: 10.1016/j.brat.2015.12.007. [DOI] [PubMed]
  42. McCrone P, Marks IM, Greist JH, Baer L, Kobak KA, Wenzel KW, Hirsch MJ. Cost-effectiveness of computer-aided behaviour therapy for obsessive-compulsive disorder. Psychother Psychosom 2007;76:249–50. https://doi.org/10.1159/000101504 doi: 10.1159/000101504. [DOI] [PubMed]
  43. Andersson E, Hedman E, Ljotsson B, Wikstrom M, Elveling E, Lindefors N, et al. Cost-effectiveness of internet-based cognitive behavior therapy for obsessive-compulsive disorder: results from a randomized controlled trial. J Obsessive Compuls Relat Disord 2015;4:47–53. https://doi.org/10.1016/j.jocrd.2014.12.004 doi: 10.1016/j.jocrd.2014.12.004. [DOI]
  44. Sculpher MJ, Claxton K, Drummond M, McCabe C. Whither trial based economic evaluation for health care decision making? Health Econ 2006;15:677–87. https://doi.org/10.1002/hec.1093 doi: 10.1002/hec.1093. [DOI] [PubMed]
  45. Jankovic D, Bojke L, Marshall D, Saramago Goncalves P, Churchill R, Melton H, et al. Systematic review and critique of methods for economic evaluation of digital mental health interventions. Appl Health Econ Health Policy 2020:1–11. https://doi.org/10.1007/s40258-020-00607-3 doi: 10.1007/s40258-020-00607-3. [DOI] [PubMed]
  46. Hodgins DC, Peden N. [Cognitive-behavioral treatment for impulse control disorders.] Braz J Psychiatry 2008;30(Suppl. 1):31–40. doi: 10.1590/s1516-44462006005000055. [DOI] [PubMed]
  47. Watts RD, Li IW. Use of checklists in reviews of health economic evaluations, 2010 to 2018. Value Health 2019;22:377–82. https://doi.org/10.1016/j.jval.2018.10.006 doi: 10.1016/j.jval.2018.10.006. [DOI] [PubMed]
  48. Drummond MF, Sculpher MJ, Claxton K, Stoddart GL, Torrance GW. Methods for the Economic Evaluation of Health Care Programmes. Oxford: Oxford University Press; 2015.
  49. Philips Z, Bojke L, Sculpher M, Claxton K, Golder S. Good practice guidelines for decision-analytic modelling in health technology assessment. PharmacoEconomics 2006;24:355–71. https://doi.org/10.2165/00019053-200624040-00006 doi: 10.2165/00019053-200624040-00006. [DOI] [PubMed]
  50. Aardoom JJ, Dingemans AE, van Ginkel JR, Spinhoven P, Van Furth EF, Van den Akker-van Marle ME. Cost-utility of an internet-based intervention with or without therapist support in comparison with a waiting list for individuals with eating disorder symptoms: a randomized controlled trial. Int J Eat Disord 2016;49:1068–76. https://doi.org/10.1002/eat.22587 doi: 10.1002/eat.22587. [DOI] [PubMed]
  51. Andersson E, Ljotsson B, Hedman E, Mattson S, Enander J, Andersson G, et al. Cost-effectiveness of an internet-based booster program for patients with obsessive-compulsive disorder: results from a randomized controlled trial. J Obsessive-Compuls Relat Disord 2015;4:14–19. https://doi.org/10.1016/j.jocrd.2014.10.002 doi: 10.1016/j.jocrd.2014.10.002. [DOI]
  52. Axelsson E, Andersson E, Ljótsson B, Hedman-Lagerlöf E. Cost-effectiveness and long-term follow-up of three forms of minimal-contact cognitive behaviour therapy for severe health anxiety: results from a randomised controlled trial. Behav Res Ther 2018;107:95–105. https://doi.org/10.1016/j.brat.2018.06.002 doi: 10.1016/j.brat.2018.06.002. [DOI] [PubMed]
  53. Bergman Nordgren L, Hedman E, Etienne J, Bodin J, Kadowaki A, Eriksson S, et al. Effectiveness and cost-effectiveness of individually tailored internet-delivered cognitive behavior therapy for anxiety disorders in a primary care population: a randomized controlled trial. Behav Res Ther 2014;59:1–11. https://doi.org/10.1016/j.brat.2014.05.007 doi: 10.1016/j.brat.2014.05.007. [DOI] [PubMed]
  54. Bergström J, Andersson G, Ljótsson B, Rück C, Andréewitch S, Karlsson A, et al. Internet-versus group-administered cognitive behaviour therapy for panic disorder in a psychiatric setting: a randomised trial. BMC Psychiatry 2010;10:54. https://doi.org/10.1186/1471-244X-10-54 doi: 10.1186/1471-244X-10-54. [DOI] [PMC free article] [PubMed]
  55. Bolier L, Majo C, Smit F, Westerhof GJ, Haverman M, Walburg JA, et al. Cost-effectiveness of online positive psychology: randomized controlled trial. The J Posit Psychol 2014;9:460–71. https://doi.org/10.1080/17439760.2014.910829 doi: 10.1080/17439760.2014.910829. [DOI]
  56. Brabyn S, Araya R, Barkham M, Bower P, Coo per C, Duarte A, et al. The second Randomised Evaluation of the Effectiveness, cost-effectiveness and Acceptability of Computerised Therapy (REEACT-2) trial: does the provision of telephone support enhance the effectiveness of computer-delivered cognitive behaviour therapy? A randomised controlled trial. Health Technol Assess 2016;20(89). https://doi.org/10.3310/hta20890 doi: 10.3310/hta20890. [DOI] [PMC free article] [PubMed]
  57. Budney AJ, Stanger C, Tilford JM, Scherer EB, Brown PC, Li Z, et al. Computer-assisted behavioral therapy and contingency management for cannabis use disorder. Psychol Addict Behav 2015;29:501–11. https://doi.org/10.1037/adb0000078 doi: 10.1037/adb0000078. [DOI] [PMC free article] [PubMed]
  58. Buntrock C, Berking M, Smit F, Lehr D, Nobis S, Ri per H, et al. Preventing depression in adults with subthreshold depression: health-economic evaluation alongside a pragmatic randomized controlled trial of a web-based intervention. J Med Internet Res 2017;19:e5. https://doi.org/10.2196/jmir.6587 doi: 10.2196/jmir.6587. [DOI] [PMC free article] [PubMed]
  59. Burford O, Jiwa M, Carter O, Parsons R, Hendrie D. Internet-based photoaging within Australian pharmacies to promote smoking cessation: randomized controlled trial. J Med Internet Res 2013;15:e64. https://doi.org/10.2196/jmir.2337 doi: 10.2196/jmir.2337. [DOI] [PMC free article] [PubMed]
  60. Calhoun PS, Datta S, Olsen M, Smith VA, Moore SD, Hair LP, et al. Comparative effectiveness of an internet-based smoking cessation intervention versus clinic-based specialty care for veterans. J Subst Abuse Treat 2016;69:19–27. https://doi.org/10.1016/j.jsat.2016.06.004 doi: 10.1016/j.jsat.2016.06.004. [DOI] [PMC free article] [PubMed]
  61. Dear BF, Zou JB, Ali S, Lorian CN, Johnston L, Sheehan J, et al. Clinical and cost-effectiveness of therapist-guided internet-delivered cognitive behavior therapy for older adults with symptoms of anxiety: a randomized controlled trial. Behav Ther 2015;46:206–17. https://doi.org/10.1016/j.beth.2014.09.007 doi: 10.1016/j.beth.2014.09.007. [DOI] [PubMed]
  62. Ebert DD, Kählke F, Buntrock C, Berking M, Smit F, Heber E, et al. A health economic outcome evaluation of an internet-based mobile-supported stress management intervention for employees. Scand J Work Environ Health 2018;44:171–82. https://doi.org/10.5271/sjweh.3691 doi: 10.5271/sjweh.3691. [DOI] [PubMed]
  63. Garrido G, Penadés R, Barrios M, Aragay N, Ramos I, Vallès V, et al. Computer-assisted cognitive remediation therapy in schizophrenia: durability of the effects and cost–utility analysis. Psychiatry Res 2017;254:198–204. https://doi.org/10.1016/j.psychres.2017.04.065 doi: 10.1016/j.psychres.2017.04.065. [DOI] [PubMed]
  64. Geraedts AS, van Dongen JM, Kleiboer AM, Wiezer NM, van Mechelen W, Cuijpers P, Bosmans JE. Economic evaluation of a web-based guided self-help intervention for employees with depressive symptoms: results of a randomized controlled trial. J Occup Environ Med 2015;57:666–75. https://doi.org/10.1097/JOM.0000000000000423 doi: 10.1097/JOM.0000000000000423. [DOI] [PubMed]
  65. Gerhards SA, de Graaf LE, Jacobs LE, Severens JL, Huibers MJ, Arntz A, et al. Economic evaluation of online computerised cognitive–behavioural therapy without support for depression in primary care: randomised trial. Br J Psychiatry 2010;196:310–18. https://doi.org/10.1192/bjp.bp.109.065748 doi: 10.1192/bjp.bp.109.065748. [DOI] [PubMed]
  66. Graham AL, Chang Y, Fang Y, Cobb NK, Tinkelman DS, Niaura RS, et al. Cost-effectiveness of internet and telephone treatment for smoking cessation: an economic evaluation of the iQUITT Study. Tob Control 2013;22:e11. https://doi.org/10.1136/tobaccocontrol-2012-050465 doi: 10.1136/tobaccocontrol-2012-050465. [DOI] [PMC free article] [PubMed]
  67. Guerriero C, Cairns J, Roberts I, Rodgers A, Whittaker R, Free C. The cost-effectiveness of smoking cessation support delivered by mobile phone text messaging: Txt2stop. Eur J Health Econ 2013;14:789–97. https://doi.org/10.1007/s10198-012-0424-5 doi: 10.1007/s10198-012-0424-5. [DOI] [PMC free article] [PubMed]
  68. Hedman E, Andersson E, Lindefors N, Andersson G, Rück C, Ljótsson B. Cost-effectiveness and long-term effectiveness of internet-based cognitive behaviour therapy for severe health anxiety. Psychol Med 2013;43:363–74. https://doi.org/10.1017/S0033291712001079 doi: 10.1017/S0033291712001079. [DOI] [PubMed]
  69. Hedman E, Andersson E, Ljótsson B, Andersson G, Rück C, Lindefors N. Cost-effectiveness of internet-based cognitive behavior therapy vs. cognitive behavioral group therapy for social anxiety disorder: results from a randomized controlled trial. Behav Res Ther 2011;49:729–36. https://doi.org/10.1016/j.brat.2011.07.009 doi: 10.1016/j.brat.2011.07.009. [DOI] [PubMed]
  70. Hedman E, Andersson E, Ljótsson B, Axelsson E, Lekander M. Cost effectiveness of internet-based cognitive behaviour therapy and behavioural stress management for severe health anxiety. BMJ Open 2016;6:e009327. https://doi.org/10.1136/bmjopen-2015-009327 doi: 10.1136/bmjopen-2015-009327. [DOI] [PMC free article] [PubMed]
  71. Hollinghurst S, Peters TJ, Kaur S, Wiles N, Lewis G, Kessler D. Cost-effectiveness of therapist-delivered online cognitive-behavioural therapy for depression: randomised controlled trial. Br J Psychiatry 2010;197:297–304. https://doi.org/10.1192/bjp.bp.109.073080 doi: 10.1192/bjp.bp.109.073080. [DOI] [PubMed]
  72. Holst A, Björkelund C, Metsini A, Madsen JH, Hange D, Petersson EL, et al. Cost-effectiveness analysis of internet-mediated cognitive behavioural therapy for depression in the primary care setting: results based on a controlled trial. BMJ Open 2018;8:e019716. https://doi.org/10.1136/bmjopen-2017-019716 doi: 10.1136/bmjopen-2017-019716. [DOI] [PMC free article] [PubMed]
  73. Hunter R, Wallace P, Struzzo P, Vedova RD, Scafuri F, Tersar C, et al. Randomised controlled non-inferiority trial of primary care-based facilitated access to an alcohol reduction website: cost-effectiveness analysis. BMJ Open 2017;7:e014577. https://doi.org/10.1136/bmjopen-2016-014577 doi: 10.1136/bmjopen-2016-014577. [DOI] [PMC free article] [PubMed]
  74. Joesch JM, Sherbourne CD, Sullivan G, Stein MB, Craske MG, Roy-Byrne P. Incremental benefits and cost of coordinated anxiety learning and management for anxiety treatment in primary care. Psychol Med 2012;42:1937–48. https://doi.org/10.1017/S0033291711002893 doi: 10.1017/S0033291711002893. [DOI] [PMC free article] [PubMed]
  75. Jolstedt M, Wahlund T, Lenhard F, Ljótsson B, Mataix-Cols D, Nord M, et al. Efficacy and cost-effectiveness of therapist-guided internet cognitive behavioural therapy for paediatric anxiety disorders: a single-centre, single-blind, randomised controlled trial. Lancet Child Adolesc Health 2018;2:792–801. https://doi.org/10.1016/S2352-4642(18)30275-X doi: 10.1016/S2352-4642(18)30275-X. [DOI] [PubMed]
  76. Jones DJ, Forehand R, Cuellar J, Parent J, Honeycutt A, Khavjou O, et al. Technology-enhanced program for child disruptive behavior disorders: development and pilot randomized control trial. J Clin Child Adolesc Psychol 2014;43:88–101. https://doi.org/10.1080/15374416.2013.822308 doi: 10.1080/15374416.2013.822308. [DOI] [PMC free article] [PubMed]
  77. Jones RB, Atkinson JM, Coia DA, Paterson L, Morton AR, McKenna K, et al. Randomised trial of personalised computer based information for patients with schizophrenia. BMJ 2001;322:835–40. https://doi.org/10.1136/bmj.322.7290.835 doi: 10.1136/bmj.322.7290.835. [DOI] [PMC free article] [PubMed]
  78. Kass AE, Balantekin KN, Fitzsimmons-Craft EE, Jacobi C, Wilfley DE, Taylor CB. The economic case for digital interventions for eating disorders among United States college students. Int J Eat Disord 2017;50:250–8. https://doi.org/10.1002/eat.22680 doi: 10.1002/eat.22680. [DOI] [PMC free article] [PubMed]
  79. Kenter RMF, van de Ven PM, Cuijpers P, Koole G, Niamat S, Gerrits RS, et al. Costs and effects of internet cognitive behavioral treatment blended with face-to-face treatment: results from a naturalistic study. Internet Interventions 2015;2:77–83. https://doi.org/10.1016/j.invent.2015.01.001 doi: 10.1016/j.invent.2015.01.001. [DOI]
  80. Kiluk BD, Devore KA, Buck MB, Nich C, Frankforter TL, LaPaglia DM, et al. Randomized trial of computerized cognitive behavioral therapy for alcohol use disorders: efficacy as a virtual stand-alone and treatment add-on compared with standard outpatient treatment. Alcohol Clin Exp Res 2016;40:1991–2000. https://doi.org/10.1111/acer.13162 doi: 10.1111/acer.13162. [DOI] [PMC free article] [PubMed]
  81. Koeser L, Dobbin A, Ross S, McCrone P. Economic evaluation of audio based resilience training for depression in primary care. J Affect Disord 2013;149:307–12. https://doi.org/10.1016/j.jad.2013.01.044 doi: 10.1016/j.jad.2013.01.044. [DOI] [PubMed]
  82. Kolovos S, Kenter RM, Bosmans JE, Beekman AT, Cuijpers P, Kok RN, van Straten A. Economic evaluation of internet-based problem-solving guided self-help treatment in comparison with enhanced usual care for depressed outpatients waiting for face-to-face treatment: a randomized controlled trial. J Affect Disord 2016;200:284–92. https://doi.org/10.1016/j.jad.2016.04.025 doi: 10.1016/j.jad.2016.04.025. [DOI] [PubMed]
  83. König HH, Bleibler F, Friederich HC, Herpertz S, Lam T, Mayr A, et al. Economic evaluation of cognitive behavioral therapy and internet-based guided self-help for binge-eating disorder. Int J Eat Disord 2018;51:155–64. https://doi.org/10.1002/eat.22822 doi: 10.1002/eat.22822. [DOI] [PubMed]
  84. Kraepelien M, Mattsson S, Hedman-Lagerlöf E, Petersson IF, Forsell Y, Lindefors N, Kaldo V. Cost-effectiveness of internet-based cognitive-behavioural therapy and physical exercise for depression. BJPsych Open 2018;4:265–73. https://doi.org/10.1192/bjo.2018.38 doi: 10.1192/bjo.2018.38. [DOI] [PMC free article] [PubMed]
  85. Kumar S, Jones Bell M, Juusola JL. Mobile and traditional cognitive behavioral therapy programs for generalized anxiety disorder: a cost-effectiveness analysis. PLOS ONE 2018;13:e0190554. https://doi.org/10.1371/journal.pone.0190554 doi: 10.1371/journal.pone.0190554. [DOI] [PMC free article] [PubMed]
  86. Lee YC, Gao L, Dear BF, Titov N, Mihalopoulos C. The cost-effectiveness of the Online MindSpot Clinic for the treatment of depression and anxiety in Australia. J Ment Health Policy Econ 2017;20:155–66. [PubMed]
  87. Lee YY, Barendregt JJ, Stockings EA, Ferrari AJ, Whiteford HA, Patton GA, Mihalopoulos C. The population cost-effectiveness of delivering universal and indicated school-based interventions to prevent the onset of major depression among youth in Australia. Epidemiol Psychiatr Sci 2017;26:545–64. https://doi.org/10.1017/S2045796016000469 doi: 10.1017/S2045796016000469. [DOI] [PMC free article] [PubMed]
  88. Lenhard F, Ssegonja R, Andersson E, Feldman I, Rück C, Mataix-Cols D, Serlachius E. Cost-effectiveness of therapist-guided internet-delivered cognitive behaviour therapy for paediatric obsessive-compulsive disorder: results from a randomised controlled trial. BMJ Open 2017;7:e015246. https://doi.org/10.1136/bmjopen-2016-015246 doi: 10.1136/bmjopen-2016-015246. [DOI] [PMC free article] [PubMed]
  89. Littlewood E, Duarte A, Hewitt C, Knowles S, Palmer S, Walker S, et al. A randomised controlled trial of computerised cognitive behaviour therapy for the treatment of depression in primary care: the Randomised Evaluation of the Effectiveness and Acceptability of Computerised Therapy (REEACT) trial. Health Technol Assess 2015;19(101). https://doi.org/10.3310/hta191010 doi: 10.3310/hta191010. [DOI] [PMC free article] [PubMed]
  90. McCrone P, Marks IM, Mataix-Cols D, Kenwright M, McDonough M. Computer-aided self-exposure therapy for phobia/panic disorder: a pilot economic evaluation. Cogn Behav Ther 2009;38:91–9. https://doi.org/10.1080/16506070802561074 doi: 10.1080/16506070802561074. [DOI] [PubMed]
  91. Mihalopoulos C, Kiropoulos L, Shih ST, Gunn J, Blashki G, Meadows G. Exploratory economic analyses of two primary care mental health projects: implications for sustainability. Med J Aust 2005;183:S73–6. https://doi.org/10.5694/j.1326-5377.2005.tb07184.x doi: 10.5694/j.1326-5377.2005.tb07184.x. [DOI] [PubMed]
  92. Murphy SM, Campbell AN, Ghitza UE, Kyle TL, Bailey GL, Nunes EV, Polsky D. Cost-effectiveness of an internet-delivered treatment for substance abuse: data from a multisite randomized controlled trial. Drug Alcohol Depend 2016;161:119–26. https://doi.org/10.1016/j.drugalcdep.2016.01.021 doi: 10.1016/j.drugalcdep.2016.01.021. [DOI] [PMC free article] [PubMed]
  93. Naughton F, Coo per S, Foster K, Emery J, Leonardi-Bee J, Sutton S, et al. Large multi-centre pilot randomized controlled trial testing a low-cost, tailored, self-help smoking cessation text message intervention for pregnant smokers (MiQuit). Addiction 2017;112:1238–49. https://doi.org/10.1111/add.13802 doi: 10.1111/add.13802. [DOI] [PMC free article] [PubMed]
  94. Naveršnik K, Mrhar A. Cost-effectiveness of a novel e-health depression service. Telemed J E Health 2013;19:110–16. https://doi.org/10.1089/tmj.2012.0081 doi: 10.1089/tmj.2012.0081. [DOI] [PubMed]
  95. Olmstead TA, Ostrow CD, Carroll KM. Cost-effectiveness of computer-assisted training in cognitive-behavioral therapy as an adjunct to standard care for addiction. Drug Alcohol Depend 2010;110:200–7. https://doi.org/10.1016/j.drugalcdep.2010.02.022 doi: 10.1016/j.drugalcdep.2010.02.022. [DOI] [PMC free article] [PubMed]
  96. Phillips R, Schneider J, Molosankwe I, Leese M, Foroushani PS, Grime P, et al. Randomized controlled trial of computerized cognitive behavioural therapy for depressive symptoms: effectiveness and costs of a workplace intervention. Psychol Med 2014;44:741–52. https://doi.org/10.1017/S0033291713001323 doi: 10.1017/S0033291713001323. [DOI] [PMC free article] [PubMed]
  97. Romero-Sanchiz P, Nogueira-Arjona R, García-Ruiz A, Luciano JV, García Campayo J, Gili M, et al. Economic evaluation of a guided and unguided internet-based CBT intervention for major depression: results from a multi-center, three-armed randomized controlled trial conducted in primary care. PLOS ONE 2017;12:e0172741. https://doi.org/10.1371/journal.pone.0172741 doi: 10.1371/journal.pone.0172741. [DOI] [PMC free article] [PubMed]
  98. Smit ES, Evers SM, de Vries H, Hoving C. Cost-effectiveness and cost-utility of internet-based computer tailoring for smoking cessation. J Med Internet Res 2013;15:e57. https://doi.org/10.2196/jmir.2059 doi: 10.2196/jmir.2059. [DOI] [PMC free article] [PubMed]
  99. Solomon D, Proudfoot J, Clarke J, Christensen H. e-CBT (myCompass), antidepressant medication, and face-to-face psychological treatment for depression in Australia: a cost-effectiveness comparison. J Med Internet Res 2015;17:e255. https://doi.org/10.2196/jmir.4207 doi: 10.2196/jmir.4207. [DOI] [PMC free article] [PubMed]
  100. Španiel F, Hrdlička J, Novák T, Kožený J, Höschl C, Mohr P, Motlová LB. Effectiveness of the information technology-aided program of relapse prevention in schizophrenia (ITAREPS): a randomized, controlled, double-blind study. J Psychiatr Pract 2012;18:269–80. https://doi.org/10.1097/01.pra.0000416017.45591.c1 doi: 10.1097/01.pra.0000416017.45591.c1. [DOI] [PubMed]
  101. Stanczyk NE, Smit ES, Schulz DN, de Vries H, Bolman C, Muris JW, Evers SM. An economic evaluation of a video- and text-based computer-tailored intervention for smoking cessation: a cost-effectiveness and cost-utility analysis of a randomized controlled trial. PLOS ONE 2014;9:e110117. https://doi.org/10.1371/journal.pone.0110117 doi: 10.1371/journal.pone.0110117. [DOI] [PMC free article] [PubMed]
  102. Titov N, Andrews G, Johnston L, Schwencke G, Choi I. Shyness programme: longer term benefits, cost-effectiveness, and acceptability. Aust N Z J Psychiatry 2009;43:36–44. https://doi.org/10.1080/00048670802534424 doi: 10.1080/00048670802534424. [DOI] [PubMed]
  103. Titov N, Dear BF, Ali S, Zou JB, Lorian CN, Johnston L, et al. Clinical and cost-effectiveness of therapist-guided internet-delivered cognitive behavior therapy for older adults with symptoms of depression: a randomized controlled trial. Behav Ther 2015;46:193–205. https://doi.org/10.1016/j.beth.2014.09.008 doi: 10.1016/j.beth.2014.09.008. [DOI] [PubMed]
  104. van Spijker BA, Majo MC, Smit F, van Straten A, Kerkhof AJ. Reducing suicidal ideation: cost-effectiveness analysis of a randomized controlled trial of unguided web-based self-help. J Med Internet Res 2012;14:e141. https://doi.org/10.2196/jmir.1966 doi: 10.2196/jmir.1966. [DOI] [PMC free article] [PubMed]
  105. Warmerdam L, Smit F, van Straten A, Ri per H, Cuijpers P. Cost-utility and cost-effectiveness of internet-based treatment for adults with depressive symptoms: randomized trial. J Med Internet Res 2010;12:e53. https://doi.org/10.2196/jmir.1436 doi: 10.2196/jmir.1436. [DOI] [PMC free article] [PubMed]
  106. Wijnen BF, Lokman S, Leone S, Evers SM, Smit F. Complaint-directed mini-interventions for depressive symptoms: a health economic evaluation of unguided web-based self-help interventions based on a randomized controlled trial. J Med Internet Res 2018;20:e10455. https://doi.org/10.2196/10455 doi: 10.2196/10455. [DOI] [PMC free article] [PubMed]
  107. Wright B, Tindall L, Littlewood E, Allgar V, Abeles P, Trépel D, Ali S. Computerised cognitive-behavioural therapy for depression in adolescents: feasibility results and 4-month outcomes of a UK randomised controlled trial. BMJ Open 2017;7:e012834. https://doi.org/10.1136/bmjopen-2016-012834 doi: 10.1136/bmjopen-2016-012834. [DOI] [PMC free article] [PubMed]
  108. Wu Q, Parrott S, Godfrey C, Gilbert H, Nazareth I, Leurent B, et al. Cost-effectiveness of computer-tailored smoking cessation advice in primary care: a randomized trial (ESCAPE). Nicotine Tob Res 2014;16:270–8. https://doi.org/10.1093/ntr/ntt136 doi: 10.1093/ntr/ntt136. [DOI] [PubMed]
  109. Duarte A, Walker S, Littlewood E, Brabyn S, Hewitt C, Gilbody S, Palmer S. Cost-effectiveness of computerized cognitive-behavioural therapy for the treatment of depression in primary care: findings from the Randomised Evaluation of the Effectiveness and Acceptability of Computerised Therapy (REEACT) trial. Psychol Med 2017;47:1825–35. https://doi.org/10.1017/S0033291717000289 doi: 10.1017/S0033291717000289. [DOI] [PubMed]
  110. El Alaoui S, Hedman-Lagerlöf E, Ljótsson B, Lindefors N. Does internet-based cognitive behaviour therapy reduce healthcare costs and resource use in treatment of social anxiety disorder? A cost-minimisation analysis conducted alongside a randomised controlled trial. BMJ Open 2017;7:e017053. https://doi.org/10.1136/bmjopen-2017-017053 doi: 10.1136/bmjopen-2017-017053. [DOI] [PMC free article] [PubMed]
  111. Hedman E, El Alaoui S, Lindefors N, Andersson E, Rück C, Ghaderi A, et al. Clinical effectiveness and cost-effectiveness of internet- vs. group-based cognitive behavior therapy for social anxiety disorder: 4-year follow-up of a randomized trial. Behav Res Ther 2014;59:20–9. https://doi.org/10.1016/j.brat.2014.05.010 doi: 10.1016/j.brat.2014.05.010. [DOI] [PubMed]
  112. Kählke F, Buntrock C, Smit F, Berking M, Lehr D, Heber E, et al. Economic evaluation of an internet-based stress management intervention alongside a randomized controlled trial. JMIR Ment Health 2019;6:e10866. https://doi.org/10.2196/10866 doi: 10.2196/10866. [DOI] [PMC free article] [PubMed]
  113. Baumann M, Stargardt T, Frey S. Cost-utility of internet-based cognitive behavioral therapy in unipolar depression: a Markov model simulation. Appl Health Econ Health Policy 2020;18:567–78. https://doi.org/10.1007/s40258-019-00551-x doi: 10.1007/s40258-019-00551-x. [DOI] [PMC free article] [PubMed]
  114. Gräfe V, Berger T, Hautzinger M, Hohagen F, Lutz W, Meyer B, et al. Health economic evaluation of a web-based intervention for depression: the EVIDENT-trial, a randomized controlled study. Health Econ Rev 2019;9:16. https://doi.org/10.1186/s13561-019-0233-y doi: 10.1186/s13561-019-0233-y. [DOI] [PMC free article] [PubMed]
  115. Klein NS, Bockting CL, Wijnen B, Kok GD, van Valen E, Ri per H, et al. Economic evaluation of an internet-based preventive cognitive therapy with minimal therapist support for recurrent depression: randomized controlled trial. J Med Internet Res 2018;20:e10437. https://doi.org/10.2196/10437 doi: 10.2196/10437. [DOI] [PMC free article] [PubMed]
  116. Kooistra LC, Wiersma JE, Ruwaard J, Neijenhuijs K, Lokkerbol J, van Oppen P, et al. Cost and effectiveness of blended versus standard cognitive behavioral therapy for outpatients with depression in routine specialized mental health care: pilot randomized controlled trial. J Med Internet Res 2019;21:e14261. https://doi.org/10.2196/14261 doi: 10.2196/14261. [DOI] [PMC free article] [PubMed]
  117. Lindsäter E, Axelsson E, Salomonsson S, Santoft F, Ljótsson B, Åkerstedt T, et al. Cost-effectiveness of therapist-guided internet-based cognitive behavioral therapy for stress-related disorders: secondary analysis of a randomized controlled trial. J Med Internet Res 2019;21:e14675. https://doi.org/10.2196/14675 doi: 10.2196/14675. [DOI] [PMC free article] [PubMed]
  118. O’Connor K, Bagnell A, McGrath P, Wozney L, Radomski A, Rosychuk RJ, et al. An internet-based cognitive behavioral program for adolescents with anxiety: pilot randomized controlled trial. JMIR Ment Health 2020;7:e13356. https://doi.org/10.2196/13356 doi: 10.2196/13356. [DOI] [PMC free article] [PubMed]
  119. Osborne D, Meyer D, Moulding R, Kyrios M, Bailey E, Nedeljkovic M. Cost-effectiveness of internet-based cognitive-behavioural therapy for obsessive-compulsive disorder. Internet Interv 2019;18:100277. https://doi.org/10.1016/j.invent.2019.100277 doi: 10.1016/j.invent.2019.100277. [DOI] [PMC free article] [PubMed]
  120. Pot-Kolder R, Veling W, Geraets C, Lokkerbol J, Smit F, Jongeneel A, et al. Cost-effectiveness of virtual reality cognitive behavioral therapy for psychosis: health-economic evaluation within a randomized controlled trial. J Med Internet Res 2020;22:e17098. https://doi.org/10.2196/17098 doi: 10.2196/17098. [DOI] [PMC free article] [PubMed]
  121. Powell J, Williams V, Atherton H, Bennett K, Yang Y, Davoudianfar M, et al. Effectiveness and cost-effectiveness of a self-guided internet intervention for social anxiety symptoms in a general population sample: randomized controlled trial. J Med Internet Res 2020;22:e16804. https://doi.org/10.2196/16804 doi: 10.2196/16804. [DOI] [PMC free article] [PubMed]
  122. Richards D, Enrique A, Eilert N, Franklin M, Palacios J, Duffy D, et al. A pragmatic randomized waitlist-controlled effectiveness and cost-effectiveness trial of digital interventions for depression and anxiety. NPJ Digit Med 2020;3:85. https://doi.org/10.1038/s41746-020-0293-8 doi: 10.1038/s41746-020-0293-8. [DOI] [PMC free article] [PubMed]
  123. Kolovos S, Van Dongen JM, Ri per H, Van Tulder MW, Bosmans JE. Cost-effectiveness of guided internet-based treatments for depression in comparison with control conditions: an individual-participant data meta-analysis. Value Health 2017;20:PA714–A715. https://doi.org/10.1016/j.jval.2017.08.1898 doi: 10.1016/j.jval.2017.08.1898. [DOI]
  124. Saramago P, Gega L, Marshall D, Nikolaidis GF, Jankovic D, Melton H, et al. Digital interventions for generalised anxiety disorder (GAD): systematic review and network meta-analysis. Front Psychiatry 2021;12:726222. https://doi.org/10.3389/fpsyt.2021.726222 doi: 10.3389/fpsyt.2021.726222. [DOI] [PMC free article] [PubMed]
  125. McManus S, Bebbington P, Jenkins R, Brugha T. Mental Health and Wellbeing in England: Adult Psychiatric Morbidity Survey 2014. A Survey Carried Out for NHS Digital by NatCen Social Research and the Department of Health Sciences. Leicester: University of Leicester; 2016.
  126. Revicki DA, Travers K, Wyrwich KW, Svedsäter H, Locklear J, Mattera MS, et al. Humanistic and economic burden of generalized anxiety disorder in North America and Europe. J Affect Disord 2012;140:103–12. https://doi.org/10.1016/j.jad.2011.11.014 doi: 10.1016/j.jad.2011.11.014. [DOI] [PubMed]
  127. Hunot V, Churchill R, Silva de Lima M, Teixeira V. Psychological therapies for generalised anxiety disorder. Cochrane Database Syst Rev 2007;1:CD001848. https://doi.org/10.1002/14651858.CD001848.pub4 doi: 10.1002/14651858.CD001848.pub4. [DOI] [PMC free article] [PubMed]
  128. Hayes-Skelton SA, Roemer L, Orsillo SM, Borkovec TD. A contemporary view of applied relaxation for generalized anxiety disorder. Cogn Behav Ther 2013;42:292–302. https://doi.org/10.1080/16506073.2013.777106 doi: 10.1080/16506073.2013.777106. [DOI] [PMC free article] [PubMed]
  129. Slee A, Nazareth I, Bondaronek P, Liu Y, Cheng Z, Freemantle N. Pharmacological treatments for generalised anxiety disorder: a systematic review and network meta-analysis. Lancet 2019;393:768–77. https://doi.org/10.1016/S0140-6736(18)31793-8 doi: 10.1016/S0140-6736(18)31793-8. [DOI] [PubMed]
  130. Aboujaoude E, Gega L, Parish MB, Hilty DM. Editorial: digital interventions in mental health: current status and future directions. Front Psychiatry 2020;11:111. https://doi.org/10.3389/fpsyt.2020.00111 doi: 10.3389/fpsyt.2020.00111. [DOI] [PMC free article] [PubMed]
  131. Cuijpers P, Sijbrandij M, Koole SL, Andersson G, Beekman AT, Reynolds CF. Adding psychotherapy to antidepressant medication in depression and anxiety disorders: a meta-analysis. World Psychiatry 2014;13:56–67. https://doi.org/10.1002/wps.20089 doi: 10.1002/wps.20089. [DOI] [PMC free article] [PubMed]
  132. Richards D, Richardson T, Timulak L, McElvaney J. The efficacy of internet-delivered treatment for generalized anxiety disorder: a systematic review and meta-analysis. Internet Interven 2015;2:272–82. https://doi.org/10.1016/j.invent.2015.07.003 doi: 10.1016/j.invent.2015.07.003. [DOI]
  133. Lumley T. Network meta-analysis for indirect treatment comparisons. Stat Med 2002;21:2313–24. https://doi.org/10.1002/sim.1201 doi: 10.1002/sim.1201. [DOI] [PubMed]
  134. Lu G, Ades AE. Combination of direct and indirect evidence in mixed treatment comparisons. Stat Med 2004;23:3105–24. https://doi.org/10.1002/sim.1875 doi: 10.1002/sim.1875. [DOI] [PubMed]
  135. Caldwell DM, Ades AE, Higgins JP. Simultaneous comparison of multiple treatments: combining direct and indirect evidence. BMJ 2005;331:897–900. https://doi.org/10.1136/bmj.331.7521.897 doi: 10.1136/bmj.331.7521.897. [DOI] [PMC free article] [PubMed]
  136. Cooper NJ, Peters J, Lai MC, Juni P, Wandel S, Palmer S, et al. How valuable are multiple treatment comparison methods in evidence-based health-care evaluation? Value Health 2011;14:371–80. https://doi.org/10.1016/j.jval.2010.09.001 doi: 10.1016/j.jval.2010.09.001. [DOI] [PubMed]
  137. Sterne JAC, Savović J, Page MJ, Elbers RG, Blencowe NS, Boutron I, et al. RoB 2: a revised tool for assessing risk of bias in randomised trials. BMJ 2019;366:l4898. https://doi.org/10.1136/bmj.l4898 doi: 10.1136/bmj.l4898. [DOI] [PubMed]
  138. Dias S, Sutton AJ, Ades AE, Welton NJ. Evidence synthesis for decision making 2: a generalized linear modelling framework for pairwise and network meta-analysis of randomized controlled trials. Med Decis Making 2013;33:607–17. https://doi.org/10.1177/0272989X12458724 doi: 10.1177/0272989X12458724. [DOI] [PMC free article] [PubMed]
  139. Dias S, Welton NJ, Sutton AJ, Ades AE. NICE DSU Technical Support Document 2: A Generalised Linear Modelling Framework for Pairwise and Network Meta-Analysis of Randomised Controlled Trials. London: National Institute for Health and Care Excellence; 2014. [PubMed]
  140. Higgins JPT, Cochrane Collaboration. Cochrane Handbook for Systematic Reviews of Interventions. 2nd edn. Hoboken, NJ: Wiley-Blackwell; 2020.
  141. Riley RD, Kauser I, Bland M, Thijs L, Staessen JA, Wang J, et al. Meta-analysis of randomised trials with a continuous outcome according to baseline imbalance and availability of individual participant data. Stat Med 2013;32:2747–66. https://doi.org/10.1002/sim.5726 doi: 10.1002/sim.5726. [DOI] [PubMed]
  142. van Breukelen GJ. ANCOVA versus CHANGE from baseline in nonrandomized studies: the difference. Multivariate Behav Res 2013;48:895–922. https://doi.org/10.1080/00273171.2013.831743 doi: 10.1080/00273171.2013.831743. [DOI] [PubMed]
  143. Winkens B, van Breukelen GJ, Schouten HJ, Berger MP. Randomized clinical trials with a pre- and a post-treatment measurement: repeated measures versus ANCOVA models. Contemp Clin Trials 2007;28:713–19. https://doi.org/10.1016/j.cct.2007.04.002 doi: 10.1016/j.cct.2007.04.002. [DOI] [PubMed]
  144. Fu R, Vandermeer BW, Shamliyan TA, O’Neil ME, Yazdi F, Fox SH, et al. Handling Continuous Outcomes in Quantitative Synthesis. In Agency for Healthcare Research and Quality, editor. Methods Guide for Effectiveness and Comparative Effectiveness Reviews. Rockville, MD: Agency for Healthcare Research and Quality; 2008.
  145. Vickers AJ. The use of percentage change from baseline as an outcome in a controlled trial is statistically inefficient: a simulation study. BMC Med Res Methodol 2001;1:6. https://doi.org/10.1186/1471-2288-1-6 doi: 10.1186/1471-2288-1-6. [DOI] [PMC free article] [PubMed]
  146. Vickers AJ, Altman DG. Statistics notes: analysing controlled trials with baseline and follow up measurements. BMJ 2001;323:1123–4. https://doi.org/10.1136/bmj.323.7321.1123 doi: 10.1136/bmj.323.7321.1123. [DOI] [PMC free article] [PubMed]
  147. Deeks JJ, Higgins JPT, Altman DG. Chapter 9: Analysing Data and Undertaking Meta-analyses. In Higgins JPT, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, Welch VA, editors. Cochrane Handbook for Systematic Reviews of Interventions. Version 5.0.1 (Updated September 2008). 2008. URL: https://training.cochrane.org/handbook/current/chapter-09 (accessed 29 July 2021).
  148. Lunn DJ, Thomas A, Best N, Spiegelhalter D. WinBUGS – a Bayesian modelling framework: concepts, structure, and extensibility. Stat Computing 2000;10:325–37. https://doi.org/10.1023/A:1008929526011 doi: 10.1023/A:1008929526011. [DOI]
  149. Sturtz S, Ligges U, Gelman A. R2WinBUGS: a package for running WinBUGS from R. J Stat Softw 2005;12:1–16. https://doi.org/10.18637/jss.v012.i03 doi: 10.18637/jss.v012.i03. [DOI]
  150. Brooks S, Gelman A. Some issues in monitoring convergence of iterative simulations. Dimension Reduct Computat Complex Info 1998;30:30–6.
  151. Brooks S, Gelman A. General methods for monitoring convergence of iterative simulations. J Comput Graph Stat 1998;7:434–55. https://doi.org/10.2307/1390675 doi: 10.2307/1390675. [DOI]
  152. Gelman A, Rubin DB. Inference from iterative simulation using multiple sequences. Stat Sci 1992;7:457–72. https://doi.org/10.2307/2246093 doi: 10.2307/2246093. [DOI]
  153. Spiegelhalter DJ, Best NG, Carlin BR, van der Linde A. Bayesian measures of model complexity and fit. J R Stat Soc Series B Stat Methodol 2002;64:583–616. https://doi.org/10.1111/1467-9868.00353 doi: 10.1111/1467-9868.00353. [DOI]
  154. Saramago P, Woods B, Weatherly H, Manca A, Sculpher M, Khan K, et al. Methods for network meta-analysis of continuous outcomes using individual patient data: a case study in acupuncture for chronic pain. BMC Med Res Methodol 2016;16:131. https://doi.org/10.1186/s12874-016-0224-1 doi: 10.1186/s12874-016-0224-1. [DOI] [PMC free article] [PubMed]
  155. Ades AE, Sculpher M, Sutton A, Abrams K, Coo per N, Welton N, Lu G. Bayesian methods for evidence synthesis in cost-effectiveness analysis. PharmacoEconomics 2006;24:1–19. https://doi.org/10.2165/00019053-200624010-00001 doi: 10.2165/00019053-200624010-00001. [DOI] [PubMed]
  156. Dias S, Welton NJ, Sutton AJ, Caldwell DM, Lu G, Ades AE. Evidence synthesis for decision making 4: inconsistency in networks of evidence based on randomized controlled trials. Med Decis Making 2013;33:641–56. https://doi.org/10.1177/0272989X12455847 doi: 10.1177/0272989X12455847. [DOI] [PMC free article] [PubMed]
  157. Dias S, Welton NJ, Sutton AJ, Caldwell DM, Lu G, Ades AE. NICE DSU Technical Support Document 4: Inconsistency in Networks of Evidence Based on Randomised Controlled Trials. London: National Institute for Health and Care Excellence; 2014. [PubMed]
  158. Andersson G, Paxling B, Roch-Norlund P, Östman G, Norgren A, Almlöv J, et al. Internet-based psychodynamic versus cognitive behavioral guided self-help for generalized anxiety disorder: a randomized controlled trial. Psychother Psychosom 2012;81:344–55. https://doi.org/10.1159/000339371 doi: 10.1159/000339371. [DOI] [PubMed]
  159. Christensen H, Mackinnon AJ, Batterham PJ, O’Dea B, Guastella AJ, Griffiths KM, et al. The effectiveness of an online e-health application compared to attention placebo or sertraline in the treatment of generalised anxiety disorder. Internet Interv 2014;1:169–74. https://doi.org/10.1016/j.invent.2014.08.002 doi: 10.1016/j.invent.2014.08.002. [DOI] [PMC free article] [PubMed]
  160. Dear BF, Staples LG, Terides MD, Karin E, Zou J, Johnston L, et al. Transdiagnostic versus disorder-specific and clinician-guided versus self-guided internet-delivered treatment for generalized anxiety disorder and comorbid disorders: a randomized controlled trial. J Anxiety Disord 2015;36:63–77. https://doi.org/10.1016/j.janxdis.2015.09.003 doi: 10.1016/j.janxdis.2015.09.003. [DOI] [PubMed]
  161. Hazen RA, Vasey MW, Schmidt NB. Attentional retraining: a randomized clinical trial for pathological worry. J Psychiatr Res 2009;43:627–33. https://doi.org/10.1016/j.jpsychires.2008.07.004 doi: 10.1016/j.jpsychires.2008.07.004. [DOI] [PubMed]
  162. Hirsch CR, Krahé C, Whyte J, Loizou S, Bridge L, Norton S, Mathews A. Interpretation training to target repetitive negative thinking in generalized anxiety disorder and depression. J Consult Clin Psychol 2018;86:1017–30. https://doi.org/10.1037/ccp0000310 doi: 10.1037/ccp0000310. [DOI] [PubMed]
  163. Howell AN, Rheingold AA, Uhde TW, Guille C. Web-based CBT for the prevention of anxiety symptoms among medical and health science graduate students. Cogn Behav Ther 2019;48:385–405 https://doi.org/10.1080/16506073.2018.1533575 doi: 10.1080/16506073.2018.1533575. [DOI] [PMC free article] [PubMed]
  164. Jones SL, Hadjistavropoulos HD, Soucy JN. A randomized controlled trial of guided internet-delivered cognitive behaviour therapy for older adults with generalized anxiety. J Anxiety Disord 2016;37:1–9. https://doi.org/10.1016/j.janxdis.2015.10.006 doi: 10.1016/j.janxdis.2015.10.006. [DOI] [PubMed]
  165. Navarro-Haro MV, Modrego-Alarcón M, Hoffman HG, López-Montoyo A, Navarro-Gil M, Montero-Marin J, et al. Evaluation of a mindfulness-based intervention with and without Virtual Reality Dialectical Behavior Therapy® mindfulness skills training for the treatment of generalized anxiety disorder in primary care: a pilot study. Front Psychol 2019;10:55. https://doi.org/10.3389/fpsyg.2019.00055 doi: 10.3389/fpsyg.2019.00055. [DOI] [PMC free article] [PubMed]
  166. Paxling B, Almlöv J, Dahlin M, Carlbring P, Breitholtz E, Eriksson T, Andersson G. Guided internet-delivered cognitive behavior therapy for generalized anxiety disorder: a randomized controlled trial. Cogn Behav Ther 2011;40:159–73. https://doi.org/10.1080/16506073.2011.576699 doi: 10.1080/16506073.2011.576699. [DOI] [PubMed]
  167. Repetto C, Gaggioli A, Pallavicini F, Cipresso P, Raspelli S, Riva G. Virtual reality and mobile phones in the treatment of generalized anxiety disorders: a phase-2 clinical trial. Pers Ubiquitous Comput 2013;17:253–60. https://doi.org/10.1007/s00779-011-0467-0 doi: 10.1007/s00779-011-0467-0. [DOI]
  168. Richards D, Timulak L, Rashleigh C, McLoughlin O, Colla A, Joyce C, et al. Effectiveness of an internet-delivered intervention for generalized anxiety disorder in routine care: a randomised controlled trial in a student population. Internet Interv 2016;6:80–8. https://doi.org/10.1016/j.invent.2016.10.003 doi: 10.1016/j.invent.2016.10.003. [DOI] [PMC free article] [PubMed]
  169. Robinson E, Titov N, Andrews G, McIntyre K, Schwencke G, Solley K. Internet treatment for generalized anxiety disorder: a randomized controlled trial comparing clinician vs. technician assistance. PLOS ONE 2010;5:e10942. https://doi.org/10.1371/journal.pone.0010942 doi: 10.1371/journal.pone.0010942. [DOI] [PMC free article] [PubMed]
  170. Titov N, Andrews G, Johnston L, Robinson E, Spence J. Transdiagnostic internet treatment for anxiety disorders: a randomized controlled trial. Behav Res Ther 2010;48:890–9. https://doi.org/10.1016/j.brat.2010.05.014 doi: 10.1016/j.brat.2010.05.014. [DOI] [PubMed]
  171. Titov N, Andrews G, Robinson E, Schwencke G, Johnston L, Solley K, et al. Clinician-assisted internet-based treatment is effective for generalized anxiety disorder: randomized controlled trial. Aust N Z J Psychiatry 2009;43:905–12. https://doi.org/10.1080/00048670903179269 doi: 10.1080/00048670903179269. [DOI]
  172. Topper M, Emmelkamp PMG, Watkins E, Ehring T. Prevention of anxiety disorders and depression by targeting excessive worry and rumination in adolescents and young adults: a randomized controlled trial. Behav Res Ther 2017;90:123–36. https://doi.org/10.1016/j.brat.2016.12.015 doi: 10.1016/j.brat.2016.12.015. [DOI] [PubMed]
  173. Gorini A, Pallavicini F, Algeri D, Repetto C, Gaggioli A, Riva G. Virtual reality in the treatment of generalized anxiety disorders. Stud Health Technol Inform 2010;154:39–43. [PubMed]
  174. Gorini A, Pallavicini F, Algeri D, Repetto C, Gaggioli A, Riva G. Virtual reality in the treatment of generalized anxiety disorders. Annu Rev CyberTherapy Telemed 2010;8:31–35. [PubMed]
  175. Pallavicini F, Algeri D, Repetto C, Gorini A, Riva G. Biofeedback, virtual reality and mobile phones in the treatment of generalized anxiety disorder (GAD): a phase-2 controlled clinical trial. J Cyber Ther Rehabil 2009;2:315–27.
  176. Lorian CN, Titov N, Grisham JR. Changes in risk-taking over the course of an internet-delivered cognitive behavioral therapy treatment for generalized anxiety disorder. J Anxiety Disord 2012;26:140–9. https://doi.org/10.1016/j.janxdis.2011.10.003 doi: 10.1016/j.janxdis.2011.10.003. [DOI] [PubMed]
  177. Sheehan DV, Lecrubier Y, Sheehan KH, Amorim P, Janavs J, Weiller E, et al. The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry 1998;59(Suppl. 20):22–33. [PubMed]
  178. Spitzer RL, Kroenke K, Williams JB, Löwe B. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med 2006;166:1092–7. https://doi.org/10.1001/archinte.166.10.1092 doi: 10.1001/archinte.166.10.1092. [DOI] [PubMed]
  179. Meyer TJ, Miller ML, Metzger RL, Borkovec TD. Development and validation of the Penn State Worry Questionnaire. Behav Res Ther 1990;28:487–95. https://doi.org/10.1016/0005-7967(90)90135-6 doi: 10.1016/0005-7967(90)90135-6. [DOI] [PubMed]
  180. Kroenke K, Spitzer RL. The PHQ-9: A new depression diagnostic and severity measure. Psychiatr Ann 2002;32:509–15. https://doi.org/10.3928/0048-5713-20020901-06 doi: 10.3928/0048-5713-20020901-06. [DOI]
  181. Beck A, Steer R, Brown G. Manual for Beck Depression Inventory-II (BDI-II). San Antonio, TX: Psychology Corporation; 1996. https://doi.org/10.1037/t00742-000 doi: 10.1037/t00742-000. [DOI]
  182. Maier W, Buller R, Philipp M, Heuser I. The Hamilton Anxiety Scale: reliability, validity and sensitivity to change in anxiety and depressive disorders. J Affect Disord 1988;14:61–8. https://doi.org/10.1016/0165-0327(88)90072-9 doi: 10.1016/0165-0327(88)90072-9. [DOI] [PubMed]
  183. Barlow DH. Anxiety and its Disorders: The Nature and Treatment of Anxiety and Panic. 2nd edn. New York, NY: Guilford Press; 2002.
  184. Latimer NR, Abrams KR, Lambert PC, Crowther MJ, Wailoo AJ, Morden JP, et al. Adjusting survival time estimates to account for treatment switching in randomized controlled trials – an economic evaluation context: methods, limitations, and recommendations. Med Decis Making 2014;34:387–402. https://doi.org/10.1177/0272989X13520192 doi: 10.1177/0272989X13520192. [DOI] [PubMed]
  185. Cuij pers P, Donker T, van Straten A, Li J, Andersson G. Is guided self-help as effective as face-to-face psychotherapy for depression and anxiety disorders? A systematic review and meta-analysis of comparative outcome studies. Psychol Med 2010;40:1943–57. https://doi.org/10.1017/S0033291710000772 doi: 10.1017/S0033291710000772. [DOI] [PubMed]
  186. Spek V, Cuij pers P, Nyklícek I, Ri per H, Keyzer J, Pop V. Internet-based cognitive behaviour therapy for symptoms of depression and anxiety: a meta-analysis. Psychol Med 2007;37:319–28. https://doi.org/10.1017/S0033291706008944 doi: 10.1017/S0033291706008944. [DOI] [PubMed]
  187. Shim M, Mahaffey B, Bleidistel M, Gonzalez A. A scoping review of human-support factors in the context of internet-based psychological interventions (IPIs) for depression and anxiety disorders. Clin Psychol Rev 2017;57:129–40. https://doi.org/10.1016/j.cpr.2017.09.003 doi: 10.1016/j.cpr.2017.09.003. [DOI] [PubMed]
  188. Dear BF, Titov N, Sunderland M, McMillan D, Anderson T, Lorian C, Robinson E. Psychometric comparison of the Generalized Anxiety Disorder scale-7 and the Penn State Worry Questionnaire for measuring response during treatment of generalised anxiety disorder. Cogn Behav Ther 2011;40:216–27. https://doi.org/10.1080/16506073.2011.582138 doi: 10.1080/16506073.2011.582138. [DOI] [PubMed]
  189. Jankovic D, Saramago PG, Gega L, Marshall D, Wright K, Hafidh M, et al. Cost Effectiveness of Digital Interventions for Generalised Anxiety Disorder: A Model-Based Analysis [published online ahead of print 27 December 2021]. PharmacoEconomics Open 2021. https://doi.org/10.1007/s41669-021-00318-y doi: 10.1007/s41669-021-00318-y. [DOI] [PMC free article] [PubMed]
  190. Yonkers KA, Warshaw MG, Massion AO, Keller MB. Phenomenology and course of generalised anxiety disorder. Br J Psychiatry 1996;168:308–13. https://doi.org/10.1192/bjp.168.3.308 doi: 10.1192/bjp.168.3.308. [DOI] [PubMed]
  191. Ruiz MA, Zamorano E, García-Campayo J, Pardo A, Freire O, Rejas J. Validity of the GAD-7 scale as an outcome measure of disability in patients with generalized anxiety disorders in primary care. J Affect Disord 2011;128:277–86. https://doi.org/10.1016/j.jad.2010.07.010 doi: 10.1016/j.jad.2010.07.010. [DOI] [PubMed]
  192. Willan AR, Briggs AH. Statistical Analysis of Cost-effectiveness Data. Hoboken, NY: John Wiley & Sons, Inc.; 2006. https://doi.org/10.1002/0470856289 doi: 10.1002/0470856289. [DOI]
  193. Kind P, Hardman G, Macran S. UK Population Norms for EQ-5D (Working Papers 172). York: Centre for Health Economics, University of York; 1999.
  194. Vera-Llonch M, Dukes E, Rejas J, Sofrygin O, Mychaskiw M, Oster G. Cost-effectiveness of pregabalin versus venlafaxine in the treatment of generalized anxiety disorder: findings from a Spanish perspective. Eur J Health Econ 2010;11:35–44. https://doi.org/10.1007/s10198-009-0160-7 doi: 10.1007/s10198-009-0160-7. [DOI] [PMC free article] [PubMed]
  195. Office for National Statistics. Consumer Price Inflation, UK: May 2015. 2015. URL: www.ons.gov.uk/economy/inflationandpriceindices/bulletins/consumerpriceinflation/2015-06-16 (accessed 3 April 2020).
  196. Office for National Statistics. Consumer Price Inflation, UK: May 2019. 2019. URL: www.ons.gov.uk/economy/inflationandpriceindices/bulletins/consumerpriceinflation/may2019 (accessed 3 April 2020).
  197. Office for National Statistics. National Life Tables: UK. 2019. URL: www.ons.gov.uk/peoplepopulationandcommunity/birthsdeathsandmarriages/lifeexpectancies/datasets/nationallifetablesunitedkingdomreferencetables (accessed 3 April 2020).
  198. Michal M, Prochaska JH, Keller K, Göbel S, Coldewey M, Ullmann A, et al. Symptoms of depression and anxiety predict mortality in patients undergoing oral anticoagulation: results from the thrombEVAL study program. Int J Cardiol 2015;187:614–19. https://doi.org/10.1016/j.ijcard.2015.03.374 doi: 10.1016/j.ijcard.2015.03.374. [DOI] [PubMed]
  199. Pharmaceutical Services Negotiating Committee. Professional Fees (Drug Tariff Part IIIA). 2019. URL: https://psnc.org.uk/dispensing-supply/endorsement/fees-allowances/ (accessed 3 April 2020).
  200. OpenPrescribing.net, EDM DataLab, University of Oxford. OpenPrescribing.net. 2020. URL: https://OpenPrescribing.net (accessed March 2020).
  201. NHS Improvement. National Cost Collection 2018/19. 2019. URL: https://improvement.nhs.uk/resources/national-cost-collection/ (accessed 3 April 2020).
  202. Claxton KP, Sculpher MJ. Using value of information analysis to prioritise health research: some lessons from recent UK experience. PharmacoEconomics 2006;24:1055–68. https://doi.org/10.2165/00019053-200624110-00003 doi: 10.2165/00019053-200624110-00003. [DOI] [PubMed]
  203. Walters K, Rait G, Griffin M, Buszewicz M, Nazareth I. Recent trends in the incidence of anxiety diagnoses and symptoms in primary care. PLOS ONE 2012;7:e41670. https://doi.org/10.1371/journal.pone.0041670 doi: 10.1371/journal.pone.0041670. [DOI] [PMC free article] [PubMed]
  204. Beesdo K, Pine DS, Lieb R, Wittchen HU. Incidence and risk patterns of anxiety and depressive disorders and categorization of generalized anxiety disorder. Arch Gen Psychiatry 2010;67:47–57. https://doi.org/10.1001/archgenpsychiatry.2009.177 doi: 10.1001/archgenpsychiatry.2009.177. [DOI] [PubMed]
  205. Strong M, Oakley JE, Brennan A. Estimating multiparameter partial expected value of perfect information from a probabilistic sensitivity analysis sample: a nonparametric regression approach. Med Decis Making 2014;34:311–26. https://doi.org/10.1177/0272989X13505910 doi: 10.1177/0272989X13505910. [DOI] [PMC free article] [PubMed]
  206. Claxton K, Martin S, Soares M, Rice N, Spackman E, Hinde S, et al. Methods for the estimation of the National Institute for Health and Care Excellence cost-effectiveness threshold. Health Technol Assess 2015;19(14). https://doi.org/10.3310/hta19140 doi: 10.3310/hta19140. [DOI] [PMC free article] [PubMed]
  207. von Winterfeldt D. Bridging the gap between science and decision making. Proc Natl Acad Sci USA 2013;110:14055–61. https://doi.org/10.1073/pnas.1213532110 doi: 10.1073/pnas.1213532110. [DOI] [PMC free article] [PubMed]
  208. Bruine de Bruin W, Bostrom A. Assessing what to address in science communication. Proc Natl Acad Sci USA 2013;110:14062–8. https://doi.org/10.1073/pnas.1212729110 doi: 10.1073/pnas.1212729110. [DOI] [PMC free article] [PubMed]
  209. Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol 2006;3:77–101. https://doi.org/10.1191/1478088706qp063oa doi: 10.1191/1478088706qp063oa. [DOI]
  210. Whyte S, Dixon S, Faria R, Walker S, Palmer S, Sculpher M, et al. Estimating the cost-effectiveness of implementation: is sufficient evidence available? Value Health 2016;19:138–44. https://doi.org/10.1016/j.jval.2015.12.009 doi: 10.1016/j.jval.2015.12.009. [DOI] [PMC free article] [PubMed]
  211. Berry K, Salter A, Morris R, James S, Bucci S. Assessing therapeutic alliance in the context of mHealth interventions for mental health problems: development of the Mobile Agnew Relationship Measure (mARM) Questionnaire. J Med Internet Res 2018;20:e90. https://doi.org/10.2196/jmir.8252 doi: 10.2196/jmir.8252. [DOI] [PMC free article] [PubMed]
  212. Henson P, Wisniewski H, Hollis C, Keshavan M, Torous J. Digital mental health apps and the therapeutic alliance: initial review. BJPsych Open 2019;5:e15. https://doi.org/10.1192/bjo.2018.86 doi: 10.1192/bjo.2018.86. [DOI] [PMC free article] [PubMed]
  213. Tremain H, McEnery C, Fletcher K, Murray G. The therapeutic alliance in digital mental health interventions for serious mental illnesses: narrative review. JMIR Ment Health 2020;7:e17204. https://doi.org/10.2196/17204 doi: 10.2196/17204. [DOI] [PMC free article] [PubMed]
  214. Black WC. The CE plane: a graphic representation of cost-effectiveness. Med Decis Making 1990;10:212–14. https://doi.org/10.1177/0272989X9001000308 doi: 10.1177/0272989X9001000308. [DOI] [PubMed]
  215. NHS England. Five Year Forward View. 2014. URL: www.england.nhs.uk/wp-content/uploads/2014/10/5yfv-web.pdf (accessed 31 January 2018).
  216. National Information Board. Personalised Health and Care 2020: Using Data and Technology to Transform Outcomes for Patients and Citizens: A Framework for Action. London: HM Government; 2014.
  217. Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M, Medical Research Council guidance. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ 2008;337:a1655. https://doi.org/10.1136/bmj.a1655 doi: 10.1136/bmj.a1655. [DOI] [PMC free article] [PubMed]
  218. Cooper NJ, Sutton AJ, Morris D, Ades AE, Welton NJ. Addressing between-study heterogeneity and inconsistency in mixed treatment comparisons: application to stroke prevention treatments in individuals with non-rheumatic atrial fibrillation. Stat Med 2009;28:1861–81. https://doi.org/10.1002/sim.3594 doi: 10.1002/sim.3594. [DOI] [PubMed]

RESOURCES