Version Changes
Revised. Amendments from Version 1
Expansion in the introduction to convey key concepts and references from the field of behavioural economics. Clarification on the limitations that the search strategy did not include economic and development databases and the search was conducted up to 2018.
Abstract
Background: Financial incentives may improve the initiation and engagement of behaviour change that reduce the negative outcomes associated with non-communicable diseases. There is still a paucity in guidelines or recommendations that help define key aspects of incentive-oriented interventions, including the type of incentive (e.g. cash rewards, vouchers), the frequency and magnitude of the incentive, and its mode of delivery. We aimed to systematically review the literature on financial incentives that promote healthy lifestyle behaviours or improve health profiles, and focused on the methodological approach to define the incentive intervention and its delivery. The protocol was registered at PROSPERO on 26 July 2018 ( CRD42018102556).
Methods: We sought studies in which a financial incentive was delivered to improve a health-related lifestyle behaviour (e.g., physical activity) or a health profile (e.g., HbA1c in people with diabetes). The search (which took place on March 3 rd 2018) was conducted using OVID (MEDLINE and Embase), CINAHL and Scopus.
Results: The search yielded 7,575 results and 37 were included for synthesis. Of the total, 83.8% (31/37) of the studies were conducted in the US, and 40.5% (15/37) were randomised controlled trials. Only one study reported the background and rationale followed to develop the incentive and conducted a focus group to understand what sort of incentives would be acceptable for their study population. There was a degree of consistency across the studies in terms of the direction, form, certainty, and recipient of the financial incentives used, but the magnitude and immediacy of the incentives were heterogeneous.
Conclusions: The available literature on financial incentives to improve health-related lifestyles rarely reports on the rationale or background that defines the incentive approach, the magnitude of the incentive and other relevant details of the intervention, and the reporting of this information is essential to foster its use as potential effective interventions.
Keywords: behavioral economics, evidence synthesis, incentives, interventions, non-communicable diseases, quality, systematic review, trials
Introduction
Many non-communicable diseases require effective engagement with lifestyle behaviours such as diet, physical activity and compliance with pharmacological medication, but this is difficult to achieve 1. There are major benefits to be achieved by preventive care, including both primary and secondary prevention, for example in the case of diabetes management 2– 5 , yet adherence to healthy behaviors and pharmacological treatment remains a challenge 6– 9 . Financial incentives may improve the initiation and engagement of behaviour change to reduce the negative outcomes associated with non-communicable diseases 10. The field of behavioural economics has provided critical insights to influence public policy 11, and incentives are one of many tools available. Concepts such as present bias, loss aversion, choice overload, and reference points, among others, have now spread to the field of public health and healthcare delivery 12– 15 .
Previous systematic reviews have focused on the effect of financial incentives on lifestyle behaviours 16– 20 , with less attention on how the financial incentives and rewards have been developed. Given the growing attention to develop incentive-oriented interventions 10, there is still a paucity in guidelines or recommendations that help define key aspects of such interventions, including the type of incentive (e.g. cash rewards, vouchers), the frequency and magnitude of the incentive, and its mode of delivery. To address this gap in the evidence-base, this study aimed to systematically review the literature on financial incentives to promote healthy lifestyle behaviours (e.g., physical activity) or to improve health profiles (e.g., HbA1c levels) with a specific interest in the methodological approach used to identify how the incentive intervention was defined, as well as its mechanisms of delivery.
Methods
Study design
A systematic review of the literature was conducted following the PRISMA guidelines 21 (see Reporting guidelines 22). In addition, the protocol was registered at PROSPERO on 26 July 2018 ( CRD42018102556) 23. We included studies that: i) had adults subjects (18+ years); ii) included financial incentives as a broad topic, i.e., no specific types of incentives (e.g. cash transfers or vouchers) were sought; and iii) the outcome of interest was a health-related lifestyle behaviour (e.g., physical activity) or a risk factor for a cardiovascular or metabolic disease (e.g., HbA1C in diabetes patients). To ensure a broad range of included studies, our review focused on the methods of the included study, rather than on the effect of the financial incentive. We also did not require a specific comparator group for the interventions. Therefore, the search approach and the selection and extraction process did not focus on effects estimates, but on the methods, including for example: criteria used to define the incentive, criteria used to define the magnitude of the incentive, and criteria used to define the recipient of the incentive 24.
Search
The search was conducted in OVID (MEDLINE and Embase), Cumulative Index to Nursing and Allied Health Literature (CINAHL), and Scopus from inception to March 3 rd 2018. No language or article type restrictions were set. The search terms used in OVID are presented in Extended data 22.
Study selection
Search results were downloaded and saved in EndNote X7 (Clarivate, Philadelphia, PA, USA). Duplicates were eliminated from the search results using EndNote duplicate reference identification. Titles and abstracts were independently screened by two reviewers; discrepancies between them were solved by a third party independently. Titles and abstracts selected from this first stage were sought in full-text, and these were studied by two reviewers independently; as before, discrepancies were solved by a third reviewer independently. These selection processes were conducted using the Rayyan online software 25.
Data extraction
With the list of selected studies, information was extracted by one reviewer using a pre-specified data extraction form. Data extraction focused on items described in a framework used to document the complexity of financial incentive interventions to change health behaviours created by Adams et al. 24. In particular, the extraction form collated information about the study design, the methodological approach of the intervention, and aspects of the financial reward used, including its direction, form (e.g. cash, vouchers etc), certainty (e.g. certain if they did something, a chance of getting something), frequency, immediacy, schedule, and recipient. The details of the reviewed studies and all data extracted during the review are available at Table 1 and Table 2 (see Underlying data 22).
Analysis
Our review aimed to describe selected characteristics of intervention studies which used economic incentives to promote healthy lifestyle behaviours as per the framework described by Adams et al. 24. To achieve this aim we undertook a narrative synthesis of the included studies and aimed to summarise the methods followed to decide upon financial incentives, magnitude of the incentives, recipient of the incentives, among other features of the economic incentives intervention. We pre-specified that we would not undertake a comprehensive analysis of the studies’ results (e.g., risk or impact estimates), including a meta-analysis, as was not the focus of our study. We also decided not to undertake a risk of bias assessment for the same reasons that this was not considered necessary for our analytical aims.
Results
General characteristics
The search yielded 7,575 results, of which 3,656 were excluded after the initial screening. From 119 texts studied in detail, 37 were included ( Figure 1 summarizes the study selection process). All but two of the retrieved studies were conducted in high-income countries, with a majority in the USA (83.8%; 31/37), and the exception were two studies from Mexico. 40.5% (14/37) of the studies were randomized controlled trials and 26 (70.2%; 26/37) included more than 100 people.
Figure 1. Flow diagram with the number of studies reviewed at each stage.
Table 1 (see Underlying data 22) summarises the details for each included study. There were a wide range of study populations including employees, families with school aged children, and low-income families. Participants had a range of different health conditions or risk factors, such as diabetes and hypertension. Interventions targeting lifestyle behaviors and health outcomes were also equally diverse ranging from group meetings with rewards, information feedback from clinicians in the form of written letters, and process and outcome-based incentives.
Defining the rationale for the financial incentive used
Only one study described a detailed rationale for the financial incentive used 26, and their methods involved conducting focus groups to understand what sort of incentives would be acceptable for their study population. None of the other included studies reported a detailed methodology or rationale to define the magnitude of the incentive, i.e. why they gave that amount of money or reward. In one of the retrieved studies, Kranker et al. 27 described that the magnitude of the incentive for one of the target goals was small because they considered such a goal (medication adherence) to be easy to achieve; in addition, they reported that “Incentive payments were moderately sized for two reasons. First, the research team needed to guarantee that total program costs would fall under a budget ceiling. Second, the research team was primarily interested in studying the effects of moderate financial incentives paired with aggressive behavior goals”.
A review of the framework used for financial incentives
Table 2 (see Underlying data 22) summarises the financial incentives framework used for each included study. The majority of included studies (83.8%; 31/37) used positive gains for the financial rewards, with three studies using the avoidance of a negative loss and three using a mixture of rewards. Cash or vouchers exchangeable for a range of goods or services were used as the financial incentive in 83.8% (31/37) of studies and five used specific goods or services, for example, health insurance discounts or diabetes test strips (see ‘Form of reward’, Table 2, Underlying data 22). The majority of included studies 81.1% (30/37) used financial incentives that participants were certain to receive if they completed the required activity, five studies used a mixed approach (e.g. some activities were certain, but others were based upon chance), and one study used chance alone (see ‘Certainty’, Table 2, Underlying data 22). In the majority of studies the recipient of the financial incentive was the individual study participant (83.8%; 31/37) with three studies providing a mixture of individual and group rewards, and a further three studies proving household-based incentives (see ‘Recipient’, Table 2, Underlying data 22).
The magnitude of the incentive varied widely from $10 up to and including $3000. 19/37 studies rewarded some behaviours, with the remaining 18 studies rewarded all incentivised behaviours. Just under half of the studies provided financial incentives immediately after an incentivized behaviour was undertaken (45.9%; 17/37). The remaining studies delayed incentives with a maximum lag of one year after the intervention. Just over half (51.4%; 19/37) of studies used a fixed schedule for the financial incentives and 17 studies (45.9%; 17/37) used a variable schedule, although these were not always provided incrementally.
Discussion
This work aimed to systematically review the literature on financial incentives with a specific focus on the methodological approaches followed to define the incentive intervention, rather than on the effect of the intervention. In so doing, we build upon previous systematic reviews which have focused on the effect of financial incentives on lifestyle behaviours 16– 20 , however less attention has been placed on how the financial incentives and rewards were developed. We found that whilst being key to achieve the expected results in any given direction, little attention has been paid to a critical aspect of how to design and define the best possible incentive strategies. The average or range earned per participant was often not described and whilst targets or outcomes were described, the achievement of the tasks depends on its difficulty. If this were to be compared to a pharmacological intervention, the field of financial incentives lacks substantial attention to the design of the pharmacodynamics of the drug —minimum and maximum doses, the most effective delivery modes to guarantee higher adoption, and the frequency and spanning of the doses to be given. Different scheme designs are likely to lead to different outcomes, and hence, it is important to think about the most effective design of incentive schemes 12, as subtle design choices in how incentives are situated, framed, or deployed can have substantial effects on their success 12, 15. Experimental data indicates that insufficient incentives may paradoxically produce less motivation to engage with a given habit than if there were no incentive at all 28. Despite the lack of studies reporting the methodological approaches taken to define the incentive intervention, there was still a degree of consistency across the studies in terms of the direction, form, certainty, and recipient of the financial incentives used, but the magnitude and immediacy of the incentives were more varied.
These findings are relevant to inform checklists and other recommendations to improve the reporting of interventions and other endeavours using financial incentives. Either on the main manuscript, a published protocol, or on an accompanying scientific report, future studies should report on the rationale used to derive key elements of the financial incentives. More detailed information about the interventions that utilize financial incentives, an objective that adds to the broader objectives of improving the quality of the reporting of health research, is needed to critically appraise the interventions, to inform the development and testing of new interventions, and to facilitate the implementation of these interventions at a larger scale, e.g., as a public health policy. We do not have any reasons to think that the available literature did not thoroughly consider the rationale of the intervention while planning the work, yet our findings suggest that this process needs to be better and more frequently reported. The development of standardised reporting guidelines such as those used to report complex interventions (TIDieR) 29 or trials (CONSORT) 30, observational studies (STROBE) 31 or data linkage studies (RECORD) 32 should be developed in order to support this process.
Our study followed standard systematic review methods including a comprehensive search in four international data sources, but there were limitations to our approach. First, because of the aims and scope of our work we did not extract and report on the effect estimates of the economic incentives interventions. Second, we did not conduct a risk of bias assessment because we aimed to summarize the methodology of the financial incentives rather than to evaluate the quality of the whole literature. Third, we did not search libraries specific for economic or behavioral sciences, which could have retrieved additional studies in addition to the health sciences databases that considers the field of health economics. Finally, our search was conducted up to 2018, an inherent limitation given the considerable dynamism in the field. Yet, this does not preclude the recommendation that guidelines for the reporting of incentive-related studies are needed, in particular the need for including information on key design features of the incentive being examined.
Our study has systematically reviewed the literature on financial incentives to promote healthy lifestyle behaviours and examined the methodological approach to identify how the incentive intervention was defined and its mechanisms of delivery. We found that studies rarely report on the rationale or background to define the incentive approach, the magnitude of the incentive and other relevant details of the intervention. Future studies to guide interventions and generate evidence about the implementation of financial incentive interventions are required to fill this evidence gap.
Data availability
Underlying data
Figshare: Design of financial incentive interventions to improve lifestyle behaviors and health outcomes: A systematic review. https://doi.org/10.6084/m9.figshare.14659176.v4 22.
This project contains the following underlying data:
- 1 Underlying data – Table 1.docx (characteristics of studies included in the review).
- 2 Underlying data – Table 2.docx (financial incentives framework summary).
Extended data
Figshare: Design of financial incentive interventions to improve lifestyle behaviors and health outcomes: A systematic review. https://doi.org/10.6084/m9.figshare.14659176.v4 22.
This project contains the following extended data:
- 3 Extended data – Search strategy.docx (Search terms as used in OVID - MEDLINE and Embase)
Reporting guidelines
Figshare: PRISMA checklist for ‘Design of financial incentive interventions to improve lifestyle behaviors and health outcomes: A systematic review’. https://doi.org/10.6084/m9.figshare.14659176.v4 22.
Data are available under the terms of the Creative Commons Attribution 4.0 International license (CC-BY 4.0).
Acknowledgments
We are thankful to Sebastián Arámbulo Castillo, Janina Bazalar Palacios, Pablo Cazzulino, Dercy Centeno, Jhacksson Córdova Agurto, Darwin Del Castillo-Fernández, Oscar Flores, Luis Helguero Santín, Hongsheng Lu, Marianne Luyo Avalo, Luis Mari Huarache, Raisa Nadine Martínez Rivera, Daniel Mendoza-Quispe, Juan Diego Mendoza Saldaña, Percy Fernando Nateros Baldeon, Andrea Oriette Ruiz Alejos, Niels Pacheco Barrios, Julia Pauschardt, Diana Fiorela Sanchez Velazco, Fiorela Solano Zapata, Janeth Tenorio, Bing Xuan Ho, Elizabeth Zavaleta Lopez, and Ludwing Zeta Solís for their support during the search and review process.
Funding Statement
This study was funded by the DFID/MRC/Wellcome Global Health Trials (MR/M007405/1). JJM acknowledges having received support from the Alliance for Health Policy and Systems Research (HQHSR1206660), Biotechnology and Biological Sciences Research Council (BB/T009004/1), Bernard Lown Scholars in Cardiovascular Health Program at Harvard T.H. Chan School of Public Health, Bloomberg Philanthropies (via University of North Carolina at Chapel Hill School of Public Health), FONDECYT via CIENCIACTIVA/CONCYTEC, British Council, British Embassy and the Newton-Paulet Fund (223-2018, 224-2018), DFID/MRC/Wellcome Global Health Trials (MR/M007405/1), Fogarty International Center (R21TW009982, D71TW010877, R21TW011740), Grand Challenges Canada (0335-04), International Development Research Center Canada (IDRC 106887, 108167), Inter-American Institute for Global Change Research (IAI CRN3036), Medical Research Council (MR/P008984/1, MR/P024408/1, MR/P02386X/1), National Cancer Institute (1P20CA217231), National Heart, Lung and Blood Institute (HHSN268200900033C, 5U01HL114180, 1UM1HL134590), National Institute of Mental Health (1U19MH098780), Swiss National Science Foundation (40P740-160366), UKRI GCRF/Newton Fund (EP/V043102/1), Wellcome (074833, 093541, 103994, 107435, 205177, 214185, 218743) and the World Diabetes Foundation (WDF15-1224). MLP is funded by the Swiss Excellence Government Scholarship. RMC-L is supported by a Wellcome Trust International Training Fellowship (214185). AB-O was supported by a Wellcome Trust International Training Fellowship (103994). RWA is supported by the Wellcome Trust through a Clinical Research Career Development Fellowship (206602).
The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
[version 2; peer review: 2 approved]
References
- 1.Kelly MP, Barker M: Why is changing health-related behaviour so difficult? Public Health. 2016;136:109–16. 10.1016/j.puhe.2016.03.030 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.American Diabetes Association: 5. Prevention or Delay of Type 2 Diabetes. Diabetes Care. 2017;40(Suppl 1):S44–7. 10.2337/dc17-S008 [DOI] [PubMed] [Google Scholar]
- 3.Diabetes Control and Complications Trial Research Group; Nathan DM, Genuth S, et al. : The effect of intensive treatment of diabetes on the development and progression of long-term complications in insulin-dependent diabetes mellitus. N Engl J Med. 1993;329(14):977–86. 10.1056/NEJM199309303291401 [DOI] [PubMed] [Google Scholar]
- 4.Li G, Zhang P, Wang J, et al. : Cardiovascular mortality, all-cause mortality, and diabetes incidence after lifestyle intervention for people with impaired glucose tolerance in the Da Qing Diabetes Prevention Study: a 23-year follow-up study. Lancet Diabetes Endocrinol. 2014;2(6):474–80. 10.1016/S2213-8587(14)70057-9 [DOI] [PubMed] [Google Scholar]
- 5.Lean ME, Leslie WS, Barnes AC, et al. : Primary care-led weight management for remission of type 2 diabetes (DiRECT): an open-label, cluster-randomised trial. Lancet. 2018;391(10120):541–51. 10.1016/S0140-6736(17)33102-1 [DOI] [PubMed] [Google Scholar]
- 6.Aziz Z, Absetz P, Oldroyd J, et al. : A systematic review of real-world diabetes prevention programs: learnings from the last 15 years. Implement Sci. 2015;10:172. 10.1186/s13012-015-0354-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Standards of Medical Care in Diabetes-2016: Summary of Revisions. Diabetes Care. 2016;39 Suppl 1:S4–5. 10.2337/dc16-S003 [DOI] [PubMed] [Google Scholar]
- 8.Institute of Medicine, Board on Population Health and Public Health Practice, Committee on Living Well with Chronic Disease: Public Health Action to Reduce Disability and Improve Functioning and Quality of Life. Living Well with Chronic Illness: A Call for Public Health Action.National Academies Press,2011. [Google Scholar]
- 9.Bosworth HB, Granger BB, Mendys P, et al. : Medication adherence: a call for action. Am Heart J. 2011;162(3):412–24. 10.1016/j.ahj.2011.06.007 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Volpp KG, Pauly MV, Loewenstein G, et al. : P4P4P: an agenda for research on pay-for-performance for patients. Health Aff (Millwood). 2009;28(1):206–14. 10.1377/hlthaff.28.1.206 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Bhargava S, Loewenstein G: Behavioral Economics and Public Policy 102: Beyond Nudging. American Economic Review. 2015;105(5):396–401. 10.1257/aer.p20151049 [DOI] [Google Scholar]
- 12.Vlaev I, King D, Darzi A, et al. : Changing health behaviors using financial incentives: a review from behavioral economics. BMC Public Health. 2019;19(1):1059. 10.1186/s12889-019-7407-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Emanuel EJ, Ubel PA, Kessler JB, et al. : Using Behavioral Economics to Design Physician Incentives That Deliver High-Value Care. Ann Intern Med. 2016;164(2):114–9. 10.7326/M15-1330 [DOI] [PubMed] [Google Scholar]
- 14.Chang LL, DeVore AD, Granger BB, et al. : Leveraging Behavioral Economics to Improve Heart Failure Care and Outcomes. Circulation. 2017;136(8):765–772. 10.1161/CIRCULATIONAHA.117.028380 [DOI] [PubMed] [Google Scholar]
- 15.Thirumurthy H, Asch DA, Volpp KG: The Uncertain Effect of Financial Incentives to Improve Health Behaviors. JAMA. 2019;321(15):1451–1452. 10.1001/jama.2019.2560 [DOI] [PubMed] [Google Scholar]
- 16.Lagarde M, Haines A, Palmer N: The impact of conditional cash transfers on health outcomes and use of health services in low and middle income countries. Cochrane Database Syst Rev. 2009;2009(4):CD008137. 10.1002/14651858.CD008137 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Giles EL, Robalino S, McColl E, et al. : The effectiveness of financial incentives for health behaviour change: systematic review and meta-analysis. PLoS One. 2014;9(3):e90347. 10.1371/journal.pone.0090347 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Kane RL, Johnson PE, Town RJ, et al. : A structured review of the effect of economic incentives on consumers' preventive behavior. Am J Prev Med. 2004;27(4):327–52. 10.1016/j.amepre.2004.07.002 [DOI] [PubMed] [Google Scholar]
- 19.Wall J, Mhurchu CN, Blakely T, et al. : Effectiveness of monetary incentives in modifying dietary behavior:a review of randomized, controlled trials. Nutr Rev. 2006;64(12):518–31. 10.1111/j.1753-4887.2006.tb00185.x [DOI] [PubMed] [Google Scholar]
- 20.Mitchell MS, Orstad SL, Biswas A, et al. : Financial incentives for physical activity in adults: systematic review and meta-analysis. Br J Sports Med. 2020;54(21):1259–1268. 10.1136/bjsports-2019-100633 [DOI] [PubMed] [Google Scholar]
- 21.Liberati A, Altman DG, Tetzlaff J, et al. : The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. PLoS Med. 2009;6(7):e1000100. 10.1371/journal.pmed.1000100 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Carrillo Larco R, Miranda JJ: Design of financial incentive interventions to improve lifestyle behaviors and health outcomes: A systematic review. figshare.Online resource. 2021. 10.6084/m9.figshare.14659176.v4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Pesantes MA: Economic incentives to improve non-communicable diseases care: a systematic review with interest in the methodological approach. PROSPERO International prospective register of systematic reviews. 2018; (accessed Nov 7, 2018). Reference Source [Google Scholar]
- 24.Adams J, Giles EL, McColl E, et al. : Carrots, sticks and health behaviours: a framework for documenting the complexity of financial incentive interventions to change health behaviours. Health Psychol Rev. 2014;8(3):286–95. 10.1080/17437199.2013.848410 [DOI] [PubMed] [Google Scholar]
- 25.Ouzzani M, Hammady H, Fedorowicz Z, et al. : Rayyan-a web and mobile app for systematic reviews. Syst Rev. 2016;5(1):210. 10.1186/s13643-016-0384-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Desai J, Taylor G, Vazquez-Benitez G, et al. : Financial incentives for diabetes prevention in a Medicaid population: Study design and baseline characteristics. Contemp Clin Trials. 2017;53:1–10. 10.1016/j.cct.2016.11.007 [DOI] [PubMed] [Google Scholar]
- 27.Kranker K: The Efficacy of Using Financial Incentives to Change Unhealthy Behaviors Among a Rural Chronically Ill and Uninsured Population. Am J Health Promot. 2018;32(2):301–11. 10.1177/0890117117696621 [DOI] [PubMed] [Google Scholar]
- 28.Gneezy U, Rustichini A: Pay Enough or Don’t Pay at All. Q J Econ. 2000;115(3):791–810. 10.1162/003355300554917 [DOI] [Google Scholar]
- 29.Hoffmann TC, Glasziou PP, Boutron I, et al. : Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ. 2014;348:g1687. 10.1136/bmj.g1687 [DOI] [PubMed] [Google Scholar]
- 30.Schulz KF, Altman DG, Moher D, et al. : CONSORT 2010 statement: updated guidelines for reporting parallel group randomized trials. Obstet Gynecol. 2010;115(5):1063–70. 10.1097/AOG.0b013e3181d9d421 [DOI] [PubMed] [Google Scholar]
- 31.von Elm E, Altman DG, Egger M, et al. : The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. Lancet. 2007;370(9596):1453–7. 10.1016/S0140-6736(07)61602-X [DOI] [PubMed] [Google Scholar]
- 32.Benchimol EI, Smeeth L, Guttmann A, et al. : The REporting of studies Conducted using Observational Routinely-collected health Data (RECORD) statement. PLoS Med. 2015;12(10):e1001885. 10.1371/journal.pmed.1001885 [DOI] [PMC free article] [PubMed] [Google Scholar]

