Table 2.
Combined review’s 95 papers on whether research engagement by healthcare organizations and staff improves healthcare
| 1st author, year | Location of study | Clinical area | Sample: including comparators, such as network membership, or not. (Data type: including, comparators if not apparent from sample, that is, if bibliometric and/or sometimes if “dose” paper) | Level of analysis: organization or clinician | Findings: positive or negative | Improvement (scope of impact) |
|---|---|---|---|---|---|---|
| Abraham 2010 [5] | United States | Substance use disorder (SUD): alcohol disorders’ medication | 127 programmes in the Clinical Trials Network (CTN) of the National Institute on Drug Abuse (NIDA) compared with 244 not in the network. (Data: repeat interviews, including on treatments used.) | Organization | Positive | Processes (broad) |
| Abraham 2014 [49] | United States | SUD: 35 treatment services | 78 programmes in NIDA’s CTN that participated in at least one protocol compared with 78 CTN programmes that had not participated in any. (Data: interviews, including on treatments used.) | Organization | Positive | Processes (broad) |
| Alder 1978 [6] | United Kingdom | Inguinal hernia/varicose veins | A health district that hosted a randomized controlled trial (RCT) on early discharge of inguinal hernia and varicose veins patients compared with two adjacent districts that had not. (Data: retrospective, length of stay [LoS].) | Organization | Positive | Processes (specific) |
| Alotaibi 2017 [50] | Canada led; international | Intracranial aneurysm neurosurgery | 3307 patients of 147 surgeons participating in trials: 42% from the United States; 12% Canada (total 21 countries including in Africa and Central America). (Data: bibliometric [publication “quality”, as measured by H-index, not quantity] compared with retrospective analysis of trial outcomes data.) | Clinician | Positive-mixed | Outcomes (broad) |
| Andersen 2006 [7] | Denmark | Asthma: medication in general practice | 10 general practices conducting a trial on asthma medication compared to 165 non-trial practices. (Data: observational cohort study on medication used.) | Organization | Negative | N/A |
| Bennett 2012 [51] | United Kingdom | Hospital care | 147 National Health Service (NHS) hospital Trusts. (Data: bibliometric [citations/admission] compared to hospital mortality data.) | Organization | Positive | Outcomes (broad) |
| Birkmeyer 2004 [52] | United States | Cancer: surgery in various cancer sites | 27 021 patients at 51 National Cancer Institute (NCI) cancer centres compared with 36 839 patients at 51 high-volume non-NCI centres. (Data: retrospective – Medicare databases for surgical mortality and survival.) | Organization | Positive-mixed | Outcomes (broad) |
| Brown 1996 [53] | United States | Hospital care | 81 Department Veterans Affairs (VA) hospitals. (Data: retrospective – databases and VA reports on research programme size compared with LoS, costs.) | Organization | Positive | Processes (broad) |
| Carpenter 2011 [8] | United States | Cancer: breast | 3874 patients: those treated at organizations affiliated with a cancer research network, such as NCI Cooperative Groups, compared with those treated at non-affiliated organizations. (Data: retrospective, Surveillance, Epidemiology and End Results [SEER]-Medicare database – treatments, surgical volume, teaching affiliation.) | Organization | Positive | Processes (broad) |
| Carpenter 2012 [54] | United States | Cancer: colon | 1029 patients treated at NCI’s Community Clinical Oncology Program (CCOP) practices compared with 3025 at treated at non-CCOP practices. (Data: retrospective, SEER-Medicare database, for 2003–2006 data on four treatments options, see also Penn [87], who analysed same data but for 2003–2005 for just two treatment options.) | Organization | Positive | Processes (broad) |
| Chaney 2011 [9] | United States | Depression: collaborative care (in primary care) | 288 patients in 7 Veterans Affairs (VA) primary care sites that implemented a collaborative care intervention compared with 258 patients in 3 VA non-intervention primary care sites. (Data: interviews, including on evidence-based care and symptom improvement.) | Organization | Positive-mixed | Processes (specific) |
| Chen 2006 [10] | United States | Cancer: laryngeal | 31 044 patients at teaching/research facilities (including most NCI Comprehensive Cancer Programs) compared with 29 854 at community cancer centres and 13 447 at community hospitals. (Data: retrospective – National Cancer Database on use of chemoradiation.) | Organization | Positive | Processes (broad) |
| Clark 2003 [11] | Canada | Apheresis for various conditions | 22 physicians and 19 major medical centres in Canada – some involved in 3 trials of the experimental apheresis therapy, some not. (Data: retrospective, registry data on adoption of the intervention prior to and during the trials—including outside trials; repeat surveys of physicians.) | Clinician | Negative-mixed | N/A |
| Corrigan 2005 [55] | United States | New drugs in various clinical fields | 2108 physicians involved with specific phase-3 trials compared with same number not involved. (Data: retrospective, databases—matched case control on prescribing.) | Clinician | Positive | Processes (specific) |
| Das 2008 [12] | United Kingdom | Barratt’s oesophagus | 228 specialists at 107 sites (57 already in a trial): comparisons over time and between specialists at sites already enrolled and those waiting to enter. (Data: repeat surveys of specialists, including on guideline adherence.) | Clinician | Positive | Processes (specific) |
| de Arriba-Enriquez 2021 [56] | Spain | Psychiatry | The top 50 hospitals with psychiatric wards. (Data: bibliometric [range of quantitative and quality indicators per number of beds] compared with system records on quality-of-care outcomes such as readmissions.) | Organization | Positive | Outcomes (broad) |
| de Lange 2015 [57] | The Netherlands | Preterm labour: tocolysis | 6489 patients treated in 8 hospitals from 2006 to 11 – comparisons between time before, during and after some patients entered into a trial. (Data: retrospective, LoS data—Obstetric High Care registry; costs.) | Organization | Positive | Processes (specific) |
| Downing 2017 [58] | United Kingdom | Cancer: colorectal (CRC) | 209 968 patients, 150 NHS Trusts. (Data: retrospective on extent and length of participation in National Cancer Research Network CRC randomized controlled trials [RCTs] compared with outcomes, patient volume and other data.) | Organization | Positive | Outcomes (broad) |
| Du Bois 2005 [13] | Germany | Cancer: ovarian | 275 patients in 80 trial study group hospitals compared with 201 patients in 85 non-trial study group hospitals (see also Rochon [34, 94]). (Data: surveys; survival data collected up to 2 years after diagnosis, hospital patient volume data also used in multivariable analysis.) | Organization | Positive | Outcomes (broad) |
| Ducharme 2007 [14] | United States | SUD: Buprenorphine and behavioural treatments | 1006 centres’ treatment compared: some were in the NIDA’s CTN and participated in the trials; some in NIDA’s CTN and did not participate in these trials; some not in NIDA’s CTN. (For contrast—see Rieckmann [91]). (Data: panel longitudinal design, repeat interviews on treatments.) | Organization | Positive-mixed | Processes (specific) |
| Eaton 2016 [59] | United States | Cancer: lung | 495 patients in a trial by NCI’s Radiation Therapy Oncology Group (RTOG) (which became part of a wider NCI Cooperation Group): 300 in high accrual volume centres compared with 195 in low accrual centres. (Data: secondary analysis of trial data – including overall survival.) | Organization | Positive | Outcomes (broad) |
| Fanaroff 2019 [60] | United States | Cardiovascular: myocardial infarction (MI) | 453 821 patients in 430 hospitals enrolling at least 1 patient in a clinical trial compared with 138 923 patients in 336 non-trial hospitals. (Data: retrospective – registry data on outcomes, procedures, patient and hospital characteristics.) | Organization | Positive | Outcomes (broad) |
| Farquhar 2021 [61] | United States | Cancer: head and neck | 463 patients who had been in a 2002–2006 population case–control study; 39 centres: 5 NCI/VA designated academic centres and 9 community cancer centres compared with 25 non-designated community hospitals. (Data: retrospective, on volume; deaths from National Death Index.) | Organization | Positive-mixed | Outcomes (broad) |
| Fernández-Domínguez 2022 [62] | Spain | Multiple fields: physiotherapists | 419 practicing physiotherapists across Spain – survey responses on their career and role, including time spent on research, compared with their responses on evidence, including its use in practice. (Data: survey – the Health-Sciences Evidence-Based Practice questionnaire.) | Clinician | Positive | Processes (broad) |
| Fields 2016 [63] | United States | SUD: Network for the Improvement of Addiction Treatment | 458 SUD treatment centres compared: 153 NIDA CTN programmes formed one group to compare with others. (Data: retrospective—used interview data from two earlier studies including on innovations used.) | Organization | Positive | Processes (specific) |
| Fong 2020 [64] | United States | Cancer: pancreatic | 989 patients treated at NCI-designated centres compared with 2070 at Commission on Cancer (CoC)-accredited centres and 2059 at non-accredited centres. (Data: retrospective – SEER-Medicare database on treatment and survival.) | Organization | Positive | Outcomes (broad) |
| García-Romero 2017 [65] | Spain | Hospital care | 189 public hospitals – both medical and surgical specialities. (Data: bibliometric [quantity and quality] compared with retrospective hospital data including LoS through detailed statistical/econometric analysis.) | Organization | Positive | Processes (broad) |
| Gilbert 2013 [66] | United States led; international | Dental: caries | 565 practitioners in an international dental practice-based research network (PBRN) – United States led with three Scandinavian countries. (Data: repeat surveys to assess impact of level of research network participation, full or partial, on increasing evidence-based treatment.) | Clinician | Positive | Processes (broad) |
| Goldberg 2002 [15] | United States | Diabetes: primary care management | 185 patients at one family medical centre divided into 2 parallel groups for an intervention study to improve routine care. (Data: computerized database, including processes and % of patients inadequately controlled.) | Organization | Negative-mixed | N/A |
| Hall 2010 [16] | United States | Veteran rehabilitation: family care | Four sites of the VA’s Family Care Collaborative’s intervention – part of its Quality Enhancement Research Initiative; 226 rehabilitation team members – interdisciplinary. (Data: cross-site, mixed-method evaluation; surveys; practice change – before/after care scores at sites.) | Organization | Positive | Processes (specific) |
| Hébert-Croteau 1999 [17] | Canada | Cancer: breast | 682 patients admitted to hospitals involved in multicentre clinical trials compared to 577 patients admitted to non-trial hospitals. (Data: retrospective – medical charts, oncology registries: guideline adherence.) | Organization | Positive | Processes (broad) |
| Janni 2005 [18] | Germany | Cancer: breast | 198 medical centres in a very large trial which provided support such as a newsletter and study meetings to a network of participating trial centres. (Data: survey of care provided by centres before and after trial.) | Organization | Positive | Processes (specific) |
| Jha 1996 [19] | Canada | Cardiovascular: acute myocardial infarction (AMI) | 32 468 patients in two trials: comparisons between trial patients, non-trial patients at trial hospitals, and external hospitals. (Data: retrospective datasets on complicated pattern of treatments and survival.) | Organization | Positive-mixed | Outcomes (specific) |
| Jones 2000 [20] | United States | Appendectomy | 200 patients treated by 25 surgeons in a hospital where a trial had previously been conducted. (Data: retrospective on type of surgery conducted – review of patient records, survey.) | Clinician | Negative | N/A |
| Jonker 2015 [67] | United Kingdom | Hospital care | 155 English NHS Hospital Trusts. (Data: retrospective, 1 year’s data [2012–2013] of National Institute for Health Research (NIHR) research activity compared with hospital performance on the overall Care Quality Commission (CQC) risk rating.) | Organization | Negative | N/A |
| Jonker 2018 [68] | United Kingdom | Hospital care | 129 English NHS Hospital Trusts. (Data: retrospective, 5 years’ data [2012/13–2016/7] on extent of NIHR research activity per clinician compared with a hospital mortality index and overall CQC rating.) | Organization | Positive | Outcomes (broad) |
| Jonker 2021 [69] | United Kingdom | Hospital care | 129 English NHS Hospital Trusts. (Data: retrospective, 2018–19 data on extent of NIHR research activity per clinician and hospital geographical location, compared with hospital performance on mortality and CQC rating.) | Organization | Positive-mixed | Outcomes (broad) |
| Karjalainen 1989 [21] | Finland | Cancer: leukaemia | 1978 patients, 21 health districts: 17 in study area exposed to protocol, compared with 4 not exposed. (Data: retrospective – Finnish Cancer Registry for 5-year cumulative relative survival rates.) | Organization | Positive | Outcomes (specific) |
| Kirkby 2020 [70] | United Kingdom | Cardiac arrest: Emergency Medical Service providers | 498 paramedics participated in an online survey about the effect on them of being part of an RCT of interventions to manage out-of hospital-cardiac arrest. Before and after comparisons. (Data: online survey, and 19 respondent interviews, including on interventions used.) | Clinician | Positive-mixed | Processes (specific) |
| Kirwan 2014 [71] | United Kingdom | Cancer: breast | 153 patients in 5 previously high trial-recruiting hospitals compared with 43 patients in 5 low/non-recruiting hospitals in same NHS Trust. (Data: retrospective: consecutive computed tomography planning images.) | Organization | Positive | Processes (specific) |
| Kizer 1999 [22] | United States | Cardiovascular: AMI medications | 8386 patients received into 7 trials (1978–1995) compared in terms of use of medications at enrolment (therefore prescribed by physicians in routine practice) and at discharge (prescribed by physicians in RCTs). (Data: retrospective – case reports on medications prescribed.) | Clinician | Positive | Processes (broad) |
| Knudsen 2009 [23] | United States | SUD: buprenorphine | 206 treatment centres of the NIDA’s CTN compared for buprenorphine adoption: if participated in drug’s trials or not. (Data: repeat interviews with administrators, 24 months apart, including on treatments used.) | Organization | Positive | Processes (specific) |
| Laliberte 2005 [24] | United States | Cancer: breast | 16 600 patients in 423 facilities: comparing 77 facilities in two or more NCI networks, with 67 in one NCI network, and with 279 in no network. (Data: retrospective, SEER-Medicare database – guideline concordance.) | Organization | Positive | Processes (broad) |
| Levan 2014 [72] | United States | Neonate: intubation | 3849 infants, in 11 centres in a trial by National Institute of Child Health and Human Development Neonatal Research Network: the three centres that had been in a feasibility study were compared with the eight that had not. (Data: retrospective, Institute’s registry – pre-/post-trial intubation data.) | Organization | Positive-mixed | Processes (specific) |
| Lin 2018 [73] | United Kingdom | Cancer: head and neck | 465 patients in 60 hospitals who had been in an NIHR Clinical Research Network (CTN) RCT: compared those treated in hospitals recruiting low numbers to cancer trials with those treated in higher recruiting hospitals. (Data: retrospective – trial recruitment, hospital throughput, survival.) | Organization | Positive | Outcomes (broad) |
| Litjens 2013 [74] | The Netherlands | Obstetrics/gynaecology | 83 sites, 202 staff (gynaecologists, residents, nurses, midwives) who had variously participated in up to nine trials. (Data: survey of knowledge and implementation of trial findings in each site.) | Organization | Positive-mixed | Processes (specific) |
| Ljunggren 2022 [75] | Sweden | Cancer: colorectal | 3168 metastatic patients with CRC treated at university hospitals (i.e. research-active) compared with 6800 treated at non-university hospitals. (Data: retrospective – Swedish CRC database and registers data on hospital volume and type, treatment [metastatic surgery] and survival.) | Organization | Positive | Outcomes (broad) |
| Majumdar 2002 [25] | Canada led; North America | Cardiovascular: AMI medication | 25 886 patients in 659 hospitals in a trial: the 1415 patients in the 22 of those hospitals that were also in an earlier trial compared to the rest. (Data: retrospective – trial data on treatments given.) | Organization | Negative | N/A |
| Majumdar 2008 [26] | United States (led from Canada) | Cardiovascular: unstable angina | 174 062 patients in 494 hospitals; comparisons between: 123 high trial enrolment hospitals, 226 low trial enrolment, 145 no trial enrolment. (Data: retrospective – data from an observational data collection and improvement initiative on processes, in-hospital mortality, size.) | Organization | Positive | Outcomes (broad) |
| Manes 2019 [76] | United States (led from Israel) | Hospital care: 3 fields | 50 United States university hospitals: same three departments/wards in each. (Data: bibliometric [see Tchetchik [100]] compared with range of retrospective data on survival, health performance, size, staffing levels, costs, LoS.) | Organization | Positive | Outcomes (broad) |
| Marmor 2015 [77] | United States | Hematopoietic cell transplantation | 12 993 transplants conducted in 162 centres: compared 24 non-certified centres; 106 certified by a Foundation; and 32 certified by the Foundation and the Blood and Marrow Transplant clinical trials network. (Data: retrospective, from relevant databases: processes and outcomes.) | Organization | Positive | Outcomes (broad) |
| McBride 2013 [78] | United States | Dental treatments | 950 dental practitioners, most members of one of three dental PBRNs: 378 full network participants compared with 346 partial network participants and 226 inactive or non-members. (Data: survey of practice patterns.) | Clinician | Positive | Processes (broad) |
| McCarthy 2015 [79] | United States | Cardiovascular: aortic valve | 5009 patients who underwent transcatheter aortic valve replacement at 68 hospitals that had participated in clinical trials compared with 1392 patients treated at 140 non-trial hospitals. (Data: retrospective, Medicare data including on mortality.) | Organization | Negative | N/A |
| McDaniels-Davidson 2022 [80] | United States | Cancer: cervical | 1395 women in California treated at NCI designated cancer centres compared with 2855 treated other locations in California. (Data: retrospective, California Cancer Registry data – death, guideline-concordant treatment.) | Organization | Positive | Outcomes (broad) |
| Meineche-Schmidt 2006 [27] | Denmark | Gastro-oesophageal reflux: primary care treatment | 1206 patients enrolled by 122 General practitioners (GPs) (some in earlier trial, some not) in study on the impact of participation in first trial. (Data: prospective – observational study including of treatments given.) | Clinician | Positive | Processes (specific) |
| Merkow 2014 [81] | United States | Cancer care | 56 NCI-designated cancer centres compared with 1112 CoC-accredited centres and 2395 non-accredited hospitals. (Data: retrospective, Medicare and American Hospital Association – range of process, outcome and cost measures.) | Organization | Negative | N/A |
| Meyer 2013 [82] | United States | Cancer: breast surgery | 874 patients of CCOP physicians compared with 16 303 patients of non-CCOP physicians. (Data: retrospective: SEER-Medicare database on level of sentinel lymph node biopsy.) | Clinician | Positive | Processes (broad) |
| Mold 2014 [83] | United States | Renal: chronic disease | 711 patients in 31 primary care practices in 4 primary care PBRNs in first wave; 1179 patients in 58 practices in the PBRNs in second wave. (Data: prospective intervention study; before/after measures of guideline use.) | Organization | Positive | Processes (specific) |
| Morton 2006 [28] | Australia | Sexual health | 100 patients of 21 clinicians: high recruiters into a relevant trial compared with low recruiters. (Data: retrospective – case notes of clinicians’ practice.) | Clinician | Positive-mixed | Processes (specific) |
| Murimwa 2023 [84] | United States | Cancer: pancreatic | 3300 patients at four NCI-designated cancer centres in Texas compared with 8969 patients at CoC centres, 1087 at safety net hospitals and 3715 no-designation hospitals; high/low volume hospitals also compared. (Data: retrospective, Texas cancer registry – guideline concordance; survival.) | Organization | Positive | Outcomes (broad) |
| Ozdemir 2015 [85] | United Kingdom | Acute care | 2 349 160 patients, 140 NHS Trusts: 35 low mortality Trusts, 63 expected level of mortality Trusts, 42 high mortality Trusts. (Data: retrospective, NIHR [Comprehensive] CRN funding/bed compared with outcomes, size, staffing, teaching, etc.) | Organization | Positive | Outcomes (broad) |
| Pancorbo-Hidalgo 2007 [29] | Spain | Pressure ulcer nursing care | 713 nurses responded to the research activity part of a wider survey: the 138 research active nurses compared with the 575 who were not. (Data: survey, including of level of guideline implementation.) | Clinician | Positive | Processes (broad) |
| Paulson 2008 [86] | United States | Cancer: colorectal surgery | 1299 patients treated at NCI designated cancer centres compared with 41 262 patients at non-NCI designated hospitals – some high volume. (Data: retrospective: SEER-Medicare database for outcomes, volume.) | Organization | Positive | Outcomes (broad) |
| Penn 2015 [87] | United States | Cancer: colon | 875 CCOP patients, 2096 non-CCOP; four groups compared: African Americans or Caucasian Americans; treated by CCOP or non-CCOP. (Data: retrospective, SEER-Medicare database, for 2003–2005 data on the use of two drugs, rather than the 2003–2006 use of the four treatment options in Carpenter, 2012 [54].) | Organization | Positive-mixed | Processes (broad) |
| Pons 2010 [30] | Spain | Cardiovascular: AMI; congestive heart failure | 50 acute hospitals voluntarily participating in a quality initiative and with more than 5 citable heart disease papers 1996–2004. (Data: bibliometric [citation measures] compared with retrospective hospital morality data.) | Organization | Positive | Outcomes (broad) |
| Prendergast 2018 [88] | South Africa-led; international | Rheumatic heart disease | 22 project sites across Africa (including in South Africa, Egypt, Ethiopia, Kenya, Mozambique, Nigeria, Rwanda, Sudan, Uganda, Zambia) and Yemen in a prospective, multi-centre project. (Data: survey and interview—trial participation impact on patient management.) | Organization | Positive | Processes (specific) |
| Puoane 2004 [31] | South Africa | Severe child malnourishment: participatory research, nurse-led in hospitals | 98 admissions in 2 rural hospital settings for a participatory “pre- and post-intervention descriptive study”. (Data: retrospective record review, including of fatality rates; structured observations; in-depth interviews; focus group discussions with nursing and medical staff.) | Organization | Positive-mixed | Outcomes (specific) |
| Rai 2017 [89] | United States | Cancer: lymphoma | 3490 patients of NCI cooperative group-affiliated institutions compared with 2222 patients of non-affiliated institutions. (Data: retrospective: SEER-Medicare database on treatment patterns.) | Organization | Positive | Processes (broad) |
| Rhyne 2011 [32] | United States | Diabetes: acanthosis nigricans | 145 clinicians who participated in two PBRN trials. (Data: practice change since trials: short-term post-trial survey and 16 interviews for one trial; long-term post-trial surveys for other trial.) | Clinician | Positive | Processes (specific) |
| Rich 2011 [33] | United Kingdom | Cancer: small-cell lung | 7845 patients in trusts in National Cancer Research Network: 2524 patients in trusts recruiting higher numbers into trials compared to 5321 patients in lower recruiting ones. (Data: retrospective, databases including research network; data on use of chemotherapy and survival.) | Organization | Positive-mixed | Processes (broad) |
| Rieckmann 2014 [90] | United States | SUD: buprenorphine | 922 counsellors from 172 NIDA CTN-affiliated programmes compared with 1203 counsellors from 251 non-CTN-affiliated programmes. (Data: survey of counsellors, interviews with administrators on the drug’s use.) | Clinician | Positive | Processes (broad) |
| Rieckmann 2016 [91] | United States | SUD: motivational interviewing | 156 CTN affiliated programmes compared with 345 non-affiliated programmes for a different type of behavioural treatment to one where Ducharme et al. [14] reported no benefit from CTN affiliation. (Data: interviews on the use of a behavioural treatment.) | Organization | Positive | Processes (broad) |
| Rindal 2014 [92] | United States | Dental: caries | 103 235 treatments between 2005 and 11 provided by 35 dentists in one multi-clinic dental group who had variable levels of engagement in the National Dental PBRN, or no involvement. (Data: natural experiment, retrospective – dental database for use of evidence-based treatments.) | Clinician | Positive | Processes (broad) |
| Robinson 2019 [93] | United Kingdom | Stroke: thrombolysis | 774 patients recruited in the United Kingdom to an international trial: 502 by 9 high-volume, well-resourced NIHR CRN Hyperacute Stroke Research Centres compared with 272 patients recruited to 24 other United Kingdom NIHR CRN sites. (Data: retrospective, trial endpoint on death or disability at 90 days.) | Organization | Positive-mixed | Outcomes (broad) |
| Rochon 2011 [34] | Germany | Cancer: ovarian | 275 patients in 80 cooperative trial study group hospitals compared with 201 patients in 85 non-trial study group hospitals. (Data: surveys; third year survival data collected, adding to data in Du Bois, 2005 [13].) | Organization | Positive | Outcomes (broad) |
| Rochon 2014 [94] | Germany | Cancer: ovarian | 219 patients with advanced cancer treated at trial study group hospitals compared with 133 treated at non-trial study group hospitals. (Data: mediation analysis of retrospective data on survival – this subset of the patient data in Rochon [34] focusses solely on advanced cancer.) | Organization | Positive | Outcomes (broad) |
| Salbach 2010 [35] | Canada | Stroke: physical therapist rehabilitation | 270 physical therapists returned a completed survey that could be used: 86 had participated in research compared with 182 who said they had not. (Data: cross-sectional mail survey, including on implementing evidence.) | Clinician | Positive | Processes (broad) |
| Salge 2009 [95] | United Kingdom | Acute care | 173 NHS Trusts. (Data: bibliometric [quantity of publications per staff member] and research and development grants/projects [collectively called science-based innovativeness] compared with retrospective data from a range of sources on mortality, size, etc. [collectively called organizational performance].) | Organization | Positive | Outcomes (broad) |
| Seaburg 2016 [96] | United States | Internal medicine | 308 Mayo Clinic resident physicians. (Data: bibliometric [publications’ quantity] compared with multi-source clinical performance evaluations.) | Clinician | Positive | Processes (broad) |
| Shahian 2022 [40] | United States | Acute care hospitals: multiple care areas | 1604 acute care hospitals, which was a random 40% of 4008 Medicare-participating hospitals; the hospitals were divided into three groups by total number of staff publications: > 46, 1–46 or 0. (Data: bibliometric [quantity and quality] compared with retrospective data including on mortality in five major fields, size, teaching, region.) | Organization | Positive | Outcomes (broad) |
| Shen 2022 [97] | China | Hospital care | 111 965 hospitalizations (random 20% from the Insurance scheme data) treated by 5794 physicians in a Chinese city’s 38 teaching hospitals. (Data: bibliometric [various quantitative and other measures of types of publications] compared with retrospective 30-day readmission data.) | Clinician | Positive-mixed | Outcomes (broad) |
| Siegel 2006 [36] | United States | Ear, nose and throat (ENT): otitis media | 17 practitioners from 11 practices who had been involved in a PBRN study compared with 18 practitioners who had not been involved. (Data: survey of prescribing in the year before and year after the trial.) | Clinician | Positive | Processes (specific) |
| Siracuse 2021 [98] | United States | Chronic limb threatening ischemia (CLI) | 9 231 909 CLI patients in the four US regions: participation rates in a relevant ongoing major trial compared with those regions’ total amputation rates. (Data: retrospective – Medicare on number of amputations and ongoing trial database on participation rates.) | Organization | Positive | Outcomes (broad) |
| Tan 2015 [99] | United States | Cancer: kidney | 1578 CCOP treated patients compared with 4316 non-CCOP treated patients (some non-CCOP patients were treated at other NCI centres). (Data: retrospective: SEER-Medicare database on surgical technologies.) | Organization | Negative-mixed | N/A |
| Tchetchik 2015 [100] | United States (led from Israel) | Hospital care: three fields | 50 university hospitals – same three departments in each, 4330 physicians. (Data: bibliometric measures [quality more than quantity] [as used in Manes [76]] compared with retrospective data: survival, care quality, etc.) | Organization | Positive | Outcomes (broad) |
| Trusson 2019 [101] | United Kingdom | Healthcare: nurses, midwives and Allied Health Professionals | 67 members of the NIHR’s East Midlands Clinical Academic Practitioner network identified how research engagement led to patient benefits etc. – implicitly compared with time before their research engagement. (Data: survey and 16 interviews – self-selected and snowball sampling.) | Clinician | Positive | Processes (specific) |
| Tsang 2015 [102] | United Kingdom | Cancer: breast radiotherapy | 26 sites of trial where National Radiotherapy Trials Quality Assurance Group assisted with adherence to components of trial protocol. (Data: survey of 26 sites to compare before/after, plus earlier Royal College of Radiologists audit of 1386 patients – in 13 trial sites and 37 non-trial.) | Organization | Positive | Processes (specific) |
| Tsang 2022 [103] | Canada | Pneumonia: probiotics prevention trial | 2203 patients in 34 academic/research hospitals in a trial compared to 352 patients in 7 community, not research, hospitals. (Data: pre-planned observational study nested in main trial – data on patient demographics, interventions, outcomes [mortality] and trial metrics.) | Organization | Positive | Outcomes (broad) |
| van der Tuuk 2011 [104] | The Netherlands | Obstetrics: eclampsia | 24 709 women delivered at 38 hospitals participating in a trial compared with 18 839 women at 55 non-participating hospitals before, during and after the trial. (Data: retrospective, Perinatal Registry – patient-records on patient management and prevalence of eclampsia.) | Organization | Positive | Outcomes (specific) |
| Venables 2012 [105] | United Kingdom | Cancer: breast radiotherapy | 51 sites of 7 trials involving the National Radiotherapy Trials Quality Assurance Group over 15 years asked about trial-linked processes. (Data: series of pre-trial and other surveys to facilitate comparisons over time on how trials/protocols help implementation of new techniques.) | Organization | Positive | Processes (specific) |
| Warnecke 1995 [37] | United States | Cancer: breast | 11 450 records from two evaluations: CCOP physicians in 66 hospitals compared with 24 non-CCOP hospitals in first evaluation, fewer in second. (Data: retrospective, hospital records and SEER registry—treatments.) | Clinician | Positive | Processes (specific) |
| Wolfson 2015 [106] | United States | Cancer: 8 adult-onset cancers | 4428 patients with cancer at three NCI-designated centres in Los Angeles County compared with 65 151 at non-NCI sites. (Data: retrospective, county cancer registry – data on survival, case-mix and race/socioeconomic status, which used to assess access equity.) | Organization | Positive | Outcomes (broad) |
| Wuthrick 2014 [107] | United States | Cancer: head and neck | 471 patients in RTOG’s chemoradiation trial: 150 in 13 historically high accrual centres compared with 321 in 88 historically low centres. (Data: retrospective: secondary analysis of trial data on processes/outcomes.) | Organization | Positive | Outcomes (broad) |
| Yawn 2010 [108] | United States | Mental health: depression | 28 practices, 48 trial-site leaders (e.g. 27 family practitioners and 6 nurses) who participating in a PBRN postpartum depression study. (Data: interviews during trial comparing mid-trial processes to previous ones.) | Organization | Positive | Processes (specific) |
| Young 2016 [109] | Australia | ENT: child (speech therapy) | 653 children in New South Wales Aboriginal health services received enhanced clinical care compared with baseline (including 5822 speech-language pathology sessions) through a research collaboration. (Data: case study evaluation – prospective interviews/service delivery data.) | Organization | Positive | Processes (specific) |
Papers in italics mean they are an original review paper. Papers not in italics mean they are an updated review paper.
AMI acute myocardial infarction, CQC Care Quality Commission, CLI chronic limb threatening ischemia, CRN Clinical Research Network, CTN Clinical Trials Network, CRC colorectal cancer, CoC Commission on Cancer, CCOP Community Clinical Oncology Program, ENT ear, nose and throat, GPs general practitioners, LoS length of stay, MI myocardial infarction, NCI National Cancer Institute, NHS National Health Service, NIHR National Institute for Health (and Care) Research, NIDA National Institute on Drug Abuse, PBRN practice-based research network, RTOG Radiation Therapy Oncology Group, RCTs randomized controlled trials, SUD substance use disorder, R&D research and development, SEER Surveillance, Epidemiology and End Results, VA (Department of) Veterans Affairs