Abstract
Objective
To develop a core outcome set for international burn research.
Design
Development and international consensus, from April 2017 to November 2019.
Methods
Candidate outcomes were identified from systematic reviews and stakeholder interviews. Through a Delphi survey, international clinicians, researchers, and UK patients prioritised outcomes. Anonymised feedback aimed to achieve consensus. Pre-defined criteria for retaining outcomes were agreed. A consensus meeting with voting was held to finalise the core outcome set.
Results
Data source examination identified 1021 unique outcomes grouped into 88 candidate outcomes. Stakeholders in round 1 of the survey, included 668 health professionals from 77 countries (18% from low or low middle income countries) and 126 UK patients or carers. After round 1, one outcome was discarded, and 13 new outcomes added. After round 2, 69 items were discarded, leaving 31 outcomes for the consensus meeting. Outcome merging and voting, in two rounds, with prespecified thresholds agreed seven core outcomes: death, specified complications, ability to do daily tasks, wound healing, neuropathic pain and itch, psychological wellbeing, and return to school or work.
Conclusions
This core outcome set caters for global burn research, and future trials are recommended to include measures of these outcomes.
Keywords: Qualitative research; Quality of health care; Surgery, plastic; Wounds and injuries; Specialties, surgical
What is already known on this topic
Outcomes reported in trials of burn care interventions are heterogeneous and limit evidence synthesis
What this study adds
This study shows agreement to seven core outcomes to be reported in all burn care trials
How this study might affect research, practice, or policy
Agreeing outcome measures and implementing the burn core outcome set will enable improved synthesis of research to reduce research waste and to support clinical decision making in global burn care
Introduction
The provision of evidence to support clinical decision making relies on data from randomised and non-randomised trials to inform systematic reviews.1 2 Systematic reviews aim to collate all available high quality empirical evidence to produce conclusions.3 One issue that challenges evidence synthesis, is the variation in outcome reporting across trials—outcome reporting heterogeneity.4 5 Outcome reporting heterogeneity can be defined as "the reporting of multiple unique outcomes across trials within one healthcare condition,"6 and makes an evidence base difficult to synthesise accurately.7 8 Burn care systematic reviewers have reported difficulty combining evidence owing to outcome reporting heterogeneity.9–11 The limitation is important in burn care—despite high numbers of patients globally (annual incidence 11 million),12 clinical uncertainty regarding optimal management persists.
An agreed minimum set of the most important outcomes is needed to standardise, but not restrict, outcome reporting in burn care research through the development of a core outcome set.5 A core outcome set is a group of outcomes to be reported in all trials of a specific condition.5 These core outcomes are identified scientifically by stakeholders as being the most important in determining the effects of an intervention or treatment.13 14 Outcomes need to be relevant to all stakeholders, highlighting a need for joint decision making in outcome choice. Shared decision making is "a process in which clinicians and patients work together to select tests, treatments, management or support packages, based on clinical evidence and the patient’s informed preferences" (https://www.nice.org.uk/Media/Default/About/what-we-do/SDM-consensus-statement.pdf). The impact of shared decision making on outcome quality has been studied.15 16 Without similar shared decision making in outcome choice, there is a risk that trial data will be based on outcomes that might not be the most important to patients.
Once a core outcome set is agreed, all future trials of that condition should include the outcome set as a minimum.13 Development and use of core outcome sets in burn care trials will simplify evidence synthesis, allowing increased use of research data, increased research relevance, reduced research waste, and ultimately increased evidence based decision making and reduction in clinical practice variation. The aim of this study is to develop an international core outcome set for burn care research using shared decision making.
Methods
The study ran from April 2017 to November 2019. The Core Outcome Set in Burn Care Research international (COSB-i) was registered on the Core Outcome Measures in Effectiveness Trials (COMET) database (http://www.comet-initiative.org/Studies/Details/798). It has been developed using standards of core outcome sets for development (COS-STAD) and reported in accordance with the Core Outcome Set-STAndards for Reporting (COS-STAR).17 18 The protocol has been published.19 Three changes to the protocol are explained. The systematic review of clinical outcomes reported in randomised controlled trials of burn care interventions, was registered on PROSPERO (CRD42017060908 https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42017060908) and is published.20
This core outcome set is intended for use in all research studies comparing interventions for the treatment of adults and children with burns, including surgical and non-surgical management, regardless of the cause or severity of the burn, healthcare setting, or mode of intervention use, and can be used across countries of all World Bank income groups.
Development of COSB-i involved three phases: generation of a comprehensive long list of outcomes informing a survey questionnaire, a Delphi survey involving two questionnaire rounds to gain consensus on the most important outcomes, and a consensus meeting to agree the final core outcome set. The process was overseen by an independently chaired steering group based in the UK. This group comprised of three adult patients with burns and a parent of a child with a burn, two burn researchers, three researchers of core outcome sets, one Cochrane wounds group representative, three burn surgeons, a burn nurse, a psychologist, a occupational therapist, and the UK burn database chair. The committee was chaired by an independent methodologist of core outcome sets (JK).
After discussions with the National Institute for Health Research at a meeting in Bristol in January 2017, it was decided to internationalise the core outcome set, for reasons including the global incidence of burn injury. A broad range of Delphi survey professional participants, from as many disciplines and countries of varying income status as possible, were included.
Phase 1: generation of a long list of outcomes and a survey questionnaire
Outcomes were identified from three sources20–22; a systematic review of clinical outcomes reported in randomised controlled trials, semi-structured interviews with patients and clinical staff, and two published systematic reviews on patient reported outcomes in burn care (table 1).
Table 1.
Identification of burn clinical outcomes allocated to domains from three information sources
| Domain of burn outcome | Count of systematic review clinical outcomes (n=993) | Count of interview outcomes (n=149) | Count of patient reported outcomes (n=45) |
| Ability to carry out daily tasks | 1 | 9 | 3 |
| Ability to fight infection | 37 | — | — |
| Adherence to treatment | — | — | 1 |
| Anxiety about medical procedures | 4 | 1 | 1 |
| Appearance | 3 | 14 | 3 |
| Blister fluid | 3 | 1 | — |
| Blood transfusion | 11 | — | — |
| Body temperature issues | — | 1 | 1 |
| Bone strength | 30 | — | — |
| Breathing and lungs | 27 | 2 | — |
| Bullying | — | 4 | 1 |
| Burden of care for patients or carers | 7 | 15 | 1 |
| Burn smell | — | 1 | — |
| Burn wound healing | 144 | 7 | — |
| Burn wound infection | 79 | 2 | — |
| Burn wound pain | 29 | 4 | 2 |
| Comfort of dressings | 1 | 2 | — |
| Complications of treatment | 52 | 4 | — |
| Costs of treatment for NHS/hospital | 14 | — | — |
| Death from any cause | 14 | 1 | — |
| Death from burn injury | 1 | — | — |
| Dignity | — | 1 | — |
| Donor site healing | 9 | — | — |
| Donor site infection | 1 | — | — |
| Donor site outcomes | 1 | 1 | — |
| Donor site pain | 6 | 1 | — |
| Donor site problems after healing | 23 | — | — |
| Effect of burn on genes | 1 | — | — |
| Effect of burn on how the body uses energy | 2 | — | — |
| Effect of scar on movement | 3 | 3 | — |
| Effect on heart and blood circulation | 1 | — | — |
| Effects of fluid from a drip | 17 | — | — |
| Fitness | 12 | 3 | — |
| Generalised anxiety | 1 | 5 | 2 |
| Growth after injury | 10 | 1 | — |
| Hair loss | — | 1 | — |
| Heart and blood circulation | 28 | — | — |
| How well muscles work | 9 | — | 6 |
| Infections other than burn wound infection | 7 | — | — |
| Itch | 24 | 3 | 2 |
| Kidney function | 17 | — | — |
| Length of hospital stay | 7 | 4 | — |
| Length of stay in intensive care unit | 3 | 1 | — |
| Length of time on breathing machine | 1 | — | — |
| Liver function | 11 | — | — |
| Maintenance of body weight | 26 | — | — |
| Medical tests to indicate how unwell a patient is | 82 | — | — |
| Mental ability | 2 | 1 | — |
| Mobility | 22 | 3 | 3 |
| More than one organ failing | 7 | — | — |
| Muscle strength | 30 | — | — |
| Pain during procedures | 14 | 1 | — |
| Personal cost for patient | — | 1 | — |
| Psychological wellbeing | 1 | 15 | 7 |
| Quality and quantity of sleep | 17 | 1 | — |
| Relationships | — | 8 | 8 |
| Return to work or school, or previous function | 1 | 2 | 3 |
| Scar colour | 25 | 1 | — |
| Scar pain | 13 | 3 | — |
| Scar size | 1 | — | — |
| Scar texture | 46 | 1 | — |
| Sepsis | 7 | — | — |
| Skin graft healing | 21 | — | — |
| Stomach and bowel function | 13 | 5 | — |
| Thirst | — | 1 | — |
| Treatment for scars | 2 | 10 | — |
| Understanding of planned care | — | 3 | — |
| Use of medicines to treat symptoms | 12 | 1 | 1 |
Systematic literature review of clinical outcomes in burn randomised controlled trials were identified by electronic searches of four search engines from January 2012 to December 2016. Searches included trials using medical subject headings and free text terms including "burn," "scald," "thermal injury," and "RCT." Outcomes were classified into domains. Detailed methodology is published elsewhere.20
Semi-structured interviews were conducted to identify burn outcomes considered important by multidisciplinary burn professionals and patients or carers. Interviews were conducted with 10 burn care clinical staff (one consultant, three nurses, four therapists, and two others), 14 adult patients, and one child and parent combination, at different times after injury. Sample size was determined by data saturation, with purposive sampling to achieve diversity.19 The interviews were audio recorded with consent and transcribed verbatim. Interviews were guided by a topic guide that centred around recovery outcomes affected by healthcare treatment and issues affecting daily life after injury. Analysis used NVivo software. Thematic analysis was conducted by one researcher, with a second researcher reviewing codes and agreeing outcome domains. Domains were defined as broad concepts that group similar outcomes together.23
Patient reported outcomes were extracted from two systematic reviews21 22 reporting generic and burn specific tools. Most generic measures had been validated with adults from the general population, and were unlikely to be sufficiently sensitive to identify health outcome changes in a burn population.24 We decided to use outcome domains from tools for patient reported outcomes related to burns. In the review of patient reported outcomes in child and adolescent burn research, 31 tools were generic, and one was specific to burns. The Children’s Burn Outcomes Questionnaire was designed for patients aged 11-18 years.25 In the systematic review assessing patient reported outcomes in adult burn care, 71 tools were generic and six were specific to burns, of which four had been validated in English. BSHS-A is an abbreviated version of the Burn Specific Health Scale assessing quality of life after a burn.26 BSHS-B is an abbreviated version of the BSHS-A and the BSHS-R (revised).27 28 The Young Adult Burn outcome Questionnaire (YABOQ) measures health outcomes in young burned adults.29 BSPAS-A measures anxiety related to pain during or after burn treatment and is a short version of the Burn Specific Pain Anxiety Scale.30 We extracted the outcome domains from the five tools.
To develop the questionnaire, outcome domains were initially created from the systematic review of clinical outcomes supplemented by domains from the interviews and data of patient reported outcomes.20 Two researchers carried out this process independently and met to discuss the results. A patient and burns nurse assisted in agreeing the outcome de-duplication and subsequent outcome terms extracted from three sources, categorising the outcomes into domains and agreeing domain names. This change to the protocol stated that two patients would undertake this role. The authors and steering group agreed that a research nurse not involved in the project would give independent advice and complement that from the patient. Domains were added to questionnaire items for the survey. The Delphi questionnaire survey was piloted through cognitive interviews with six parents and with adults and young people who reviewed the survey, to assess usability, face validity, and acceptability. The survey was modified as a result of feedback.
We uploaded the final questionnaire survey onto a specifically designed Research Electronic Data CAPture (REDCap) database, with weblinks to the consent, personal characteristics questions, and questionnaire outcome items. REDCap (https://www.project-redcap.org/) is a secure, web based software platform designed to provide an interface for validated data capture.
Phase 2: prioritisation of outcomes through a Delphi questionnaire survey
Delphi survey participants were multidisciplinary international clinical staff working with burn patients, burn researchers, UK burns patients aged 10 years or older, and carers of children with burns of any age. Patients and carers were identified through four NHS burn services, support groups, and social media. Methods to identify international professional participants included communication via ResearchGate (https://www.researchgate.net/), international professional burn organisations, international burn charities, social media, key country collaborators, and personal email through the authors’ own international contacts.
Information was provided through a plain English video devised as part of the study (https://www.youtube.com/watch?v=9DYH072uPrQ). For each included questionnaire item (outcome), a 9 point, Likert type response scale was provided (1-3 was not important, 4-6 important but not vital, and 7-9 very important). A zero option was provided to indicate no opinion (eg, no experience of the condition illustrated). Following feedback, we used a coloured traffic light spectrum to facilitate comprehension among young people. At the end of round 1, an option was provided to allow additional outcomes to be suggested. All participants who had completed round 1 were emailed a personalised link to round 2 on the REDCap database. During round 2, participants were shown the distribution of scores for each stakeholder group (alongside the median overall score) for each outcome, with their own score from round 1 and asked to score the outcome again, using the same 1-9 Likert scale and taking this information into consideration (figure 1). No agreed sample size guidelines for numbers of participants currently exist for consensus methods when developing a core outcome set. We aimed to recruit 150 UK patients or carers, and 200 clinical staff and researchers.
Figure 1.

Delphi survey round 2 feedback
Study data were collected and managed using REDCap.31 We considered participants to be any individual completing both the consent form and rating at least one survey item. For item ratings, any completed datapoint was included. For each item, the following summary data were produced: number of participants completing; statistical measures (mean and standard deviation, median and interquartile range); and number and percentage of participants rating the item as 1-3, 4-6, and 7-9. Items rated as 0 (no opinion) were excluded from the data. Data were tabulated for the overall sample and according to stakeholder group, whereby participants were grouped as clinical staff (including researchers) or patients/carers.
Predefined criteria for progression of items to round 2 and consensus meeting were agreed by the steering group, were based on previous core outcome work, and were explicit in the protocol.19 For progression to round 2, at least 50% of the sample (or of either stakeholder group) needed to rate the item a score of 7-9. More stringent criteria were applied for items to carry through to the consensus meeting; items needed to be rated 8-9 by more than 70% of the participant sample. We assessed attrition between rounds by median and mean survey scores at round 1, comparing those participants who did with did not complete both rounds. Mann Whitney U tests were used. The significance level was set at P<0.05.
Phase 3: consensus meeting
A consensus meeting was held in London, UK, on 9 October 2019. An independent chair was appointed from a burn research charity (Charlotte Coates, Scar Free Foundation https://scarfree.org.uk/). Clinical staff or patient or carer participants who had completed round 2 of the survey were invited, attending in person or by video conference call. We used online voting software (https://turningtechnologies.com) to enable remote voting. Before voting, a discussion was conducted by the independent chair, to agree questionnaire items (from now on called outcomes) that were similar and could be combined.
Outcomes were voted in or out with real time results shown to participants as a histogram. Two rounds of voting were undertaken. After the first voting round, outcomes with >50% of participants rating it in to include were carried through to the next round. For the second round, a more stringent criterion of >60% of the sample rating it as important to include in the core outcome set (voted in), was used to select items to include in the final set.
Patient and public involvement
Patients and carers were involved in designing the study protocol and patient information, through participation in the steering group, interviews to inform the long list of core outcomes, participation in the Delphi survey and consensus meeting, and in ongoing dissemination.
Results
A summary of the outcome selection into the final process for the core outcome set is shown in figure 2.
Figure 2.
Flow chart for the Core Outcome Set in Burn Care Research international (COSB-i)
Phase 1: generation of outcome long list and survey questionnaire
Examination of all data sources identified 1149 outcomes, which after de-duplication left 1021 unique outcomes that were grouped into 68 outcome domains. Additional domains were added for those patient reported outcomes and interview data that did not fit into the existing set of 68. This resulted in 88 questionnaire items (outcomes) constructed for round 1 of the survey.
Phase 2: prioritisation of outcomes through Delphi questionnaire survey
In round 1 of the survey, 668 (84%) participants were international clinical staff or researchers and 126 (15%) were UK patients or carers. Clinical participants’ personal characteristics for rounds 1 and 2 are in table 2. For round 1, clinical participants originated from 77 countries and five continents. Of these, 120 (18%) came from lower middle and lower income countries. Of the clinical staff, 303 (45%) were doctors, 158 (24%) were allied health professionals, 100 (15%) were nurses, and 88 (13%) were burn researchers. Of the patients, 97 (77%) were adults, 28 (22%) were carers of a child with a burn injury, and one was a young person (11 years) (1%). Eighty (63%) patients were of white British origin, and 52 (41%) had a university education. The mean time since injury in the children of carers who responded was 5.5 years (standard deviation 10.7), and 12.8 years (15.3) for adult patients.
Table 2.
Personal characteristics of clinical staff participants in Delphi survey rounds 1 and 2
| Survey round 1 (n=668) | Survey round 2 (n=378) | |
| Clinical staff occupation | ||
| Doctors | ||
| Consultant in burn care (burn surgeon, plastic surgeon, paediatrician, trauma, pain specialist) | 173 (25.9) | 87 (23.0) |
| Anaesthetist or intensivist | 84 (12.6) | 46 (12.0) |
| Pathologist | 1 (0.2) | 0 |
| General practitioner | 2 (0.3) | 2 (0.5) |
| Junior doctor or registrar | 43 (6.4) | 21 (5.6) |
| Medical student | 1 (0.2) | 1 (0.3) |
| Allied health professional | ||
| Burn allied health professional (physiotherapist, occupational therapist, dietician, psychologist, play, speech and language, laser technician, social worker. | 158 (23.7) | 97 (25.7) |
| Paramedic | 2 (0.3) | 2 (0.5) |
| Nursing | ||
| Burn care nurse, research nurse, or theatre nurse | 100 (15.0) | 56 (14.8) |
| Researchers | ||
| Burn researcher | 88 (13.2) | 58 (15.3) |
| Other | ||
| Burn charity | 1 (0.2) | 1 (0.3) |
| Commercial | 1 (0.2) | 1 (0.3) |
| Burn commissioner or service manager | 2 (0.3) | 2 (0.5) |
| Medical education | 4 (0.6) | 2 (0.5) |
| UK National Institute for Health and Care Research | 1 (0.2) | 1 (0.3) |
| Not stated | 5 (0.7) | 1 (0.3) |
| Time spent in burn care | ||
| 6-12 months | 45 (6.7) | 18 (4.8) |
| >1-3 years | 76 (11.4) | 36 (9.5) |
| >3-5 years | 77 (11.5) | 44 (11.6) |
| >5 years | 466 (69.8) | 278 (73.5) |
| Not stated | 4 (0.6) | 2 (0.5) |
| World Bank income group | ||
| High income country | 473 (70.8) | 306 (81.0) |
| Upper middle income country | 71 (10.6) | 32 (8.5) |
| Low middle income country | 95 (14.2) | 26 (6.9) |
| Low income country | 25 (3.7) | 12 (3.2) |
| Missing data | 4 (0.6) | 2 (0.5) |
Of all 88 items in round 1, 85 were rated as very important (survey score 7-9) by at least 50% of the sample. Two items did not reach the threshold (thirst, smell of the burn). More than 50% of the patients and carers independently rated these items as very important (7-9), so they were carried through to round 2. One item did not reach the 50% threshold for the overall sample, for either group (mild complications), and was removed. Thirteen new outcomes were suggested and added. One hundred items formed the round 2 survey (figure 2).
Of those participating in round 1, 431 participants (54.3%) undertook round 2. Of all participants in round 2, 53 were patients or carers (42.1% of those completing round 1), and 378 were clinical staff (56.6% of those completing round 1). Details of those completing both rounds, or only round 1, were similar (table 2). Analyses examining differences in outcome ratings between participants who completed round 1 only or rounds 1 and 2 indicated that 24 outcomes were significantly different at P<0.05. However, closer inspection indicated minimal differences between the medians and means for these outcomes; these small differences are unlikely to have substantially affected the outcomes that met the criteria.
Of all the questionnaire items, 31 reached the threshold to be carried through to the consensus meeting, of which 20 had been voted survey scores 8-9 by >70% of all participants combined (ie, clinical staff plus patients or carers). An additional 11 outcomes were voted as more than 8-9 by >70% of either patients or clinical staff. In a change to the protocol, because strong consensus had been achieved through the two Delphi survey rounds, we considered a third survey round to be unnecessary. The raw data and codebook are available through the Dryad repository.32
Phase 3: consensus meeting to agree final core outcome set
The consensus meeting was attended by 28 UK clinical staff and patients, and 19 international clinical staff joined by teleconference. A discussion, chaired independently, was undertaken with participants to determine outcomes that could be pragmatically combined owing to similarity in meaning. Discussion identified overlap between nine outcomes. Agreement was reached to combine specific items; death due to the burn with death from other causes, multiorgan failure and multiorgan dysfunction into organ dysfunction, kidney and lung dysfunction into organ dysfunction, length of stay in intensive care with length of time on a ventilator, anxiety with psychological impact into psychological wellbeing, procedural and background pain into acute pain, and scar pain with itch into neuropathic pain, to group specified complications under one heading with the inclusion of sepsis, wound infection, and thrombosis, and to incorporate burn wound, grafted wound, and donor site healing into burn wound healing. Combining outcomes resulted in 17 outcomes on which to vote.
Of the 17 outcomes voted in on round 1, outcomes with at least 50% of participants stating that they should be included were identified, resulting in five outcomes being removed before round 2. Of the 12 items voted on in round 2, seven reached the criteria to be included in the final core outcome set. These seven outcomes were agreed to represent the final set for burn care research and are shown in box 1.
Box 1. Final Core Outcome Set in Burn Care Research international (COSB-i).
Death from the burn or any cause
Prespecified serious complications or adverse events; for example, sepsis, wound infection, and thrombotic events
Ability to do daily tasks
Time to wound healing, including that of grafted and donor site wounds
Long term (after healing) neuropathic pain and itch
Psychological wellbeing
Time to return to work, school, or previous occupation
Discussion
Principal findings
International burn care is inconsistent, resulting in varying healthcare outcomes. Increased, high quality, synthesised evidence to support decision making is needed, but hindered by variation in outcome reporting. This study has developed a core outcome set to standardise, but not restrict, outcome reporting in burn care trials. It was developed using shared decision making by UK patients/carers and international clinicians/researchers, using novel strategies to achieve consensus, including a web based survey to ensure engagement. The core outcome set was generated from three information sources informing a modified Delphi survey. Consensus meeting voting generated seven core outcomes.
Funding bodies are advocating the use of core outcome sets, and their uptake among triallists is increasing.33 New core outcome sets are increasingly being developed in specialties such as dermatology, rheumatology, paediatrics, and breast and colorectal surgery.8 34–39 These core outcome sets are more commonly developed using international participants, to increase dissemination, to support applicability in global healthcare settings, and to make it more likely that the core outcome set will be used wherever future trials take place.40–42 The core outcome set in this study included 794 survey participants, of whom 668 were international clinical staff or researchers, from 77 countries of all four world income groups; 18% were from low income countries. This diversity is important for the global relevance of a core outcome set for burn injury.43–46
Burn injury is a form of trauma. The outcomes chosen are similar in type to those agreed in other trauma related core outcome sets. In a core outcome set for traumatic dental injuries, outcomes include healing, pain, complications, functional status of teeth, and quality of life including return to work.47 The COSB-i outcomes are also similar to the core outcomes chosen for trials of hip fracture interventions; mortality, pain, activities of daily living, mobility, and quality of life. Participants for the core outcome set for whiplash injury agreed on six core outcomes: physical function, perceived recovery, work and social functioning, psychological functioning, quality of life, and pain.
Strengths and limitations of the study
The outcomes chosen for this core outcome set will reflect priorities for all stakeholder groups. Implementation will result in more effective dissemination, a more meaningful result for international research, and an emerging shared decision making network researching outcomes for burn care.48 Shared decision making has a traditional definition. The term could also imply joint decisions in research outcome choice, weighing the views of all stakeholders equally.
Outcomes achieved with clinicians alone often focus on short term physiological endpoints that are often of less importance to patients. In this study, stakeholders agreed on outcomes spanning short and long term recovery. Acute complications including infection and healing time are outcomes to measure the effect of interventions in burn efficacy trials. The other outcomes, (death, ability to undertake tasks of daily living, neuropathic pain and itch, psychological wellbeing, and time to return to work or school), are more likely to be of value when assessing clinical interventions in longer term pragmatic trials. The participant inclusivity and co-production is increasingly common in the development of core outcome sets, and is a strength of this study.40 49
Further study strengths lie in the comprehensive search for potential outcomes, through three sources, including patient reported outcomes. Some outcomes in the final core outcome set (eg, daily activities; return to school, work, or previous occupation) were not commonly reported in previous systematic reviews of patient reported outcomes, adding to the likelihood that new knowledge will be obtained by using this current set. Our study followed the standards for development and reporting of core outcome sets and previous practice endorsed by the COMET initiative. Three methodology changes from the published protocol have been explained.
A limitation of the study was the lack of representation from international patients, which could have limited the generalisability of the study to international patients. Recruiting global patients incurs costs and time for questionnaire translation and validation, along with ethical research permissions to achieve in many countries. Such desired recruitment was impossible owing to time and financial constraints in this study. The study also had a lack of representation of children, although carers of children were included.
Future work will require operationalising the core outcome set with clearly defined outcomes, outcome measures, agreed measurement timepoints and a method to update the list to reflect changes in knowledge. Ultimately, reporting data for these core outcomes will make burn trial design more relevant and make the ability to synthesise evidence more effective with reduced research waste. We recommend that the COSB-i core outcome set is used consistently in burn care research.
Conclusions
This study used rigorous methodology and international shared decision making to agree a minimum set of core outcomes to be reported in trials assessing burn care interventions. The development of this core outcome set was undertaken to promote the standardised reporting of outcomes and facilitate the robust evaluation of burn care. We recommend that future trials include measures of these seven outcomes.
Acknowledgments
We thank for the following people for their help in this study: Jeremy Rodrigues, Matthew Gardiner, Barnaby Scholefield, Sharmila Disanaika, Christos Giannou, Albert Law, Steven Kahn, Federica D’Asta, Duncan Nickerson, Rochelle Kurmis, Peter Moortgat, Anna Cutler, Michela Venturi, Saidur Rahman Mashreky, Mohsen Rezaeian, Chineye Ogbogu, Declan Collins, Alison Tweddle, Christian Overgaard Steensen, Catrin Pugh, Martin Rison Westergaard, Nicola Clayton, Peter Nthumba, Jonathan Bayou, Belinda Gabbe, Yvonne Singer, Leila Cuttle, Gretchen Carrougher, Idowu Fadeyibi, Susan Hendrickson, Kamal Phuyal, Willy Boeckx, Cecilia Li, David Kulber, Celma Issufu, Muhammed Babakur-Mina, Nguyen Nhu Lam, Tahir Mehmood Khan, Jonathan Oliver White, Pedro Santos, Jim Gallagher, Emma Hansson, Anthony Charles, Tsjitske Haanstra, Joanne Potterton, Diana Harcourt, Abdul Bachani, Michael Peck, David Meddings, Simon Booth, Linzette Morris, Ioannis Goutos, Krissie Stiles, William Lineaweaver, Claudia Malic, Andrea McKittrick, Margriet van Baar, Lisa Hyde, Petra Brysiewicz, Fredrik Huss, Mamta Shah, Ali Samadikuchaksaraei, Jane Leaver, Anne Francois Rousseau, Victoria Dudman, Saffron Kelman, Paul Van Zuijlen, Marit Hjellestad, Sue O’Connell, Julien Textoris, Pam Warren, Janice Gullick, Ingrid Parry, Marie Teresa Rosanova, Denise Kendrick, Inge Spronk, Charmaine Childs, Heather Cleland, Linda Yoder, Henry Tan, Clare Thomas, Habib Ur Rahman Qasim, Karen Coy, Anthony Sack, William Tremlett, Ezeja Godwin, Mathilde Sengoelge, Jan Plock, Bernadette Nedelec, Patrick Weledji, Marko Zdravkovich, Alison Guy, Maryam Meskini, Arsene Seka, Lee Ann Laurent-Applegate, Marjorie Flahaut, Ian King, Serrana Tihista, Jim Gollogly, Hannah Callas, Eduardo Herrera Reyes, Miodrag Milenovic, Shameem Fatima, Lovisa Baldursdottir, Faith Muchemwa, Edrisa Sanyang, Andre Oliviera Paggiaro, Shelley Wall, Clemens Schiestl, Mahlomoma Kutoane, Jyrki Vuola, Rhianydd Thomas, Esteban Ortiz-Prado, Joshua Cuddihy, Marcela Vizcaychipi, Jennifer Newberry, Esther Middlekoop, Rahul Bamool, Anna Rumbach, Rita Galeiras, Axel Pavez, Jorge Vega, Sarvesh Logsetty, Inesa Rimdeikiene, Allyson Brown, Mansour Alshehri, Dmitry Azovskiy, Mansour Alsheri, Davide Naggi, Selina Ahmed, Temnov Andrey, Amalia Cochran, Lee Cancio, James Jeng, Josef Haik, Despoina Kakagia, Nancy van Looey, Markus Landolt, Maudet Ludovic, Olivier Pantet, Joel Fish, Pammla Petrucka, Luciano Pighinelli, Asgjerd Litlere Moi, Berhanu Nega, Guido Ciprandi, Taous Khan, Fazli Wahid, Cleo Ngadimin, Orlando Flores, Mahnoush Momeni, Cindy Lolobali, Jennifer Manning, Simon Stanworth, Bronwyn Griffin, Jill Weibel, Yousef Awad, Alan Phipps, Christopher VanFossen, David Kulber, Celma Issufu, Tahir Mehmood Khan, Jonathan White, Pedro Santos, Jim Gallagher, Emma Hansson, Anthony Charles, Lisa Tropez Arceneaux, Chuka Ahachi, AA Gde Putra Semara Jaya, Hamid Karimi, Belson Rugwizangoga, Piret Mohsen, Gimaa Gerelmaa, Carisa Perry-Parish, Surajit, Dimitrios Karypidis, Guillaume Monneret, Patrick Bourke, Rory Rickard, Keng Siang Lee, Zakiyeh Jafaryparvar, Jennifer Zuccaro, Linda Yoder, Randeep Mullhi, Hairil Rizal Abdullah, Diana Chan Zin Hui, Tsoutsos Dimos, Sonia Gaucher, Marienne Nieuwenheis, Tan Jin Huei, GaoXing Luo, Lee Seng Koo, Babur Shakirov, Fikri Abu-zidan, Vivian Carvalho, Alberto Bolgiani, John Myers, Mary Kennedy, Laura Shepherd, Rachel Wiltshire, Shibabshish Giri, Hanjing Lee, Vladimir Berezutsky, Victor Joe, Hamish Graham, Marion Wiegele, Meltem Yildirim, Nastaran Heydarikhayat, Dennis Orgill, Ernest Azzopardi, Rei Ogawa, Tomasz Torlinski, Nam Tram, Melissa Yelvington, Koo Chan, Chris Hobbs, Todd Constantini, Laura Godat, Patricia Sharp, Ludovic Maudat, Gary Dos Passos, Heinz Rode, Victor Kong, Andrew Linford, Linzette Morris, Lara Harvey, Cleo Ngadimin, Claire Jennings, Kim Tran, Ahmad Sukari Bin Halim, Mohammed Al Marjani, David Rothstein, Beth Sheilds, Angela Gibson, Alexandra de Young, Olayinka Olawoye, Stephen Boyce, Amy Acton, and Chris Van Fossen.
Footnotes
Twitter: @tyack_z
Contributors: All authors contributed to the article and this study through conception, methodology design, study undertaking through country collaborator for survey distribution, achieving funding and writing and editing the paper. AEY acts as guarantor for the study and paper. The corresponding author attests that all listed authors meet authorship criteria and that no others meeting the criteria have been omitted. Transparency: The lead author (the guarantor) affirms that the manuscript is an honest, accurate, and transparent account of the study being reported; that no important aspects of the study have been omitted; and that any discrepancies from the study as planned (and, if relevant, registered) have been explained.
Funding: This article presents independent research funded by the National Institute for Health Research (NIHR) doctoral research fellowship DRF-2016-09-031. The views expressed are those of the author(s) and not necessarily those of the NHS, the NIHR, or the UK Department of Health. The study was also supported by the NIHR Biomedical Research Centre at the University Hospitals Bristol and Weston NHS Foundation Trust and the University of Bristol. JMB is an NIHR senior investigator. AEY acts as guarentor for the study.
Competing interests: All authors have completed the ICMJE uniform disclosure form at www.icmje.org/disclosure-of-interest/ and declare: support from the NIHR for the submitted work; no financial relationships with any organisations that might have an interest in the submitted work in the previous three years; no other relationships or activities that could appear to have influenced the submitted work.
Provenance and peer review: Not commissioned; externally peer reviewed.
Data availability statement
Data are available in a public, open access repository. Additional data available through Dryad repository: doi:10.5061/dryad.79cnp5htr.
Ethics approval
This study involves human participants and was approved by South West Frenchay Research Ethics Committee (reference 17/SW/0025 IRAS 221625). Participants gave informed consent to participate in the study before taking part.
References
- 1. Shea BJ, Reeves BC, Wells G, et al. AMSTAR 2: a critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both. BMJ 2017;358:j4008. 10.1136/bmj.j4008 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2. Lund H, Brunnhuber K, Juhl C, et al. Towards evidence based research. BMJ 2016;355:i5440. 10.1136/bmj.i5440 [DOI] [PubMed] [Google Scholar]
- 3. Higgins JPT TJ, Chandler J, Cumpston M, eds. Cochrane Handbook for Systematic Reviews of Interventions version 6.0 (updated July 2019). Cochrane, 2019 . Vol. 6, 2019. www.training.cochrane.org/handbook [Google Scholar]
- 4. Sautenet B, Contentin L, Bigot A, et al. Strong heterogeneity of outcome reporting in systematic reviews. J Clin Epidemiol 2016;75: :93–9. 10.1016/j.jclinepi.2016.01.008 [DOI] [PubMed] [Google Scholar]
- 5. Williamson PR, Altman DG, Blazeby JM, et al. Developing core outcome sets for clinical trials: issues to consider. Trials 2012;13:132. 10.1186/1745-6215-13-132 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6. Young AE, Brookes ST, Avery KNL, et al. A systematic review of core outcome set development studies demonstrates difficulties in defining unique outcomes. J Clin Epidemiol 2019;115:14–24. 10.1016/j.jclinepi.2019.06.016 [DOI] [PubMed] [Google Scholar]
- 7. Rogozińska E, Eckert LO, Khan KS. Reducing research waste through the standardisation of outcomes and definitions. BJOG 2019;126:308–9. 10.1111/1471-0528.15238 [DOI] [PubMed] [Google Scholar]
- 8. McNair AGK, Whistance RN, Forsythe RO, et al. Core outcomes for colorectal cancer surgery: a consensus study. PLoS Med 2016;13:e1002071. 10.1371/journal.pmed.1002071 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9. Wasiak J, Cleland H, Campbell F, et al. Dressings for superficial and partial thickness burns. 18. The Cochrane Library, 2013. 10.1002/14651858.CD002106.pub4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10. Dumville JC, Munson C. Negative pressure wound therapy for partial-thickness burns. Cochrane Database Syst Rev 2012;12:CD006215. 10.1002/14651858.CD006215.pub3 [DOI] [PubMed] [Google Scholar]
- 11. Norman G, Christie J, Liu Z, et al. Antiseptics for burns. Cochrane Database Syst Rev 2017;10. 10.1002/14651858.CD011821.pub2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12. Peck MD. Epidemiology of burns throughout the world. Part I: distribution and risk factors. Burns 2011;37:1087–100. 10.1016/j.burns.2011.06.005 [DOI] [PubMed] [Google Scholar]
- 13. Williamson PR, Altman DG, Bagley H, et al. The comet Handbook: version 1.0. Trials 2017;18:280. 10.1186/s13063-017-1978-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14. Sanderson T, Morris M, Calnan M, et al. What outcomes from pharmacologic treatments are important to people with rheumatoid arthritis? creating the basis of a patient core set. Arthritis Care Res 2010;62:640–6. 10.1002/acr.20034 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15. Shay LA, Lafata JE. Where is the evidence? A systematic review of shared decision making and patient outcomes. Med Decis Making 2015;35:114–31. 10.1177/0272989X14551638 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16. Hughes TM, Merath K, Chen Q, et al. Association of shared decision-making on patient-reported health outcomes and healthcare utilization. Am J Surg 2018;216:7–12. 10.1016/j.amjsurg.2018.01.011 [DOI] [PubMed] [Google Scholar]
- 17. Kirkham JJ, Gorst S, Altman DG, et al. Core outcome Set-STAndards for reporting: the COS-STAR statement. PLoS Med 2016;13:e1002148. 10.1371/journal.pmed.1002148 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18. Kirkham JJ, Davis K, Altman DG, et al. Core outcome Set-STAndards for development: the COS-STAD recommendations. PLoS Med 2017;14:e1002447. 10.1371/journal.pmed.1002447 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19. Young A, Brookes S, Rumsey N, et al. Agreement on what to measure in randomised controlled trials in burn care: study protocol for the development of a core outcome set. BMJ Open 2017;7:e017267. 10.1136/bmjopen-2017-017267 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20. Young AE, Davies A, Bland S, et al. Systematic review of clinical outcome reporting in randomised controlled trials of burn care. BMJ Open 2019;9:e025135. 10.1136/bmjopen-2018-025135 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21. Griffiths C, Armstrong-James L, White P, et al. A systematic review of patient reported outcome measures (PROMs) used in child and adolescent burn research. Burns 2015;41:212–24. 10.1016/j.burns.2014.07.018 [DOI] [PubMed] [Google Scholar]
- 22. Griffiths C, Guest E, White P, et al. A systematic review of patient-reported outcome measures used in adult burn research. J Burn Care Res 2017;38:e521–45. 10.1097/BCR.0000000000000474 [DOI] [PubMed] [Google Scholar]
- 23. Tong A, Manns B, Hemmelgarn B, et al. Establishing core outcome domains in hemodialysis: report of the standardized outcomes in Nephrology-Hemodialysis (SONG-HD) consensus workshop. Am J Kidney Dis 2017;69:97–107. 10.1053/j.ajkd.2016.05.022 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24. Geisser ME, Kratz AL. How condition-specific do measures of pain intensity need to be? Pain 2018;159:1001–2. 10.1097/j.pain.0000000000001218 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25. Daltroy LH, Liang MH, Phillips CB, et al. American burn Association/Shriners hospitals for children burn outcomes questionnaire: construction and psychometric properties. J Burn Care Rehabil 2000;21:29–39. 10.1097/00004630-200021010-00007 [DOI] [PubMed] [Google Scholar]
- 26. Munster AM, Horowitz GL, Tudahl LA. The abbreviated Burn-Specific health scale. J Trauma 1987;27:425–8. 10.1097/00005373-198704000-00015 [DOI] [PubMed] [Google Scholar]
- 27. Blalock SJ, Bunker BJ, DeVellis RF. Measuring health status among survivors of burn injury: revisions of the burn specific health scale. J Trauma 1994;36:508–15. 10.1097/00005373-199404000-00009 [DOI] [PubMed] [Google Scholar]
- 28. Kildal M, Andersson G, Fugl-Meyer AR, et al. Development of a brief version of the burn specific health scale (BSHS-B). J Trauma 2001;51:740–6. 10.1097/00005373-200110000-00020 [DOI] [PubMed] [Google Scholar]
- 29. Ryan CM, Schneider JC, Kazis LE, et al. Benchmarks for multidimensional recovery after burn injury in young adults: the development, validation, and testing of the American burn Association/Shriners hospitals for children young adult burn outcome questionnaire. J Burn Care Res 2013;34:e121–42. 10.1097/BCR.0b013e31827e7ecf [DOI] [PubMed] [Google Scholar]
- 30. Taal LA, Faber AW. The burn specific pain anxiety scale: introduction of a reliable and valid measure. Burns 1997;23:147–50. 10.1016/S0305-4179(96)00117-9 [DOI] [PubMed] [Google Scholar]
- 31. Harris PA, Taylor R, Thielke R, et al. Research electronic data capture (REDCap)--a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform 2009;42:377–81. 10.1016/j.jbi.2008.08.010 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32. Young AE. An international core outcome set for burn care research (COSB-i) using shared decision-making in outcome choice to improve evidence synthesis. Dryad Repository, 2021. Available: doi:10.5061/dryad.79cnp5htr
- 33. Hughes KL, Kirkham JJ, Clarke M, et al. Assessing the impact of a research funder's recommendation to consider core outcome sets. PLoS One 2019;14:e0222418. 10.1371/journal.pone.0222418 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34. Klokker L, Berthelsen DB, Woodworth T, et al. Identifying possible outcome domains from existing outcome measures to inform an OMERACT core domain set for safety in rheumatology trials. J Rheumatol 2019;46:1173–8. 10.3899/jrheum.190196 [DOI] [PubMed] [Google Scholar]
- 35. Boers M, Kirwan JR, Wells G, et al. Developing core outcome measurement sets for clinical trials: OMERACT filter 2.0. J Clin Epidemiol 2014;67:745–53. 10.1016/j.jclinepi.2013.11.013 [DOI] [PubMed] [Google Scholar]
- 36. Allin B, Ross A, Marven S, et al. Development of a core outcome set for use in determining the overall success of gastroschisis treatment. Trials 2016;17:360. 10.1186/s13063-016-1453-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37. Allin BSR, Bradnock T, Kenny S, et al. NETS1HD study: development of a Hirschsprung's disease core outcome set. Arch Dis Child 2017;102:1143–51. 10.1136/archdischild-2017-312901 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38. Potter S, Holcombe C, Ward JA, et al. Development of a core outcome set for research and audit studies in reconstructive breast surgery. Br J Surg 2015;102:1360–71. 10.1002/bjs.9883 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39. Spuls PI, Gerbens LAA, Simpson E, et al. Patient-Oriented eczema measure (POEM), a core instrument to measure symptoms in clinical trials: a Harmonising outcome measures for eczema (home) statement. Br J Dermatol 2017;176:979–84. 10.1111/bjd.15179 [DOI] [PubMed] [Google Scholar]
- 40. Biggane AM, Brading L, Ravaud P, et al. Survey indicated that core outcome set development is increasingly including patients, being conducted internationally and using Delphi surveys. Trials 2018;19:113. 10.1186/s13063-018-2493-y [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41. Gargon E, Gorst SL, Harman NL, et al. Choosing important health outcomes for comparative effectiveness research: 4th annual update to a systematic review of core outcome sets for research. PLoS One 2018;13:e0209869. 10.1371/journal.pone.0209869 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42. Alkhaffaf B, Metryka A, Blazeby JM, et al. Core outcome set for surgical trials in gastric cancer (GASTROS study): international patient and healthcare professional consensus. Br J Surg 2021;108:1216–24. 10.1093/bjs/znab192 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43. Orbai A-M, de Wit M, Mease P, et al. International patient and physician consensus on a psoriatic arthritis core outcome set for clinical trials. Ann Rheum Dis 2017;76:673–80. 10.1136/annrheumdis-2016-210242 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44. Dos Santos F, Drymiotou S, Antequera Martin A, et al. Development of a core outcome set for trials on induction of labour: an international multistakeholder Delphi study. BJOG 2018;125:1673–80. 10.1111/1471-0528.15397 [DOI] [PubMed] [Google Scholar]
- 45. Haywood KL, Whitehead L, Perkins GD. An international, consensus-derived core outcome set for cardiac arrest effectiveness trials: the COSCA initiative. Curr Opin Crit Care 2019;25:226–33. 10.1097/MCC.0000000000000612 [DOI] [PubMed] [Google Scholar]
- 46. Jansen L, et al. A Core Outcome Set for Hyperemesis Gravidarum Research: an international consensus study. BJOG: An International Journal of Obstetrics & Gynaecology, 2020. [DOI] [PubMed] [Google Scholar]
- 47. Kenny KP, Day PF, Sharif MO, et al. What are the important outcomes in traumatic dental injuries? an international approach to the development of a core outcome set. Dent Traumatol 2018;34:4–11. 10.1111/edt.12367 [DOI] [PubMed] [Google Scholar]
- 48. Young B, Bagley H. Including patients in core outcome set development: issues to consider based on three workshops with around 100 international delegates. Res Involv Engagem 2016;2:25. 10.1186/s40900-016-0039-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49. Harman NL, Bruce IA, Kirkham JJ, et al. The importance of integration of stakeholder views in core outcome set development: otitis media with effusion in children with cleft palate. PLoS One 2015;10:e0129514. 10.1371/journal.pone.0129514 [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
Data are available in a public, open access repository. Additional data available through Dryad repository: doi:10.5061/dryad.79cnp5htr.

