Abstract
Introduction
Musculoskeletal deformities and gait deviations are common features in ambulatory cerebral palsy (CP). Deformity correction through lower limb orthopaedic surgery is the standard form of care aimed at improving or preserving motor function. Current research on CP care does not always take into account individual patients’ expectations and needs. There is a wide range of outcome domains and outcome measures used to assess outcome from treatment. This can lead to reporting bias and make it difficult to compare and contrast studies. A core outcome set (COS) would enhance the efficiency, relevance and overall quality of CP orthopaedic surgery research. The aim of this study is to establish a standardised COS for use in evaluating lower limb orthopaedic surgery for ambulatory children and young people with CP.
Methods/analysis
A set of outcomes domains and outcome measures will be developed as follows: (1) a qualitative evidence synthesis to identify relevant outcomes from children and young people and family perspective; (2) a scoping review to identify relevant outcomes and outcome measures; (3) qualitative research to explore the experience of key stakeholders; (4) prioritisation of outcome domains will be achieved through a two-round Delphi process with key stakeholders; (5) a final COS will be developed at a consensus meeting with representation from key stakeholder groups.
Ethics and dissemination
Ethical approval for this study was granted in the UK by the Oxfordshire Research Ethics Committee B (REC reference 19/SC/0357). Informed consent will be obtained from participants taking part in the qualitative research and Delphi process. Study findings will be published in an open access journal and presented at relevant national and international conferences. Charities and associations will be engaged to promote awareness of the project COS results.
Trial registration number
COMET registration: 1236.
PROSPERO registration number
CRD42018089538.
Keywords: musculoskeletal disorders, paediatric orthopaedics, paediatric orthopaedic & trauma surgery
Strengths and limitations of this study.
Rigorous core outcome set development methods that adhere to Core Outcome Measures in Effectiveness Trials guidelines.
Different stakeholder inputs and engagement during the development of the protocol, in order to ensure outcomes that are important to patients, are identified.
Support of several societies and charities that represent key stakeholders, which will facilitate participant recruitment during the Delphi process, dissemination and uptake of our core outcome sets.
The Delphi exercise will be conducted using an online survey, limiting participants to those with access to the internet.
Introduction
Cerebral palsy (CP) is the most common cause of childhood physical disability, affecting two to three individuals per 1000 live births globally.1 2 CP is defined as ‘a group of permanent disorders of the development of movement and posture causing activity limitation[s] that are attributed to non-progressive disturbances that occurred in the developing fetal or infant brain’.3 Functional mobility in children and young people with CP is usually classified according to the five-level gross motor function classification system (GMFCS), ranging from Level I, indicating maximal mobility with slight deficiencies in challenging activities, to Level V indicating full immobility and reliance on others.4 Approximately two-thirds of the children are ambulant within GMFCS I, II, III.5 Musculoskeletal deformities and resulting gait abnormalities are common and progressive during childhood, and lead to pathological and compensatory gait patterns.6
Many children with CP undergo lower limb orthopaedic surgery to address secondary musculoskeletal deformities and gait abnormalities with the aim of improving or maintaining mobility.7Lower limb orthopaedic operations comprise a variety of soft tissue and bone procedures, including tendon/muscle lengthening or transfer and osteotomy or arthrodesis, often combined in the context of single-event multi-level surgery.8–10
Although many outcome measures for the evaluation of clinical trial results are in use, their application in the research context is largely inconsistent.7 The consequences of research heterogeneity in outcome measures and outcome domains across studies limit the ability to compare findings among studies.11 12 Generic and clinician-administrated outcome measures such as clinical measurements of joint range of motion, spasticity, muscle strength and instrumented motion and gait analysis are employed in the majority of CP orthopaedic literature,7 leaving the needs and expectations of both patient and caregivers unfulfilled.7 13 Furthermore, several reviews in CP lower limb orthopaedic surgery clinical trials have been suspected of selective outcome reporting bias.7 11 12 For example, McGinley and colleagues reported that adverse effects of single-event multi-level surgery weighed against its benefits are rarely addressed and only reported in a limited number of studies. Such inadequate reporting renders these studies less reliable and further reduces the ability to compare and combine studies through meta-analysis.12
The Core Outcome Measures in Effectiveness Trials (COMET) initiative brings together researchers interested in developing a standardised set of core outcomes in different health-related fields.14 A core outcome set (COS) is defined as ‘an agreed minimum set of outcomes that is recommended to be measured and reported in all clinical trials’.15 In recent years, limited consensus has been reached about what outcomes should be measured in CP. For example, there are five International Classification of Functioning, Disability and Health (ICF) core sets for CP,16–20 one comprehensive and four brief sets. The ICF core sets for children and young people with CP offer service providers and stakeholders an age-appropriate framework to explore functioning and disability for assessment, treatment, evaluation and policy purposes in a global context. Specifically, the ICF core sets for CP standardise what should be measured and reported—adopting the ICF biopsychosocial model. However, the ICF core sets do not include specific sets of interventions for this population.
Lower limb orthopaedic surgery is a common intervention in the management of ambulatory children with CP. However, significant variation in the outcomes collected and reported remains a challenge. The post-surgical emotional and physical challenge that this treatment imposes on children and their families is significantly bigger than any other gait improvement intervention in this population. It is therefore of the highest importance to ensure that the surgical aims and the expected outcomes are of relevance to children and their families. Developing a COS representing all stakeholders for this specific intervention would represent the first step in this direction. Therefore, it is important to develop a COS that specifically addresses the needs of children and young people with CP undergoing lower limb orthopaedic surgery. A search of the COMET database and existing literature revealed that COS development has not been undertaken for the orthopaedic surgical management of lower limb problems in CP. Therefore, the aim of this study is to develop a COS for use in clinical trials involving lower limb orthopaedic surgery for ambulant children and young people with CP.
Conceptual framework
The COMET initiative emphasises the need for a comprehensive framework of healthcare when developing a COS.14 The WHO’s International Classification of Functioning, Disability and Health for Children and Youth (ICF-CY) provides a useful framework that includes key aspects of a health condition and has been used extensively in CP research.21–24 The ICF-CY has two parts: (1) functioning and disability and (2) contextual factors. Each part has two components; functioning and disability is subdivided into (a) body functions and structures and (b) activities and participation. Contextual factors are subdivided into environmental and personal factors.25 Therefore, the ICF-CY framework taxonomy will be used as a basis of the development of COS.
Scope
The scope of the COS will include four main areas based on the Core Outcome Set-STAndards for Development26: (1) population, (2) health condition, (3) intervention and (4) setting or context of use for which the COS is to be applied. Accordingly, the proposed COS will serve as an international standard that can be used to evaluate the overall success of lower limb orthopaedic surgery among ambulant children and young people with CP. It will comprise important outcomes (domains) and outcome measures that can be used in both clinical and research practice.
Methods and analysis
Study design
The study design will follow the recommendations of the COMET initiative,14 with reporting adhering to the Core Outcome Set-STAndardised Protocol Items statement.27 COS development will involve two main parts, first, developing the COS domains and second, developing the core outcome measures. A brief overview of our study design, including estimated time frames, is highlighted in figure 1.
Figure 1.
Study design.
Stakeholder involvement
Stakeholders are defined as those who provide insight regarding outcomes of importance during the development of the proposed COS. Box 1 lists potential stakeholders, which include healthcare professionals and clinical academics (researchers), healthcare experts and children and young people with CP and their caregivers.
Box 1. Stakeholder involvement.
Clinical academics (researchers)
Healthcare scientists/researchers (expert in the fields of clinical research for cerebral palsy (CP), more specifically in the area of orthopaedics).
Trialists and systematic reviewers.
Healthcare professionals
-
Have at least 2 years of clinical experience in CP.
Orthopaedic surgeons.
Paediatrics physiotherapists, occupational therapists.
Paediatrics nurses.
Orthotists.
Clinical scientists.
Children and young people, representative (family, carer)
Diagnosed with CP.
Age from 8 to 18 years old at the time of the surgery.
Ambulant or within level I, II, III of gross motor function classification system.
Have undergone or are being considered for lower limb orthopaedic surgical intervention.
Family or carer of a child or young people with earlier criteria.
Establishing a steering committee
An international steering committee will be formed to guide the development of this COS. The steering committee will include 10–15 individuals ranging from experts in orthopaedic interventions, researchers, parents and patient representatives. Committee members will be provided input through face-to-face meetings and email communications.
Patient and public involvement
The development of this study protocol has been informed by discussions with a young adult with CP who has previously undergone lower limb orthopaedic surgery and with a parent representing approximately 40 families of children with CP. Representatives confirmed the importance of the topic and partnered in the design of the study and the information material to support the interview and the Delphi methods. As a result, the study design was refined, tips were given on how to maximise the sample of participants (caregivers and patients) and feedback was given on the participant information sheet for both the interview and Delphi studies and the interview topic guide questions.
Identifying potential outcome domains and outcome measures
Phase 1: qualitative evidence synthesis
Research question and purpose
The review question for this study is: from the perspective of children with CP and their caregivers, what is the experience and expectation of outcomes after lower limb surgery?
The main purpose of the review is to (1) identify the aspect of health and outcomes that are considered important from the perspective of ambulatory children and young people with CP and their caregivers regarding to lower limb orthopaedic surgery and (2) explore how they experience lower limb orthopaedic surgery. A best-fit framework approach28 will be used and the data from primary qualitative studies will be coded against an existing model. The ICF-CY framework25 will be selected as a model ‘best-fit’ to extract the data from the included studies since the generated themes would represent a robust base of knowledge that form the first list of a future ICF-CY COS for lower limb orthopaedic surgery of ambulant children and young people with CP. Data that do not fit the ICF-CY will be analysed inductively into additional themes through thematic analysis.29 Two reviewers will independently perform each stage of the review and resolve uncertainty through discussion. Review findings will be reported following enhancing transparency in reporting the synthesis of qualitative research statement guidelines to enhance transparency in reporting qualitative evidence synthesis.30 The review protocol is available online via the PROSPERO database.
Search strategy
A systematic search will be conducted using four databases, Medical Literature Analysis and Retrival System Online (MEDLINE), Excerpta Medica Database (EMBASE), PsychINFO and Cumulative Index to Nursing and Allied Health Literature (CINAHL) with search terms and free-text terms combining four components: (1) CP; (2) perspective and experience; (3) orthopaedics, musculoskeletal and (4) qualitative research methodologies (online supplementary file 1). The search will include relevant studies from inception to January 2018. In addition, the citation and the reference lists of all included studies will be checked through Web of Science citation search to identify any additional potentially relevant studies.
bmjopen-2019-034744supp001.pdf (56.5KB, pdf)
Study selection and eligibility criteria
Potential studies will be exported into the EndNote X8.2 reference manager and duplicates will be removed. Studies will be put through a two-stage screening process. Titles and abstracts of studies identified by the search will be assessed against the inclusion criteria first; then, selected studies will be read in full to determine inclusion. Studies will be eligible if they meet the following inclusion criteria: (1) the study population consisted of individuals diagnosed with CP and/or their parent or primary caregiver; (2) the study participants were ambulatory or within level I, II, III of the GMFCS; (3) the study explored the experience of children and young people with CP and their family following lower limb surgery and their expectations of the surgery outcomes; (4) the study employed a qualitative design; (5) in the case of mixed-method studies, data from the quantitative and qualitative approaches were analysed and reported separately; (6) full article was published in English. Opinions, editorials and articles containing only quantitative data will be excluded. Studies with samples representing several types of disabilities will be excluded if the authors did not define findings by type or specify which findings were linked to individuals with CP. In addition, studies with only an abstract and those published as poster will be excluded as it would not be possible to adequately assess their methodological quality.
Quality appraisal
Identified studies will be assessed by the critical appraisal skills programme tool.31 Studies will also be assessed using the Dixon-Woods and colleagues categorisation method,32which consists of a global appraisal of whether the study was a key or satisfactory paper, as opposed to a paper that was irrelevant to the synthesis or methodologically fatally flawed.
Data extraction
A template will be created for extracting data from the identified studies. The major elements comprised key research aims; details of the research context; participants; data collection and analysis methods.
Synthesis
In order to map data onto precise ICF-CY codes, the ICF linking rule will be used (table 1).33 Each line of text will be coded according to its meaning and will be linked to the most precise ICF-CY code. If the content of a code is not explicitly named in the ICF-CY category, the ‘not defined’ and ‘not covered’ category will be applied. Data that do not fit the ICF-CY will be analysed thematically.29
Table 1.
ICF linking rules
| Number | Rule |
| 1 | Acquire good knowledge of the conceptual and taxonomical fundamentals of the ICF, as well as of the chapters, domains and categories of the detailed classification, including definitions before starting to link meaningful concepts to the ICF categories |
| 2 | Identify the main concept(s) most relevant to be linked to the ICF |
| 3 | Identify any additional concepts contained in the piece of information in addition to the main concept(s) already identified in the previous step |
| 4 | Identify and document the perspective taken on within a certain piece of information when linking it to the ICF |
| 5 | Identify and document the categorisation of the response options |
| 6 | Link all meaningful concepts, the most relevant and additional ones, to the most precise ICF category |
| 7 | Use ‘other specified’ or ‘unspecified’ ICF categories as appropriate |
| 8 | If the information provided by the meaningful concept is not sufficient for making a decision about the most precise ICF category, assign the concept to nd (not definable) |
| 9 | If the meaningful concept is not contained in the ICF, but is clearly a personal factor as defined in the ICF, assign the meaningful concept to pf (personal factors) |
| 10 | If the meaningful concept is not contained in the ICF, assign this meaningful concept to nc (not covered) |
ICF, International Classification of Functioning, Disability and Health.
The data will be linked to the ICF-CY separately by two reviewers. A third independent reviewer with expertise in the concepts and taxonomy of the ICF-CY will be consulted to resolve disagreements between the two reviewers concerning the selected categories. The process will be discussed and refined by three reviewers to develop a final list of relevant themes.
Phase 2: Scoping review
Research question and purpose
This review aimed to answer these questions: (1) what outcomes are reported in the medical literature after lower limb orthopaedic surgery for ambulant children with CP? And (2) what outcome measures are used in this field?
The purpose of this scoping review is to identify relevant outcome domains and outcome measures used in clinical trials of lower limb orthopaedic surgery for CP. Although previous scoping reviews for studies published between 1990 and 2015 were identified,7 34 updating the review was important to ensure that recently published outcome domains and outcome measures were identified. This was important particularly because, in recent years, researchers and healthcare professionals have become more aware of patient priorities and have acknowledged the value of patient-reported outcomes. These outcomes and outcome measures will underpin the consensus on selecting outcomes of important and outcome measures. According to the Cochrane Review recommendation, a review update should be re-conducted using the same methods as the original review35; therefore, this review was in line with the methodology of the original scoping review.7 The review will be developed in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Protocol guidelines. Two reviewers will independently undertake each stage of the review. The research team will resolve any uncertainty and provide consensus after each stage through discussion. The review will be reported following the Preferred Reporting Items for Systematic review and Meta-Analysis for Scoping Reviews (PRISMA-ScR) checklist.36
Search strategy
A systematic search of five databases (MEDLINE, PubMed, EMBASE, CINAHL and the Cochrane Controlled-Trials Registry) will be performed. Search terms including ‘cerebral palsy’ AND ‘surgical procedures’ OR ‘surgery’ OR ‘operative’ will be used. Reference lists of all studies identified will be hand searched to identify any additional potentially relevant studies. All studies published between January 2016 and June 2019 will be included.
Study selection
Potential studies will be exported into the reference manager, EndNote X8.2, and duplicated studies will be removed. Studies will then go through a two-stage screening process. First, the titles and abstracts will be assessed against the inclusion criteria. Second, a full-text screening will be undertaken of all studies that were identified in the first step.
Eligibility criteria
Studies will be eligible if they meet the following inclusion criteria: (1) ambulatory children and young people diagnosed with CP; (2) participants are aged between 0 and 20 years old; (3) have had lower limb orthopaedic surgery; (4) studies reported at least one outcome measure; (5) each outcome measure must have at least one published paper reporting its psychometric properties; (6) the full article was published in English. Purely observational investigations and qualitative studies, grey literature, studies involving only adults, those with patients receiving alternative therapy or pharmacologic interventions, and papers that reported surgery performed only for hip dysplasia will be excluded.
Data extraction
A pre-designed standardised data-extraction form will be used to extract the main characteristics of identified studies. Information extracted will include author, year of publication, aim/purpose, study population and sample size, methodology, intervention type, outcome domains and outcome measures used.
Analysis
Content analysis will be used to identify the breadth of content of the identified outcome domains and measures, which will then be mapped to the ICF-CY domains. After mapping, each outcome domain and measure will be analysed descriptively. Descriptive analyses will be conducted to determine the frequency and proportion of each outcome reported and of instruments used to assess identified outcome domains.
Phase 3: qualitative study
Research question and purpose
The following question will guide the study: what outcome domains are considered important by ambulant children and young people with CP, their caregivers and health professionals after lower limb orthopaedic surgery? Children and young people with CP and their families may prioritise different outcomes post-surgery. Thus, the aim of the qualitative study is to identify important outcome domains from each stakeholders’ group.
Study sample
A purposive sampling strategy37 will be used to include a range of stakeholders: (1) children and young people with CP and their representatives (family, carer); (2) health professionals who have at least 2 years of clinical experience in CP (box 1). The study will only include English speakers who have the capacity to give informed consent for themselves or their children (under 16 years old). Data saturation will be defined as a point at which data from three consecutive interviews do not contribute to additional themes. It is likely that a sample of 20 participants will allow data saturation.38
Recruitment
Participants will be recruited from the paediatric orthopaedic clinic at the Nuffield Orthopaedic Centre in Oxford. Information for potential participants will be provided verbally by the usual care team and a participant information leaflet will be used. Healthcare professionals and clinical academics (researchers) will be invited through the usual care team using their publically available professional details.
Consent
Written informed consent will be obtained from potential participants prior to conducting the interviews. Individuals who do not have capacity to give informed consent will not be included in the study. It will be stressed that participants are under no obligation to take part and they are free to withdraw at any time without affecting their medical care (CP children and their representatives) or legal rights (for healthcare professionals and researchers).
Data collection
Semi-structured interviews will take place at a time and place convenient to the participant. This might be in a clinic room at the hospital or at the participant’s home. Young adults (16–18 years old) will be given the option of an interview separately from their caregivers. The following demographic information will be collected: child age, identity, operation history, year of health professional’s experience. Interviews will be semi-structured and include several open-ended questions to encourage participants’ thoughts and opinions, guided by a topic guide to ensure key areas are covered. The interview topic guide will be formed and shaped by the findings of phases 1 and 2. For example, participants will be asked to reflect on the identified outcome domains from the reviews. Child-friendly techniques through using a talking mat (https://www.talkingmats.com/) will be available for children aged 8–15 years old to enhance children’s participation and interest in answering the questions. Talking mat is an interactive resource that designed picture symbols to facilitate communication and provide structured framework for open questions. To facilitate children’s participation and engagement, a play specialist will be available during the children interviews.
Data analysis
Interviews will be audio-recorded and transcribed. Participant will be identified only by a code (participant ID number) on trial documents and in any electronic database to maintain confidentiality.
Data will be analysed through content analysis. Data will be coded, indexed and charted to identify themes or patterns of key points and priorities.39 The list of prioritised outcomes generated by the analysis will be systematically classified using an international ICF framework linking process outlined by Cieza and colleagues.33 If participants identify domains that are outside the ICF categories, these will be documented, analysed and reported. The resulting ICF codes will be analysed in terms of their representation across ICF-CY components and between stakeholder groups.
Potential outcome domains and outcome measures
A list of potential outcomes domains derived from the qualitative evidence synthesis (phase 1), scoping review (phase 2) and semi-structured interviews (phase 3) will be collected and assessed by the COS steering committee. The steering committee will revise the phrasing of the potential domains to confirm clarity, relevance and suitability prior to the Delphi process (phase 4).
Determining core outcome sets
Phase 4: Delphi process
Research question and purpose
The study aims to answer the following question: which outcomes do children and young people with CP, caregivers and healthcare professionals think should be included in a COS for lower limb orthopaedic surgery? The aim of the Delphi survey40 is to gain consensus on important lower limb orthopaedic surgery outcome domains from the perspective of stakeholders.
Selection of panel members and sample size
The eligibility criteria shown in Box 1 will be used as a guide in the selection of the Delphi panel members. Potential Delphi panel members will be invited to a two-stage Delphi survey. The aim is to maintain a minimum of 40 participants representing each stakeholder group throughout the Delphi rounds, including (1) children and young people and their caregivers, and (2) health professionals. Balanced representation of multiple viewpoints, and expertise will be considered.41 Based on an estimated attrition of 30% across rounds,14 the initial target recruitment will be approximately 100 participants.
Recruitment
Different strategies will be followed to identify the potential panel, as shown in box 2. Clinical academics and healthcare professionals will be invited through professional societies. Specific invitations to authors of relevant references identified through the qualitative evidence synthesis and scoping review will be also targeted. Snowballing techniques will be used to ensure a representative sample of international researchers and clinicians are invited. Children and family recruitment will be initiated through the clinical care team at Nuffield Orthopaedic Centre (Oxford, UK) and will expand nationally and internationally to include patient and parent organisations and charities.
Box 2. Selection of Delphi panel member.
Clinical academics (researchers)
-
Personalised recruitment emails.
Researchers of primary studies identified from the scoping review.
Healthcare scientists/researchers (expert in the fields of clinical research for cerebral palsy (CP), more specifically in the area of orthopaedics).
Trialists and systematic reviewers.
Snowball sampling.
Healthcare professionals
-
Personalised recruitment emails.
National and international societies and associations focusing on paediatric CP.
Social media of these societies, associations and organisations.
Snowball sampling.
Children and young people, representative (family, carer)
-
Personalised recruitment emails.
National and international charities of CP, disabilities, families.
Patients/families attending clinics at the Nuffield Orthopaedic Centre, Oxford.
Social media of the earlier charities.
Delphi survey
Adapted participant information leaflets developed from the COMET initiative will be used to outline the rationale for the development of the proposed COS and describe the requirements for taking part in the Delphi. A child-friendly animation will be developed to explain the rationale of the study and promote children’s understanding of the purpose of the COS (online supplementary file 2). The Jisc online survey tool will be used. The Delphi survey will be pilot tested by the members of the steering committee to assess face validity, understanding and acceptability. Demographic information will be collected at the start of the Delphi survey to describe the study sample, and to provide each respondent with a unique identifier enabling personalised reminders for completion of subsequent rounds. This information will include the stakeholder group that the participant belongs to, the age group, years of experience, and position.
bmjopen-2019-034744supp002.mp4 (6.6MB, mp4)
Participants will be asked to score each outcome in the Delphi using a GRADE scale, which ranges from 1 to 9 (1 to 3=not important, 4 to 6=important but not critical and 7 to 9=critical for inclusion).42 The proposed scoring system was selected to facilitate maximum discrimination between items. There will be free-text fields to allow the participants to give a reason for their decision and/or any additional outcomes that they consider to be important. Items scored between 7 and 9 (critical importance) by ≥75% will be directly moved to the following stage (ie, consensus meeting) for discussion. Items scored between 1 and 3 (not important) by ≥25% will be excluded from the round 2 of the Delphi survey. Only items scored between 4 and 6 (important but not critical) will be carried out in round 2 of the Delphi survey. Additional outcomes from the free-text field will be reviewed by the research team and where appropriate carried forward to round 2. During round 2 of the Delphi survey, participants will be asked to re-score the importance of each outcome that were scored between 4–6. A consensus process will be carried out similar to that in round 1. A report with findings including all items results and consensus category will be presented in the consensus meeting. Each round will be open to the panel for 4 weeks and reminder emails will be sent at 2 week intervals in order to maximise follow-up rates. Only the research team will have access to the complete list of those taking part in the Delphi survey.
Analysis
Descriptive statistics will be undertaken using Statistical Package for the Social Sciences (SPSS) software to summarise the distribution of scores and to calculate the median and IQR for each Delphi survey item. The denominator for each Delphi survey item will be the number of participants completing that item, rather than the number of participants completing the Delphi survey overall (ie, a participant may choose not to score a particular Delphi item for whatever reason). Survey data will be analysed separately for each stakeholder group. Outcomes from both rounds will be analysed descriptively; the number of participants rating each outcome from rounds 1 and 2 will be calculated.
Phase 5: consensus meeting
Recruitment
A consensus meeting will be hosted for the purpose of finalising the COS. The meeting will include approximately 20 panel members. Representatives from all stakeholder groups, representing as much geographical, ethnic, demographic and cultural diversity as possible (as recommended by COMET) will be invited at this stage. Ten of those participants will be randomly selected from the Delphi survey participants and the study steering group. Face-to-face and remote access to the meeting will be available.
Final decisions
At the meeting, Delphi survey results will serve as the basis for the discussion and development of the final COS to be agreed across stakeholder groups. Across all stakeholder groups, any outcome categorised as ‘consensus in’ will be proposed to be included in the final COS, while any outcome categorised as ‘consensus out’ will be excluded. The panel members will electronically vote to accept this proposal or suggest outcomes that warrant further discussion.
Outcomes that are differently categorised by different stakeholder groups and those categorised as ‘no-consensus’ will be discussed individually. A second round of voting will be used to agree the final COS. A second meeting will be arranged in the event of no agreement on the final COS at the end of the first meeting. Based on COMET recommendations, the final COS is expected to include five to ten outcomes.14
Phase 6: selection of outcome measure
After the development of a COS, it is recommended to identify a set of measurements, the ‘outcome measures’ that would be used to evaluate the selected outcomes.43 In order to establish a core outcome measures set, a four-step process will be followed: (1) conceptual considerations (scope); (2) identifying existing outcome measures; (3) quality assessment of the identified outcome measures and (4) generic recommendations for the selection of outcome measures for a COS.
The conceptual considerations of the proposed core outcome measures set will be associated with the study scope. Accordingly, all available outcome measures used in clinical research following lower limb orthopaedic surgery in ambulant CP will be considered for the core set. An international perspective on the subject will be captured by involving stakeholders from the study’s international steering committee and consensus panel members.
Previous reviews on this field7 34 alongside the scoping review (phase 2) will be used as a starting point to identify currently used outcome measures. The quality assessment of each outcome measure identified will be determined by the available systematic reviews using the consensus-based standards for selection of health measurement instruments (COSMIN). This will assess the psychometric properties of outcome measures that have been used in CP clinical studies. For example, two recent systematic reviews using a modified COSMIN method to assess gait-related outcome measures in CP will be employed to choose suitable, high-quality outcome measures.44 45
A consensus meeting with a panel of health professionals will subsequently be organised to establish appropriate outcome measures for each outcome domain identified during the COS development. Members will be asked to recommend one high-quality outcome measure per core outcome domain. If no adequate outcome measures exist for a specific core outcome, this will be acknowledged, and recommendation will be made for future development of an adequate high-quality outcome measure.
Ethics and dissemination
Informed consent will be obtained from all participants taking part in the interview and Delphi process. All procedures will be conducted according to the Declaration of Helsinki.
Support of societies, associations and charities that represent health professionals, families of children and young people with CP will facilitate dissemination of the COS and subsequent uptake, for example, the ‘British Society for Children Orthopaedic Surgery’, ‘Step charity’ and ‘Action Cerebral Palsy’. A one-page summary will be provided to the clinicians and researchers and a lay language summary will be available for the patients and their caregivers to the relevant societies. The findings will be submitted for publication in peer-reviewed and open access journals and will be presented at national and international conferences on CP. Journals and funding bodies will be approached to promote awareness of the COS results.
Discussion
To our knowledge, this is the first study on the development of a COS for lower limb orthopaedic surgery in ambulant children with CP. This study employed a well-established and widely used method developed by the COMET Initiative. Involving patients in COS development has become common practice to ensure the relevance of the proposed COS to all stakeholders. In this protocol, children and families will be directly engaged with the COS development through participation in the steering committee, the interviews, the Delphi process and the consensus meeting.
This study includes a comprehensive search for potentially relevant outcomes through qualitative evidence synthesis, a scoping review and interviews with stakeholders’ groups. This process will be conducted by at least two independent researchers ensuring identification of all potential outcomes. This will provide a comprehensive list of all pertinent outcomes for the Delphi survey.
As the comprehensive search for outcomes focuses on the English literature and on interviews with English speaking stakeholders, any outcomes available in the non-English literature may be omitted. Free-text fields will be included in the Delphi survey to allow participants to suggest any additional outcomes that they consider important. The potential imbalance between national and international participants may represent a limitation of the study. Although the proposed COS development will aim to reach international consensus, it is possible that most participants will be recruited from the UK, which may affect the wider generalisability of the COS findings.
Supplementary Material
Footnotes
Contributors: All authors contributed to the design of this protocol. The study protocol was developed by HA, HD, SH, FT and TT. The manuscript was drafted by HA and was refined by all authors (HD, SH, FT, CJ and TT). TT is responsible for the management of the study and is the principal investigator for the study. HD, SH and FT provide supervision and have had input to all aspects of the study. CJ advised on the design of the protocol. All authors edited the manuscript and read and approved the final version.
Funding: This study is funded by the Imam Abdulrahman Bin Faisal University, Saudi Arabia as part of HA’s PhD program. HD is supported by the Elizabeth Casson Trust and the National Institute for Health Research (NIHR) Oxford Health Biomedical Research Centre. TT was funded by the Oxford Biomedical Research Centre.
Competing interests: None declared.
Patient consent for publication: Not required.
Provenance and peer review: Not commissioned; externally peer reviewed.
References
- 1.Glinianaia SV, Best KE, Lingam R, et al. Predicting the prevalence of cerebral palsy by severity level in children aged 3 to 15 years across England and Wales by 2020. Dev Med Child Neurol 2017;59:864–70. 10.1111/dmcn.13475 [DOI] [PubMed] [Google Scholar]
- 2.Moreno-De-Luca A, Ledbetter DH, Martin CL. Genetic [corrected] insights into the causes and classification of [corrected] cerebral palsies. Lancet Neurol 2012;11:283–92. 10.1016/S1474-4422(11)70287-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Rosenbaum P, Paneth N, Leviton A, et al. A report: the definition and classification of cerebral palsy April 2006. Dev Med Child Neurol Suppl;2007:8–14. [PubMed] [Google Scholar]
- 4.Damiano DL, Leonard R. 2014 section on pediatrics knowledge translation Lecture: clinicians and researchers on the same path toward facilitating family goals for mobility and participation. Pediatr Phys Ther 2015;27:105–12. 10.1097/PEP.0000000000000147 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Thomason P, Tan A, Donnan A, et al. The gait outcomes assessment list (goal): validation of a new assessment of gait function for children with cerebral palsy. Dev Med Child Neurol 2018;60:618–23. 10.1111/dmcn.13722 [DOI] [PubMed] [Google Scholar]
- 6.Narayanan UG. The role of gait analysis in the orthopaedic management of ambulatory cerebral palsy. Curr Opin Pediatr 2007;19:38–43. 10.1097/MOP.0b013e3280118a6d [DOI] [PubMed] [Google Scholar]
- 7.Wilson NC, Chong J, Mackey AH, et al. Reported outcomes of lower limb orthopaedic surgery in children and adolescents with cerebral palsy: a mapping review. Dev Med Child Neurol 2014;56:808–14. 10.1111/dmcn.12431 [DOI] [PubMed] [Google Scholar]
- 8.Kerr Graham H, Selber P. Musculoskeletal aspects of cerebral palsy. J Bone Joint Surg Br 2003;85:157–66. 10.1302/0301-620x.85b2.14066 [DOI] [PubMed] [Google Scholar]
- 9.Quinby JM, Abraham A. Musculoskeletal problems in cerebral palsy. Current Paediatrics 2005;15:9–14. 10.1016/j.cupe.2004.10.002 [DOI] [Google Scholar]
- 10.Sharan D. Orthopedic surgery in cerebral palsy: instructional course lecture. Indian J Orthop 2017;51:240–55. 10.4103/ortho.IJOrtho_197_16 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Lamberts RP, Burger M, du Toit J, et al. A systematic review of the effects of Single-Event multilevel surgery on gait parameters in children with spastic cerebral palsy. PLoS One 2016;11:e0164686 10.1371/journal.pone.0164686 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.McGinley JL, Dobson F, Ganeshalingam R, et al. Single-event multilevel surgery for children with cerebral palsy: a systematic review. Dev Med Child Neurol 2012;54:117–28. 10.1111/j.1469-8749.2011.04143.x [DOI] [PubMed] [Google Scholar]
- 13.Wright FV, Majnemer A. The concept of a toolbox of outcome measures for children with cerebral palsy: why, what, and how to use? J Child Neurol 2014;29:1055–65. 10.1177/0883073814533423 [DOI] [PubMed] [Google Scholar]
- 14.Williamson PR, Altman DG, Bagley H, et al. The comet Handbook: version 1.0. Trials 2017;18:280 10.1186/s13063-017-1978-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Williamson PR, Altman DG, Blazeby JM, et al. Developing core outcome sets for clinical trials: issues to consider. Trials 2012;13:132 10.1186/1745-6215-13-132 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Schiariti V, Klassen AF, Cieza A, et al. Comparing contents of outcome measures in cerebral palsy using the International classification of functioning (ICF-CY): a systematic review. Eur J Paediatr Neurol 2014;18:1–12. 10.1016/j.ejpn.2013.08.001 [DOI] [PubMed] [Google Scholar]
- 17.Schiariti V, Mâsse LC. Relevant areas of functioning in children with cerebral palsy based on the International classification of functioning, disability and health coding system: a clinical perspective. J Child Neurol 2015;30:216–22. 10.1177/0883073814533005 [DOI] [PubMed] [Google Scholar]
- 18.Schiariti V, Mâsse LC, Cieza A, et al. Toward the development of the International classification of functioning core sets for children with cerebral palsy: a global expert survey. J Child Neurol 2014;29:582–91. 10.1177/0883073813475481 [DOI] [PubMed] [Google Scholar]
- 19.Schiariti V, Sauve K, Klassen AF, et al. 'He does not see himself as being different': the perspectives of children and caregivers on relevant areas of functioning in cerebral palsy. Dev Med Child Neurol 2014;56:853–61. 10.1111/dmcn.12472 [DOI] [PubMed] [Google Scholar]
- 20.Schiariti V, Selb M, Cieza A, et al. International classification of functioning, disability and health core sets for children and youth with cerebral palsy: a consensus meeting. Dev Med Child Neurol 2015;57:149–58. 10.1111/dmcn.12551 [DOI] [PubMed] [Google Scholar]
- 21.Burak M, Kavlak E. Investigation of the relationship between quality of life, activity-participation and environmental factors in adolescents with cerebral palsy. Neuro Rehabilitation 2019;12:1–11. [DOI] [PubMed] [Google Scholar]
- 22.Geijen M, Ketelaar M, Sakzewski L, et al. Defining functional therapy in research involving children with cerebral palsy: a systematic review. Phys Occup Ther Pediatr 2019:1–16. 10.1080/01942638.2019.1664703 [DOI] [PubMed] [Google Scholar]
- 23.Lidman GRM, Nachemson AK, Peny‐Dahlstrand MB, et al. Long‐term effects of repeated botulinum neurotoxin A, bimanual training, and splinting in young children with cerebral palsy. Dev Med Child Neurol 2020;62:252–8. 10.1111/dmcn.14298 [DOI] [PubMed] [Google Scholar]
- 24.Schiariti V, Oberlander TF. Evaluating pain in cerebral palsy: comparing assessment tools using the International classification of functioning, disability and health. Disabil Rehabil 2019;41:2622–9. 10.1080/09638288.2018.1472818 [DOI] [PubMed] [Google Scholar]
- 25.WHO International classification of functioning, disability and health: children and youth version: ICF-CY. World Health Organization, 2007. [Google Scholar]
- 26.Kirkham JJ, Davis K, Altman DG, et al. Core outcome Set-STAndards for development: the COS-STAD recommendations. PLoS Med 2017;14:e1002447 10.1371/journal.pmed.1002447 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Kirkham JJ, Gorst S, Altman DG, et al. Core outcome Set-STAndardised protocol items: the COS-STAP statement. Trials 2019;20:116 10.1186/s13063-019-3230-x [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Carroll C, Booth A, Leaviss J, et al. “Best fit” framework synthesis: refining the method. BMC Med Res Methodol 2013;37:1–16. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Thomas J, Harden A. Methods for the thematic synthesis of qualitative research in systematic reviews. BMC Med Res Methodol 2008;8:45 10.1186/1471-2288-8-45 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Tong A, Flemming K, McInnes E, et al. Enhancing transparency in reporting the synthesis of qualitative research: ENTREQ. BMC Med Res Methodol 2012;12:181 10.1186/1471-2288-12-181 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Critical Appraisal Skills Programme (2018). CASP (Qualitative) Checklist. [online]. Available: https://casp-uk.net/casp-tools-checklists/ [Accessed 20 May 2018].
- 32.Dixon-Woods M, Sutton A, Shaw R, et al. Appraising qualitative research for inclusion in systematic reviews: a quantitative and qualitative comparison of three methods. J Health Serv Res Policy 2007;12:42–7. 10.1258/135581907779497486 [DOI] [PubMed] [Google Scholar]
- 33.Cieza A, Fayed N, Bickenbach J, et al. Refinements of the ICF linking rules to strengthen their potential for establishing comparability of health information. Disabil Rehabil 2019;41:574–83. 10.3109/09638288.2016.1145258 [DOI] [PubMed] [Google Scholar]
- 34.Wilson NC. Measuring outcomes after lower limb surgery in children with cerebral palsy [PhD. New Zealand: University of Auckland, 2015. [Google Scholar]
- 35.Moher D, Tsertsvadze A, Tricco A, et al. When and how to update systematic reviews. Cochrane Database of Systematic Reviews 2008;3 10.1002/14651858.MR000023.pub3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Tricco AC, Lillie E, Zarin W, et al. PRISMA extension for scoping reviews (PRISMA-ScR): checklist and explanation. Ann Intern Med 2018;169:467–73. 10.7326/M18-0850 [DOI] [PubMed] [Google Scholar]
- 37.Teddlie C, Yu F. Mixed Methods Sampling:A Typology With Examples. J Mix Methods Res 2007;1:77–100. [Google Scholar]
- 38.Francis JJ, Johnston M, Robertson C, et al. What is an adequate sample size? Operationalising data saturation for theory-based interview studies. Psychol Health 2010;25:1229–45. 10.1080/08870440903194015 [DOI] [PubMed] [Google Scholar]
- 39.Vaismoradi M, Turunen H, Bondas T. Content analysis and thematic analysis: implications for conducting a qualitative descriptive study. Nurs Health Sci 2013;15:398–405. 10.1111/nhs.12048 [DOI] [PubMed] [Google Scholar]
- 40.Murphy MK, Black NA, Lamping DL, et al. Consensus development methods, and their use in clinical Guideline development. Health Technol Assess 1998;2:i-iv–1. 10.3310/hta2030 [DOI] [PubMed] [Google Scholar]
- 41.Bloor M, Sampson H, Baker S, et al. Useful but no Oracle: reflections on the use of a Delphi group in a multi-methods policy research study. Qualitative Research 2015;15:57–70. 10.1177/1468794113504103 [DOI] [Google Scholar]
- 42.Guyatt GH, Oxman AD, Kunz R, et al. Grade guidelines: 2. framing the question and deciding on important outcomes. J Clin Epidemiol 2011;64:395–400. 10.1016/j.jclinepi.2010.09.012 [DOI] [PubMed] [Google Scholar]
- 43.Prinsen CAC, Vohra S, Rose MR, et al. How to select outcome measurement instruments for outcomes included in a "Core Outcome Set" - a practical guideline. Trials 2016;17:449 10.1186/s13063-016-1555-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Himuro N, Abe H, Nishibu H, et al. Easy-To-Use clinical measures of walking ability in children and adolescents with cerebral palsy: a systematic review. Disabil Rehabil 2017;39:957–68. 10.1080/09638288.2016.1175036 [DOI] [PubMed] [Google Scholar]
- 45.Zanudin A, Mercer TH, Jagadamma KC, et al. Psychometric properties of measures of gait quality and walking performance in young people with cerebral palsy: a systematic review. Gait Posture 2017;58:30–40. 10.1016/j.gaitpost.2017.07.005 [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
bmjopen-2019-034744supp001.pdf (56.5KB, pdf)
bmjopen-2019-034744supp002.mp4 (6.6MB, mp4)

