Abstract
Background:
A core outcome set (COS) is an agreed minimum set of outcomes that should be reported in all clinical trials in specific areas of health care. A considerable amount of trials did not report essential outcomes or outcomes measurement methods, which makes it challenging to evaluate the efficacy and safety of treatment strategies for pressure injury (PI) and produced significant heterogeneity of reported outcomes. It is necessary to develop a COS, which can be used for clinical trials in PI treatment.
Methods/Design:
The development of this COS will be guided by an advisory group composed of clinicians, senior nurses, patients, and methodologists. We will search six databases and 2 registry platforms to identify currently reported PI treatment outcomes and outcome measurement instruments in randomized controlled trials, meta-analysis, and systematic reviews. We will also conduct a semi-structured interview with clinicians, nurses, and adult PI patients to collect their opinions on important outcomes. Each outcome of the initial list generated from systematic review and interviews will be scored and reach a consensus through two rounds of international Delphi survey with all key stakeholders. A face-to-face consensus meeting with key stakeholders will be conducted to finish a final COS and recommend measurement instruments for each outcome.
Results:
We will develop a COS that should be reported in future clinical trials to evaluate the effectiveness of PI treatment.
Discussion:
The COS will follow current guidance to develop a high-quality COS in the field of PI treatment to reduce heterogeneity in trial reporting, facilitate valid comparisons of new therapies, and improve the quality of clinical trials.
Keywords: core outcome set, outcome measurement instruments, pressure injury
1. Introduction
Pressure injury (PI) is localized damage to the skin and underlying soft tissue, usually over a bony prominence or related to a medical or other device.[1] PI prevalence (categories 1–4) ranges from 8.8% to 29.9% in nursing homes [2–5] and between 7.3% and 23.0% in hospitals throughout Europe and North-America.[6–9] The daily cost of PI treatment per patient ranged from 1.71 € to 470.49 € across different settings.[10] PI has been a common problem faced by global health care institutions, which seriously threat patients’ life and health; it brings heavy economic pressure and medical burden to society.
In recent years, researchers have carried out a large number of studies on risk factors, treatment, prevention, and diagnosis of PI to provide support for the prevention and treatment of PI. However, the outcomes for the therapeutic effect on PI were measured in various ways, and there were little standards across studies.[11] Some clinical trials did not report essential outcome indicators, such as time to complete healing, the proportion of PI healed, healing rate and adverse events.[12–18] When a systematic review (SR) was conducted, the review's prespecified outcomes were hard to obtain in the included trials.[11,19] There is also a lack of reports of PI treatment outcome measurement instruments (OMIs), and the same outcomes were measured by different methods in clinical trials [17,18,20] or measured in differing time of follow-up.[16,17,21–23] Only a handful of studies considered PI patients’ perspective of which outcomes should be reported in clinical trials of PI treatment, and this may undermine the external validity of published research in clinical practice.[24,25]
Choosing appropriate outcome indicators can not only improve the reliability and practicability of clinical research, but also promote the transformation of clinical research results into clinical practice.[26] However, there are significant differences in the reporting forms of PI results, which will bring inconvenience to the statistical analysis of the results and hinder the formulation of clear evidence-based treatment recommendations for PI. This problem may be solved by developing a core outcome set (COS), which is an agreed and minimal set of outcomes that should be measured and reported in all clinical trials in specific areas of health or healthcare.[27]
The overall aim of our research is to develop a COS that should be reported in future clinical trials to evaluate the effectiveness of PI treatment interventions in adults and select a measurement instrument for each outcome. It is essential to consider all key stakeholders’ perspectives on the importance of outcomes when conducting a core outcome set, and we will develop this COS followed by the recommendation from the COMET handbook (version 1.0) [24] and the Core Outcome Set-STAndards for Reporting (COS-STAR).[25]
2. Materials and methods
We will develop the COS of PI treatment based on the general guidelines of the COMET handbook,[24] COS-STAD[25] and consensus-based standards for the selection of health measurement instruments (COSMIN)[28]. An overview of our studies’ progress is shown in Figure 1.
2.1. Registration
Our research has been registered on the COMET initiative (http://cometinitiative.org/studies/details/1408).
2.2. Steering advisory group
A steering advisory group will be created, including clinicians, senior nurses, patients, and methodologists. The group will evaluate the preliminary checklist of the outcome, and add important outcome if they think which have been left off the checklist. The advisory group will take part in the consensus meeting to develop the COS.
2.3. Stage 1: Systematic review (previously reported outcomes).
2.3.1. Literature search
We will conduct a comprehensive search of PubMed, Embase, Cochrane library, Web of Science, the Cumulative Index to Nursing and Allied Health Literature, Chinese Biomedicine Literature, International Prospective Register of Systematic Reviews (PROSPERO) and ClinicalTrials.gov to identify relevant clinical trials and SRs. Titles and abstracts of publications are selected independently by two reviewers (JYS and YG). The same two reviewers will retrieve full-text of potentially eligible studies and determine study inclusion or exclusion independently. Any disagreement will be resolved by a discussion with a third reviewer (ML).
2.3.2. Eligibility and inclusion
Studies will be included if:
all randomized controlled trials (RCT), meta-analysis, and SRs that reported any type of PI treatment in adult (aged≥18 years) will be included
all reported outcomes will be included.
Studies will be excluded if:
review, abstracts and letters will be excluded
the main objectives of the study were to prevent PI will be excluded
for feasibility, we will exclude articles published in languages other than Chinese and English.
2.3.3. Data extraction and analysis
The data will be extracted from each study by 2 reviewers (XM and YG) independently. The data items include first author name, journal, number of participants, study type, time-point, intervention details, effectiveness, and safety outcome(s), follow-up, and outcome measurement instruments. Any disagreement will be discussed with a third reviewer (ML). The data will then be grouped into appropriate outcome domains defined by the COMET handbook,[24] and the advisory group will confirm the classification and outcome list. The frequency of each outcome and the method of outcome measurement will be recorded.
2.4. Stage 2: Semi-structured interviews
2.4.1. The inclusion/exclusion criteria of stakeholders
According to recommendations of COS-STAD and COMET handbook (version 1.0),[24,25] it is necessary to obtain the opinion from stakeholders on PI treatment. Semi-structured interviews will be conducted to acquire stakeholders’ perspectives about the outcomes of treating PI that should be measured in a clinical trial.[29] This project will facilitate us to understand which outcomes are patients, clinicians, and nurses focus on, and further refine our list of results. The inclusion/exclusion criteria of patients, clinicians, and nurses are shown in Table 1.
Table 1.
2.4.2. Sampling
There are no robust standards for the sample size of semi-structured interviews. We will divide participates into the patient group and the clinical group. More than 20 patients will be recruited, and we will recruit patients in a diversity of age, sex, treatment types, and PI categories following the purpose of obtaining the overall outcomes. We will also invite 20 clinicians and 20 nurses who meet our criteria list in Table 1.
2.4.3. Data collection and analysis
The analysis of the data will be conducted simultaneously with the data collection. Investigators will explain the purpose of this study to participates, they can withdraw at any time, and participants who have completed the survey will be invited to continue to participate in the Delphi survey and consensus meeting as a representative.[30] A face-to-face conversation will be conducted after all informed consents are signed, questions in English and Chinese will be provided according to the choice of participants, and each investigator will be trained before. All participates will review the outcome list generating from the systematic review, and we will use open questions as a topic guide. All the interviews will be audio-recorded, the semi-structured interview will be conducted until the thematic saturation, and no new outcome is obtained. We will use qualitative analysis software (NVivo 11, QSR International Pty Ltd., Burlington, MA) to import the recordings and analyze through thematic analysis by the framework method. Researchers and the Steering Advisory Committee will identify whether these outcomes are new and judge whether they should be added to the list of candidate outcomes.
2.5. Stage 3: Delphi survey
Our original list will go through two rounds of questionnaires by using the Delphi Method for optimization,[31] and each series of questionnaires will last 2 to 3 weeks. If the response rate is too low, the time of the following questionnaires recycling can be prolonged appropriately.
2.5.1. Stakeholders involvement
The participation of stakeholders on a broad geographic scale, and multiple groups will be invited, including clinicians, senior nurses, patients, researchers. However, there are no robust standards for the sample size of Delphi survey, and we will use snowball sampling to expand the scale of stakeholders, the experts will invite colleagues who they think meet the criteria for inclusion in the study. In the first round, each stakeholder group will be invited at least 20 participants.
2.5.2. Round one
We will invite participants through email with links to the original questionnaire. Before carrying out the survey, all Delphi survey texts will be approved by the advisory group to confirm the readability of the language. Each participant will use the 9-point Likert-type scale to rate each outcome from 1 (unimportant) to 9 (critically important outcome), depending on the importance of each item. In the first round of Delphi questionnaires,[32–34] participants can put forward new items that may be included in the second round of questionnaires.[35,36]
2.5.3. Round two
Participants who have completed round 1 of the Delphi survey will be invited to round 2. The number of participants who have scored each item and the score they rate the outcome in round 1 will show to participants. All stakeholder groups will be asked to re-score each outcome. As shown in Table 2, each outcome will be defined as 3 categories.[35,36]
Table 2.
2.6. Stage 4: Consensus meeting
After completing the Delphi survey, each outcome scored from the Delphi survey will be present at face to face meetings to reach a final consensus about a COS that should be reported in all clinical trials of PI treatment with COMET guidance.[24] Participants who have participated in the two rounds of Delphi survey will be requested to attend face to face meetings. We aim to gather approximately 15 to 20 participants with equal representation from each stakeholder group. Journal editors and policymakers will also be invited. After discussion, participants will be required to score each of “no consensus” outcome by the anonymous method according to the same scoring system as the Delphi process, and for which consensus is achieved in at least one but not all stakeholder groups, further discussion will take place. Outcomes achieving “consensus in” will be included in the final COS. After finishing the final COS, participants will use the same scoring system to discuss and recommend the time point of measurement and OMIs for every included outcome.[24,27] The meeting will also discuss and reach an agreement on dissemination strategies.
3. Dissemination
The finished COS will follow recommendation of recent studies on dissemination strategies,[35–37] All outcomes of each step, including excluded outcomes will be published in a peer-reviewed journal, each of participates of the COS will be asked to implement the COS in their future clinical trials of PI treatment and recommend this COS to their colleagues and other potential researchers. We plan to present our results at international conferences and post our final COS information on the COMET website. We will also send our article to professional associations and related groups by e-mail if our manuscript is accepted.
4. Discussion
PI has been a common problem faced by global health care institutions,[19] which seriously threatens the life and health of patients. It is uncertain which treatment strategy is more clinically effective and more acceptable to PI patients, or more cost-effective compared to others. There are still a significant number of clinical trials in varies of therapeutic methods are being performed, but there are almost no standards in reporting outcomes for the therapeutic effect on PI across clinical trials.
The lack of standards reporting on outcomes of the clinical trial may cause heterogeneity and hinder evidence synthesis in systematic review/meta-analysis.[24,27,38] After years of development, there are more researchers focus on the importance of developing a COS, but there are still a great number of clinical trials in PI treatment that have been conducted without a COS currently exists or is in development.[39] A high-quality COS can help combine and compare the result of trials to reduce waste in research, and it is necessary to improve the quality of trials result by developing a COS of PI treatment. It is worth noting that COS is not to limit outcomes reporting; it just represents the minimum outcomes that should be measured and reported, researchers can still explore reporting other appropriate outcomes.[25]
The main objective of this project is to follow current guidance to develop a high-quality COS in the field of PI treatment, including all efficacy and safety outcomes and measurements as determined. Furthermore, if researchers select a COS of PI treatment developed by high standards, it can reduce the reporting bias of clinical trials and promote evidence-based recommendations.
Acknowledgments
We express our thanks to Jinhui Tian for the the assistance with the design of the protocol.
Author contributions
JS, JZ conceived the idea for this study; JS, LS and XM designed the core outcome set; ML provided statistical advice and input; JS and YG drafted the protocol. JZ and XL reviewed the protocol and provided critical feedback. All authors approved the article in its final form.
Footnotes
Abbreviations: COS = core outcome set, OMIs = outcome measurement instruments, PI = pressure injury, SR= systematic review.
How to cite this article: Shi J, Gao Y, Si L, Ma X, Liu M, Liao X, Zhang J. Determine what to measure and how to measure in clinical trials for the treatment of pressure injury: A protocol for the development of a core outcome set. Medicine. 2020;99:9(e19311).
This project of development COS is considered a service evaluation not directly influencing patient care or safety, and therefore, ethics approval was not required. The final COS will be published and freely available.
This research was funded by Science and Technology Program of Henan Province, China (162102310170).
The authors declare that there is no conflict of interest.
References
- [1]. The National Pressure Ulcer Advisory Panel. National Pressure Ulcer Advisory Panel (NPUAP) announces a change in terminology from pressure ulcer to pressure injury and updates the stages of pressure injury [EB/OL]. www.npuap.org/national-pressure-ulcer-advisory-panel-npuap-announces-a-change-in-terminology-from-pressure-ulcer-topressure-injury-and-updates-the-stages-of-pressure-injury/. [Google Scholar]
- [2].Gunningberg L. Risk, Prevalence and prevention of pressure ulcers in three Swedish healthcare settings. J Wound Care 2004;13:286–90. [DOI] [PubMed] [Google Scholar]
- [3].Lahmann NA, Halfens RJ, Dassen T. Prevalence of pressure ulcers in Germany. J Clin Nurs 2005;14:165–72. [DOI] [PubMed] [Google Scholar]
- [4].Muurinen S, Soini H, Pitkala K, et al. Differences in prevalence of pressure ulcers between the Netherlands and Germany--associations between risk, prevention and occurrence of pressure ulcers in hospitals and nursing homes. J Clin Nurs 2009;18:304–5. [DOI] [PubMed] [Google Scholar]
- [5].Tannen A, Bours G, Halfens R, et al. A comparison of pressure ulcer prevalence rates in nursing homes in the Netherlands and Germany, adjusted for population characteristics. Res Nurs Health 2006;29:588–96. [DOI] [PubMed] [Google Scholar]
- [6].Hurd T, Posnett J. Point prevalence of wounds in a sample of acute hospitals in Canada. Int Wound J 2009;6:287–93. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [7].Kottner J, Wilborn D, Dassen T, et al. The trend of pressure ulcer prevalence rates in German hospitals: results of seven cross-sectional studies. J Tissue Viability 2009;18:36–46. [DOI] [PubMed] [Google Scholar]
- [8].Vanderwee K, Clark M, Dealey C, et al. Pressure ulcer prevalence in Europe: a pilot study. J Eval Clin Pract 2007;13:227–35. [DOI] [PubMed] [Google Scholar]
- [9].Whittington KT, Briones R. National prevalence and incidence study: 6-year sequential acute care data. Adv Skin Wound Care 2004;17:490–4. [DOI] [PubMed] [Google Scholar]
- [10].Demarre L, Van Lancker A, Van Hecke A, et al. The cost of prevention and treatment of pressure ulcers: a systematic review. Int J Nurs Stud 2015;52:1754–74. [DOI] [PubMed] [Google Scholar]
- [11].McInnes E, Jammali-Blasi A, Bell-Syer SEM, et al. Support surfaces for treating pressure ulcers. Cochrane Database Syst Rev 2018;11:CD009490. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [12].Malbrain M, Hendriks B, Wijnands P, et al. A pilot randomised controlled trial comparing reactive air and active alternating pressure mattresses in the prevention and treatment of pressure ulcers among medical ICU patients. J Tissue Viability 2010;19:7–15. [DOI] [PubMed] [Google Scholar]
- [13].McGinnis E, Brown S, Collier H, et al. Pressure relieving support surfaces: a Randomised Evaluation 2 (PRESSURE 2) photographic validation sub-study: study protocol for a randomised controlled trial. Trials 2017;18:132. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [14]. Finnegan MJ, Gazzerro L, Finnegan JO, et al. Comparing the effectiveness of a specialized alternating air pressure mattress replacement system and an air-fluidized integrated bed in the management of post-operative flap patients: a randomized controlled pilot study. J Tissue Viability. 2008;17:0–9. [DOI] [PubMed] [Google Scholar]
- [15].Rosenthal MJ, Felton RM, Nastasi AE, et al. Healing of advanced pressure ulcers by a generic total contact seat: 2 randomized comparisons with low air loss bed treatments. Aech Phys Med Rehab 2004;84:1733–42. [DOI] [PubMed] [Google Scholar]
- [16].Keogh A, Dealey C. Profiling beds versus standard hospital beds: effects on pressure ulcer incidence outcomes. J Wound Care 2001;10:15–9. [DOI] [PubMed] [Google Scholar]
- [17].Cassino R, Ippolito AM, Cuffaro C, et al. A controlled, randomised study on the efficacy of two overlays in the treatment of decubitus ulcers. Minerva Chir 2013;68:105–16. [PubMed] [Google Scholar]
- [18].Strauss MJ, Gong J, Gary BD, et al. The cost of home air-fluidized therapy for pressure sores. A randomized controlled trial. J Fam Practice 1991;33:52–9. [PubMed] [Google Scholar]
- [19].McInnes E, Dumville JC, Jammali-Blasi A, et al. Support surfaces for treating pressure ulcers. Cochrane Database Syst Rev 2011;7:CD009490. [DOI] [PubMed] [Google Scholar]
- [20].Munro BH, Brown L, Heitman BB. Pressure ulcers: One bed or another?: How does an air-fluidized bed compare with pads and other devices on a standard bed? Geriatr Nurs 1989;10:190–2. [DOI] [PubMed] [Google Scholar]
- [21].Brown S, Smith IL, Brown JM, et al. Pressure relieving support surfaces: A Randomised Evaluation 2 (PRESSURE 2): Study protocol for a randomised controlled trial. Trials 2016;17:604. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [22].Russell L, Reynolds TM, Carr J, et al. Randomised controlled trial of two pressure-relieving systems. J Wound Care 2000;9:52–5. [DOI] [PubMed] [Google Scholar]
- [23].Nixon J, Nelson EA, Cranny G, et al. Pressure relieving support surfaces: a randomised evaluation. Health Technol Assess 2006;10: iii-iv, ix-x, 1-163. [DOI] [PubMed] [Google Scholar]
- [24].Williamson PR, Altman DG, Bagley H, et al. The COMET Handbook: version 1.0. Trials 2017;18:280. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [25].Kirkham JJ, Gorst S, Altman DG, et al. Core Outcome Set-STAndards for reporting: the COS-STAR statement. PLoS Med 2016;13:e1002148. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [26].Tian JH, Zhang J, Ge L, et al. The methodological and reporting quality of systematic reviews from China and the USA are similar. J Clin Epidemiol 2017;85:50–8. [DOI] [PubMed] [Google Scholar]
- [27]. COMET Initiative. http://www.comet-initiative.org/. [Google Scholar]
- [28].Mokkink LB, Terwee CB, Patrick DL, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res 2010;19:539–49. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [29].Sinha IP, Gallagher R, Williamson PR, et al. Development of a core outcome set for clinical trials in childhood asthma: a survey of clinicians, parents, and young people. Trials 2012;13:103. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [30].Qiu R, Li M, Zhang X, et al. Development of a core outcome set (COS) and selecting outcome measurement instruments (OMIs) for non-valvular atrial fibrillation in traditional Chinese medicine clinical trials: study protocol. Trials 2018;19:541. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [31].Sinha IP, Smyth RL, Williamson PR. Using the Delphi technique to determine which outcomes to measure in clinical trials: recommendations for the future based on a systematic review of existing studies. PLoS Med 2011;8:e1000393. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [32].McMillan SS, King M, Tully MP. How to use the nominal group and Delphi techniques. Int J Clin Pharm-Net 2016;38:655–62. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [33].Rutges JP, Kempen DH, van Dijk M, et al. Outcome of conservative and surgical treatment of pyogenic spondylodiscitis: a systematic literature review. Eur Spine J 2016;25:983–99. [DOI] [PubMed] [Google Scholar]
- [34].Guyatt GH, Oxman AD, Kunz R, et al. GRADE guidelines: 2. Framing the question and deciding on important outcomes. J Clin Epidemiol 2011;64:395–400. [DOI] [PubMed] [Google Scholar]
- [35].Thorlacius L, Ingram JR, Garg A, et al. Protocol for the development of a core domain set for hidradenitis suppurativa trial outcomes. BMJ Open 2017;7:e014733. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [36].Young A, Brookes S, Rumsey N, et al. Agreement on what to measure in randomised controlled trials in burn care: study protocol for the development of a core outcome set. BMJ Open 2017;7:e017267. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [37].Akinremi A, Turnbull AE, Chessare CM, et al. Delphi panelists for a core outcome set project suggested both new and existing dissemination strategies that were feasibly implemented by a research infrastructure project. J Clin Epidemiol 2019;114:104–7. [DOI] [PubMed] [Google Scholar]
- [38].Gao Y, Ge L, Ma X, et al. Methodology and reporting quality of Cochrane network meta-analyses provides the room to improve the network geometry and inconsistency. J Clin Epidemiol 2019;113:214–27. [DOI] [PubMed] [Google Scholar]
- [39]. PROSPERO. https://www.crd.york.ac.uk/prospero/. [Google Scholar]