Abstract
Study design
Systematic review.
Objectives
To examine use of theory and quality of reporting in skin care self-management interventions for people with SCI.
Setting
International.
Methods
The Theory Coding Scheme (TCS) and the Template for Intervention Description and Replication (TIDieR) checklist were applied by two independent researchers to 17 interventions identified in a systematic review of self-management interventions for skin care in people with SCI.
Results
Six (35%) of the 17 interventions reviewed were reported to have a theoretical basis. Theories used included three of the most commonly featured in health behavior research (the Health Belief Model, Social Cognitive Theory, and the Transtheoretical Model). In these six interventions, theory was used to design content but not to select participants or tailor strategies. None of the interventions were used to test theories in the SCI population, or to propose theoretical refinements. Reporting quality was found to vary by TIDieR item, with 6–100% of interventions including recommended information. Information on two intervention fidelity items was missing in 53 and 82% of descriptions.
Conclusions
Use of theory and reporting quality in SCI self-management research remains suboptimal, potentially slowing down advancements in this area of research. Rehabilitation researchers should direct their efforts toward improving these practices to help build a science of SCI self-management that is cumulative and reproducible by clinicians, scientists, and policy makers.
Sponsorship
This work was funded through a postdoctoral fellowship awarded to the first author by the Rick Hansen Institute.
Introduction
Pressure ulcers (or injuries) are one of the commonest and most challenging clinical problems people with a spinal cord injury (SCI) experience. They can result in recurrent hospitalizations, surgeries, and are life-threatening in end-stage cases [1]. They have become a health care priority in recent years, particularly now that most pressure ulcers in clinical settings are considered avoidable with appropriate care [2]. Following their time in acute and rehabilitation settings, newly injured people with SCI discharged back to the community are required to engage in preventative skin care behaviors similar to those adopted in clinical settings (e.g., skin checks, pressure relief, protein intake) [3]. Research, however, suggests that adherence to these SCI skin care recommendations is suboptimal [4, 5]. Consequently, a growing number of self-management interventions have been designed to equip people with a SCI with the necessary knowledge, skills, and confidence to engage in these preventative skin care behaviors. Despite these efforts, a trend toward an increase in pressure ulcer prevalence in community-dwelling people with SCI has been observed [6].
In light of the pressing problem that pressure ulcers pose in the SCI population and the severity of their consequences, the need for the SCI self-management researchers to build a solid evidence base in a timely manner is reinforced. One concern that jeopardizes this is that rehabilitation and self-management evaluations are often considered to be a “black box” [7, 8]. In science, this labeling usually refers to two main problems. The first problem is that researchers do not always explicitly report the theories on which the interventions and evaluations they design are based [9]. Although this could be the result of poor reporting practices, it is likely to reflect actual lack of theory use at the study design stage. Interventions designed without theoretical considerations may be unclear about the specific behavior(s) or outcomes they target, the processes they aim to change, the mechanism through which anticipated effects may occur, or the methods used to assess this impact [10]. Failure to use theory therefore impedes the efficacy and understanding of these interventions and limits the learning that can be used in future intervention planning [10]. The second problem that results in the “black box” labeling is the poor reporting of treatment descriptions. Incomplete reporting of intervention descriptions affects the building of an evidence base by making difficult the interpretation and replication of study results [11]. Researchers cannot interpret or reproduce interventions on which essential information is missing or unclear (e.g., unclear about the active ingredients delivered, mode(s) of delivery, timing, dosage, location, intervention providers). Collecting and reporting data on intervention fidelity is part of the accurate description of tested interventions [11]. Modifications of intervention protocols during implementation need to be described with transparency for correct interpretation of outcomes and replication to be possible.
Shortcomings in theory use and intervention reporting are not specific to rehabilitation and self-management sciences [9]. Their detrimental effect on the building of a solid evidence base is likely amplified by the inherent complexity of the interventions delivered in these areas of work. Given these concerns and the pressing need for effective SCI skin care self-management interventions, our program of work aims to examine the existing evidence base on these interventions. A first project consisted in a systematic review to investigate skin care self-management interventions (see published protocol [12]). Results of this systematic review are reported in two publications. A first publication details findings on the content and effectiveness of these interventions [13]. This second publication reports on the use of theory and quality of intervention reporting in these interventions. By assessing the state of these research practices in SCI skin care self-management research, our aim is to highlight practice gaps that, if addressed, can strengthen the available evidence base.
Methods
Search strategy
Electronic bibliographic databases: Search strategies that included terms relating to SCI, self-management, and skin care were designed for nine electronic bibliographic databases (MEDLINE, Embase, PsycINFO, CENTRAL, CINAHL, REHABDATA, CIRRIE, PeDro, ERIC) and reviewed by a librarian for comprehensiveness and accuracy. They were run on 23 February 2016.
Additional data sources: JSB searched for relevant papers using (1) posters, abstracts, and conference proceedings identified in electronic bibliographic database search results, (2) hand-searching of reference lists in relevant protocols, systematic reviews, and of eligible studies, (3) keyword searches in electronic prospective trial registers on 21 June 2016 (World Health Organization International Clinical Trials Registry, and the Meta-Register of Controlled Trials). Authors or principal investigators of relevant studies were contacted to identify relevant published or forthcoming publications.
Search strategies applied to electronic databases are presented in Supplementary Information 1.
Eligibility criteria
As per protocol [12], eligibility criteria listed in Table 1 were defined to address a series of research questions including theory use and intervention reporting quality. Requirements relating to measurement of outcomes of interest were used to help determine whether an intervention was sufficiently skin care oriented for inclusion in this review.
Table 1.
Inclusion criteria | |
---|---|
Publication status | Published papers only |
Publication date | No restrictions |
Language | English |
Study design | Randomized controlled trials and non-randomized trials |
Control or comparison | At least one control group No restrictions on number of intervention groups |
Population | At least 50% of participants diagnosed with a spinal cord injury |
Intervention | Interventions aiming to improve, at least in part, self-management skin care capabilities related to pressure ulcer prevention |
Intervention setting | No restrictions |
Outcome | Measurement of at least one outcome of interest: mediators of skin care behaviors (e.g., knowledge, self-efficacy, or skills in relation to skin care or pressure ulcer prevention etc.), skin care behaviors (e.g., skin checks, pressure relief), and pressure ulcer-related clinical outcomes (e.g., incidence, reoccurrence, severity, or hopsitalization) |
Length of follow-up | No restrictions |
Exclusion criteria | Interventions with a primary focus on pressure ulcer treatment Interventions with a primary focus on lifestyle-related behaviors that affect physiological indicators of skin health (e.g., improving nutritional intake or physical activity, smoking cessation) |
Study selection
Two-level screening (first titles and abstract, then full texts) of bibliographic database search results was performed by two independent reviewers (JSB and JMS). Publications identified in additional data sources by JSB and considered to have relevant titles and abstracts were referred to the second reviewer (JMS) for same level screening (publications considered irrelevant by JSB were not reviewed by JMS). Full texts of publications approved by JMS for full-text review were then retrieved and screened independently by JSB and JMS. A third reviewer (JMG) was consulted if JSB and JMS could not agree on a screening outcome during any of the above screening processes. Discussions continued until consensus was reached.
Data extraction
Excel spreadsheets were designed to capture information relevant to items in the theory use and intervention reporting tools described below. Two researchers (JSB and KJS) with experience in health psychology and knowledge translation independently applied these two tools to the interventions described in eligible papers. Published materials linked to eligible studies via personal communications with authors of included papers or in-text references, as well as during reference screening, were used in data extraction. A third party (JG) was consulted if disagreements between the two reviewers during data extraction remained unresolved after discussion.
Use of theory
The Theory Coding Scheme (TCS) [14] is a 19 item checklist that allows for an in-depth analysis of whether and how theory is used in the design and evaluation of behavioral interventions. Each item is coded “Yes” or “No” and the tool has been shown to have good inter-rater reliability [14]. The coding scheme items cover six domains: (1) is theory mentioned?, (2) are the relevant theoretical constructs targeted?, (3) is theory used to select recipients or tailor interventions?, (4) are the relevant theoretical constructs measured?, (5) is theory tested?, and (6) is theory refined?. Following communications with the authors of the TCS, items 13 and 14 (assessing the quality of the measures used and presence of successful randomization methods) were removed as they were not considered relevant to theory use. As per TCS instructions, the TCS was applied using the information provided for each intervention. We used example papers previously reported [15] to explicitly describe links between theory and intervention techniques to guide our application of items 7–11. Diagram explanations to help interpret these items can be found in the original TCS paper [14].
Intervention reporting quality
The Template for Intervention Description and Replication (TIDieR) [11] is a reporting guideline that can be used to assess completeness of intervention descriptions. It proposes 12 essential elements to include in the description of a health intervention including brief name of intervention (item 1), why (i.e., rationale, or theory underlying intervention, item 2), what (intervention materials for participants and providers, items 3a and 3b), intervention procedures (item 4), who provided (intervention providers, item 5), how (modes of delivery, item 6a; individual or group, item 6b), where (intervention setting, item 7), when and how much (i.e., number of sessions, item 8a; schedule/frequency, item 8b; duration of sessions, item 8c), tailoring (i.e., what, why, when, and how intervention was personalized, item 9), modifications (changes to protocol, item 10), how well (fidelity assessment methods, item 11a; fidelity promotion strategies, 11b), and extent to which intervention was delivered as planned (actual fidelity, item 12). Each item is coded “No, not fully reported” (no mention or incomplete information in intervention description) or “Yes, fully reported” (complete information available). The decision rules applied are provided in Supplementary Information 2.
Results
A PRISMA flow diagram is available in Supplementary Information 3. Ten randomized controlled trials and five non-randomized trials testing 17 interventions were identified to meet the inclusion criteria. Interventions (k) consisted of structured educational programs (k = 5) [16–21], telehealth (k = 6) [22–26], wheelchair skills training (k = 3) [27–29], risk assessment and feedback (k = 2) [30, 31], and body positioning training (k = 1) [32]. They were delivered across a range of settings (e.g., inpatient, outpatient, community settings) and varied in length and the extent of their focus on skin care. A detailed description of study characteristics is not within the scope of this publication, but is available elsewhere [13]. Scientific publications linked to primary papers and used for data extraction included papers on intervention development/content [33, 34], protocol [35], pilot test [36], and an erratum [16].
Use of theory
Table 2 illustrates how theory was used in the design and evaluation of the 17 interventions reviewed. Six interventions [19–21, 25, 26, 29, 32] were explicitly reported to have based their intervention on theory (i.e., item five coded “yes”) with four [19, 20, 29, 32] based on a single theory (item 3). The behavioral theories reported to guide intervention design in the six interventions with a theoretical basis were Social Cognitive Theory (k = 2 [25, 26, 29]), Operant Conditioning (k = 2 [21, 32]), Multidimensional Theory of Motivation (k = 1 [20]), the Health Belief Model (k = 1 [19]), the Transtheoretical Model (k = 1 study [25, 26]), Information Theory (applied to optimize educational information intake and uptake) (k = 1 study [21]), and Cognitive Dissonance Theory (k = 1 [21]). Two further interventions [16–18] based their intervention design on the Chronic Care Model, which includes a reference to improving patient self-management via patient activation but is not a behavioral theory per se (i.e., does not propose relationships between predictor variables and behavior). Of the six interventions with a reported theoretical basis, three (50%) [19, 29, 32] mentioned a targeted construct as a predictor of behavior (self-efficacy, motivation, and stimulus-response association, i.e., behavioral reinforcer) and provided evidence to support this link (item 2). The remaining three interventions [20, 21, 25, 26] also mentioned predictors of behavior (self-efficacy [25, 26], motivation [20], and knowledge and skills [21]), but failed to provide supporting evidence linking these constructs to targeted self-management behaviors.
Table 2.
TCS items | Garber (2002), Rintala (2008)* | Guihan (2014)* | Phillips (2002)- Video* | Phillips (2002)-Phone* | Houlihan (2013), Mercier (2015)* | Hossain (2016)* | Worobey (2016)* | Best (2016)* | Ozturk (2011)* | Rowland (2006)* | Rottkamp (1976)* | Scotzin (1990) | Schopp (2007) | Norris (1982) | Phillips (1999)- Video | Phillips (1999)- Phone | Kennedy (2003) | % |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
1. Theory/model of behavior | Y | Y | Y | Y | Y | Y | Y | 41 | ||||||||||
2. Targeted construct mentioned (with supporting evidence) | Y | Y | Y | Y | 24 | |||||||||||||
3. Based on single theory | Y | Y | Y | Y | Y | 29 | ||||||||||||
4. Theory used to select recipients | 0 | |||||||||||||||||
5. Theory used to select/develop intervention techniques | Y | Y | Y | Y | Y | Y | 35 | |||||||||||
6. Theory used to tailor intervention techniques to recipients | 0 | |||||||||||||||||
7. All intervention techniques explicitly linked to at least one theory-relevant construct | 0 | |||||||||||||||||
8. At least one, but not all, intervention techniques explicitly linked to at least one theory-relevant construct | Y | Y | Y | 18 | ||||||||||||||
9. Group of techniques are linked to a group of constructs | 0 | |||||||||||||||||
10. All theory-relevant constructs explicitly linked to at least one intervention technique | 0 | |||||||||||||||||
11. At least one, but not all, theory-relevant constructs explicitly linked to at least one intervention technique | Y | Y | Y | Y | 24 | |||||||||||||
12. Theory-relevant constructs are measured | Y | Y | Y | 18 | ||||||||||||||
13. Changes in measured theory-relevant constructs | Y | Y | Y | 18 | ||||||||||||||
14. Mediational analysis of construct(s) | 0 | |||||||||||||||||
15. Results discussed in relation to theory | 0 | |||||||||||||||||
16. Appropriate support for theory | 0 | |||||||||||||||||
17. Results used to refine theory | 0 |
Notes: Items 13 and 14 of the Theory Coding Scheme (TCS) were not applied in this study. Y yes
Interventions marked with an * were tested in randomized controlled trials, the remaining interventions were tested in non-randomized trials
Explanations of how theory guided the design and evaluation of interventions were limited and vague (Table 2, items 4–19).
Intervention reporting quality
Table 3 presents results of our application of the TIDierR checklist to the 17 interventions reviewed. A summary display of these results is available in Supplementary File 4. None of the intervention descriptions included complete information on all TIDieR items. There were fifteen interventions for which complete information was provided on more than 50% of TIDieR items.
Table 3.
TIDieR item | Garber (2002), Rintala (2008)* | Guihan (2014)* | Phillips (2002)- Video* | Phillips (2002)-Phone* | Houlihan (2013), Mercier (2015)* | Hossain (2016)* | Worobey (2016)* | Best (2016)* | Ozturk (2011)* | Rowland (2006)* | Rottkamp (1976)* | Scotzin (1990) | Schopp (2007) | Norris (1982) | Phillips (1999)- Video | Phillips (1999)- Phone | Kennedy (2003) | % |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
1. Brief name | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | 100 |
2. Rationale | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | 71 | |||||
3. What: intervention materials | ||||||||||||||||||
3a. For participants | Y | Y | Y | Y | Y | Y | Y | Y | Y | 53 | ||||||||
3b. For providers | Y | Y | Y | Y | Y | 29 | ||||||||||||
4. Intervention procedures | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | 71 | |||||
5. Who provided the intervention | Y | Y | Y | Y | Y | Y | Y | Y | Y | 53 | ||||||||
6. How | ||||||||||||||||||
6a. Mode(s) of delivery | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | 94 | |
6b. Individual or group | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | 88 | ||
7. Location of intervention | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | 88 | ||
8. When and how much | ||||||||||||||||||
8a. No. of sessions | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | 94 | |
8b. Schedule/frequency sessions | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | 82 | |||
8c. Duration of sessions | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | 59 | |||||||
9. Tailoring of intervention | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | 59 | |||||||
10. Modifications | Y | 6 | ||||||||||||||||
11. How well (planned) | ||||||||||||||||||
11a. Fidelity assessment methods | Y | Y | Y | 18 | ||||||||||||||
11b. Fidelity promotion strategies | Y | Y | Y | Y | Y | Y | Y | Y | 47 | |||||||||
12. Actual fidelity (results) | Y | Y | Y | Y | Y | Y | 35 |
Note: Y yes, fully reported; empty cells indicate the TIDieR item was rated No, not fully reported
Interventions marked with an * were tested in randomized controlled trials, the remaining interventions were tested in non-randomized trials
The papers reviewed were published between 1976 and 2016. There was no clear pattern in the data suggesting improvements in reporting quality over time. It is noteworthy, however, that the two interventions reported the least comprehensively were published in earlier years (1990 [20] and 2003 [31]), and that the mean proportion of items fully reported on in the 4 interventions reported after 2014 (publication date of the TIDieR guidelines) was slightly higher (74%) than in the 13 studies published on or before this date (59%).
Results suggest that multiple TIDieR items were incompletely reported in the intervention descriptions reviewed, including intervention materials (item 3), who provided the intervention (item 5), duration of sessions (item 8c), tailoring of intervention (item 9), modifications (item 10), fidelity assessment methods (item 11a), presence of fidelity strategies (i.e., development of intervention manuals, training of interventionists, or methods to monitor intervention fidelity; item 11b), and actual intervention fidelity assessment results (item 12). In some cases, efforts were made to report some aspects of the above items, but insufficient information to rate an item as “fully reported” was reported (see decision rules in Supplementary File 2). This was more often the case for the TIDieR items on “who provided the intervention” (item 5) and on “fidelity assessment methods” (item 11a). Several studies reported only the disciplinary background of intervention providers (e.g., nurse, occupational therapist) without specifying additional information on years of experience, number of providers, or specific training provided to deliver the intervention. Similarly, how the fidelity assessment was performed may have been indicated (e.g., survey, detailed logs) but details on who performed this assessment or kept these records may have been missing. Finally, some interventions as described did not appear to include any form of tailoring (item 9) but this was not explicitly stated by the authors, leaving readers with some degree of uncertainty.
Discussion
To the best of our knowledge, this study is the first to investigate theory use and quality of reporting in self-management interventions for people with SCI that include a focus on skin care behaviors. Only 6 (35%) of the 17 interventions reviewed were explicitly reported to have a theoretical basis. This is considerably lower than findings from a systematic review of physical activity interventions for people with a physical disability [37] (94% of studies theory-informed). Although there are differences in the methods used to assess theory use in this study, this comparison suggests that theory may currently play a lesser role in SCI skin care self-management research than it does in other areas, despite the applicability of behavioral theories to the field of rehabilitation [38]. In addition, we found that very few explicit links between BCTs and targeted theoretical constructs were articulated compared to a review of behavioral interventions on physical activity and diet [9]. These findings tend to confirm prior observations on the suboptimal reliance on, and reporting of, theory use in intervention design and evaluation in rehabilitation [38]. Although theory-relevant constructs were measured in half of the six theory-based interventions in our analysis, statistical investigations of pathways of change (mediation analyses) were absent (0%), as were discussions of theoretical basis (0%) or suggestions for theory refinements (0%). It is debatable whether empirical research should always include formal theory testing or propose theory refinements, but other reviews of health behavior research have reported higher rates for the above three types of theory use [9, 39]. One explanation for the identified lack of theory use in this study may be a historical tendency within the SCI field to consider interventions focused on prevention of pressure ulcers (or other secondary conditions) from a biomedical rather than a behavioral perspective. Behavioral approaches are certainly warranted when one considers that pressure ulcers are perceived as mostly preventable [3]. Rehabilitation practices targeting prevention typically focus on the adoption and routine performance of skin care behaviors such as regular off-loading of pressure, checking of skin, and appropriate nutrition and fluid intake, among others. A shift to considering behavioral approaches is becoming more evident in recent SCI self-management literature, and may be partially attributed to SCI-specific funding agencies directing funds toward psychosocial research.
In light of our findings, Dunn and colleagues’ recommendations for rehabilitation researchers on theory use and development seem particularly relevant [38]. They include encouragements to (1) identify key variables and the relationships among them to develop a theoretical narrative, (2) link the psychological (cognitions and emotions) with the behavioral, (3) articulate a theory’s prediction clearly and completely, and (4) take small steps toward theory development by embarking on small, manageable empirical projects that test a few, clearly defined propositions, (5) use a combination of quantitative and qualitative methods of inquiry to move toward expanding relevant theories on the basis of logical extensions and results of previous work. Evidence suggests that theory-based interventions result in larger effects, possibly because they are more aligned with the problem and context, or because studies that test them are built with greater care, fidelity, and structure [40]. Researchers who remain unsure of the value in using theory, or for whom use of theory appears daunting, may benefit from Davidoff and colleagues’ work “Demystifying theory and its use in improvement” [10].
Theories reported to have been used in the interventions reviewed in our work included Social Cognitive Theory, the Health Belief Model, and the Transtheoretical Model. These are also the three most commonly used theories in health behavior research [39]. There are over 80 behavioral theories [41], and selecting a theory is a challenging task for intervention designers for whom little guidance is available. More important than using “favorite” theories is the need to select a theoretical basis that is suited to the characteristics of the target population and behavior. Conducting formative research on the factors that influence specific behaviors in a specific population can help selecting a theory. For example, the Theoretical Domains Framework [42] is a tool designed by psychologists and implementation researchers. Researchers should consider its use to inform the design of theory-informed health interventions. It allows for the identification of barriers/facilitators to health behaviors, and the design of tailored and theory-driven interventions. Finally, the validity of any theoretical model should be critically examined prior to use in intervention design. The scientific merit of the Transtheoretical Model for example has been questioned, with some believing it should be abandoned [43].
In terms of intervention reporting quality, our study found high variability in reporting quality across TIDieR items, with complete reporting occurring in 6–100% of interventions. Similar trends to those observed in the current study were found in a review of stroke rehabilitations interventions [44] in which items on intervention and providers, tailoring and modifications, and intervention fidelity were under-reported. It is likely that the nature of some interventions influences the type of information reported in intervention descriptions. For example, a review [45] of supervised exercise training interventions found tailoring to be one of the most well-reported TIDieR items. Compared to self-management interventions, it may be that these interventions are more often delivered to individuals rather than groups, making the personalization component a potentially unique and well-articulated characteristic of the intervention. Authors should aim to report complete information relevant to all TIDieR items, irrespective of intervention type. Where word count is problematic, supplementary materials should be submitted alongside a publication offering a more comprehensive description of the intervention. To report on intervention fidelity, assessment methods need to be considered during study design. Published recommendations [46] to address intervention fidelity in health behavior research can act as a starting point for researchers aiming to include intervention fidelity components in their evaluations.
An interesting finding from our study is that while 6 (35%) interventions were reported to have a theoretical basis, a rationale to support a proposed mechanism of change was mentioned in 12 (71%) interventions. These results are encouraging as they suggest researchers’ reliance on theories of change (i.e., logic models), even though these are not always theory-driven. This is not necessarily surprising, as a majority of SCI researchers and clinicians are likely to base their study design on a logic model. Explicitly formulating these theories of change and assumptions will improve the evaluation of complex health interventions as they allow the research community to reach a better understanding of how and why a program works [47]. Breuer and colleagues [47] propose a checklist to guide the comprehensive description of theories of change. These recommendations are relevant for rehabilitation researchers designing and reporting intervention research with or without a theoretical basis.
The strengths of this review lies in the reliance on standardized approaches to assess use of theory and intervention reporting quality, and in the involvement of two independent reviewers to apply assessment tools. Eligibility criteria for the review required papers to report the results of an evaluation. Papers describing intervention design and development may have been missed. The effects of this limitation are likely small as references cited in papers and related to tested interventions were consulted. Materials used during intervention delivery (e.g., scripts, PowerPoint slides, educational brochures) were not used in data extraction. Their use may have influenced TIDieR items on intervention content and delivery. This, however, was a deliberate decision, as the TIDieR reporting guidelines aim to improve the descriptions of interventions provided within scientific publications only. Finally, we did not apply the TIDieR tool to control group treatment descriptions. Complete control group treatment descriptions have clinical importance, avoid flawed interpretations of study results, and allow for study replication. Our content analysis of the intervention and control groups included in this review and reported elsewhere suggests that reporting quality for control group treatments was very poor [13].
In conclusion, this study suggests that skin care self-management interventions for people with SCI do to some extent remain “a black box”. A heavier reliance on theory in the design and evaluation of such trials is recommended, and will help reach a better understanding of the mechanisms through which these interventions achieve their effects and the applicability of behavioral theories to this area of work. Similarly, improving the reporting of these interventions will contribute toward building a cumulative and reproducible science of SCI self-management.
Electronic supplementary material
Acknowledgements
This work was funded by the Rick Hansen Institute. JMG holds Canada Research Chair in Health Knowledge Uptake and Transfer.
Author contributions
JSB, KJS, JMS, AA, SJ, JP, DW, JG were responsible for designing the systematic review protocol; JSB was responsible for conducting the search; JSB and JMS were responsible for screening potentially eligible studies and JG for arbitrating potentially eligible studies; JSB and KJS were responsible for extracting and analyzing the data; JSB, KJS, JMS, AA, SJ, JP, DW, JG were responsible for interpreting results; JSB, KJS, JG were responsible for designing and creating the results tables; JSB drafted the manuscript; KJS, JMS, AA, SJ, JP, DW, JG provided feedback on the drafted manuscript; JSB and KJS revised the manuscript; JSB, KJS, JMS, AA, SJ, JP, DW, JG approved the final version and agree to be accountable for all aspects of the work.
Compliance with ethical standards
Conflict of interest
Dr. Baron’s work on this study was funded by the Rick Hansen Institute. The Rick Hansen Institute did not influence study design, data collection, interpretation of findings, or preparation of this manuscript. The authors declare that they have no conflict of interest.
Electronic supplementary material
The online version of this article (10.1038/s41393-018-0136-5) contains supplementary material, which is available to authorized users.
References
- 1.Kruger EA, Pires M, Ngann Y, Sterling M, Rubayi S. Comprehensive management of pressure ulcers in spinal cord injury: current concepts and future trends. J Spinal Cord Med. 2013;36:572–85. doi: 10.1179/2045772313Y.0000000093. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Black JM, Edsberg LE, Baharestani MM, Langemo D, Goldberg M, McNichol L, et al. Pressure ulcers: avoidable or unavoidable? Results of the National Pressure Ulcer Advisory Panel Consensus Conference. Ostomy Wound Manag. 2011;57:24–37. [PubMed] [Google Scholar]
- 3.Bowman T. Preventing and treating pressure sores: a guide for people with spinal cord injuries 2015. Ontario Neurotrauma Foundation and Spinal Cord Injury Ontario Sutton: Silverback Publishing .
- 4.Bloemen-Vrencken J, Witte LP, Post MW, Heuvel WJ. Health behaviour of persons with spinal cord injury. Spinal Cord. 2007;45:243–9. doi: 10.1038/sj.sc.3101967. [DOI] [PubMed] [Google Scholar]
- 5.Walters JL, Buchholz AC, Martin Ginis K. Evidence of dietary inadequacy in adults with chronic spinal cord injury. Spinal Cord. 2009;47:318–22. doi: 10.1038/sc.2008.134. [DOI] [PubMed] [Google Scholar]
- 6.Chen Y, Devivo MJ, Jackson AB. Pressure ulcer prevalence in people with spinal cord injury: age-period-duration effects. Arch Phys Med Rehabil. 2005;86:1208–13. doi: 10.1016/j.apmr.2004.12.023. [DOI] [PubMed] [Google Scholar]
- 7.Linden A, Roberts N. Disease management interventions: what’s in the black box? Dis Manag. 2004;7:275–91. doi: 10.1089/dis.2004.7.275. [DOI] [PubMed] [Google Scholar]
- 8.Whyte J, Hart T. It’s more than a black box; it’s a Russian doll: defining rehabilitation treatments. Am J Phys Med Rehabil. 2003;82:639–52. doi: 10.1097/01.PHM.0000078200.61840.2D. [DOI] [PubMed] [Google Scholar]
- 9.Prestwich A, Sniehotta FF, Whittington C, Dombrowski SU, Rogers L, Michie S. Does theory influence the effectiveness of health behavior interventions? Meta-analysis. Health Psychol. 2014;33:465–74. doi: 10.1037/a0032853. [DOI] [PubMed] [Google Scholar]
- 10.Davidoff F, Dixon-Woods M, Leviton L, Michie S. Demystifying theory and its use in improvement. BMJ Qual Saf. 2015;24:228–38. doi: 10.1136/bmjqs-2014-003627. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Hoffmann TC, Glasziou PP, Boutron I, Milne R, Perera R, Moher D, et al. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. Br Med J. 2014;348:g1687. doi: 10.1136/bmj.g1687. [DOI] [PubMed] [Google Scholar]
- 12.Baron J, Swaine J, Presseau J, Aspinall A, Jaglal S, White B, et al. Self-management interventions to improve skin care for pressure ulcer prevention in people with spinal cord injuries: a systematic review protocol. Syst Rev. 2016;5:150. doi: 10.1186/s13643-016-0323-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Baron JS, Sullivan KJ, Swaine J, Aspinall A, Jaglal S, Presseau J, et al. Self-management interventions for skin care in people with a spinal cord injury: self-management interventions for skin care in people with a spinal cord injury: part 1—a systematic review of intervention content and effectiveness. Spinal Cord (in press). [DOI] [PMC free article] [PubMed]
- 14.Michie S, Prestwich A. Are interventions theory-based? Development of a theory coding scheme. Health Psychol. 2010;29:1–8. doi: 10.1037/a0016939. [DOI] [PubMed] [Google Scholar]
- 15.Silva MN, Marques M, Teixeira PJ. Testing theory in practice: the example of self-determination theory-based interventions. Eur Health Psychol. 2014;16:171–80. [Google Scholar]
- 16.Garber SL, Rintala DH, Holmes SA, Rodriguez GP, Friedman J. A structured educational model to improve pressure ulcer prevention knowledge in veterans with spinal cord dysfunction. J Rehabil Res Dev. 2002;39:575–88. [PubMed] [Google Scholar]
- 17.Rintala DH, Garber SL, Friedman JD, Holmes SA. Preventing recurrent pressure ulcers in veterans with spinal cord injury: impact of a structured education and follow-up intervention. Arch Phys Med Rehabil. 2008;89:1429–41. doi: 10.1016/j.apmr.2008.01.015. [DOI] [PubMed] [Google Scholar]
- 18.Guihan M, Bombardier CH, Ehde DM, Rapacki LM, Rogers TJ, Bates-Jensen B, et al. Comparing multicomponent interventions to improve skin care behaviors and prevent recurrence in veterans hospitalized for severe pressure ulcers. Arch Phys Med Rehabil. 2014;95:1246–53.e3. doi: 10.1016/j.apmr.2014.01.012. [DOI] [PubMed] [Google Scholar]
- 19.Schopp LH, Clark MJ, Hagglund KJ, Mokelke EK, Stout BJ, Mazurek MO. Evaluation of a consumer-personal assistant training project. Disabil Rehabil. 2007;29:403–10. doi: 10.1080/09638280600835903. [DOI] [PubMed] [Google Scholar]
- 20.Scotzin M. A program design to motivate individuals with SCI for self-care. ABC of behaviour change theories; an essential resource for researchers, policy makers and practitioners. Boston, MA: Silverback Publishing; 1990. [Google Scholar]
- 21.Norris WC, Vise GT, Wharton GW, Noble CE, Atrickland SB. The spinal injury learning series: an experimental test. Arch Phys Med Rehabil. 1982;63:243–8. [PubMed] [Google Scholar]
- 22.Phillips VL, Temkin A, Vesmarovich S, Burns R, Idleman L. Using telehealth interventions to prevent pressure ulcers in newly injured spinal cord injury patients post-discharge. Results from a pilot study. Int J Technol Assess Health Care. 1999;15:749–55. [PubMed] [Google Scholar]
- 23.Phillips VL, Vesmarovich S, Hauber R, Wiggers E, Egner A. Telehealth: reaching out to newly injured spinal cord patients. Public Health Rep. 2001;116:94–102. doi: 10.1093/phr/116.S1.94. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Hossain MS, Harvey LA, Rahman MA, Bowden JL, Islam MS, Taylor V, et al. A pilot randomised trial of community-based care following discharge from hospital with a recent spinal cord injury in Bangladesh. Clin Rehabil. 2016;31:781–9. doi: 10.1177/0269215516654207. [DOI] [PubMed] [Google Scholar]
- 25.Houlihan BV, Jette A, Friedman RH, Paasche-Orlow M, Ni P, Wierbicky J, et al. A pilot study of a telehealth intervention for persons with spinal cord dysfunction. Spinal Cord. 2013;51:715–20. doi: 10.1038/sc.2013.45. [DOI] [PubMed] [Google Scholar]
- 26.Mercier HW, Ni P, Houlihan BV, Jette AM. Differential impact and use of a telehealth intervention by persons with MS or SCI. Am J Phys Med Rehabil. 2015;94:987–99. doi: 10.1097/PHM.0000000000000291. [DOI] [PubMed] [Google Scholar]
- 27.Worobey LA, Kirby RL, Heinemann AW, Krobot EA, Dyson-Hudson TA, Cowan RE, et al. Effectiveness of group wheelchair skills training for people with spinal cord injury: a randomized controlled trial. Arch Phys Med Rehabil. 2016;97:1777–84.e3. doi: 10.1016/j.apmr.2016.04.006. [DOI] [PubMed] [Google Scholar]
- 28.Ozturk A, Ucsular FD. Effectiveness of a wheelchair skills training programme for community-living users of manual wheelchairs in Turkey: a randomized controlled trial. Clin Rehabil. 2011;25:416–24. doi: 10.1177/0269215510386979. [DOI] [PubMed] [Google Scholar]
- 29.Best KL, Miller WC, Huston G, Routhier F, Eng JJ. Pilot study of a peer-led wheelchair training program to improve self-efficacy using a manual wheelchair: a randomized controlled trial. Arch Phys Med Rehabil. 2016;97:37–44. doi: 10.1016/j.apmr.2015.08.425. [DOI] [PubMed] [Google Scholar]
- 30.Rowland JL, White GW, Wyatt DA. Analysis of an intervention to reduce or prevent secondary conditions for people with spinal cord injuries. J Clin Psychol Med Settings. 2006;13:261–9. doi: 10.1007/s10880-006-9032-9. [DOI] [Google Scholar]
- 31.Kennedy P, Berry C, Coggrave M, Rose L, Hamilton L. The effect of a specialist seating assessment clinic on the skin management of individuals with spinal cord injury. J Tissue Viability. 2003;13:122–5. doi: 10.1016/S0965-206X(03)80017-7. [DOI] [PubMed] [Google Scholar]
- 32.Rottkamp BC. An experimental nursing study: a behavior modification approach to nursing therapeutics in body positioning of spinal cord-injured patients. Nurs Res. 1976;25:181–6. doi: 10.1097/00006199-197605000-00004. [DOI] [PubMed] [Google Scholar]
- 33.Norris W, Strickland SB, Noble CE. SILS: spinal injury learning series. Jackson: Mississippi Methodist Rehabilitation Center, University Press of Mississippi; 1981. [Google Scholar]
- 34.Houlihan BV, Jette A, Paasche-Orlow M, Wierbicky J, Ducharme S, Zazula J, et al. A telerehabilitation intervention for persons with spinal cord dysfunction. Am J Phys Med Rehabil. 2011;90:756–64. doi: 10.1097/PHM.0b013e31820b140f. [DOI] [PubMed] [Google Scholar]
- 35.Hossain MS, Harvey LA, Rahman MA, Muldoon S, Bowden JL, Islam MS, et al. Community-based InterVentions to prevent serIous Complications (CIVIC) following spinal cord injury in Bangladesh: protocol of a randomised controlled trial. BMJ Open. 2016;6:e010350. doi: 10.1136/bmjopen-2015-010350. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Wyatt DWG. Reducing secondary conditions for spinal-cord-injured patients: pilot testing a risk assessment and feedback instrument. Top Spinal Cord Inj Rehabil. 2000;6:9–22. doi: 10.1310/8JG6-XT2T-5NT2-6R5L. [DOI] [Google Scholar]
- 37.Tomasone JR, Flood SM, Ma JK, Scime NV, Burke SM, Sleeth L, et al. The SCIRE research team. Physical activity self-management interventions for adults with spinal cord injury: part 1—a systematic review of the use and effectiveness of behavior change techniques. Psychol Sport Exerc. https://www.sciencedirect.com/science/article/pii/S1469029217304387 2018; in press.
- 38.Dunn DS, Elliott TR. The place and promise of theory in rehabilitation psychology. Rehabil Psychol. 2008;53:254–67. doi: 10.1037/a0012962. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Painter JE, Borba CP, Hynes M, Mays D, Glanz K. The use of theory in health behavior research from 2000 to 2005: a systematic review. Ann Behav Med. 2008;35:358–62. doi: 10.1007/s12160-008-9042-y. [DOI] [PubMed] [Google Scholar]
- 40.Glanz K, Bishop DB. The role of behavioral science theory in development and implementation of public health interventions. Annu Rev Public Health. 2010;31:399–418. doi: 10.1146/annurev.publhealth.012809.103604. [DOI] [PubMed] [Google Scholar]
- 41.Michie S, West R, Campbell R, Brown J, Gainforth H. ABC of behaviour change theories; an essential resource for researchers, policy makers and practitioners. Sutton: Silverback Publishing; 2014.
- 42.Cane J, O’Connor D, Michie S. Validation of the theoretical domains framework for use in behaviour change and implementation research. Implement Sci. 2012;7:37. doi: 10.1186/1748-5908-7-37. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.West R. Time for a change: putting the transtheoretical (stages of change) model to rest. Addiction. 2005;100:1036–9. doi: 10.1111/j.1360-0443.2004.00995.x. [DOI] [PubMed] [Google Scholar]
- 44.Walker MF, Hoffmann TC, Brady MC, Dean CM, Eng JJ, Farrin AJ, et al. Improving the development, monitoring and reporting of stroke rehabilitation research: consensus-based core recommendations from the stroke recovery and rehabilitation roundtable. Int J Stroke. 2017;12:472–9. doi: 10.1177/1747493017711815. [DOI] [PubMed] [Google Scholar]
- 45.Tew GA, Brabyn S, Cook L, Peckham E. The completeness of intervention descriptions in randomised trials of supervised exercise training in peripheral arterial disease. PLoS ONE. 2016;11:e0150869. doi: 10.1371/journal.pone.0150869. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Bellg AJ, Borrelli B, Resnick B, Hecht J, Minicucci DS, Ory M, et al. Enhancing treatment fidelity in health behavior change studies: best practices and recommendations from the NIH Behavior Change Consortium. Health Psychol. 2004;23:443–51. doi: 10.1037/0278-6133.23.5.443. [DOI] [PubMed] [Google Scholar]
- 47.Breuer E, Lee L, De Silva M, Lund C. Using theory of change to design and evaluate public health interventions: a systematic review. Implement Sci. 2016;11:63. doi: 10.1186/s13012-016-0422-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.