Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2024 Apr 1.
Published in final edited form as: Arch Phys Med Rehabil. 2022 Oct 26;104(4):562–568. doi: 10.1016/j.apmr.2022.09.021

Rehabilitation Treatment Specification System: Identifying Barriers, Facilitators, and Strategies for Implementation in Research, Education, and Clinical Care

Jarrad H Van Stan 1,2,3, Jain Holmes 4, Lauren Wengerd 5, Lisa A Juckett 5, John Whyte 6, Shanti M Pinto 7, Leanna W Katz 8,9, Jeremy Wolfberg 2,3
PMCID: PMC10073238  NIHMSID: NIHMS1845125  PMID: 36306923

Abstract

Objective:

To explore rehabilitation professionals’ experiences and perspectives of barriers and facilitators to implementing the RTSS in research, education, and clinical care.

Design:

A cross-sectional survey with free text and binary responses was completed by rehabilitation professionals. Survey data was analyzed with a deductive approach of directed content analysis using two implementation science frameworks: Consolidated Framework for Implementation Research (CFIR) and the Expert Recommendations for Implementing Change (ERIC).

Setting:

Rehabilitation professionals across research, educational, and clinical settings.

Participants:

One hundred and eleven rehabilitation professionals—including speech-language pathologists, occupational therapists, physical therapists, physicians, psychologists, researchers, and clinic directors—who explored possible uses or applicaåtions of the RTSS for clinical care, education, or research.

Interventions:

Not applicable

Main outcome measures:

Frequency of reported CFIR barriers and facilitators, as well as keywords related to CFIR and ERIC constructs.

Results:

The barriers and facilitating strategies differed according to the end-users’ intended use, i.e., research, education, or clinical. Overall, the four most frequently encountered CFIR barriers were the RTSS’s complexity, a lack of available RTSS resources, reduced access to knowledge and information about the RTSS, and limited knowledge and beliefs about the RTSS. The ERIC-CFIR matching tool identified seven ERIC strategies to address these barriers, which include conducting educational meetings, developing and distributing educational materials, accessing new funding, capturing and sharing local knowledge, identifying and preparing champions, and promoting adaptability.

Conclusions:

When attempting to use the RTSS, rehabilitation professionals commonly encountered barriers to understanding and skillfully using the framework. Theory-driven implementation strategies have been identified that have potential for addressing the RTSS’s complexity and lack of educational and skill-building resources. Future work can develop the identified implementation strategies and evaluate their effects on RTSS implementation.

Keywords: Rehabilitation, therapeutics, methods, implementation science

INTRODUCTION (Original Research Article)

It is well known that rehabilitation treatments are not described in ways that explicitly identify the hypothesized active ingredients and associated improved outcomes.13 This problem impairs the field’s ability to systematically improve, compare, and clinically adopt and adapt treatments. Reporting guidelines have been the most common approach to solve this problem, as hundreds have been developed (see https://www.equator-network.org/) and most journals require that authors use a reporting guideline to be eligible for publication. However, guidelines typically list categories of information that should be described—e.g., components of a treatment, procedures for tailoring the treatment—without a theory-driven framewååork that outlines how to identify and specify the relevant aspects of treatment thought to bring about observable, functional changes.4,5

The Rehabilitation Treatment Specification System (RTSS) addresses this issue, as it is a cross-discipline, theory-driven framework proposing how to identify and describe the critical clinician actions and modified patient functions of rehabilitation treatments.6 The RTSS’s most significant theoretical advancements include guidance to parse [1] the clinician actions ostensibly responsible for modified patient functioning (i.e., ingredients) versus non-critical actions within a treatment activity, [2] ingredients’ direct versus indirect effects on various patient functions (targets versus aims, respectively), and [3] ingredients’ clinically meaningful changes in patient functioning (i.e., targets) versus modified patient functions that describe why an ingredient affects a target (i.e., mechanisms of action). In-depth description of the RTSS is outside the scope of this manuscript and can be found elsewhere.58

Multiple disciplines and condition-specific work groups have begun to practically demonstrate the benefits of RTSS application. Researchers have used the RTSS to more clearly identify/describe treatment ingredients and targets as well as their connecting mechanisms of action in voice disorders,9 social communication impairments,10 dementia,11 and aphasia.1215 Methodologists have used the RTSS to identify when rehabilitation targets and ingredients are unique or overlapping,16 code and quantify ingredients and targets in standard clinical care with high reliability and validity,17 increase the interpretability of treatment effect sizes and power analyses across theoretically dissimilar types of treatments,18,19 and revise treatment reporting guidelines.20 Rehabilitation students have shown improved clinical decision making when including the RTSS in graduate curriculum.21 Thought leaders across multiple disciplines have found the RTSS’s conceptual advancements valuable enough to write editorials recommending RTSS use in occupational therapy (OT),22 physical therapy (PT),23 and speech-language pathology (SLP).24 Finally, rehabilitation clinicians, educators, and researchers are interested in the RTSS’s theoretical advancements, as shown by 752 rehabilitation practitioners from 55 countries have downloaded the RTSS manual over the past three and a half years. This interest appears to be increasing, as the number of professionals accessing the manual has increased from seven per month in 2018 to 25 per month in 2021.

Despite the RTSS’s advancements, it is well known that innovations are often poorly adopted (if adopted at all) when no strategies are designed to explicitly facilitate their implementation.25,26 The field of implementation science provides many theory-driven frameworks2729 that can help identify the barriers and facilitators of innovation adoption/adaptation. For example, the Consolidated Framework for Implementation Research (CFIR)30 includes barrier/facilitator constructs that have been associated with implementation across multiple disciplines and hundreds of published studies. Once barriers and facilitators are identified, these frameworks can also help identify and tailor strategies to improve implementation. For example, the Expert Recommendations for Implementing Change (ERIC)31 includes a list of implementation strategy categories that, according to expert opinion, can address implementation barriers.

Traditionally, implementation projects aim to put an evidenced-based treatment, practice guideline, innovation, etc. into clinical practice. In contrast, the RTSS is a framework that should facilitate implementation of various research (identifying active ingredients, performing meta-analyses), clinical (adoption and adaptation of an evidence-based treatment), or educational (teaching clinical decision making) projects. The strategies to facilitate RTSS implementation with high fidelity will undoubtedly differ depending upon the intended application. For example, a researcher would need the skill to create an in-depth specification of their research treatment. A clinician does not need in-depth specification skills, but instead must understand how an evidence-based treatment’s specification translates to the activities they perform and document for each individual patient. While researchers and clinicians often require specifications with minimal uncertainty—i.e., they must “know” what they are delivering and the desired changes in patient functioning—educators might be more interested in specification ambiguities to facilitate clinical reasoning skills, e.g., discussing various alternative specifications for a treatment or patient.

A substantial body of literature supports the critical importance of evaluating the needs of end-users32,33 in the development or refinement of any innovation, such as the RTSS, even in the earliest stages of evidence building.34 As a first step towards developing implementation strategies, this study aimed to identify the perceived and/or experienced barriers to RTSS use as well as any perceived or experienced facilitators that addressed these barriers. It is expected that this information will directly influence the future creation of RTSS implementation strategies for researchers, educators, and clinicians.

METHODS

Survey

The design is a cross-sectional study using online survey methods. An online survey acquired information on the needs of rehabilitation stakeholder groups—especially researchers, clinicians, and educators—attempting to use the RTSS. This study did not require human subjects ethical review. As shown in Table 1, an RTSS implementation assessment survey was developed to explore how end-users used (or were unable to use) the RTSS in their rehabilitation endeavors, barriers encountered, and potential or experienced facilitators. The survey was iteratively designed by the ACRM’s Rehabilitation Treatment Specification Implementation Assessment Task Force over 4 monthly meetings. The survey was emailed to 489 rehabilitation professionals who downloaded the Manual for Rehabilitation Treatment Specification (via Research Electronic Data Capture) and/or were members of the ACRM’s Networking Group for Rehabilitation Treatment Specification (via Survey Monkey). An individual completing the survey twice was prevented by automatically linking each survey to an email address. Recruitment was optimized by the original survey email including a 3-month time limit for responses, multiple reminder emails, and an incentive. The three email reminders occurred one month later, two months later, and 1 week before the deadline. The incentive was the chance to win a $100 Amazon gift card.

Table 1.

Online survey questions and branching logic.

Questions Branching logic Response
0 Have you attempted to apply (or are planning to apply) the RTSS to your work? Always ask yes, no
1 Why have you not applied (or attempted to apply) the RTSS? If Question 0 = “no” free text
2 Please describe how you have tried to apply the RTSS, being as specific as you can. If Question 0 = “yes” free text
3 What do you think are significant barriers/ obstacles to using the RTSS in the ways you hope to? If Question 0 = “yes” free text
4 What, if anything, would be helpful to circumvent these barriers/obstacles? If Question 0 = “yes” free text

Data analysis

First, comments were classified according to the CFIR barrier and facilitator categories based on consensus agreement amongst three coders. The CFIR was chosen, out of many available frameworks, because of its application in health services (e.g., rehabilitation services) research, and its barriers have been directly mapped to the standard categories of implementation strategies in ERIC. Open-ended comments were extracted from the survey questions concerning barriers (Questions 1 and 3) and facilitators (Question 4). After being trained by an experienced CFIR coder,35,36 two coders independently classified each reported barrier and facilitator to a single CFIR construct. To guide coding, the coders used the detailed descriptions and rationales for each construct in the CFIR codebook (https://cfirguide.org/constructs/). To establish consensus, the experienced coder reconciled disagreements between the two other coders. Table 2 provides examples of original responses mapped to CFIR constructs.

Table 2.

Example CFIR coding of raw barrier and facilitator survey responses

Raw survey response CFIR code
(Barrier) Lack of understanding RTSS concept, only was exposed to 1 power point presentation about the topic and it seems more complex than that. Intervention characteristics: Complexity
Facilitator) More discipline specific applications/examples would be helpful. Intervention characteristics: Adaptability
(Facilitator) A well-organized campaign to address ASHA, AOTA, and CAPTE. Outer setting: External policy & incentives
(Barrier) It takes quite a bit of time to understand and then more time to apply it to my own work to see if it will be useful. Inner setting: Readiness: Available resources
(Facilitator) RTSS built into our EMR-system! Inner setting: Readiness: Access to knowledge & information
(Barrier) It may be difficult to get consensus to use among the 3 disciplines and to teach in the academic settings. Inner setting: Implementation climate: Compatibility
(Barrier) Lack of clear understanding when educating others on concepts Characteristics of individuals: Knowledge & beliefs about the intervention
(Facilitator) Feedback from an experienced [RTSS] user was very helpful! Process: External change agents

Second, a key word analysis was used to explore any specific barriers and facilitators underlying the more general CFIR constructs. It was also used to describe obvious differences between user groups (i.e., clinicians, educators, researchers) within each barrier or facilitator. A single rater summarized the topic(s) of each raw survey response.

Third, the CFIR-ERIC matching tool used a subset of CFIR barriers—those frequently reported by the RTSS end-users, specifically ≥2 total occurrences per subgroup—to produce expert-recommended implementation strategies. The number of CFIR barriers input into the ERIC matching tool was based on reported frequency for two reasons. First, subgroup differences cannot be explored unless a barrier is reported frequently enough to permit investigation. Thus, at least two occurrences per subgroup was chosen as a lower cutoff. Second, the publicly available CFIR-ERIC matching tool allows users to select any number of CFIR barriers and will match the summation of all, as well as individual, barriers to recommended implementation strategies endorsed by a panel of implementation scientists.37 As a result, it is pragmatically beneficial to input a parsimonious number of barriers to minimize the quantity of implementation strategies while increasing the strategies’ potential applicability. Those who did not use the RTSS were excluded from this analysis because the survey’s branching logic did not explicitly ask them about facilitators, and upon review of the responses, only one of these respondents listed a potential facilitator in their response.

RESULTS

One hundred and eleven rehabilitation professionals completed the survey (~25% response rate). To download the Rehabilitation Treatment Specification Manual, potential RTSS users were asked to report their discipline and intended use. This downloader information was used to compare survey responders and nonresponders. Survey responders and nonresponders were qualitatively similar in occupation: 32 (29%) versus 114 (30%) SLPs, 31 (28%) versus 83 (22%) OTs, 16 (14%) versus 63 (17%) PTs, 14 (13%) versus 58 (15%) Physicians, 10 (9%) versus 40 (11%) Psychologists, 8 (7%) versus 20 (5%) other occupations (respectively). Survey responders and nonresponders were qualitatively similar in two RTSS applications: clinical care projects—33 (30%) versus (128, 34%), respectively—and educational projects; 21 (19%) versus 78 (20%), respectively. Survey responders and nonresponders, were not qualitatively similar in two RTSS applications: research projects—36 (32%) versus 82 (22%), respectively—and exploring various uses of the RTSS; 18 (16%) versus 93 (24%), respectively. Forty-one of the responders (37%) did not ultimately use the RTSS and 5 (5%) did not select a specific use for the RTSS. Those who did not use the RTSS were evenly distributed across professions—7 SLPs, 10 OTs, 7 PTs, 10 Physicians, 6 Psychologists, 6 Other—and mostly attempting to use the RTSS for research (n = 14) or exploring potential uses (n = 18).

Table 3 outlines the CFIR barrier categories reported by clinicians, educators, researchers, and those who did not use the RTSS. For clinicians, their institution’s lack of resources and access to knowledge and information about the RTSS were the most frequently reported barriers to RTSS application. According to the key word analysis, clinicians primarily felt that they lacked the time and educational resources necessary to learn/use the RTSS. For educators, incomplete knowledge and/or beliefs about the RTSS was the most frequently reported barrier. According to the key word analysis, educators reported not understanding the RTSS clearly enough to confidently teach others about it. For researchers, the RTSS’s complexity was the most frequently reported barrier. The key word analysis provided specific reasons for this complexity: the RTSS contains new terminology with technical definitions, the terms interact with each other, the RTSS requires considerable time to learn, and the RTSS requires a more fine-grained description than current practice. For those who did not eventually use the RTSS, the main barrier was available resources. The keyword analysis showed that many end-users did not have the time to familiarize themselves with the RTSS.

Table 3.

Number of occurrences (% of total) the RTSS end-users identified a CFIR barrier construct.

CFIR construct Total occurrences Occurrences split according to RTSS application
Clinic Education Research Did not use
Intervention characteristics 44 (31) 14 (24) 4 (17) 15 (43) 11 (35)
  Complexity 22 (15) 5 (8) 3 (13) 10 (30) 4 (14)
  Adaptability 8 (6) 5 (8)   2 (6) 1 (3)
  Design quality & packaging 7 (5) 3 (5) 1 (4) 1 (3) 2 (7)
  Evidence strength & quality 4 (3)     2 (6) 2 (7)
  Relative advantage 2 (1)       2 (7)
  Trialability 1 (1) 1 (2)      
Inner setting 69 (48) 35 (59) 10 (43) 11 (31) 13 (42)
  Readiness for implementation          
    Available resources 31 (22) 12 (20) 5 (22) 6 (18) 8 (28)
    Access to knowledge & information 18 (13) 11 (19) 2 (9) 2 (6) 3 (10)
    Leadership engagement 5 (3) 3 (5)   1 (3) 1 (3)
  Implementation climate          
    Compatibility 7 (5) 3 (5) 2 (9) 2 (6)  
    Tension for change 2 (1) 1 (2) 1 (4)    
    Relative priority 3 (2) 3 (5)      
    Organizational incentives & rewards 1 (1) 1 (2)      
    Learning climate 1 (1)       1 (3)
  Networks & communications 1 (1) 1 (2)      
Characteristics of Individuals 29 (20) 9 (15) 8 (35) 7 (20) 5 (16)
  Knowledge & beliefs about the intervention 26 (18) 8 (14) 8 (35) 6 (18) 4 (14)
  Self-efficacy 3 (2) 1 (2)   1 (3) 1 (3)
Process 1(1) 1(2) 0 (0) 0 (0) 0 (0)
  External change agents 1 (1) 1 (2)      
Outer setting 1 (1) 0 (0) 1 (4) 0 (0) 0 (0)
  External policy & incentives 1 (1)   1 (4)    

Table 4 outlines the CFIR facilitator categories reported by clinicians, educators, and researchers. Only “external change agents” was reported to have been an experienced facilitator and the other facilitators were suggested as potential facilitators. All three groups wanted more materials showing the RTSS’s adaptability through concrete, applied examples in discipline- and condition-specific treatments. All three groups also wanted increased access to knowledge and information about the RTSS. However, extracted key words were different among the groups. Clinicians requested that the RTSS be integrated into their electronic medical or health records. Researchers asked for educational materials that simplify the RTSS’s concepts and application, e.g., “a cheat sheet” or “RTSS for beginners.” Educators wanted materials that could be incorporated into their teaching curriculum.

Table 4.

Number of occurrences (%) the RTSS end-users identified a CFIR facilitator construct. Of note, those who reported not using the RTSS were excluded because the survey’s branching logic did not explicitly ask them about facilitators.

CFIR construct Total occurrences Occurrences split according to RTSS application
Clinic Education Research
Intervention characteristics 32 (36) 12 (30) 8 (30) 12 (54)
  Adaptability 21 (24) 9 (23) 4 (15) 8 (36)
  Evidence strength & quality 6 (7) 2 (5) 2 (7) 2 (9)
  Complexity 2 (2)   1 (4) 1 (4)
  Design quality & packaging 2 (2) 1 (3) 1 (4)  
  Trialability 1 (1)     1 (4)
Inner setting 43 (49) 21 (54) 16 (59) 6 (27)
  Readiness for implementation        
    Access to knowledge & information 37 (42) 17 (44) 15 (56) 5 (23)
    Available resources 2 (2) 2 (5)    
    Leadership engagement 2 (2) 1 (3)   1 (4)
  Implementation climate        
    Compatibility 2 (2) 1 (3) 1 (4)  
Characteristics of individuals 3 (3) 2 (6) 0 (0) 1 (4)
  Knowledge & beliefs about the intervention 2 (2) 1 (3)   1 (4)
  Other personal attributes 1 (1) 1 (3)    
Process 6 (7) 3 (8) 1 (4) 2 (9)
  External change agents 6 (7) 3 (8) 1 (4) 2 (9)
Outer setting 4 (5) 1 (3) 2 (7) 1 (4)
  External policy & incentives 4 (5) 1 (3) 2 (7) 1 (4)

The CFIR-ERIC matching tool evaluated the four most frequently reported barriers, which were 1) complexity, 2) availability of resources, 3) access to knowledge and information, and 4) individual knowledge and beliefs about the RTSS. Table 5 outlines the matching tool’s 17 recommended implementation strategies. Three suggested ERIC strategies may directly address the barriers of access to knowledge/information and knowledge/beliefs about the RTSS: 1) Develop education materials, 2) Distribute educational materials, and 3) Conduct educational meetings. The suggested ERIC strategies of “promote adaptability” and “identifying and preparing champions” aligns with user feedback for more high quality, applied RTSS examples and external change agents, respectively. “Accessing new funding” is a suggested ERIC strategy to directly address the barrier of available resources. The matching tool suggested one broadly applicable strategy—over 20% expert agreement for all four barriers—that was not mentioned by the RTSS end-users: capture and share local knowledge.

Table 5.

ERIC strategies and their level of expert consensus (% agreement) in relation to the most frequently identified CIFR barriers.

ERIC strategies CFIR Barriers
Complexity Available resources Access to knowledge & information Knowledge & beliefs about the intervention
Conduct educational meetings 13 0 79** 56**
Develop educational materials 13 4 59** 36*
Distribute educational materials 3 0 55** 16
Access new funding 3 78** 0 8
Capture & share local knowledge 27* 22* 31* 24*
Create a learning collaborative 33* 9 45* 16
Identify & prepare champions 30* 4 24* 40*
Conduct ongoing training 37* 9 38* 12
Assess for readiness, identify barriers/ facilitators 30* 13 7 16
Promote adaptability 40* 4 7 16
Stage implementation scale up 30* 13 3 20*
Develop a formal implementation blueprint 43* 4 14 4
Conduct cyclical small tests of change 37* 13 3 12
Conduct educational outreach visits 7 0 28* 28*
Facilitation 20* 4 10 20*
Change physical structure and equipment 3 48* 0 0
Identify early adopters 20* 0 10 20*
*

Top quartile agreement in original CFIR-ERIC matching tool ≥ 20%

***

Majority expert agreement.

DISCUSSION

Rehabilitation professionals attempting to use the RTSS identified four barriers that frequently occurred, regardless of specific RTSS application: the RTSS’s complexity, a lack of available RTSS resources, reduced access to knowledge and information about the RTSS, and limited knowledge and beliefs about the RTSS. In response to these four general barriers, the ERIC-CFIR matching tool and/or RTSS users identified seven general implementation strategies: conduct educational meetings, develop educational materials, distribute educational materials, access new funding, capture and share local knowledge, identify and prepare champions, and promote adaptability. The frequency at which these barriers and facilitators were reported—as well as the underlying keywords—qualitatively varied based on whether the RTSS was being used for clinical, educational, or research projects; thus, the specific implementation strategies will likely need to be tailored for the specific RTSS use. For example, educational materials (to improve knowledge) and concrete RTSS examples (to promote adaptability) would need to be tailored to facilitate in-depth specification skills for researchers, correct use of already-specified treatments in an RTSS-based electronic medical records for clinicians, or direct integration of RTSS concepts into course curricula for educators. Since consulting RTSS experts (i.e., “identify and prepare champions or external change agents”) helped many respondents to apply the framework, the development of new materials should align with education or training programs designed to increase the number of RTSS experts in various disciplines and specialties, e.g., train the trainer models.

Most RTSS work has focused on creating educational and training materials to improve the knowledge, beliefs, skills, and self-efficacy of the end-users.916,18,19,2124 However, barriers such as limited available resources, minimal leadership engagement, and lack of outer setting policies would require implementation strategies at the organizational or societal level. Bigger picture strategies could focus on facilitating the development of policies and guidelines for inner settings—e.g., the RTSS users’ research, educational, and/or clinical institutions—and outer settings—e.g., professional entities such as the Centers for Medicare and Medicaid, American Speech-Language-Hearing Association, American Physical Therapy Association, American Occupation Therapy Association. Typically, organizations have resource constraints and any policy or guideline that integrates the RTSS will require resources such as time, money, personnel, etc. This might be mitigated in the short-term by acquiring funding to provide these additional resources, as suggested by the CFIR-ERIC matching tool. Also, some implementation strategies, such as electronic medical record menus, would obviously benefit from consistency at a national level, international level, or by professional societies rather than individual implementation efforts across many local institutions. Future work could focus on developing strategies associated with societal and organizational changes such as accreditation or licensure standards, involving executive or advisory boards, engaging with policy makers, and directly working with various educational, medical, and professional institutions.

Implementation science is typically focused on facilitating the adoption of specific clinical best practices supported by emerging evidence.25 In contrast, RTSS implementation is not the adoption of any specific evidence-based treatment but implementing a way of studying and communicating about treatments in general. As such, more specific skills will need to be measured during implementation, e.g., research reporting, treatment documentation, clinical decision making. Thus, it’s probably most useful to consider the barriers and facilitators to adoption of RTSS-informed changes in the critical skills and behaviors specific to research, clinical care, and education. Future work would undoubtedly benefit from iterative stakeholder input to both guide specific implementation strategy development and identify what kinds of “evidence of benefit” would most motivate adoption by researchers, educators, clinicians, i.e., investigating feasibility with an embedded process evaluation. An iterative, stakeholder approach could help ensure that any abstractions of research, clinical care, and education have maximal potential for realizing the practical benefits of RTSS implementation.

Study limitations:

First, the primary barriers were identified by frequency, which is less preferable than eliciting information regarding the relative importance or weight among the barriers. Future work could obtain information regarding the relative importance of each barrier in relation to other stated barriers. Second, the manual downloaders were asked to generally identify and describe barriers and facilitators, without being guided by the frameworks we later used for data analysis, e.g., CFIR or ERIC. Thus, potentially critical concepts within those frameworks may not have been thoroughly explored. This is an acceptable limitation because the project was designed as a preliminary needs assessment to identify frequently occurring barriers and facilitators and future steps. Moreover, the survey responses were successfully retrofitted to the more specific constructs of the CFIR and ERIC. Third, most respondents were in the early stages of attempting to use the RTSS. Thus, while many reported barriers that had been encountered, facilitators were mainly “wants” that had not been experienced. However, as noted, there was substantial correspondence between these desired facilitators and the CFIR-recommended facilitators for the experienced barriers.

CONCLUSION

A needs assessment was completed with over 100 rehabilitation professionals across multiple disciplines to identify commonly encountered barriers and facilitators for RTSS implementation in research, education, and clinical care. According to the CFIR, the four most frequently faced barriers were the RTSS’s complexity, a lack of available resources, reduced access to knowledge and information, and limited knowledge and beliefs. The ERIC-CFIR matching tool identified seven general implementation strategies to address these barriers, which include conducting educational meetings, developing educational materials, distributing educational materials, accessing new funding, capturing and sharing local knowledge, identifying and preparing champions, and promoting adaptability. The specific barriers and facilitating strategies differed according to the end-users’ intended use, i.e., research, education, or clinical. The RTSS has great potential to advance the quality of rehabilitation research, education, and clinical practice, but the implementation and dissemination of clinical innovations is known to be difficult. Thus, this prospective exploration should be helpful to pre-empt challenges as well as develop strategies and evaluate their impact for facilitating broad use of the RTSS.

Acknowledgements:

We would like to acknowledge and thank other members of the ACRM Implementation Assessment Task Force for their assistance with survey development, data collection, and analysis/interpretation, especially Andrew Packel and Mary Ferraro.

Acknowledgement of any presentation of material:

This material has not been presented anywhere.

Acknowledgement of financial support:

This work was supported by the National Institutes of Health (NIH) National Institute on Deafness and Other Communication Disorders and the Office of the Director’s Office of Behavioral and Social Sciences Research via Grant R21 DC016124 (PI: Dr. Jarrad Van Stan). The article’s contents are solely the responsibility of the authors and do not necessarily represent the official views of the NIH. The funders had no role in the preparation, review, or approval of the manuscript, or the decision to submit the manuscript for publication.

Abbreviations

ACRM

American Congress of Rehabilitation Medicine

CFIR

Consolidated Framework for Implementation Research

ERIC

Expert Recommendations for Implementing Change

OT

Occupational therapist

PT

Physical therapist

SLP

Speech language pathologist

RTSS

Rehabilitation Treatment Specification System

Footnotes

Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.

Potential conflicts of interest: Jarrad Van Stan and John Whyte are 2 of 9 copyright holders for the Manual for Rehabilitation Treatment Specification. All other authors declare no competing interests. We certify that no party having a direct interest in the results of the research supporting this article has or will confer a benefit on us or on any organization with which we are associated AND we certify that all financial and material support for this research is clearly identified in the title page of the manuscript.

REFERENCES

  • 1.Wade DT. Research into the black box of rehabilitation: the risks of a Type III error. Clinical rehabilitation 2001;15(1):1–4. [DOI] [PubMed] [Google Scholar]
  • 2.Dijkers MP, Kropp GC, Esper RM, Yavuzer G, Cullen N, Bakdalieh Y. Quality of intervention research reporting in medical rehabilitation journals. American Journal of Physical Medicine & Rehabilitation 2002;81(1):21–33. [DOI] [PubMed] [Google Scholar]
  • 3.Wilson BA. How do we know that rehabilitation works? Neuropsychological Rehabilitation 1993;3(1):1–4. [Google Scholar]
  • 4.Dijkers MP, Millis SR. The Template for Intervention Description and Replication (TIDieR) as a measure of intervention reporting quality: Rasch analysis. Archives of Rehabilitation Research and Clinical Translation 2020:100055. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Van Stan JH, Dijkers MP, Whyte J, et al. The Rehabilitation Treatment Specification System: implications for improvements in research design, reporting, replication, and synthesis. Archives of Physical Medicine and Rehabilitation 2019;100(1):146–155. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Hart T, Dijkers MP, Whyte J, et al. A theory-driven system for the specification of rehabilitation treatments. Archives of Physical Medicine and Rehabilitation 2019;100(1):172–180. [DOI] [PubMed] [Google Scholar]
  • 7.Whyte J, Dijkers MP, Hart T, et al. The importance of voluntary behavior in rehabilitation treatment and outcomes. Archives of Physical Medicine and Rehabilitation 2019;100(1):156–163. [DOI] [PubMed] [Google Scholar]
  • 8.Zanca JM, Turkstra LS, Chen C, et al. Advancing rehabilitation practice through improved specification of interventions. Archives of Physical Medicine and Rehabilitation 2019;100(1):164–171. [DOI] [PubMed] [Google Scholar]
  • 9.Van Stan JH, Whyte J, Duffy JR, et al. Voice therapy according to the Rehabilitation Treatment Specification System (RTSS-Voice): Expert consensus ingredients and targets. American Journal of Speech Language Pathology 2021;30(5):2169–2201. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Meulenbroek P, Ness B, Lemoncello R, et al. Social communication following traumatic brain injury part 2: Identifying effective treatment ingredients. International journal of speech-language pathology 2019;21(2):128–142. [DOI] [PubMed] [Google Scholar]
  • 11.Sikkes SA, Tang Y, Jutten RJ, et al. Toward a theory‐based specification of non‐pharmacological treatments in aging and dementia: Focused reviews and methodological recommendations. Alzheimer’s & Dementia 2021;17(2):255–270. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Boyle M, Gordon JK, Harnish SM, et al. Evaluating Cognitive-Linguistic Approaches to Interventions for Aphasia Within the Rehabilitation Treatment Specification System. Archives of physical medicine and rehabilitation 2022;103(3):590–598. [DOI] [PubMed] [Google Scholar]
  • 13.Fridriksson J, Basilakos A, Boyle M, et al. Demystifying the Complexity of Aphasia Treatment: Application of the Rehabilitation Treatment Specification Systemx. Archives of physical medicine and rehabilitation 2022;103(3):574–580. [DOI] [PubMed] [Google Scholar]
  • 14.Basilakos A, Hula WD, Johnson LP, Kiran S, Walker GM, Fridriksson J. Defining the Neurobiological Mechanisms of Action in Aphasia Therapies: Applying the RTSS Framework to Research and Practice in Aphasia. Archives of Physical Medicine and Rehabilitation 2022;103(3):581–589. [DOI] [PubMed] [Google Scholar]
  • 15.Cherney LR, DeDe G, Hoover EL, Murray L, Obermeyer J, Pompon RH. Applying the Rehabilitation Treatment Specification System to Functional Communication Treatment Approaches for Aphasia. Archives of physical medicine and rehabilitation 2022;103(3):599–609. [DOI] [PubMed] [Google Scholar]
  • 16.Van Stan JH, Whyte J, Duffy JR, et al. Rehabilitation Treatment Specification System: Methodology to identify and describe unique targets and ingredients. Archives of Physical Medicine & Rehabilitation 2021;102(3):521–531. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Wengerd LR. Advancing Rehabilitation Research Through Characterization of Conventional Occupational Therapy for Adult Stroke Survivors with Upper Extremity Hemiparesis The Ohio State University; 2019. [Google Scholar]
  • 18.Kinney AR, Eakman AM, Graham JE. Novel effect size interpretation guidelines and an evaluation of statistical power in rehabilitation research. Archives of physical medicine and rehabilitation 2020; [DOI] [PubMed] [Google Scholar]
  • 19.Kinney AR, Middleton A, Graham JE. Evaluating the Strength of Evidence in Favor of Rehabilitation Effects: A Bayesian Analysis. Annals of Physical and Rehabilitation Medicine 2022;65(1):101503. [DOI] [PubMed] [Google Scholar]
  • 20.Whyte J, Dijkers M, Fasoli SE, et al. Recommendations for Reporting on Rehabilitation Interventions. American Journal of Physical Medicine & Rehabilitation 2020; [DOI] [PubMed] [Google Scholar]
  • 21.Ness BM, O’Neil-Pirozzi T, Meulenbroek P. Three Speech-language Pathology Graduate Programs, One Model: Using Systematic Instruction to Develop Students’ Clinical Decision-making Skills. Teaching and Learning in Communication Sciences & Disorders 2021;5(1):4. [Google Scholar]
  • 22.Fasoli SE, Ferraro MK, Lin SH. Occupational therapy can benefit from an interprofessional rehabilitation treatment specification system. American Journal of Occupational Therapy 2019;73(2):7302347010p1–7302347010p6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Jette AM. Opening the black box of rehabilitation interventions. Physical Therapy 2020;100(6):883–884. [DOI] [PubMed] [Google Scholar]
  • 24.Turkstra LS, Norman R, Whyte J, Dijkers MP, Hart T. Knowing What We’re Doing: Why Specification of Treatment Methods Is Critical for Evidence-Based Practice in Speech-Language Pathology. American Journal of Speech-Language Pathology 2016:1–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Bauer MS, Kirchner J. Implementation science: what is it and why should I care? Psychiatry research 2020;283:112376. [DOI] [PubMed] [Google Scholar]
  • 26.Glasgow RE, Vinson C, Chambers D, Khoury MJ, Kaplan RM, Hunter C. National Institutes of Health approaches to dissemination and implementation science: current and future directions. American journal of public health 2012;102(7):1274–1281. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Birken SA, Powell BJ, Shea CM, et al. Criteria for selecting implementation science theories and frameworks: results from an international survey. Implementation Science 2017;12(1):1–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Nilsen P, Bernhardsson S. Context matters in implementation science: a scoping review of determinant frameworks that describe contextual determinants for implementation outcomes. BMC health services research 2019;19(1):1–21. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Ridde V, Pérez D, Robert E. Using implementation science theories and frameworks in global health. BMJ global health 2020;5(4):e002269. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implementation Science 2009;4(1):50. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Waltz TJ, Powell BJ, Chinman MJ, et al. Expert recommendations for implementing change (ERIC): protocol for a mixed methods study. Implementation Science 2014;9(1):1–12. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Camden C, Shikako-Thomas K, Nguyen T, et al. Engaging stakeholders in rehabilitation research: a scoping review of strategies used in partnerships and evaluation of impacts. Disability and rehabilitation 2015;37(15):1390–1400. [DOI] [PubMed] [Google Scholar]
  • 33.Schippke J, Provvidenza C, Kingsnorth S. Peer support for families of children with complex needs: Development and dissemination of a best practice toolkit. Child: care, health and development 2017;43(6):823–830. [DOI] [PubMed] [Google Scholar]
  • 34.Gaugler JE, Gitlin LN, Zimmerman S. Aligning dementia care science with the urgent need for dissemination and implementation. Journal of the American Medical Directors Association 2021;22(10):2036–2038. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Juckett LA, Bunger AC, Jarrott SE, et al. Determinants of fall prevention guideline implementation in the home-and community-based service setting. The Gerontologist 2021;61(6):942–953. [DOI] [PubMed] [Google Scholar]
  • 36.Juckett LA, Wengerd LR, Faieta J, Griffin CE. Evidence-based practice implementation in stroke rehabilitation: a scoping review of barriers and facilitators. American Journal of Occupational Therapy 2020;74(1):7401205050p1–7401205050p14. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Waltz TJ, Powell BJ, Fernandez ME, Abadie B, Damschroder LJ. Choosing implementation strategies to address contextual barriers: diversity in recommendations and future directions. Implementation Science 2019;14(42):1–15. [DOI] [PMC free article] [PubMed] [Google Scholar]

RESOURCES