Skip to main content
JMIR Formative Research logoLink to JMIR Formative Research
. 2020 Sep 18;4(9):e19296. doi: 10.2196/19296

Telerehabilitation to Address the Rehabilitation Gap in Anterior Cruciate Ligament Care: Survey of Patients

Emma Dunphy 1,, Elizabeth C Gardner 2,#
Editor: Gunther Eysenbach
Reviewed by: Danilo De Oliveira Silva, Saeed Alghamdi
PMCID: PMC7532455  PMID: 32945776

Abstract

Background

Evidence shows that after anterior cruciate ligament (ACL) reconstruction, patients may have varied access to physical therapy. In particular, physical therapy input may end many months before patients reach full recovery. Telerehabilitation may provide an opportunity to address this rehabilitation gap and improve access to evidence-based rehabilitation alongside physical therapy at all stages of care.

Objective

This study aims to understand the opinions of patients who have undergone ACL surgery and rehabilitation on the use of telerehabilitation as part of ACL care and define the population and explore their experiences and views on the acceptability of telerehabilitation after ACL reconstruction.

Methods

This study was a cross-sectional, voluntary, web-based survey combining both closed and open questions. Ethical approval was obtained from the Yale School of Medicine Institutional Review Board. Participants were aged 16 years or older at the time of recruitment and had undergone ACL reconstruction within the past 5 years. A 26-item survey was developed using the Qualtrics survey platform. No items were mandatory. Responses were multiple choice, binary, and qualitative. The CHERRIES (Checklist for Reporting Results of Internet E-Surveys) was used to ensure the quality of reporting of surveys in the medical literature. Data were analyzed using Stata version 15. Qualitative data were analyzed using NVivo 11. The theoretical framework for this analysis is based on the Capability, Opportunity, and Motivation-Behavior model of behavior change.

Results

A total of 100 participants opened the survey. All completers were unique. The participation and completion rates were each 96% (96/100). Patients reported their physical therapy care ended at an average of 6.4 months and that they felt fully recovered at an average of 13.2 months. Only 26% (25/96) of patients felt fully recovered at the end of physical therapy. Of these 96 patients, 54 (60%) were younger than 30 years, 71 (74%) were recreational athletes, 24 (24%) were competitive athletes, 72 (75%) had private insurance, 74 (77%) were not familiar at all with telerehabilitation, and 89% (85/96) felt capable. They preferred to use telerehabilitation at different stages of care. Reported benefits included resource saving, improved access to care, improved learning, and greater engagement. Concerns included incorrect performance of exercises or unmanaged pain being missed and less access to manual therapy, motivation, and opportunities to ask questions. Participants’ priorities for a future telerehabilitation intervention included its use as an adjunct to physical therapy rather than a replacement, with content available for each stage of care, especially return to sports. Participants stressed that the intervention should be personalized to them and include measures of progress.

Conclusions

These findings helped understand and define the ACL reconstruction population. Participants found telerehabilitation acceptable in principle and highlighted the key user requirements and scope of future interventions.

Keywords: anterior cruciate ligament, telerehabilitation, rehabilitation, eHealth, knee, survey, telehealth, patient experience

Introduction

An estimated 150,000 to 250,000 anterior cruciate ligament (ACL) injuries occur each year in the United States [1-3]. The cost is estimated at more than 3 billion dollars annually, not including the psychosocial costs incurred by patients, their families, and clinical teams involved [4]. The postoperative rehabilitation process can be lengthy [5] and includes predominantly evidence-based exercise interventions led by physical therapists through clearly defined stages of care [6-11]. It takes most patients 9 to 12 months after surgery to pass the return-to-sports criteria [5].

The return-to-sport stage of rehabilitation is crucial for those who intend to participate in sports after anterior cruciate ligament reconstruction (ACLR), particularly as returning to sports too soon risks re-injury [12,13]. It includes complex decision making around when and how to progress through physical and psychological challenges to facilitate optimum function and minimize the risk of re-injury [12,14]. It requires appropriate return-to-sport tests that recreate the physical challenges of sports in a controlled way and measure the individual’s ability to perform the necessary physical tasks of their sport [9,12,13]. Delaying return to sports until an individual passes these return-to-sport milestone tests helps prevent re-injury [3,15,16]. Negotiating this without a supervising physical therapist presents challenges, particularly as evidence suggests there is a difference between athletes’ perceived and actual readiness to return to sports [17].

A recent web-based survey of more than 1000 American physical therapists found that rehabilitation practice varied significantly in terms of the content and duration of supervised care [14]. Specifically, with regard to the length of treatment, supervised physical therapy ranged from 1 to 3 months (15% of respondents) to 12 months (11% of respondents). Overall, 56% of respondents reported 3 to 5 months or less of supervised physical therapy. These data suggest that many patients leave supervised care before the return to sports rehabilitation or achieving a return to sports [5]. This suggests the existence of a rehabilitation gap between the end of care and return to sports. Greenberg et al [14] concluded that this gap may contribute to patient confusion and suboptimal outcomes.

Telerehabilitation interventions may provide an option to address this rehabilitation gap. Telerehabilitation can provide evidence-based information, education, and exercise guidance and is acceptable to patients [18,19]. This technology has the potential to improve adherence to rehabilitation by engaging with mechanisms of behavior, including personalized features such as prompts, goal setting, and exercise logs [18,20]. Some of these interventions are wearable [21], some are app or website based [18,22], and some are delivered to home [19,20]. The latter study used a three-dimensional camera to facilitate communication between the physical therapists and the patients [20]. In this context, telerehabilitation has been employed as a catch-all term for digital rehabilitation methods and is variously called digital health, eHealth, or mobile health; the term is increasingly used to describe digital tools, including video consultation. However, in this paper, we use this catch-all term to describe digital rehabilitation strategies that may or may not include video consultations.

The rehabilitation gap appears to be caused by patients only being allowed (or able to afford) a certain number of appointments. Using telerehabilitation through the rehabilitation process as an adjunct to face-to-face care may create an opportunity to prolong physical therapy by stretching the allocated appointments over a longer period. Patients have previously used telerehabilitation for knee injuries with high fidelity and noted improved confidence and motivation with their rehabilitation [18-20]. The attitude of patients toward this technology after ACLR is unknown.

Objectives

This study aims to understand the acceptability of patients who have completed ACL surgery and rehabilitation regarding the use of telerehabilitation as part of ACL care. Our objectives are as follows:

  1. obtain patients’ experiences and opinions on their access to physical therapy throughout ACL rehabilitation,

  2. explore the patients’ understanding of telerehabilitation, and

  3. explore patients’ opinions about the acceptability of telerehabilitation as part of ACL care.

Methods

Design

We used a cross-sectional, voluntary, web-based survey combining both closed (fixed-response options) and open questions.

Ethics

Ethical approval was obtained from the Yale School of Medicine Institutional Review Board (IRB), and proper consent procedures were employed for all participants.

Participants and Recruitment

Potential participants were drawn from the Yale New Haven Hospital Healthcare database. Patients aged 16 years or older at the time of recruitment who had undergone ACL reconstruction within the past 5 years were invited to give their “thoughts and opinions regarding a potentially new approach to post-surgical rehab” and introduced to the possibility of telerehabilitation in addition to usual care (Multimedia Appendix 1). Potential participants were provided with an IRB-approved patient information sheet and informed that completing the survey was entirely voluntary. Consent was implied by participation. Participants were offered the opportunity to enter a draw for a US $50 Visa gift card as an expression of gratitude for their participation [23]. This was an exploratory study; therefore, no formal sample size calculation was used [23].

Survey Development

This survey was developed using the Qualtrics survey platform. The study authors designed the questionnaire based on expertise and previous research in the field. Input on the content was sought from research and clinical peers. A total of 4 orthopedic surgeons and 5 physical therapists reviewed the questionnaire over email. This led to the removal of marginally relevant questions and the addition of questions to identify patient self-described activity levels. The questionnaire layout was organized under the guidance of a Qualtrics survey expert at Yale University. The survey was then piloted with 8 colleagues (4 physiotherapists and 4 orthopedic surgeons) and patients who had undergone ACL but were not in the study for comprehension, interpretation, and availability of appropriate responses. Questions were further edited or removed for repetition or clarification, and new response options were added. A short video example of telerehabilitation was provided.

The survey included 26 question items on the survey distributed over 4 screen pages. A total of 4 questions focused on demographic details such as age, gender, race, and socioeconomic status. The remaining questions explored participants’ experience of ACL postoperative care and their attitudes toward telerehabilitation and obtaining data on knee health. The final 3 questions of the survey invited respondents to put forward opinions about what they saw as the potential benefits and concerns of telerehabilitation and how they felt it would be best utilized in the management of patients after ACLR.

We used Likert scale answers in 2 questions. The scale chosen was a 5-point scale; however, only points 1, 3, and 5 were labeled. Points 2 and 4 were unlabeled but offered a second scale point between 1 and 3 or 3 and 5 to indicate either a slightly negative or slightly positive score that was not wholly positive or wholly negative and not neutral at 3. The challenge of measuring Likert scales is much discussed; as an ordinal scale, responses can be rated or ranked, but the space between often and sometimes cannot be empirically measured [24]. Although arguments have been made regarding parametric testing of Likert scales with normal distributions, in this instance, the Likert results are described in their ordinal categories [25].

Participants were prompted to complete questions before clicking through; no items were mandatory, which allowed participants to choose not to answer certain questions. Responses were multiple choice, binary, and qualitative. Neither randomization nor adaptive questions were used. Participants could use a back function to change a response if they chose to do so. A copy of the survey is available in Multimedia Appendix 2.

Survey Distribution

The survey was distributed to patients through the Yale Qualtrics software. It was distributed on October 7, 2019, and 2 follow-up emails were sent to the nonresponders 1 week apart. Participants were advised as to the purpose of the survey.

Data Analysis

Responses were collected through a web database. The survey responses were entered manually into a database, with the exception of time taken on the survey and percentage completed, which were captured automatically. The Checklist for Reporting Results of Internet E-Surveys, known as the CHERRIES statement, was used to ensure the quality of reporting of surveys in the medical literature [26]. The checklist is included in Multimedia Appendix 3. Eysenbach et al [26] suggested that as there is no standard methodology, authors should avoid the term response rate. They defined the participation and completion rates as recommended measures and calculated the participation rate as a ratio of those who click on the survey link and then chose to partake: “Count the unique number of people who filled in the first survey page (or agreed to participate, for example by checking a checkbox) divided by visitors who visit the first page of the survey.”

Data were analyzed using Stata version 15 (StataCorp). Descriptive statistics were used in the primary analysis of data to summarize the frequency and distribution of responses. Secondary analysis to determine relationships between patient demographic characteristics and multiple-choice opinion responses were performed using a chi-square test. Likert responses were analyzed in relation to patient demographic characteristics using a one-way analysis of variance (ANOVA; parametric distribution) or Kruskal-Wallis ANOVA (nonparametric distribution). Missing data were accounted for by multiple imputation techniques using means.

Qualitative questionnaire data were analyzed using NVivo 11 (QSR International). A pragmatic thematic analysis was conducted to analyze responses with respect to the research question. The process was deduced from the data driving the analysis. The themes that arose from each question were grouped so that data relating to a patient’s opinion were clear. Quotes from the survey support themes. Data are weighted and reported secondary to the frequency of occurrence or explanatory value [27]. The data were coded and analyzed independently by 2 members of the research team. Textual answers were coded into a word frequency cloud diagram that illustrates a hierarchy of terms at the heart of the participant’s responses.

The theoretical framework for this analysis is based on a model of behavior change that relates the capability, opportunity, and motivation to behavior (COM-B). [28]. In rehabilitation, the target behavior is most often exercised. Michie et al [29] designed a system in which capability, opportunity, and motivation are understood in relation to the target behavior. This model identifies that to perform the target behavior (ie, exercise), patients must be physically and psychologically capable, must have social and physical opportunities, and must be motivated to engage in behavior in the form of deeper desires and reflective planning [30]. Applying the COM-B theory to the survey results can aid further understanding of patient acceptability of telerehabilitation as a tool for ACL rehabilitation.

Data Protection

Data were anonymized, and no personal medical data were stored or analyzed. Qualtrics survey software and the local Yale University servers were used to protect the data. Anonymized data were stored on encrypted laptops.

Results

First, the survey response and characteristics of respondents are described, followed by the results for each objective of the study; then, the respondents’ experiences of physical therapy after ACLR, their previous experience of telerehabilitation, and views on the acceptability of telerehabilitation are reported.

Survey Response

A total of 213 patients were contacted; 29 emails bounced and 184 were delivered. Of these, 100 respondents clicked on the survey. On the basis of internet protocol addresses, all completers were unique throughout the study. Cookies were not used to assign identifiers to each computer.

On examination of the data, 4 responses were found to be empty and were therefore excluded. Therefore, the analysis included 96 responses. The participation and completion rates were calculated according to the CHERRIES guidance [26]. For this study, the participation rate was 96% (96/100). The completion rate is calculated as the ratio of users who finished the survey relative to those who clicked on the survey link and agreed to participate. The completion rate was 96% (96/100). The view rate was not applicable. Participant characteristics are detailed in Table 1. Missing data were minimal (26/2112, 1.2%) and therefore accounted for by a multiple imputation technique using means.

Table 1.

Demographics and patient characteristics (N=96).

Characteristics Values
Frequency of age at surgery (years), n (%)

15-19 4 (4)

20-24 18 (19)

25-29 32 (33)

30-34 8 (8)

35-39 4 (4)

40-44 9 (10)

45-49 13 (14)

>50 8 (8)
Year of surgery; frequency, n (%)

2014 5 (5)

2015 14 (15)

2016 27 (28)

2017 16 (17)

2018 23 (24)

2019 11 (11)
Surgical procedure; frequency, n (%)

ACLRa alone 57 (60)

ACLR with meniscus repair 36 (37)

ACLR with another procedure 3 (3)
Gender; frequency, n (%)

Female 55 (57)

Male 40 (42)

Trans or nonbinary 1 (1)
Race/ethnicity; frequency, n (%)

Asian 14 (15)

Black or African American 5 (5)

Hispanic or Latino 12 (13)

Native Hawaiian or other Pacific Islanders 1 (1)

White 64 (66)
Insurance; frequency, n (%)

Commercial (eg, Blue Cross/Blue Shield and Cigna) 72 (75)

State (eg, Medicaid and Medicare) 21 (22)

Uninsured 3 (3)
Level of sport; frequency, n (%)

Competitive sport/activity 24 (25)

I am not active 1 (1)

Recreational sport/activity 71 (74)
Returned to the same level; frequency, n (%)

No 39 (41)

Yes 57 (59)
Did you have sufficient physical therapy; frequency, n (%)

No 22 (23)

Yes 74 (77)
Determining factors to end physical therapyb , n (%)

Determined by the expense 14 (15)

Determined by the insurance 36 (38)

Determined by the physical therapist 66 (69)

Determined by you 49 (51)

I was fully recovered 25 (26)

Other 12 (13)

Too far away 7 (7)

Too time consuming 18 (19)
Percentage of knee function compared with previous, mean (SD); range 82.6 (13.8); 25-100
Months you had physical therapy, mean (SD); range 6.4 (4.8); 2-30
Patient’s stated ideal length of physical therapy (months), mean (SD); range 7.25 (4.3); 2-36
When did you feel fully recovered (months)?, mean (SD); range 13.17 (8.3); 0-60

aACLR: anterior cruciate ligament reconstruction.

bMultiple responses were permitted; % will not add up to 100.

Characteristics of the Respondents

More than half of patients (54/96, 56%) were younger than 30 years at the time of their surgery. There were more female respondents (55/96, 57%) than male respondents and more White respondents (64/96, 66%) than other ethnic groups. The participants identified themselves mostly as recreational athletes (71/96, 74%); 25% (24/96) identified themselves as competitive athletes, and 1% (1/96) reported that they were not active. Most participants had ACL reconstruction alone (57/96, 59%), although concomitant meniscal repair was also common (26/96, 38%). Overall, 59% (57/96) of participants reported that they returned to their pre-injury performance level. When asked to compare their knee before injury on a scale of 0 to 100, the mean knee score was 82.6 (SD 13.82). Response rates were lowest in patients who underwent surgery in 2014 but were otherwise unremarkable. Most respondents had private insurance (72/96, 75%). The results are shown in Table 1.

Experiences of Physical Therapy

Only 26% (25/96) of patients felt that they had fully recovered at the end of their physical therapy; 77% (74/96) of patients felt that they had sufficient physical therapy, whereas 23% (22/96) did not. Moreover, 69% (66/96) of patients stated that their physical therapy was ended by their physical therapist, whereas 51% (49/96) ended physical therapy themselves, and 39% (37/96) said that travel, time commitments, and other factors were causal for ending their physical therapy Patients recalled that they had a mean of 6.4 (4.8, 2-30) months of physical therapy after ACLR. The mean preferred length of physical therapy was 7.25 (4.3, 2-36) months. The mean time to fully recover was 13.17 months. These results are shown in Table 1.

Experience and Views on the Acceptability of Telerehabilitation: Quantitative Data

As indicated in Table 2, 92% (88/96) of patients had never used a telerehabilitation tool. Approximately 77% (74/96) reported that they were not familiar at all with telerehabilitation; 25% (24/96) of people felt there would be challenges to using telerehabilitation, although most were not overly concerned about data protection (48/96, 50% not at all; and 29/96, 30% were less than somewhat concerned). When asked in which phase they preferred to use their allocated physical therapy appointments, 60% (58/96) said they preferred face to face in the early stages of care, 33% (32/96) said they preferred to use face to face with the return-to-sport care, and 6% (6/96) chose other. Most patients (85/96, 89%) felt capable of using physical therapy, further, a secondary analysis using a chi-square test showed no significant association between capability and gender, age, level of sport, or race and ethnicity. However, we interpret this with caution, given that there was no formal sample size for this exploratory study, and there is some risk of a type 2 error.

Table 2.

Experiences and opinions on telerehabilitation quantitative data (N=96).

Characteristics Values
Previous use of telerehabilitation; frequency, n (%)

No 88 (92)

Yes 8 (8)
How familiar are you with telerehabilitation; frequency, n (%)

1 (not familiar at all) 74 (77)

2 11 (12)

3 (somewhat familiar) 9 (9)

4 1 (1)

5 (very familiar) 1 (1)
Concern about data protection; frequency, n (%)

1 (not at all concerned) 48 (50)

2 29 (30)

3 (somewhat concerned) 13 (14)

4 3 (3)

5 (very concerned) 3 (3)
How would you prioritize use of physical therapy appointments; frequency n (%)

Other 6 (6)

Early phase 58 (61)

Return-to-sport phase 32 (33)
Do you feel capable of using telerehabilitation; frequency, n (%)

No 11 (12)

Yes 85 (88)
Association of feeling capable by chi-square, P value

Age .94

Insurance .75

Gender .91

Race and ethnicity .30

Level of sport .79

Experiences and Views on the Acceptability of Telerehabilitation: Mixed Qualitative and Quantitative Data

About 25% of patients perceived challenges in using telerehabilitation at home. When participants described these challenges, 2 themes emerged and are shown in Table 3 “Resources” and “Value placed on face-to-face care.” Participant quotes are identified with the letter P and an anonymous identification number. First, access to technology such as appropriate computers with high-quality cameras for two-way communication and access to the internet were cited as potential limitations. Space and proper equipment with which to exercise were also mentioned as limitations to exercising at home. Second, patients emphasized the value they place on in-person therapy. In particular, meeting with their physical therapist afforded them the opportunity to make sure that exercise techniques were correct and that pain levels were normal. In addition, patients reported being motivated by their physical therapy and having improved confidence based on face-to-face physical therapy. They also mentioned the individualized nature of face-to-face care and the potential need for manual therapy.

Table 3.

Experiences and opinions on telerehabilitation: mixed data.

Questions Responses
Are there challenges to telerehabilitation use? Frequency, n (%)

No 72 (75)

Yes 24 (25)
If yes, what are they?

Concerns about resources
  • “No computer.” (P10)

  • “Lack space.” (P86)

  • “Lack of equipment or space for exercise time management.” (P24)

  • “not having access to equipment” (P39)

  • “unreliable wifi” (P43)


Value placed on face-to-face physical therapy
  • “Direct one on one instruction is irreplaceable.” (P11)

  • “being able to talk through new movements” (P42)

  • “Knowing what level of pain is ok.” (P16)

  • “How do you know you are doing the movements correctly?” (P20)

  • “Some of my rehab had to have been done by a physical therapist. I could not do the manipulation.” (P7)

Experiences and Views on the Acceptability of Telerehabilitation: Qualitative Data

Within each qualitative question, patients were invited to give their opinions on telerehabilitation. Table 4 shows the 3 questions asked and the themes that arose.

Table 4.

Experience and opinions of telerehabilitation: qualitative data.

Question Theme 1 Theme 2 Theme 3 Theme 4
What, if any, do you see as potential benefits to the use of telerehabilitation following ACLa reconstruction surgery? Companion to physical therapy Improving access to care Telerehabilitation as a learning tool over the long term Telerehabilitation as a tool to motivate and engage
What, if any, are your primary concerns regarding the use of telerehabilitation following your ACL reconstruction surgery? Clinical concerns: biopsychosocial needs of patient Sociopolitical b
What would you need from a telerehabilitation program to make it right for you to use? Utilized alongside physical therapy Preferred timing of telerehabilitation use Personalized

aACL: anterior cruciate ligament.

bThemes were not present for all questions.

Responses regarding the potential benefits of telerehabilitation were collated into 4 themes: telerehabilitation as a resource-saving companion to physical therapy care, improving access to care, a learning tool during and after physical therapy, and to engage patients more with the education and exercises of their care (Textbox 1). Patients emphasized the potential value of telerehabilitation as an adjunct to usual physical therapy care. They emphasized its potential to facilitate saving appointments or to fill the gap at the end of rehabilitation. Patients placed significant emphasis on how telerehabilitation could improve their access to care. They commonly cited a lack of transport options, cost of transport, or bad weather as limiting their access, and they saw telerehabilitation as a way to improve this. Patients who had concluded physical therapy believed that it has a potential benefit of having access to telerehabilitation, such as an app, in an ongoing way to provide maintenance advice and reminders. Respondents identified their understanding of the role of telerehabilitation in motivating and engaging them in personal care plans. Goal setting, progress measures, and modes of encouragement were all mentioned as benefits of using telerehabilitation.

What are the potential benefits of telerehabilitation? (PT: physical therapy).

Question asked: What, if any, do you see as potential benefits to the use of telerehabilitation following anterior cruciate ligament reconstruction surgery?

  • Telerehabilitation as a resource-saving companion to physical therapy care:

    “It might be useful for the home exercises, but would have to be paired simultaneously with in-person treatment to be useful.” (P24)

    “Also you could save your Dr visits when it counts the most.” (P10)

    “Physical therapy was mostly for the initial recovery (for the first three months at most). I wish I had more sessions for ‘return-to-sport’ type exercises. Of course being supervised would be ideal but perhaps ‘return-to-sport’ type rehab can be done remotely.” (P19)

    “For patients who have a time constraint and who have run out of in person rehab, this may be a more affordable option.” (P20)

    “Saving rehabilitation appointments until later.” (P60)

  • Telerehabilitation as a resource to improve access to care:

    “Tele-rehab would save the commute from home or class to a PT center, which is difficult directly post-surgery, and especially so if the patient (such as a student) lives on their own.” (P83)

    “In case you are not able to make it to your appointments.” (P2)

    “Reduction in commuting costs.” (P68)

  • Telerehabilitation as a learning tool during and after physical therapy:

    “Don’t know what the correct exercises are now to keep strengthening it. I would love to have specific exercises so I would go on your tele rehab app now.” (P23)

    “Improvement in return to activity and return to full prior level of activity—and maintenance after.” (P21)

    “I felt like I was released from PT before my recovery was ‘complete,’ but I had passed the tests. This would hopefully help prevent that from happening.” (P13)

  • Telerehabilitation to motivate and engage patients:

    “I would use tele-rehab daily, because having a program that measures your progress and fulfilment of daily goals is more encouraging than a doctor’s note that tells you to do ‘x’ repetitions of some exercise, which I would be less likely to do regularly.” (P83)

Patient concerns with telerehabilitation predominantly focused on the clinical issues of patients and their biopsychosocial needs (Textbox 2). They were concerned about a negative impact on their care if they were performing exercises incorrectly or if they were not managing their pain well. Access to manual therapy, motivation, and opportunities to ask questions were again cited as reasons why they would require one-on-one sessions in addition to telerehabilitation. One patient expressed a strong opinion that telerehabilitation was providing a solution to the problem of not enough health care insurance. One participant described wanting to be able to progress at her own rate. Others commented simply that it should be personalized or specific.

What are your potential concerns about the use of telerehabilitation in care?

Question asked: What, if any, are your primary concerns regarding the use of telerehabilitation following your anterior cruciate ligament reconstruction surgery?

  • Clinical concerns: biopsychosocial needs of patient

    “In the initial recovery phase, I wouldn’t be confident enough to judge what’s OK and what’s not.” (P19)

    “It would slow rehab process due to lack of personal contact.” (P11)

    “No instructor there to tell you if you are doing the movements incorrectly. I know there is a camera but does it pick up on minor nuances?” (P20)

    “Not pushing myself especially if there is pain.” (P84)

    “I need someone to push me.” (P88)

  • Sociopolitical concerns

    “The state of healthcare in this country is deplorable. If the reason for a tele-rehab program is that insurance won’t cover enough in person visits, the insurance system needs to be fixed, not the treatment system.” (P24)

The final question was, “What would you need from a telerehabilitation program to make it right for you to use?” The predominant theme was that telerehabilitation needed to be used as an adjunct to physical therapy rather than instead of it. Further themes focused on the preferred timing of a telerehabilitation tool and a necessity to be personalized so that a patient’s individual plan is reflected in their care needs (Textbox 3).

What would you need from a telerehabilitation program to make it right for you to use? (PT: physical therapy).

Question asked: What would you need from a telerehabilitation program to make it right for you to use?

  • Utilized alongside physical therapy

    “I would need to intersperse the program with visits to an actual PT centre, where therapists would check in on my progress and either tell me to go harder or back off on the intensity of the exercises.” (P83)

    “I wouldn’t have it replace all face to face appointments, but I would think it might be a good idea to use on every other appointment.” (P68)

  • Preferred timing of telerehabilitation use

    “Mid-late phase is ok.” (P11)

    “If it can help me with the ‘return-to-sport’ type exercises (at various levels), I would be interested.” (P19)

    “I would like to use it after the first month or two of in person rehab.” (P20)

    “I would prefer to have (a) professional at least in early stages of recovery process rather than tele-rehabilitation.” (P63)

  • Personalized

    “I would want to have the option to make exercises more difficult: younger bodies recover faster than older ones, and I was often frustrated during my therapy by how basic some exercises were, especially early during the recovery.” (P83)

    “Specific.” (P9)

Patients discussed the necessity of progress testing and supervision of physical therapy as important to their recovery and outcomes. They re-emphasized the value they place on face-to-face care and had differing views on whether they would prefer to use telerehabilitation in different stages of care. Many patients expressed that they would prefer to have access to face-to-face rehabilitation in the early stages of care. Some patients emphasized the appeal of having return-to-sports content on a telerehabilitation tool and discussed telerehabilitation as being adaptive to their individual needs.

Discussion

Principal Findings

These results provide a detailed impression of participants’ knee health, their recollections of access to physical therapy, and their opinions on the role of telerehabilitation in ACL rehabilitation. Missing data were minimal, and the results demonstrated that for many patients, a rehabilitation gap exists between the time they are discharged from care and the time they recovered. It is unlikely that an average patient would have passed the return-to-sport criteria when care was completed at 6 months, given that 9 and 12 months have been given as typical [5,12,31]; return to sports before 9 months increases the risk of re-injury by 51% [13], and returning to sports without meeting the specific physical criteria also increases the risk of re-injury [16]. It is, therefore, highly likely that patients, including those in this cohort, are discharged from care before they can undertake advanced rehabilitation or be subjected to the return-to-sport criteria testing, and this may expose them to an increased risk of re-injury.

Recovery after ACLR was also measured by a return to the previous level of activity. Feucht et al [32] reported that 91% of athletic patients expect to return to the same level of sport. In this study, 99% of patients identified as being either competitively or recreationally athletic, indicating that the goal of return to sports was likely commonplace. Typically, 55% of patients returned to compete in sports at the same level as before their injury [31]. In line with these findings, 59% of our study respondents reported return at the same level. Although the overall reported knee health was 83% of the pre-injury level, this figure is difficult to interpret because of its subjectivity and demonstrates the importance of objective outcome measures such as the Knee Injury and Osteoarthritis Outcome Score (KOOS), which can indicate in which area of function or daily life the knee deficit persists [33]. The data in this study contributed to the knowledge that patients undergoing ACLR see themselves as competitive or recreationally athletic, and a lack of guidance during the advanced rehabilitation and return-to-sports phase could contribute to overall suboptimal outcomes for return to previous levels of activity [14].

When considering participants’ access to physical therapy, there are some contradictory responses for which we can suggest possible explanations. The finding that 77% of patients felt that they had sufficient physical therapy appears to contradict the finding that only 11% of patients felt that they had fully recovered at the end of physical therapy. The possible explanations for this are that patients were satisfied with the level that they had achieved despite not reaching full recovery or that they continued to progress through rehabilitation independently or with support from outside physical therapy such as athletic trainers, coaches, or personal trainers.

It is also important to note that some patients may choose not to return to sports, and older patients (30% of respondents were older than 40 years) were more likely than younger patients to choose to modify their activities rather than returning at the same level [34]. The fear of re-injury is frequently cited as a cause of people not returning to sports [35]. Some participants with less physically challenging goals may have completed their rehabilitation at 6 months; however, this does not include people who are returning to high-demand sports such as football, lacrosse, and soccer.

The aim of this study is to investigate the acceptability of telerehabilitation tools in ACL rehabilitation. It is thought that telerehabilitation may have positive benefits for delivering exercise interventions and create opportunities for improved self-management and progress measurement [36]. There is growing availability and popularity of health apps and other telerehabilitation tools [37,38]; however, they have not been widely integrated into rehabilitation practice or tested under research conditions. As such, patient experience and knowledge may be minimal. Indeed, our data suggested that 92% had never used telerehabilitation. Patients in this study primarily expressed concern over how telerehabilitation is integrated into current care, with an emphasis on not wanting telerehabilitation to replace face-to-face care but to be offered alongside it. Concern about the security of their data was less of an issue for this cohort (20%).

The COM-B model of behavior change suggests that having the capability, motivation, and opportunity to perform a given task is associated with behavior outcomes [29]. In rehabilitation, the target behavior is often the exercise. This analysis considered participants’ survey responses in relation to their understanding of exercise and rehabilitation behavior. Participants were not concerned about being able to use telerehabilitation; 89% of the patients felt that they were capable, indicating that they would have the knowledge and skill to engage with this process. There was no indication of a digital divide among respondents, with no significant interaction being found between capability and participant demographic group (Table 3); however, digital literacy may have excluded some people from a web survey at the first instance. One-fourth (25%) of patients who expressed concern were predominantly focused on having the physical capability or skill to perform exercises correctly without the supervision of a physical therapist. Any implemented telerehabilitation tool would need to address this concern through careful development.

Opportunities to change behavior can be both physical and social. Physical opportunities for rehabilitation include the availability of resources and the environment to facilitate behavior. A social opportunity might pertain to cultural norms and standards that are familiar. About 25% of patients identified potential physical opportunity challenges to using telerehabilitation, such as access to computers, physical space, and Wi-Fi. They further referenced social norms and beliefs about the values of traditional physical therapy. They expressed anxiety about how telerehabilitation might be integrated into care and potential loss of face-to-face therapy. About 60% of patients expressed that they would prefer to use fewer appointments in the early stage of their care and save them for later, whereas the remaining identified that they would prefer to use telerehabilitation in the return-to-sports phase.

Patients also endorsed opportunities to adapt to norms. They highlighted the potential benefits of telerehabilitation alongside physical therapy to improve care and create physical opportunities such as saving time and money by avoiding commutes. A number of patients also identified the potential of telerehabilitation as a maintenance tool after discharge from physical therapy, whereas some reported that they felt their care ended prematurely.

Motivation to exercise is a significant factor in rehabilitation behavior, and, similar to other psychological factors, it is positively correlated with successful outcomes in ACL rehabilitation [39,40]. Digital health tools are thought to influence motivation and adherence to exercise programs [18,41,42]. Motivation can be reflective, including goals and plans, and automatic, where it interacts with wants, needs, and impulses [29]. One participant stated that being able to set and fulfill their own goals through telerehabilitation would be “more encouraging.” They discussed the benefit of measures of progress, which is a common function of telerehabilitation tools, where they can collect outcomes such as KOOS and pain scores to measure and record progress over time and motivate the patient to continue to set and pursue goals in a validated way [18,20].

Limitations

Limitations of this survey include the potential for recollection bias with regard to how much physical therapy patients had, and participants who had undergone surgery more recently may have been less able to offer a long-term view. The study had a relatively small sample size, and, as an exploratory study, psychometric properties were not calculated, which may inform the reliability of results.

All surveys are limited to the data gathered, and it is known that participation can be affected by socioeconomic condition and education or digital literacy levels, where some populations are known to be less likely to access internet surveys [43]. This may include a population for whom telerehabilitation is not appropriate, and therefore, face-to-face rehabilitation would need to be provided. Future work should include a measure of insurance type in the data set where possible so that socioeconomic biases can be identified. For example, this study had few Medicaid patient responses, but it is not known whether this is related to fewer invites issued to Medicaid patients or if it could be considered to be related to socioeconomic disadvantage where Medicaid patients are known to be at a greater risk [44-46].

Conclusions

Physical therapy care most commonly ends before patients reach the return-to-sport phase of care. This indicates that there is a rehabilitation gap where patients may not have access to the best guidance for return-to-sports rehabilitation. This may have implications for their injury risk and successful return to sports. Telerehabilitation may provide an alternative way for patients to access evidence-based ACL rehabilitation in this phase. The results suggest that telerehabilitation is acceptable to patients as part of their rehabilitation following ACLR but would need to be an adjunct to care rather than a replacement.

Acknowledgments

The authors would like to thank Professor Elizabeth Murray, PhD, Professor of eHealth and Primary Care, and Dr Fiona L Hamilton, Senior Clinical Research Associate in the eHealth Unit, University College London, for their comments on the manuscript.

This study/project was partly funded by the National Institute for Health Research (NIHR) Clinical Doctoral Research Fellowship Award ICA-CDRF-2016-02-027 of the NIHR Integrated Clinical Academic program. The views expressed are those of the authors and not necessarily those of the NIHR or the Department of Health and Social Care. Funding was also received with gratitude from the Chartered Society of Physiotherapists Educational and Development Placement Awards and the University College London-Yale PhD Scholarship program.

Abbreviations

ACL

anterior cruciate ligament

ACLR

anterior cruciate ligament reconstruction

ANOVA

analysis of variance

CHERRIES

Checklist for Reporting Results of Internet E-Surveys

COM-B

Capability, Opportunity, and Motivation-Behavior

IRB

institutional review board

KOOS

Knee Injury and Osteoarthritis Outcome Score

NIHR

National Institute for Health Research

Appendix

Multimedia Appendix 1

Introductory email.

Multimedia Appendix 2

Survey.

Multimedia Appendix 3

CHERRIES (Checklist for Reporting Results of Internet E-Surveys).

Footnotes

Conflicts of Interest: None declared.

References

  • 1.Toth AP, Cordasco FA. Anterior cruciate ligament injuries in the female athlete. J Gend Specif Med. 2001;4(4):25–34. [PubMed] [Google Scholar]
  • 2.Hewett TE, Lindenfeld TN, Riccobene JV, Noyes FR. The effect of neuromuscular training on the incidence of knee injury in female athletes. A prospective study. Am J Sports Med. 1999;27(6):699–706. doi: 10.1177/03635465990270060301. [DOI] [PubMed] [Google Scholar]
  • 3.Capin JJ, Snyder-Mackler L, Risberg MA, Grindem H. Keep calm and carry on testing: a substantive reanalysis and critique of 'what is the evidence for and validity of return-to-sport testing after anterior cruciate ligament reconstruction surgery? A systematic review and meta-analysis'. Br J Sports Med. 2019 Dec;53(23):1444–1446. doi: 10.1136/bjsports-2019-100906. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Hewett TE, Myer GD, Ford KR, Paterno MV, Quatman CE. Mechanisms, prediction, and prevention of ACL injuries: Cut risk with three sharpened and validated tools. J Orthop Res. 2016 Nov;34(11):1843–1855. doi: 10.1002/jor.23414. doi: 10.1002/jor.23414. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Hartigan EH, Axe MJ, Snyder-Mackler L. Time line for noncopers to pass return-to-sports criteria after anterior cruciate ligament reconstruction. J Orthop Sports Phys Ther. 2010 Mar;40(3):141–54. doi: 10.2519/jospt.2010.3168. http://europepmc.org/abstract/MED/20195019. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Kruse LM, Gray B, Wright RW. Rehabilitation after anterior cruciate ligament reconstruction: a systematic review. J Bone Joint Surg Am. 2012 Oct 03;94(19):1737–48. doi: 10.2106/JBJS.K.01246. http://europepmc.org/abstract/MED/23032584. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Lobb R, Tumilty S, Claydon LS. A review of systematic reviews on anterior cruciate ligament reconstruction rehabilitation. Phys Ther Sport. 2012 Nov;13(4):270–8. doi: 10.1016/j.ptsp.2012.05.001. [DOI] [PubMed] [Google Scholar]
  • 8.Risberg MA, Holm I, Myklebust G, Engebretsen L. Neuromuscular training versus strength training during first 6 months after anterior cruciate ligament reconstruction: a randomized clinical trial. Phys Ther. 2007 Jun;87(6):737–50. doi: 10.2522/ptj.20060041. [DOI] [PubMed] [Google Scholar]
  • 9.van Melick N, van Cingel RE, Brooijmans F, Neeter C, van Tienen T, Hullegie W, Nijhuis-van der Sanden MW. Evidence-based clinical practice update: practice guidelines for anterior cruciate ligament rehabilitation based on a systematic review and multidisciplinary consensus. Br J Sports Med. 2016 Dec;50(24):1506–1515. doi: 10.1136/bjsports-2015-095898. [DOI] [PubMed] [Google Scholar]
  • 10.Arna Risberg M, Lewek M, Snyder-Mackler L. A systematic review of evidence for anterior cruciate ligament rehabilitation: how much and what type? Physical Therapy in Sport. 2004 Aug;5(3):125–145. doi: 10.1016/j.ptsp.2004.02.003. [DOI] [Google Scholar]
  • 11.Wright RW, Haas AK, Anderson J, Calabrese G, Cavanaugh J, Hewett TE, Lorring D, McKenzie C, Preston E, Williams G, MOON Group Anterior cruciate ligament reconstruction rehabilitation: MOON guidelines. Sports Health. 2015 May;7(3):239–43. doi: 10.1177/1941738113517855. http://europepmc.org/abstract/MED/26131301. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Ardern CL, Glasgow P, Schneiders A, Witvrouw E, Clarsen B, Cools A, Gojanovic B, Griffin S, Khan KM, Moksnes H, Mutch SA, Phillips N, Reurink G, Sadler R, Silbernagel KG, Thorborg K, Wangensteen A, Wilk KE, Bizzini M. 2016 consensus statement on return to sport from the first world congress in sports physical therapy, BERN. Br J Sports Med. 2016 Jul;50(14):853–64. doi: 10.1136/bjsports-2016-096278. [DOI] [PubMed] [Google Scholar]
  • 13.Grindem H, Snyder-Mackler L, Moksnes H, Engebretsen L, Risberg MA. Simple decision rules can reduce reinjury risk by 84% after ACL reconstruction: the Delaware-Oslo ACL cohort study. Br J Sports Med. 2016 Jul;50(13):804–8. doi: 10.1136/bjsports-2016-096031. http://europepmc.org/abstract/MED/27162233. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Greenberg EM, Greenberg ET, Albaugh J, Storey E, Ganley TJ. Rehabilitation practice patterns following anterior cruciate ligament reconstruction: a survey of physical therapists. J Orthop Sports Phys Ther. 2018 Oct;48(10):801–11. doi: 10.2519/jospt.2018.8264. [DOI] [PubMed] [Google Scholar]
  • 15.Joreitz R, Lynch A, Rabuck S, Lynch B, Davin S, Irrgang J. Patient-specific and surgery-specific factors that affect return to sport after ACL reconstruction. Int J Sports Phys Ther. 2016 Apr;11(2):264–78. http://europepmc.org/abstract/MED/27104060. [PMC free article] [PubMed] [Google Scholar]
  • 16.Kyritsis P, Bahr R, Landreau P, Miladi R, Witvrouw E. Likelihood of ACL graft rupture: not meeting six clinical discharge criteria before return to sport is associated with a four times greater risk of rupture. Br J Sports Med. 2016 Aug;50(15):946–51. doi: 10.1136/bjsports-2015-095908. [DOI] [PubMed] [Google Scholar]
  • 17.Myer GD, Paterno MV, Ford KR, Quatman CE, Hewett TE. Rehabilitation after anterior cruciate ligament reconstruction: criteria-based progression through the return-to-sport phase. J Orthop Sports Phys Ther. 2006 Jun;36(6):385–402. doi: 10.2519/jospt.2006.2222. [DOI] [PubMed] [Google Scholar]
  • 18.Dunphy E, Hamilton FL, Spasić I, Button K. Acceptability of a digital health intervention alongside physiotherapy to support patients following anterior cruciate ligament reconstruction. BMC Musculoskelet Disord. 2017 Nov 21;18(1):471. doi: 10.1186/s12891-017-1846-0. https://bmcmusculoskeletdisord.biomedcentral.com/articles/10.1186/s12891-017-1846-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Chughtai M, Kelly JJ, Newman JM, Sultan AA, Khlopas A, Sodhi N, Bhave A, Kolczun MC, Mont MA. The role of virtual rehabilitation in total and unicompartmental knee arthroplasty. J Knee Surg. 2019 Jan;32(1):105–10. doi: 10.1055/s-0038-1637018. [DOI] [PubMed] [Google Scholar]
  • 20.Chughtai M, Newman JM, Sultan AA, Khlopas A, Navarro SM, Bhave A, Mont MA. The role of virtual rehabilitation in total knee and hip arthroplasty. Surg Technol Int. 2018 Jun 1;32:299–305. [PubMed] [Google Scholar]
  • 21.McDaid A , A. Alder, and S. H. Ward, Digital Technology to Monitor Rehabilitation Outcomes After Knee Injury: A Case Study; The 41st International Engineering in Medicine and Biology Conference,; 23-27 July 2019; Berlin, Germany,. Science Foundation Ireland: Insight Research Collection; 2019. p. A. https://researchrepository.ucd.ie/handle/10197/11061. [Google Scholar]
  • 22.Spasić I, Button K, Divoli A, Gupta S, Pataky T, Pizzocaro D, Preece A, van Deursen R, Wilson C. TRAK App Suite: A Web-Based Intervention for Delivering Standard Care for the Rehabilitation of Knee Conditions. JMIR Res Protoc. 2015 Oct 16;4(4):e122. doi: 10.2196/resprot.4091. https://www.researchprotocols.org/2015/4/e122/ [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Kelley K, Clark B, Brown V, Sitzia J. Good practice in the conduct and reporting of survey research. Int J Qual Health Care. 2003 Jun;15(3):261–6. doi: 10.1093/intqhc/mzg031. [DOI] [PubMed] [Google Scholar]
  • 24.Sullivan GM, Artino AR. Analyzing and interpreting data from likert-type scales. J Grad Med Educ. 2013 Dec;5(4):541–2. doi: 10.4300/JGME-5-4-18. http://europepmc.org/abstract/MED/24454995. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Fisher MJ, Marshall AP. Understanding descriptive statistics. Aust Crit Care. 2009 May;22(2):93–7. doi: 10.1016/j.aucc.2008.11.003. [DOI] [PubMed] [Google Scholar]
  • 26.Eysenbach G. Improving the quality of web surveys: the checklist for reporting results of internet e-surveys (CHERRIES) J Med Internet Res. 2004 Sep 29;6(3):e34. doi: 10.2196/jmir.6.3.e34. https://www.jmir.org/2004/3/e34/ [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Pope C, Ziebland S, Mays N. Qualitative research in health care. Analysing qualitative data. Br Med J. 2000 Jan 8;320(7227):114–6. doi: 10.1136/bmj.320.7227.114. http://europepmc.org/abstract/MED/10625273. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Michie S . Atkins, and R. West, The behaviour change wheel. A guide to designing interventions. 1st ed. Great BritaSilverback Publishing. 14 Victoria Road, Sutton, Surrey, SM1 4RT: Silverback Publishing; 2014. , L; pp. 1003–1010. [Google Scholar]
  • 29.Michie S, van Stralen MM, West R. The behaviour change wheel: a new method for characterising and designing behaviour change interventions. Implement Sci. 2011 Apr 23;6:42. doi: 10.1186/1748-5908-6-42. https://implementationscience.biomedcentral.com/articles/10.1186/1748-5908-6-42. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Barker F, Atkins L, de Lusignan S. Applying the COM-B behaviour model and behaviour change wheel to develop an intervention to improve hearing-aid use in adult auditory rehabilitation. Int J Audiol. 2016 Jul;55(Suppl 3):S90–8. doi: 10.3109/14992027.2015.1120894. [DOI] [PubMed] [Google Scholar]
  • 31.Ardern CL, Taylor NF, Feller JA, Webster KE. Fifty-five per cent return to competitive sport following anterior cruciate ligament reconstruction surgery: an updated systematic review and meta-analysis including aspects of physical functioning and contextual factors. Br J Sports Med. 2014 Nov;48(21):1543–52. doi: 10.1136/bjsports-2013-093398. [DOI] [PubMed] [Google Scholar]
  • 32.Feucht MJ, Cotic M, Saier T, Minzlaff P, Plath JE, Imhoff AB, Hinterwimmer S. Patient expectations of primary and revision anterior cruciate ligament reconstruction. Knee Surg Sports Traumatol Arthrosc. 2016 Jan;24(1):201–7. doi: 10.1007/s00167-014-3364-z. [DOI] [PubMed] [Google Scholar]
  • 33.Roos EM, Roos HP, Lohmander LS, Ekdahl C, Beynnon BD. Knee injury and osteoarthritis outcome score (KOOS)--development of a self-administered outcome measure. J Orthop Sports Phys Ther. 1998 Aug;28(2):88–96. doi: 10.2519/jospt.1998.28.2.88. [DOI] [PubMed] [Google Scholar]
  • 34.Webster KE, Feller JA. A research update on the state of play for return to sport after anterior cruciate ligament reconstruction. J Orthop Traumatol. 2019 Jan 28;20(1):10. doi: 10.1186/s10195-018-0516-9. http://europepmc.org/abstract/MED/30689073. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Kvist J, Ek A, Sporrstedt K, Good L. Fear of re-injury: a hindrance for returning to sports after anterior cruciate ligament reconstruction. Knee Surg Sports Traumatol Arthrosc. 2005 Jul;13(5):393–7. doi: 10.1007/s00167-004-0591-8. [DOI] [PubMed] [Google Scholar]
  • 36.Nussbaum R, Kelly C, Quinby E, Mac A, Parmanto B, Dicianno BE. Systematic review of mobile health applications in rehabilitation. Arch Phys Med Rehabil. 2019 Jan;100(1):115–27. doi: 10.1016/j.apmr.2018.07.439. [DOI] [PubMed] [Google Scholar]
  • 37.Ernsting C, Dombrowski SU, Oedekoven M, O Sullivan JL, Kanzler M, Kuhlmey A, Gellert P. Using smartphones and health apps to change and manage health behaviors: a population-based survey. J Med Internet Res. 2017 Apr 5;19(4):e101. doi: 10.2196/jmir.6838. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Bondaronek P, Alkhaldi G, Slee A, Hamilton FL, Murray E. Quality of publicly available physical activity apps: review and content analysis. JMIR Mhealth Uhealth. 2018 Mar 21;6(3):e53. doi: 10.2196/mhealth.9069. https://mhealth.jmir.org/2018/3/e53/ [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Everhart JS, Best TM, Flanigan DC. Psychological predictors of anterior cruciate ligament reconstruction outcomes: a systematic review. Knee Surg Sports Traumatol Arthrosc. 2015 Mar;23(3):752–62. doi: 10.1007/s00167-013-2699-1. [DOI] [PubMed] [Google Scholar]
  • 40.Czuppon S, Racette BA, Klein SE, Harris-Hayes M. Variables associated with return to sport following anterior cruciate ligament reconstruction: a systematic review. Br J Sports Med. 2014 Mar;48(5):356–64. doi: 10.1136/bjsports-2012-091786. http://europepmc.org/abstract/MED/24124040. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Huber M. PlayStation 3-based tele-rehabilitation for children with hemiplegia. in 2008 Virtual Rehabilitation. IEEE. 2008:-. doi: 10.1109/icvr.2008.4625145. [DOI] [Google Scholar]
  • 42.Berry A, McCabe CS, Muir S, Walsh N. Digital behaviour change interventions to facilitate physical activity in osteoarthritis: a systematic review. Physical Therapy Reviews. 2018 Jul 02;23(3):197–206. doi: 10.1080/10833196.2018.1470747. [DOI] [Google Scholar]
  • 43.Bethlehem, J. Selection bias in web surveys. International Statistical Review. 2010;78(2):161–188. doi: 10.1111/j.1751-5823.2010.00112.x. [DOI] [Google Scholar]
  • 44.Foraker RE, Rose KM, Whitsel EA, Suchindran CM, Wood JL, Rosamond WD. Neighborhood socioeconomic status, Medicaid coverage and medical management of myocardial infarction: atherosclerosis risk in communities (ARIC) community surveillance. BMC Public Health. 2010 Oct 21;10:632. doi: 10.1186/1471-2458-10-632. https://bmcpublichealth.biomedcentral.com/articles/10.1186/1471-2458-10-632. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Perloff JD, Kletke PR, Fossett JW, Banks S. Medicaid participation among urban primary care physicians. Med Care. 1997 Feb;35(2):142–57. doi: 10.1097/00005650-199702000-00005. [DOI] [PubMed] [Google Scholar]
  • 46.Weiss BD, Blanchard JS, McGee DL, Hart G, Warren B, Burgoon M, Smith KJ. Illiteracy among Medicaid recipients and its relationship to health care costs. J Health Care Poor Underserved. 1994;5(2):99–111. doi: 10.1353/hpu.2010.0272. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Multimedia Appendix 1

Introductory email.

Multimedia Appendix 2

Survey.

Multimedia Appendix 3

CHERRIES (Checklist for Reporting Results of Internet E-Surveys).


Articles from JMIR Formative Research are provided here courtesy of JMIR Publications Inc.

RESOURCES