Abstract
Background
Rehabilitation care for patients with chronic musculoskeletal pain (CMP) is not optimally organized. The Network Pain Rehabilitation Limburg 2.0 (NPRL2.0) provides integrated care with a biopsychosocial approach and strives to improve the Quadruple Aim outcomes: pain-related disability of patients with CMP; experiences of care of patients with CMP; meaning in the work of healthcare professionals; and healthcare costs. Firstly, in this study, the effectiveness (with regard to the functioning and participation of patients) of primary care for patients with CMP will be assessed, comparing care organized following the NPRL2.0 procedure with usual care. Secondly, the cost-effectiveness and cost-utility with regard to health-related quality of life and healthcare costs will be assessed. And thirdly, the effect of duration of participation in a local network in primary care will be studied.
Methods
In this pragmatic study, it is expected that two local networks with 105 patients will participate in the prospective cohort study and six local networks with 184 patients in the stepped-wedge based design. Healthcare professionals in the local networks will recruit patients. Inclusion criteria: age ≥ 18 years; having CMP; willing to improve functioning despite pain; and adequate Dutch literacy. Exclusion criteria: pregnancy; and having a treatable medical or psychiatric disease. Patients will complete questionnaires at baseline (T1), 3 months (T2), 6 months (T3), and 9 months (T4). Questionnaires at T1 and T4 will include the Pain Disability Index and Short Form Health Survey. Questionnaires at T1, T2, T3, and T4 will include the EQ-5D-5L, and iMTA Medical Consumption and Productivity Cost Questionnaires. Outcomes will be compared using linear mixed-model analysis and costs will be compared using bootstrapping methods.
Discussion
NPRL2.0 is a multidimensional, complex intervention, executed in daily practice, and therefore needing a pragmatic study design. The current study will assess NPRL2.0 with respect to the Quadruple Aim outcomes: patient health and costs. This will provide more information on the (cost-) effectiveness of the organization of care in a network structure regarding patients with CMP. The other two Quadruple Aim outcomes will be examined alongside this study.
Trial registration Netherlands Trial Register: NL7643. https://www.trialregister.nl/trial/7643.
Keywords: Effectiveness, Cost-effectiveness, Cost-utility, Pragmatic trial, Rehabilitation, Chronic musculoskeletal pain, Organization of care, Primary care, Network
Background
In Western society, the prevalence of chronic musculoskeletal pain (CMP) is up to 20% in the adult population [1, 2]. CMP, the major cause of pain and disability, includes a diverse range of diagnoses such as nonspecific low back pain, fibromyalgia, complex regional pain syndrome, and nonspecific musculoskeletal pain [2, 3]. Biopsychosocial factors contribute to the development and persistence of pain and the associated perceived disabilities. However, the level of complexity of biomedical and psychosocial factors varies widely between people with CMP. This depends on the biomedical context and meaning of the pain, and on the impact of psychosocial factors, such as depression, anxiety, and social influences, on patients’ functioning [4, 5]. People with CMP often have difficulties in performing a range of daily activities and in maintaining an independent lifestyle. A high intensity of CMP is strongly associated with impaired function and is one of the leading causes of long-term work absenteeism and health-related early retirement, leading to high societal costs [6–10]. Earlier studies have shown that the health-related quality of life and levels of physical activity in people with CMP with a duration of 3–6 months is already low, and work absenteeism is high [1, 11, 12].
Due to high healthcare costs and high work absenteeism, CMP is one of the most expensive health conditions worldwide. In the Netherlands, CMP costs approximately 20 billion euros per year (direct and indirect costs) [11]. Of people with CMP, 60–74% receive treatment and most of these (34–79%) perceive the treatment as inadequate and therefore seek an explanation or solution for their pain problem [1, 13–15]. Earlier research shows that 61% of people with CMP had visited from six to more than 20 healthcare professionals in the year before starting a rehabilitation program [16]. A reason for medical ‘shopping around’ might be the more biomedical-oriented (instead of biopsychosocial-oriented) outlook of the general population, healthcare professionals, and decision-makers, in which explaining and solving the pain remains the ultimate focus [15, 17]. Additionally, healthcare professionals receive inadequate training on the assessment and management of CMP, leading to over- or under-treatment. As a result, the complexity of the patient’s pain problem does not accord with the treatment delivered [17–19]. This highlights the need for adequate (cost-) effective treatment strategies.
Multidisciplinary and interdisciplinary treatments, with a biopsychosocial focus in primary, secondary, and tertiary care, have been shown to be both clinically- and cost-effective for people with CMP [20–26]. In order to overcome the previously-mentioned challenges in rehabilitation care for people with CMP, a National Care Standard for Chronic Pain (NCSCP) was presented in the Netherlands in 2017 [11]. In this standard, a matched and person-centered care approach with multi- and interdisciplinary treatments in an integrated care network was proposed. This integrated care network would provide a shared vision of CMP and its biopsychosocial treatment through guidelines for referral and treatment. Moreover, there would be a focus on the early recognition of subacute pain in order to prevent this from becoming chronic. In line with this, the World Health Organization advises focusing on the stimulation of functioning and participation in the design of (new) rehabilitation care [27, 28].
As an elaboration of the NCSCP, the Network Pain Rehabilitation Limburg 1.0 (NPRL1.0) was developed to provide integrated care with a biopsychosocial approach for people with CMP in order to improve their level of functioning. Its main aim is to deliver the right care, at the right place, by the right person, for the right price, thus accomplishing the Quadruple Aim: improving the functioning and participation of people with CMP; improving the experiences of care of people with CMP; improving the meaning of the work of healthcare professionals; and reducing the healthcare costs of people with CMP [29, 30]. As a first step, a feasibility study was performed in 2017 and 2018 to assess the barriers and facilitators for the development, implementation, and transferability of NPRL1.0 [31]. The main facilitators were that the guidelines provide consistency and transparency in the collaboration of the healthcare professionals and that the iterative, bottom-up implementation strategy fits in with the target population with CMP. However, the current views and knowledge of CMP from the patient’s perspective, as well as from the healthcare perspective, and the current organization of care, are challenges for the implementation of NPRL1.0. The results of this feasibility study were used to adjust NPRL1.0 in areas such as the content of the education days for healthcare professionals, the eHealth application for healthcare professionals and patients, and educational information for patients, in the development of NPRL2.0 [32]. The existing local networks in primary care will participate in a cohort study in NPRL2.0. Additionally, extra local networks in primary care will be recruited. It is expected that healthcare professionals will experience a learning curve, as NPRL2.0 is a multidimensional, complex intervention [33]. Therefore, the long-term results of effectiveness, as well as views and knowledge, regarding CMP must be studied.
In this phase, the Quadruple Aim outcomes from NPRL2.0 will be evaluated. This study will focus on the (long-term) effectiveness, cost-effectiveness, and cost-utility part of the Quadruple Aim for primary care of patients with CMP organized according to NPRL2.0 compared to usual care. The research aims of this study are:
To evaluate whether primary care organized according to NPRL2.0 leads to a lower level of pain-related disability in patients with CMP than in patients receiving usual care (effectiveness).
To evaluate whether primary care organized according to NPRL2.0 is more cost-effective for the health-related quality of life in patients with CMP than in patients receiving usual care (cost-effectiveness).
To evaluate whether primary care organized according to NPRL2.0 leads to higher Quality Adjusted Life Years (QALYs) than in patients receiving usual care (cost-utility analysis).
To study the effect of duration of participation and the experience of using biopsychosocial principles in treatment of local networks on (cost)-effectiveness (learning curve).
Methods
Study design
In this pragmatic study, the recruiting period will be from April 2019 till March 2020, with follow-ups till December 2020. This study comprises two designs; a prospective cohort study and a stepped-wedge based design.
Two local networks of NPRL1.0 will be enrolled in NPRL2.0. They will receive additional education and information based on the results of the feasibility study of NPRL1.0. In NPRL2.0, they will invite patients to participate in a prospective cohort study.
In the stepped-wedge based design working according to NPRL2.0 will be introduced in three steps in two local primary care networks at the same step (step A, B or C). Local networks that intensively collaborate, due to their geographical location, will be placed together in one step (A, B or C). An independent research assistant will randomly allocate the local networks over the steps. In one local network, at least one therapist, general practitioner (GP), and mental health nurse will participate. Each local network will first recruit patients as controls during a period of care as usual, followed by a 3-month ‘wash-out’ period in which education is given (see Fig. 1). After the wash-out period, a local network will then recruit patients during the intervention period in which NPRL2.0 is the standard of care. According to the stepped-wedge based design, length of control and intervention periods vary in each group: Group A will spend 3 months as control and 5 months with intervention; for Group B, there will be 4 months as control and 4 months with intervention; and Group C will spend 5 months as control and 3 months with intervention. Thus, healthcare professionals in all local networks will recruit patients for participation in both control and intervention groups. Patients will contribute data to either the control group or the intervention group, but not both. A stepped-wedge based design is the most feasible design in this pragmatic study as it has the following advantages: (1) it controls for between-local network variation in daily practice; (2) it gives the opportunity to assess intervention effects in a pre/post comparison across local networks, which increases statistical power; (3) it gives an opportunity to assess learning effects by comparing the results of local networks that transit earlier with those that transit later [34].
Intervention
NPRL2.0 is an integrated, transmural healthcare network for patients with CMP, focusing on improving the level of functioning of patients, despite pain. In the primary care of NPRL2.0, the GP is the gatekeeper for assessing the level of complexity of pain complaints, referral, and treatment selection. In the Netherlands, therapists (such as physiotherapists, practice therapists, and occupational therapists) in primary care can be visited by people with CMP directly, without referral. Therefore, therapists will also be able to assess the level of complexity of the pain complaints and to advise these patients to visit a GP if necessary. Depending on the level of complexity involved, the follow-up policy will either include advice without further treatment, monodisciplinary treatment in primary care, interdisciplinary treatment in primary care (collaboration between GPs, primary care therapists, and mental health practice nurses in assessing and treating patients with CMP who need mental support besides physical exercise) or interdisciplinary treatment in secondary or tertiary care (Fig. 2). Primary care in NPRL2.0 consists of the following elements:
Integral focus on assessment and referral: assessment tool
To support the healthcare professionals in their decision-making for problem-mapping and treatment selection, an evidence-based objective assessment tool will be used for the assessment of complexity of the pain problem: the STarT MSK Tool [35]. The Dutch version of this tool is translated and validated (not published yet). STarT MSK will support decision-making by choosing the right treatment to match the patient’s biopsychosocial profile.
Integral focus on treatment content and duration: treatment protocols
Patients will receive individualized treatments based on their current needs in order to improve their daily functioning. NPRL2.0 protocols are based on the most recent evidence-based treatment methods, such as Graded Activity, Exposure in vivo, and Acceptance and Commitment Therapy, and are adjusted to the primary care setting [22–24, 36, 37]. In the feasibility study, healthcare professionals were invited to provide feedback on the NPRL2.0 treatment protocols. Based on this, adjustments were made to the content and duration of NPRL2.0 treatment protocols. The primary care NPRL2.0 protocols are extended with a module focusing on self-management in daily living after treatment by a primary care therapist. In these treatment protocols, no advice for medication will be described. It is hypothesized that the biopsychosocial oriented healthcare professionals working in NPRL2.0 will prescribe less medication compared to patients receiving usual care.
Integral focus on self-management: eHealth application
Healthcare professionals and patients participating in the NPRL2.0 will make use of the eHealth application: SanaCoach Pain Rehabilitation [38]. The coach's primary goal is to support self-management. Its main function is to provide module-based pain education. Different eLearning modules are developed for the patients in order to teach them about the biopsychosocial aspects of pain. In addition, diaries are integrated in which patients can provide information on their pain intensity, level of activity, mood, and participation level. Moreover, healthcare professionals can use scores from these diaries to adjust treatment protocols to the needs of individual patients. The application also consists of a chat function between the patient and their healthcare professionals to ensure prompt communications. The functions in the SanaCoach Pain Rehabilitation, such as the number of diaries and the level of education, will be adapted to the patient, based on his/her complexity and level of disability.
Education and collaboration
Healthcare professionals will receive education during the 3-month wash-out period: GPs 2 × 3 h and therapists 3 × 3 h. Topics in the education program include biopsychosocial theories of CMP, recognition of patients with or at risk of CMP, providing education to patients with CMP, use of the assessment tool and eHealth application, and treatment selection. The first two sessions are organized jointly for all disciplines of healthcare professional in order to promote a common understanding of biopsychosocial treatment. Separately, therapists will also receive information about the treatment protocols. To encourage collaboration in the local networks, three additional peer-review meetings of one hour (every 6–8 weeks) are organized by the project team in each local network after the wash-out period. During these meetings, healthcare professionals apply the theories and treatment protocols learned during the education program in daily practice, with room for extra education by the teachers if necessary. After these three peer-review meetings, the local networks are encouraged to organize further such meetings in order to align the working procedures and treatment plans of the patients.
Control
All networks start with a control period, in which local networks will invite patients who are attending consultations for CMP complaints to participate in the study. The healthcare professionals will refer and treat the patients, following the usual way of working in pain rehabilitation care in the Netherlands. In usual care, patients can receive treatments from a variety of approaches: from a more biomedical to a psychological or biopsychosocial approach. This results in a wide range of treatments that can vary in duration, content, and intensity, like medication prescription, a few sessions of physiotherapy in primary care or a complex multidisciplinary treatment in tertiary care. In usual care, the goal of the treatment does not have to be on daily functioning of the patient.
Recruitment of primary healthcare professionals
Primary healthcare professionals (therapists, GPs and mental health nurses) working in the Parkstad region (Limburg, the Netherlands) who have no prior experience with NPRL1.0 will be recruited for participation in the study. Social media and the network of healthcare professionals of NPRL1.0 will be used to recruit new healthcare professionals. Healthcare professionals must be willing to recruit patients for the control and intervention periods, to attend the education days, and to make use of the assessment tool and treatment protocol of NPRL2.0.
Recruitment of patients
Patients with CMP complaints, who visit the participating GPs and therapists via direct access, will be informed about the study and asked for consent to transfer their contact details to the research team. The research team will contact these patients by phone to inform them about the study and ask for oral consent for participation. Subsequently, the patients will receive the first questionnaire (T1) electronically or by post, in which they can give electronic/written informed consent for participation in the study.
Patients will be eligible if they are ≥ 18 years at the start of the study, have CMP or musculoskeletal pain with a high risk of becoming chronic, are willing to improve their functioning despite the pain, and have adequate Dutch literacy to complete the questionnaires. Exclusion criteria are pregnancy or any medical (orthopedic, rheumatic or neurological) or psychiatric disease which could be treated by a more appropriate therapy, according to the expert opinion of the GP. The data will be handled based on intention-to-treat.
Sample size
In the prospective cohort, all patients with CMP who visit the two local networks of NPRL1.0 will be invited to participate in the study. Based on the recruitment results of the feasibility study of NPRL1.0, and the number of patients visiting a GP practice, we expect that each local network will also recruit about six patients per month. Therefore, the two local networks from NPRL1.0 together should recruit approximately 132 patients in 11 months. Assuming a dropout rate of 20%, we expect to include approximately 105 patients in this study.
To calculate the desired sample size for the stepped-wedge based design, we used the method described by Woertman et al. [39]. The calculations of the number of patients needed are based on the primary outcome of the cost-utility analysis, the health-related quality of life measured with the 5-level EQ-5D version (EQ-5D-5L). Based on McClure et al., we consider an increase of 0.063 points (SD = 0.013) in 1 year as clinically relevant [40]. In addition, an alpha of 0.05, a power of 80%, a 1:1 ratio between control and intervention groups, and a dropout rate of 30% were assumed. Based on these values and the stepped-wedge based design, a design effect (DEsw) of 0.416 exists, which leads to a required sample size of 184 patients (92 control and 92 intervention). Based on the recruitment results of the feasibility study of NPRL1.0, and the number of patients visiting a GP practice, we expect that each local network will recruit 6 patients per month [32]. Therefore, with a dropout rate of 30% of local networks, six local networks will need to participate.
Data collection
An overview of the content of the different data collection methods can be found in Fig. 3.
Patients participating in NPRL2.0 are asked to fill in four questionnaires electronically or on paper: T1 after initial contact with healthcare professionals about their CMP complaints (50 min completion time); T2 3 months after T1 (30 min completion time); T3 6 months after T1 (30 min completion time); and T4 9 months after T1 (50 min completion time).
Additionally, assessment tool 1 will be used for research purposes, as well as for decision-making in primary care. Therefore, patients in the control group will complete assessment tool 1 as part of the questionnaire at T1. Patients in the intervention group will complete it during their consultations in primary care. Assessment tool 1 will assess the level of complexity of the pain complaints and consists of one Visual Analogue Scale (VAS) for pain intensity and nine dichotomous questions on biopsychosocial factors.
At the end of the study, records of the treatment characteristics of each patient will be collected from the participating practices and rehabilitation centers.
In order to encourage completion of the questionnaires, patients will be reminded up to three times by phone if they have not responded within one week. If incomplete questionnaires are returned, patients will be contacted by phone to answer the remaining questions. The researcher who performs the analyses will be blinded as to patient allocation.
Outcome measures
Baseline characteristics
Baseline characteristics will be collected at T1 and they will include questions about: birth date, gender, nationality, marital status, family composition, level of education, and co-morbidities.
Health assessment
The Pain Disability Index (PDI) will be used as the primary outcome for pain-related disability. It measures the influence of pain on a patient’s life and on the performance of daily activities. The questionnaire consists of seven items that measure the complexity of the disabilities experienced in different situations such as work, leisure time, activities in daily life, and sport. Each item is scored on a scale from 0 (no disability) to 10 (severe disability). Scores from the individual items are summed to a total (0–70). The minimal important change is 13 points for patients with CMP [41]. The Dutch version of the PDI has proven internal consistency and test–retest reliability [42].
The Dutch language version of the Short Form Health Survey (SF-12) will be used as the primary outcome for cost-effectiveness, measuring quality of life on specific domains. The SF-12 has proven to be a practical, reliable, and valid instrument for use in both general population surveys and in studies of chronic disease populations in the Netherlands [43, 44]. The SF-12 will be summarized into two scales: a physical component score (PCS) and a mental component score (MCS), in accordance with the guidelines for the SF12 instrument [45]. The PCS comprises the domains of physical functioning, physical role limitation, bodily pain, and general health perceptions. The MCS comprises the domains of vitality, social functioning, emotional role limitations, and general mental health. Both scores range from 0 to 100 (a higher score indicates a better quality of life) with a minimal clinically important difference of 8.9 for low back pain [46]. These sub-scales will be used in the effectiveness analysis. Besides the SF-12 score, the Short-Form Health Survey with six dimensions (SF-6D) scores will be used in a sensitivity analysis.
The EQ-5D-5L will be used for the cost-utility analysis: it provides a single health index based on self-reported mobility, self-care, usual activities, pain/discomfort, and anxiety/depression, with a minimal clinically important change of 0.04 [47]. There are five levels in each dimension from which respondents select that which most closely matches their health state. The levels are no, slight, moderate, severe, and extreme problems, coded 1 to 5. A health state index score, ranging from − 0.446 to 1 (worst to best imaginable health status), will be calculated from individual health profiles, using the Dutch utility tariff [48]. QALYs were calculated from utilities by using the area under the curve method. The accompanying visual analogue scale (VAS: 0–100) rates the current health state, with higher scores indicative of better experienced health. The minimal clinically important difference for low back pain is 22.5 [46]. The Dutch version of the EQ-5D-5L was found valid and reliable [49, 50].
The Numeric Rating Scale (NRS) will be used to measure pain intensity on an 11-point scale varying from 0 (no pain) to 10 (worst pain imaginable). At each measurement point (T1-4), the patient will complete the NRS three times: current pain intensity; lowest pain intensity in the last week; highest pain intensity in the last week. The NRS has shown high test–retest reliability and validity [51]. A reduction of 2 points, or 30%, on the pain NRS scores can be seen as clinically important [52].
The Hospital Anxiety and Depression Scale (HADS) consists of 14 items of which seven are related to anxiety and seven to depression. The patient is asked to rate the items on a 4-point scale ranging from 0 (not at all) to 3 (most of the time). Total scores range from 0 to 21 on each subscale: a higher score reflects higher distress. The HADS has a sensitivity and specificity of about 80% and a predictive validity for identification of about 70% [53]. The reliability ranges from 0.84 to 0.96 [54].
The six-item short form Pain Catastrophizing Scale (PCS-6) comprises six definitions of thoughts and feelings when experiencing pain [55]. The patient is asked to rate the definitions on a 5-point scale, ranging from 0 (not at all) to 4 (all the time), with total scores ranging from 0 to 24 [55]. The six-item version is used because it places a lower burden on patients than the original PCS. This form is adequate for detecting pre- to post-treatment changes in pain catastrophizing [56]. The PCS-6 is highly comparable to the original PCS and meets the construct validity criteria. Internal consistency and test–retest reliability of the original PCS appears to be adequate [55–57].
The Pain Self-Efficacy Questionnaire (PSEQ) is used to measure pain self-efficacy [58]. In patients with CMP, it shows satisfactory internal consistency and construct validity [59]. The four-item short form PSEQ-4 (items 4, 6, 8 and 9) will be used because it places a lower burden on patients than the original PSEQ [55]. Items are rated on a 7-point Likert scale ranging from 0 (not at all confident) to 6 (completely confident). The scores are summed, ranging from 0 to 24: the minimal important change is 1.5 points [60]. The PSEQ-4 is a good alternative for the PSEQ as the sensitivity and specificity of the PSEQ-4 are 0.803 and 0.687 respectively, compared with 0.648 and 0.875 respectively for the PSEQ [60].
Cost assessment
To evaluate the economic consequences of NPRL2.0 from a societal perspective, as recommended by the Dutch guidelines for costing studies in healthcare, the intervention costs, other healthcare costs, patient and family costs, and productivity losses will be assessed [48].
The intervention costs include costs of education meetings for healthcare professionals and peer review meetings for the intervention group, and consulting and/or treatment hours for the intervention and control groups. The education costs are for 2 × 3 h of education and 1 × 3 h of additional education for therapists. For each education session, the costs of two teachers and one meeting room will be taken into account. These costs will be charged at 10% per patient as it is assumed that healthcare professionals need education only once. Multidisciplinary consultations are organized with all healthcare professionals of the local networks in the absence of patients. For the multidisciplinary consultations per patient, the costs of the healthcare professionals will be divided by six, assuming that during one hour the status of six patients will be discussed. Moreover, it will be assumed that on average each patient is discussed during three multidisciplinary consultations. The number of consultations and/or treatment hours will be collected by the research team from the records of the patients in both the intervention and control groups. To calculate costs for healthcare professionals, standardized cost-prices as prescribed in the Dutch manual for cost-analysis in healthcare research will be used [48].
Healthcare usage will be measured with the iMTA Medical Consumption Questionnaire (iMCQ). It contains questions about healthcare consumption related to frequently-occurring contacts with healthcare professionals (www.imta.nl). The iMCQ will be combined with the iMTA Productivity Cost Questionnaire (iPCQ), a standardized instrument suitable for self-completion by patients for measuring and valuing all relevant productivity losses of paid and unpaid work for use in economic evaluations [61]. The manual for the iMCQ and iPCQ will be used for evaluating healthcare usage and productivity losses with the friction cost approach. The costs of prescribed medication will be calculated by multiplying the number of tablets that participants used during 3 months with the cost price as described at the Dutch webpage https://www.medicijnkosten.nl; the pharmacist costs will also be included. For over-the-counter medication, the lowest prices of Dutch drugstores and pharmacies will be used. All costs will be given in euros and, when necessary, indexed using the general Dutch Consumer Price Index rates [62].
Besides the iPCQ and iMCQ, the patients will be asked about their current care status and the treatment program for their CMP complaints. Moreover, at the end of the study, participating practices and rehabilitation centers will use the records of the patients to collect data about the length, content, and duration of the program.
Learning curve
Data regarding the background experience and knowledge of healthcare professionals will be assessed at the start of the study to judge whether there is a learning curve when participating in NPRL2.0. Whether patient outcomes regarding health and costs are improved when healthcare professionals have more experience of and knowledge about treating patients with CMP will be assessed.
The Pain Attitudes and Beliefs Scale (PABS) will be used to measure clinicians’ biomedical and biopsychosocial treatment orientations with respect to back pain [63]. It consists of 36 statements about treatment preferences, scored on a six-point Likert scale (from 1 = ‘totally disagree’ to 6 = ‘totally agree’). The sum score ranges from 6 to 60 for the biomedical factor and 6 to 54 for the biopsychosocial factor [64]. The PABS shows a consistent factor structure and good test–retest reliability and construct validity [65].
Data analysis
Demographic data (e.g. gender, age, home situation, level of education, nationality, and co-morbidities) will be described overall and separately for the intervention and control groups. Frequencies are to be presented for categorical variables, means and standard deviations (SDs) for normally-distributed continuous variables, and medians and ranges for non-normally-distributed continuous data. The two groups will be tested on differences between characteristics, using the t-test for continuous variables and the chi-squared test for categorical variables. If variables differ between the two groups, with p ≤ 0.10, they are considered to be potential confounders in further analyses.
Outcomes on questionnaires will be compared using linear mixed-model analysis, to take into account repeated measurements in patients as well as the effects of the clustering of patients within local networks. The fixed part of the model contains treatment group (intervention/control), time, treatment group*time, and cluster (local network). To assess the learning effect in local practices, the time (months) that a local network participates in NPRL2.0 will also be taken into account as a fixed variable. Variables known to be related to the outcome and differing between treatment groups at T1 (p ≤ 0.10) will be added to the model. An unstructured covariance structure will be used for repeated measures. Missing values for items in the questionnaires will be handled according to the scoring algorithms of the questionnaires. Missing variables in the follow-up data will not be imputed because linear mixed-model analysis is a flexible method for handling missing data for stepped-wedge and repeated-measures designs (likelihood-based approach). Linear mixed-model analyses will be performed using IBM SPSS Statistics for Windows (version 24.0 or higher, Armonk, NY: IBM Corp.) according to the intention-to-treat principle. Other missing values for non-repeated measures will be handled by multiple imputation, which means that missing values will be predicted using existing values for other variables [66].
Costs will be compared using bootstraps (1000 replications) with Microsoft Excel 2016 with mean differences and 95% confidence intervals. Subsequently, sample uncertainties around the incremental cost-effectiveness ratio (ICER) and incremental cost-utility ratio (ICUR) will be explored using bootstrapping with a minimum of 5,000 replications. The ICER and ICUR will be defined by the difference in costs between NPRL2.0 and the control group, divided by the difference in incremental effects of the SF-12 and incremental QALYs respectively. Cost-effectiveness analyses will be performed with the mean total costs and the mean SF-12 scores. The cost-utility analysis will be performed by relating the mean total costs to the mean QALY scores of both groups, and the bootstrapped ICURs will be plotted in cost-effectiveness planes. Moreover, uncertainties of the ICERs and ICURs will be graphically presented in cost-effectiveness planes (CE plane), as well as cost-effectiveness acceptability curves (CEAC). A CEAC will be calculated to describe the probability of NPRL2.0 being a cost-effective alternative to the control group [67]. This CEAC includes the amount of money the society is willing to pay (WTP) in order to gain one unit of effect (one QALY here). The WTP threshold in the Netherlands for one QALY is based on the health burden and varies between €20,000 (health burden 0.1 to 0.4), €50,000 (health burden 0.41 to 0.7) and €80,000 (health burden 0.71 to 1) (2015) [68].
Four sets of sensitivity analyses will be performed to measure the robustness of the economic evaluation. These analyses will explore the impact of an assumption on the results when changing one value of one parameter while keeping all the other parameter values unchanged [69]. One sensitivity analysis will be performed to measure the influence of taking the educational costs included the intervention costs. Because healthcare professionals will only need training once, the intervention costs may be overestimated. The secondary sensitivity analysis will be performed to assess the influence of the multidisciplinary consultation costs. No standard cost price exists for multidisciplinary consultations in primary care in the Netherlands and it is not known how many patients will be discussed in order to be able to split the costs over these patients. The tertiary sensitivity analysis will be performed to see if there is over- or under-reporting of healthcare consumption in the iMCQ. The data from the records regarding GP and therapist sessions will be compared with the patient data from the iMCQ. When over- or under-reporting is found, a secondary cost analysis will be performed with corrections on all healthcare consumption data, assuming that the same amount of over- or under-reporting is present in the iMCQ. In a fourth sensitivity analysis the impact of the SF-6D to calculate QALYs instead of the EQ-5D-5L will be assessed.
Discussion
The Network Pain Rehabilitation Limburg 2.0 (NPRL2.0) has been developed in order to provide integrated care with a biopsychosocial approach for people with CMP with the goal of improving their level of functioning. Moreover, it is intended to accomplish the Quadruple Aim: improvement of pain-related disability of people with CMP; improvement of experiences of care of people with CMP; improvement in the meaning of work for healthcare professionals; and the reduction of healthcare costs of people with CMP. In this quantitative study, the effectiveness of NPRL2.0 in reducing the pain-related disability of people with CMP will be assessed. In addition, the influence of NPRL2.0 on healthcare costs will be examined with a cost-effectiveness and cost-utility analysis. Moreover, the learning curve of healthcare professionals working in NPRL2.0 will also be studied.
NPRL2.0 is a multidimensional, complex intervention, executed in daily practice [33]. Because of the practice-based approach of this study, a randomized controlled trial design (RCT) is not suitable. Therefore, a pragmatic study with stepped-wedge based design using randomization of the local networks was seen as a viable alternative to an RCT [70]. The local primary care networks involved would be randomly assigned to the three steps (A, B or C) in order to randomize the duration of being a control group or intervention group. Local networks are their own controls in a stepped-wedge based design. Healthcare professionals are instructed to recruit patients at their first consultation for CMP complaints. Therefore, it is expected that patients with comparable complexities of complaints will be distributed equally over the control and intervention groups. Moreover, in this practice-based research, connections between science, policy, and practice exist during implementation and execution of NPRL2.0, leading to evidence-based practice. The external validity of the results of such as this pragmatic study of NPRL2.0 is commonly higher than that of RCTs because the results are more generalizable.
As NPRL2.0 is a complex intervention, it takes time for healthcare professionals to fully adopt the guidelines and treatments in their daily practice. Also, the internalization of the biopsychosocial perspective by healthcare professionals takes time and so no beneficial change in pain-related disability or healthcare costs is expected in the short term, as shown in other studies of complex interventions [71, 72]. Instead, the learning effect on the healthcare professionals will be studied. However, it is hypothesized that the effectiveness outcomes and healthcare costs, without the educational costs, will be no worse than with usual pain rehabilitation care. The results for the other Quadruple Aim outcomes, the experiences of care of people with CMP and meaning in the work of healthcare professionals, will be discussed elsewhere. These outcomes will be studied alongside this effectiveness and cost-utility study with a mixed-methods approach. A strength of this approach is that NPRL2.0 will be studied from different domains simultaneously.
Acknowledgements
We would like to thank Albère Köke, senior policymaker Adelante Centre of Expertise in Rehabilitation and Audiology, Hoensbroek, The Netherlands, and Mario Geilen, physician assistant Adelante Centre of Expertise in Rehabilitation and Audiology, Hoensbroek, The Netherlands, for their contribution in the development of the treatment protocols and the education of the healthcare professionals. Scientific editing and proofreading by Les Hearn (les_hearn@yahoo.co.uk).
Abbreviations
- CEAC
Cost-effectiveness acceptability curves
- CE plane
Cost-effectiveness plane
- CMP
Chronic musculoskeletal pain
- DEsw
Design effect
- EQ-5D-5L
5-Level EQ-5D version
- GP
General practitioner
- HADS
Hospital Anxiety and Depression Scale
- ICER
Incremental cost-effectiveness ratio
- ICUR
Incremental cost-utility ratio
- iMCQ
IMTA Medical Consumption Questionnaire
- iPCQ
IMTA Productivity Cost Questionnaire
- MCS
Mental Component Score
- NCSCP
National Care Standard for Chronic Pain
- NPRL
Network Pain Rehabilitation Limburg
- NRS
Numeric Rating Scale
- PCS-6
Pain Catastrophizing Scale 6-item
- PDI
Pain Disability Index
- PCS
Physical Component Score
- PSEQ
Pain Self-Efficacy Questionnaire
- QALY
Quality-Adjusted Life Year
- RP
Rehabilitation physician
- SD
Standard deviation
- T1
First questionnaire
- T2
Second questionnaire
- T3
Third questionnaire
- T4
Fourth questionnaire
- SD
Standard deviation
- SF-12
12-Item Short Form Health Survey
- SF-12 MCS
Mental health component scale
- SF-12 PCS
Physical health component scale
- WTP
Willing to pay
Authors' contributions
IPJH and JAMCFV conceived the original idea and outline of the study, and CL, MEK, IPJH, JAMCFV, and DR contributed to designing the study. CL, IPJH, and JAMCFV were responsible for developing the intervention. MEJBG was involved in the design and analysis of the cost-effectiveness part, and BW was consulted for the statistical part of the study. CL was the primary writer of the study protocol in collaboration with MEK and IPJH. All authors discussed and commented on draft versions and approved the final version.
Funding
Health Insurance Companies CZ, VGZ and Zilveren Kruis Achmea funded the study, but they had no role in the design of the study and collection, analysis, and interpretation of data and in writing the manuscript.
Availability of data and materials
Not applicable.
Ethics approval and consent to participate
Approval from the Medical Ethics Committee Z, the Netherlands, METCZ20190037. Amendments to the protocol will be assessed by the METC-Z. Written informed consent will be obtained from study participants.
Consent for publication
Not applicable.
Competing interests
CL, MEJBG, BW, DR, and MEK have nothing to disclose. IPJH and JAMCFV report grants from Health Insurance Companies CZ, VGZ and Zilveren Kruis Achmea, during the conduct of the study.
Footnotes
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Bekkering GE, Bala MM, Reid K, Kellen E, Harker J, Riemsma R, et al. Epidemiology of chronic pain and its treatment in The Netherlands. Neth J Med. 2011;69(3):141–153. [PubMed] [Google Scholar]
- 2.Woolf AD, Erwin J, March L. The need to address the burden of musculoskeletal conditions. Best Pract Res Clin Rheumatol. 2012;26(2):183–224. doi: 10.1016/j.berh.2012.03.005. [DOI] [PubMed] [Google Scholar]
- 3.Woolf AD, Akesson K. Understanding the burden of musculoskeletal conditions. The burden is huge and not reflected in national health priorities. BMJ. 2001;322(7294):1079–80. doi: 10.1136/bmj.322.7294.1079. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Bushnell MC, Ceko M, Low LA. Cognitive and emotional control of pain and its disruption in chronic pain. Nat Rev Neurosci. 2013;14(7):502–511. doi: 10.1038/nrn3516. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Gatchel RJ, Peng YB, Peters ML, Fuchs PN, Turk DC. The biopsychosocial approach to chronic pain: scientific advances and future directions. Psychol Bull. 2007;133(4):581–624. doi: 10.1037/0033-2909.133.4.581. [DOI] [PubMed] [Google Scholar]
- 6.Hayden JA, Dunn KM, van der Windt DA, Shaw WS. What is the prognosis of back pain? Best Pract Res Clin Rheumatol. 2010;24(2):167–179. doi: 10.1016/j.berh.2009.12.005. [DOI] [PubMed] [Google Scholar]
- 7.Kamaleri Y, Natvig B, Ihlebaek CM, Bruusgaard D. Does the number of musculoskeletal pain sites predict work disability? A 14-year prospective study. Eur J Pain. 2009;13(4):426–430. doi: 10.1016/j.ejpain.2008.05.009. [DOI] [PubMed] [Google Scholar]
- 8.Mallen CD, Peat G, Thomas E, Dunn KM, Croft PR. Prognostic factors for musculoskeletal pain in primary care: a systematic review. Br J Gen Pract. 2007;57(541):655–661. [PMC free article] [PubMed] [Google Scholar]
- 9.Paananen MV, Taimela SP, Auvinen JP, Tammelin TH, Kantomaa MT, Ebeling HE, et al. Risk factors for persistence of multiple musculoskeletal pains in adolescence: a 2-year follow-up study. Eur J Pain. 2010;14(10):1026–1032. doi: 10.1016/j.ejpain.2010.03.011. [DOI] [PubMed] [Google Scholar]
- 10.Saastamoinen P, Laaksonen M, Kaaria SM, Lallukka T, Leino-Arjas P, Rahkonen O, et al. Pain and disability retirement: a prospective cohort study. Pain. 2012;153(3):526–531. doi: 10.1016/j.pain.2011.11.005. [DOI] [PubMed] [Google Scholar]
- 11.Zorgstandaard Chronische Pijn 2017. https://www.pijnpatientennaar1stem.nl/wp-content/uploads/2017/04/ZorgStandaard_Chronische_Pijn_versie_2017_03_28.pdf. Accessed 28 Sept 2020.
- 12.Majlesi J. Patients with chronic musculoskeletal pain of 3-6-month duration already have low levels of health-related quality of life and physical activity. Curr Pain Headache Rep. 2019;23(11):81. doi: 10.1007/s11916-019-0817-6. [DOI] [PubMed] [Google Scholar]
- 13.Krol M, de Boer D, Plass A, Rademakers J. CQ-index module Pijn: meetinstrumentontwikkeling. Utrecht: NIVEL; 2013. [Google Scholar]
- 14.Breivik H, Collett B, Ventafridda V, Cohen R, Gallacher D. Survey of chronic pain in Europe: prevalence, impact on daily life, and treatment. Eur J Pain. 2006;10(4):287–333. doi: 10.1016/j.ejpain.2005.06.009. [DOI] [PubMed] [Google Scholar]
- 15.Niv D, Devor M, European Federation of IC Position paper of the European Federation of IASP Chapters (EFIC) on the subject of pain management. Eur J Pain. 2007;11(5):487–9. doi: 10.1016/j.ejpain.2007.03.005. [DOI] [PubMed] [Google Scholar]
- 16.Köke AJ, Smeets RJ, Schreurs KM, van Baalen B, de Haan P, Remerie SC, et al. Dutch Dataset Pain Rehabilitation in daily practice: content, patient characteristics and reference data. Eur J Pain. 2017;21(3):434–444. doi: 10.1002/ejp.937. [DOI] [PubMed] [Google Scholar]
- 17.Foster NE, Anema JR, Cherkin D, Chou R, Cohen SP, Gross DP, et al. Prevention and treatment of low back pain: evidence, challenges, and promising directions. Lancet. 2018;391(10137):2368–2383. doi: 10.1016/S0140-6736(18)30489-6. [DOI] [PubMed] [Google Scholar]
- 18.Committee on Education of the EFIC (European Federation of IASP Chapters). The Pain Management Core Curriculum for European Medical Schools. 2013.
- 19.Peerenboom PBG, Spek J. Medisch Specialistische Revalidatie; Aanspraak en praktijk. Elst: Tangram Zorgadviseurs; 2013. [Google Scholar]
- 20.Weiner SS, Nordin M. Prevention and management of chronic back pain. Best Pract Res Clin Rheumatol. 2010;24(2):267–279. doi: 10.1016/j.berh.2009.12.001. [DOI] [PubMed] [Google Scholar]
- 21.Geneen LJ, Martin DJ, Adams N, Clarke C, Dunbar M, Jones D, et al. Effects of education to facilitate knowledge about chronic pain for adults: a systematic review with meta-analysis. Syst Rev. 2015;4:132. doi: 10.1186/s13643-015-0120-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Hayes SC. Acceptance and commitment therapy, relational frame theory, and the third wave of behavioral and cognitive therapies: republished article. Behav Ther. 2016;47(6):869–885. doi: 10.1016/j.beth.2016.11.006. [DOI] [PubMed] [Google Scholar]
- 23.Kamper SJ, Apeldoorn AT, Chiarotto A, Smeets RJ, Ostelo RW, Guzman J, et al. Multidisciplinary biopsychosocial rehabilitation for chronic low back pain: cochrane systematic review and meta-analysis. BMJ. 2015;350:h444. doi: 10.1136/bmj.h444. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Lindstrom I, Ohlund C, Eek C, Wallin L, Peterson LE, Fordyce WE, et al. The effect of graded activity on patients with subacute low back pain: a randomized prospective clinical study with an operant-conditioning behavioral approach. Phys Ther. 1992;72(4):279–90. doi: 10.1093/ptj/72.4.279. [DOI] [PubMed] [Google Scholar]
- 25.Louw A, Diener I, Butler DS, Puentedura EJ. The effect of neuroscience education on pain, disability, anxiety, and stress in chronic musculoskeletal pain. Arch Phys Med Rehabil. 2011;92(12):2041–2056. doi: 10.1016/j.apmr.2011.07.198. [DOI] [PubMed] [Google Scholar]
- 26.Nicholl BI, Sandal LF, Stochkendahl MJ, McCallum M, Suresh N, Vasseljen O, et al. Digital support interventions for the self-management of low back pain: a systematic review. J Med Internet Res. 2017;19(5):e179. doi: 10.2196/jmir.7290. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.World Health Organization. Rehabilitation in health systems. Geneva. 2017.
- 28.Krug E, Cieza A. Strengthening health systems to provide rehabilitation services. Can J Occup Ther. 2017;95:167. doi: 10.1177/0008417417705853. [DOI] [PubMed] [Google Scholar]
- 29.Bodenheimer T, Sinsky C. From triple to quadruple aim: care of the patient requires care of the provider. Ann Fam Med. 2014;12(6):573–576. doi: 10.1370/afm.1713. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Sikka R, Morath J, Leape L. The quadruple aim: care, health, cost and meaning in work. BMJ Qual Saf. 2015;24:608. doi: 10.1136/bmjqs-2015-004160. [DOI] [PubMed] [Google Scholar]
- 31.Lamper C, Kroese MEAL, Köke AJ, Ruwaard D, Verbunt JAMCF, Huijnen IPJ. Developing the network pain rehabilitation limburg: a feasibility study protocol; Submitted. [DOI] [PMC free article] [PubMed]
- 32.Lamper C, Huijnen IPJ, Kroese MEAL, Köke AJ, Brouwer G, Ruwaard D, et al. Developing the Network Pain Rehabilitation Limburg: results of a feasibility study Pain in Europe XI: Bringing the future to the present, Valencia, Spain; 2019.
- 33.Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M, et al. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337:a1655. doi: 10.1136/bmj.a1655. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Hussey MA, Hughes JP. Design and analysis of stepped wedge cluster randomized trials. Contemp Clin Trials. 2007;28:182–191. doi: 10.1016/j.cct.2006.05.007. [DOI] [PubMed] [Google Scholar]
- 35.Campbell P, Hill JC, Protheroe J, Afolabi EK, Lewis M, Beardmore R, et al. Keele Aches and Pains Study protocol: validity, acceptability, and feasibility of the Keele STarT MSK tool for subgrouping musculoskeletal patients in primary care. J Pain Res. 2016;9:807–818. doi: 10.2147/JPR.S116614. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Mansell G, Hall A, Toomey E. Behaviour change and self-management interventions in persistent low back pain. Best Pract Res Clin Rheumatol. 2016;30(6):994–1002. doi: 10.1016/j.berh.2017.07.004. [DOI] [PubMed] [Google Scholar]
- 37.Vlaeyen JW, Kole-Snijders AM, Boeren RG, van Eek H. Fear of movement/(re)injury in chronic low back pain and its relation to behavioral performance. Pain. 1995;62(3):363–372. doi: 10.1016/0304-3959(94)00279-N. [DOI] [PubMed] [Google Scholar]
- 38.Sananet Care BV. Sananet: specialist in eHealth. https://www.sananet.nl/. Accessed 28 Sept 2020.
- 39.Woertman W, de Hoop E, Moerbeek M, Zuidema SU, Gerritsen DL, Teerenstra S. Stepped wedge designs could reduce the required sample size in cluster randomized trials. J Clin Epidemiol. 2013;66(7):752–758. doi: 10.1016/j.jclinepi.2013.01.009. [DOI] [PubMed] [Google Scholar]
- 40.McClure NS, Sayah FA, Xie F, Luo N, Johnson JA. Instrument-defined estimates of the minimally important difference for EQ-5D-5L Index Scores. Value Health. 2017;20(4):644–650. doi: 10.1016/j.jval.2016.11.015. [DOI] [PubMed] [Google Scholar]
- 41.Beemster T, van Bennekom C, van Velzen J, Reneman M, Frings-Dresen M. The interpretation of change score of the pain disability index after vocational rehabilitation is baseline dependent. Health Qual Life Outcomes. 2018;16(1):182. doi: 10.1186/s12955-018-1000-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Soer R, Koke AJ, Vroomen PC, Stegeman P, Smeets RJ, Coppes MH, et al. Extensive validation of the pain disability index in 3 groups of patients with musculoskeletal pain. Spine. 2013;38(9):E562–E568. doi: 10.1097/BRS.0b013e31828af21f. [DOI] [PubMed] [Google Scholar]
- 43.Aaronson NK, Muller M, Cohen PD, Essink-Bot ML, Fekkes M, Sanderman R, et al. Translation, validation, and norming of the Dutch language version of the SF-36 Health Survey in community and chronic disease populations. J Clin Epidemiol. 1998;51(11):1055–1068. doi: 10.1016/S0895-4356(98)00097-3. [DOI] [PubMed] [Google Scholar]
- 44.Bohannon RW, DePasquale L. Physical Functioning Scale of the Short-Form (SF) 36: internal consistency and validity with older adults. J Geriatr Phys Ther. 2010;33(1):16–18. [PubMed] [Google Scholar]
- 45.Ware J, Jr, Kosinski M, Keller SD. A 12-Item Short-Form Health Survey: construction of scales and preliminary tests of reliability and validity. Med Care. 1996;34(3):220–233. doi: 10.1097/00005650-199603000-00003. [DOI] [PubMed] [Google Scholar]
- 46.Park KB, Shin JS, Lee J, Lee YJ, Kim MR, Lee JH, et al. Minimum clinically important difference and substantial clinical benefit in pain, functional, and quality of life scales in failed back surgery syndrome patients. Spine. 2017;42(8):E474–E481. doi: 10.1097/BRS.0000000000001950. [DOI] [PubMed] [Google Scholar]
- 47.EuroQol G. EuroQol: a new facility for the measurement of health-related quality of life. Health Policy. 1990;16(3):199–208. doi: 10.1016/0168-8510(90)90421-9. [DOI] [PubMed] [Google Scholar]
- 48.Kanters TA, Bouwmans CAM, van der Linden N, Tan SS, Hakkaart-van RL. Update of the Dutch manual for costing studies in health care. PLoS ONE. 2017;12(11):e0187477. doi: 10.1371/journal.pone.0187477. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Brooks R. EuroQol: the current state of play. Health Policy. 1996;37(1):53–72. doi: 10.1016/0168-8510(96)00822-6. [DOI] [PubMed] [Google Scholar]
- 50.van Agt HM, Essink-Bot ML, Krabbe PF, Bonsel GJ. Test-retest reliability of health state valuations collected with the EuroQol questionnaire. Soc Sci Med. 1994;39(11):1537–1544. doi: 10.1016/0277-9536(94)90005-1. [DOI] [PubMed] [Google Scholar]
- 51.Ferraz MB, Quaresma MR, Aquino LR, Atra E, Tugwell P, Goldsmith CH. Reliability of pain scales in the assessment of literate and illiterate patients with rheumatoid arthritis. J Rheumatol. 1990;17(8):1022–1024. [PubMed] [Google Scholar]
- 52.Farrar JT, Young JP, Jr, LaMoreaux L, Werth JL, Poole RM. Clinical importance of changes in chronic pain intensity measured on an 11-point numerical pain rating scale. Pain. 2001;94(2):149–158. doi: 10.1016/S0304-3959(01)00349-9. [DOI] [PubMed] [Google Scholar]
- 53.Hansson M, Chotai J, Nordstom A, Bodlund O. Comparison of two self-rating scales to detect depression: HADS and PHQ-9. Br J Gen Pract. 2009;59(566):e283–e288. doi: 10.3399/bjgp09X454070. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Bjelland I, Dahl AA, Haug TT, Neckelmann D. The validity of the Hospital Anxiety and Depression Scale: an updated literature review. J Psychosom Res. 2002;52(2):69–77. doi: 10.1016/S0022-3999(01)00296-3. [DOI] [PubMed] [Google Scholar]
- 55.McWilliams LA, Kowal J, Wilson KG. Development and evaluation of short forms of the Pain Catastrophizing Scale and the Pain Self-efficacy Questionnaire. Eur J Pain. 2015;19(9):1342–1349. doi: 10.1002/ejp.665. [DOI] [PubMed] [Google Scholar]
- 56.Sullivan MJ, Thorn B, Haythornthwaite JA, Keefe F, Martin M, Bradley LA, et al. Theoretical perspectives on the relation between catastrophizing and pain. Clin J Pain. 2001;17(1):52–64. doi: 10.1097/00002508-200103000-00008. [DOI] [PubMed] [Google Scholar]
- 57.Van Damme S, Crombez G, Bijttebier P, Goubert L, Van Houdenhove B. A confirmatory factor analysis of the Pain Catastrophizing Scale: invariant factor structure across clinical and non-clinical populations. Pain. 2002;96(3):319–324. doi: 10.1016/S0304-3959(01)00463-8. [DOI] [PubMed] [Google Scholar]
- 58.Miles CL, Pincus T, Carnes D, Taylor SJ, Underwood M. Measuring pain self-efficacy. Clin J Pain. 2011;27(5):461–470. doi: 10.1097/AJP.0b013e318208c8a2. [DOI] [PubMed] [Google Scholar]
- 59.Nicholas MK. The pain self-efficacy questionnaire: taking pain into account. Eur J Pain. 2007;11(2):153–163. doi: 10.1016/j.ejpain.2005.12.008. [DOI] [PubMed] [Google Scholar]
- 60.Chiarotto A, Vanti C, Cedraschi C, Ferrari S, de Lima e Sa Resende F, Ostelo RW, et al. Responsiveness and minimal important change of the pain self-efficacy questionnaire and short forms in patients with chronic low back pain. J Pain. 2016;17(6):707–18. doi: 10.1016/j.jpain.2016.02.012. [DOI] [PubMed] [Google Scholar]
- 61.Bouwmans C, Krol M, Severens H, Koopmanschap M, Brouwer W, Hakkaart-van RL. The iMTA productivity cost questionnaire: a standardized instrument for measuring and valuing health-related productivity losses. Value Health. 2015;18(6):753–758. doi: 10.1016/j.jval.2015.05.009. [DOI] [PubMed] [Google Scholar]
- 62.Centraal Bureau voor Statistiek. Consumer prices [18–12–2019]. https://opendata.cbs.nl/statline/#/CBS/en/dataset/83131ENG/table?fromstatweb. Accessed 28 Sept 2020.
- 63.Eland ND, Kvale A, Ostelo R, de Vet HCW, Strand LI. Discriminative validity of the pain attitudes and beliefs scale for physical therapists. Phys Ther. 2019;99(3):339–353. doi: 10.1093/ptj/pzy139. [DOI] [PubMed] [Google Scholar]
- 64.Houben RM, Ostelo RW, Vlaeyen JW, Wolters PM, Peters M, Stomp-van den Berg SG. Health care providers' orientations towards common low back pain predict perceived harmfulness of physical activities and recommendations regarding return to normal activity. Eur J Pain. 2005;9(2):173–83. doi: 10.1016/j.ejpain.2004.05.002. [DOI] [PubMed] [Google Scholar]
- 65.Mutsaers JH, Pool-Goudzwaard AL, Ostelo RW, Peters R, Koes BW, Verhagen AP. The psychometric properties of the PABS-PT in neck pain patients: a validation study. Man Ther. 2014;19(3):208–214. doi: 10.1016/j.math.2013.12.004. [DOI] [PubMed] [Google Scholar]
- 66.Twisk JWR. Applied multilevel analysis: a practical guide for medical researchers. Cambridge: Cambridge University Press; 2006. [Google Scholar]
- 67.Fenwick E, Marshall DA, Levy AR, Nichol G. Using and interpreting cost-effectiveness acceptability curves: an example using data from a trial of management strategies for atrial fibrillation. BMC Health Serv Res. 2006;6:52. doi: 10.1186/1472-6963-6-52. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 68.Zwaap J, Knies S, van der Meijden C, Staal P, van der Heiden L. Kosteneffectiviteit in de praktijk. The Netherlands: Uitgebracht aan minister van Volksgezondheid, Welzijn en Sport; 2015. 26–06–2015.
- 69.Drummond M, Manca A, Sculpher M. Increasing the generalizability of economic evaluations: recommendations for the design, analysis, and reporting of studies. Int J Technol Assess Health Care. 2005;21(2):165–171. doi: 10.1017/S0266462305050221. [DOI] [PubMed] [Google Scholar]
- 70.Kessler R, Glasgow RE. A proposal to speed translation of healthcare research into practice: dramatic change is needed. Am J Prev Med. 2011;40(6):637–644. doi: 10.1016/j.amepre.2011.02.023. [DOI] [PubMed] [Google Scholar]
- 71.Munneke M, Nijkrake MJ, Keus SH, Kwakkel G, Berendse HW, Roos RA, et al. Efficacy of community-based physiotherapy networks for patients with Parkinson's disease: a cluster-randomised trial. Lancet Neurol. 2010;9(1):46–54. doi: 10.1016/S1474-4422(09)70327-8. [DOI] [PubMed] [Google Scholar]
- 72.Ritchie MJ, Kirchner JE, Townsend JC, Pitcock JA, Dollar KM, Liu CF. Time and organizational cost for facilitating implementation of primary care mental health integration. J Gen Intern Med. 2019;34:1001–1010. doi: 10.1007/s11606-019-04920-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 73.Lamper C, Kroese M, Köke A, Ruwaard D, Verbunt J, Huijnen I. Developing the Network Pain Rehabilitation Limburg: a feasibility study protocol. BMJ Open. 2019;9(6):e025962. doi: 10.1136/bmjopen-2018-025962. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
Not applicable.