Abstract
Background
The primary objective of this study is to identify which modifiable and non-modifiable factors are independent predictors of the development of chronic pain in patients with acute- or subacute nonspecific idiopathic, non-traumatic neck pain, and secondly, to combine these to develop and internally validate a prognostic prediction model.
Methods
A prospective cohort study will be conducted by physiotherapists in 30 primary physiotherapy practices between January 26, 2020, and August 31, 2022, with a 6-month follow-up until March 17, 2023. Patients who consult a physiotherapist with a new episode of acute- (0 to 3 weeks) or subacute neck pain (4 to 12 weeks) will complete a baseline questionnaire. After their first appointment, candidate prognostic variables will be collected from participants regarding their neck pain symptoms, prior conditions, work-related factors, general factors, psychological and behavioral factors. Follow-up assessments will be conducted at six weeks, three months, and six months after the initial assessment. The primary outcome measure is the Numeric Pain Rating Scale (NPRS) to examine the presence of chronic pain. If the pain is present at six weeks, three months, and six months with a score of NPRS ≥3, it is classified as chronic pain. An initial exploratory analysis will use univariate logistic regression to assess the relationship between candidate prognostic factors at baseline and outcome. Multiple logistic regression analyses will be conducted. The discriminative ability of the prognostic model will be determined based on the Area Under the receiver operating characteristic Curve (AUC), calibration will be assessed using a calibration plot and formally tested using the Hosmer and Lemeshow goodness-of-fit test, and model fit will be quantified as Nagelkerke’s R2. Internal validation will be performed using bootstrapping-resampling to yield a measure of overfitting and the optimism-corrected AUC.
Discussion
The results of this study will improve the understanding of prognostic and potential protective factors, which will help clinicians guide their clinical decision making, develop an individualized treatment approach, and predict chronic neck pain more accurately.
Introduction
Neck pain is one of the most prevalent and disabling health conditions, with a substantial impact on public health [1, 2]. The Global Burden of Disease study demonstrated that neck pain is third in the ranking of ‘years lived with disability’ in non-fatal diseases in Europe [3]. Costs related to neck pain are rising mainly due to extended work absence and usage of health care services [1, 4, 5]. In particular, neck pain that becomes chronic causes high healthcare costs [6]. The prevalence of chronic neck pain has increased from 2005 to 2015 by 21% up to approximately 358 million people worldwide, and it is likely to increase further in Western countries due to an aging population [7]. In the Netherlands, pain in the cervical region is the most commonly reported complaint for which patients seek help in physiotherapy practices [8].
Recovery from neck pain and related disability mainly occurs in the first few weeks. Thereafter, the recovery rate is much lower [9, 10]. The reported effect of physiotherapy treatment in patients with chronic musculoskeletal pain is, at best, only moderate [11–13]. It is therefore not surprising that defining the natural course and the prognostic factors in people with acute- and subacute neck pain is a top-five priority of the new agenda for Neck Pain Research [14]. Knowledge of prognostic factors can help health care providers to improve clinical decision-making and is a likely key factor in combatting chronification of idiopathic neck pain. Preventing chronicity should be the major focus of physiotherapists in the (sub)acute phase of musculoskeletal pain. Being able to predict which patients with neck pain are likely to develop chronic pain may help prevent chronification of pain in physiotherapy practices.
At the present time the existing literature on prognostic models shows a low performance in predicting chronicity or recovery from neck pain [15, 16], it is thereby not applicable as a starting point for a new prognostic study. A limitation and possible explanation of this low performance is the inclusion of a too-heterogeneous group of neck pain patients. Most studies include (sub)acute neck pain, whiplash-related neck pain, pain with neurological symptoms, and even patients who already have chronic pain [15, 17, 18], although these groups are known to differ in both clinical symptoms and prognosis [19–21]. Therefore, it seems useful to pay attention to the pain etiology and pathophysiological mechanisms of the existent pain in classification and inclusion systems [22].
In addition, prognostic research has often focused on factors that are non-modifiable by physiotherapists, such as age and sex [16]. Only clinically modifiable factors have the potential to change patient outcome and are therefore recommended to be included in prognostic research [16, 23]. However, to strengthen a prognostic model, it can be relevant to include some non-modifiable factors. Based on a recent consensus study of potential modifiable prognostic factors, including psychosocial factors in prognostic research for chronification is relevant [24]. It seems that psychosocial factors in particular can be modified. Furthermore, it is known that neurophysiological changes in the chronification of pain are modulated by psychosocial factors [25].
Therefore, there is a need for a prognostic study that identifies modifiable prognostic factors using a biopsychosocial view, that includes only patients with acute- (0 to 3 weeks) or subacute (4 to 12 weeks) nonspecific idiopathic, non-traumatic neck pain, to help prevent chronification of pain in physiotherapy practices. This study should occur in primary care physiotherapy practices and with a cohort of patients of an adequate sample size.
The primary objective of this study is to identify which modifiable and non-modifiable factors are independent predictors of the development of chronic pain in patients with acute- or subacute nonspecific idiopathic, non-traumatic neck pain, and secondly, to combine these to develop and internally validate a prognostic prediction model.
Methods
Study design
The present study is a prospective cohort study of prognostic factors informed by the PROGRESS framework and TRIPOD statement type 1b and specific recommendations for statistical approaches to Type 3 prognostic model research [26, 27]. This study will be reported in accordance with the Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD) statement [27].
Study setting
Potential participants will be selected from 30 primary care physiotherapy practices including 81 physiotherapists between January 26, 2020, and August 31, 2022, and is due to be completed at March 17, 2023 (including reminders and time for response).
For the generalizability of this research, we selected physiotherapists with different backgrounds; physiotherapists pursuing a master’s degree working in primary care and experienced physiotherapists with and without affiliation to an academic institute will include participants.
Ethical approval
The Medical Research Ethics Committee approved that this study (protocol number: 19-766/C) does not apply to the Medical Research Involving Human Subjects Act (WMO). Therefore an official approval of this study by the Medical-Ethical Review Committee (METC) Utrecht is not required under the WMO Utrecht. All data is processed anonymously, and all participants have to sign an informed consent. The participants receive a personal code upon inclusion, which must be submitted at each measurement moment. The measurements will be collected through the secure data transfer system Formdesk [28].
Participants
The patients will be approached if they present with a new episode of acute- (0 to 3 weeks) or subacute (4 to 12 weeks) nonspecific idiopathic, non-traumatic neck pain. To be eligible to take part in the study, participants must meet the following criteria:
The patients are at least 18 years or older.
The patients have a new presentation of neck pain not more than 12 weeks upon onset.
The neck pain region has to fall within the used region presented in Fig 1.
If the patient has had neck pain before, the patients must be relatively free from symptoms for at least three months (Numeric Pain Rating Scale (NPRS) of < 3) prior to this new episode of neck pain.
These inclusion criteria will effectively exclude the population with chronic pain [29, 30].
The following general and specific exclusion criteria will be examined at an initial history taking by the physiotherapist prior to the recruitment:
Specific exclusion criteria
Neck surgery in the past.
Cervical spine radiculopathy measured with the Upper Limb Neurodynamic Test 1 [32].
Widespread pain (ICD 11); diffuse musculoskeletal pain in at least 4 of 5 body regions and in at least 3 or more body quadrant (as defined by upper-lower / left-right side of the body) and axial skeleton (neck, back, chest, and abdomen).
Pain not caused by a musculoskeletal origin (not located in in the muscles, bones, joints, or tendons) [33].
General exclusion criteria
Inability to read or understand the Dutch language.
The participating physiotherapists record reasons for exclusion during the study period. In addition, an anonymized record will be kept of patients who meet the inclusion criteria but choose not to participate and their reasons for doing so. The treatment the patients receive will be reported. The coding will be done based on the Dutch Physiotherapy Guideline for neck pain [34, 35]. Participation in this study has no influence on the content of the treatment.
Baseline and follow-up procedure
If the patient meets the criteria during the first consultation, the physiotherapist informs the patient orally about the purpose and discusses participant expectations of the study. If the patient indicates verbally that he/she wants to participate in the study, written informed consent is obtained from the participant before the first questionnaire is completed. Subsequently, each participant receives a digital questionnaire sent via a link by email in week one (T0, baseline) and at six weeks (T1), three months (T2), and six months (T3). The T0 questionnaire takes 30–40 minutes to complete, the T1 measurement 20–30 minutes, and the T2 and T3 around 20 minutes. If the participant has not completed a questionnaire after one week, a reminder is sent by email or telephone contact will be made by the therapist who includes the participant. This procedure is repeated one week later, if necessary.
Outcome
The NPRS is used to quantify the presence of chronic pain. If pain is present at all measurement moments, six weeks, three months, and six months with a score of NPRS ≥3, it will be classified as chronic pain [30, 36]. The NPRS is known to have an average reliability (ICC = 0.67 [0.27–0.84]) in neck pain, the minimal detectable change is 2.6 and a minimum clinically important difference of 1.5 in patients with mechanical neck pain [37]. The NPRS is an inventory and evaluation questionnaire, which was found to be valid [38].
Candidate prognostic factors
The candidate prognostic factors are based on our previous systematic review and Delphi study [16, 24]. From the systematic review, we included the variables significantly predictive of pain chronification or non-recovery. Furthermore, we included the variable with a consensus of >70% in the first round of our Delphi study.
Table 1 shows the researched domains, candidate prognostic factors, the measure method used and how the variables will be handled in the statistical analysis.
Table 1. Candidate prognostic factors.
Candidate prognostic factors | Measure | Range of the scale | Handling variables in statistical analysis |
---|---|---|---|
Patients’ characteristics | |||
Sex | Self-report question | Male / Female | Dichotomous |
Age | Self-report question | Age in years | Continuous |
Symptoms | |||
Pain intensity at baseline | Numeric Pain Rating Scale (NPRS) “On a scale of 0 to 10, how much pain do you experience? Where 0 is no pain at all and 10 is the most imaginable pain” |
0–10 Higher scores indicate a higher degree of pain. |
Continuous |
Duration of neck pain | In weeks | Number of weeks | Continuous |
Reported pain in different body regions | Self-report question: Do you also experience pain in other parts of your body? |
Yes / No | Dichotomous |
Accompanying headache | Self-report question: Have you experienced accompanying headache(s) since you have neck pain? |
Yes / No/ I had headache(s) before the neck pain. | Dichotomous 1 = Yes 2 = No or I had headaches before the neck pain |
Disability | Pain Disability Index (PDI) is a 7-item questionnaire to investigate the magnitude of self-reported pain-related disability. The PDI measures family/home responsibilities, recreation, social activity, occupation, sexual behavior, self-care, and life support [39] | 0–70 Higher scores indicate higher interference of pain with daily activity. |
Continuous The sum score will be divided by the entered items. |
Work related factors | |||
Happiness at work* | Self-report question: Can you indicate how happy you are with your current job? |
Five point Likert scale.
|
Dichotomous 1 = Happy (happy and totally happy) 2 = Not happy (totally unhappy, not happy and neutral) |
Job satisfaction* | Self-report question: How much satisfaction do you get from your current job? |
Five point Likert scale.
|
Dichotomous 1 = Satisfied (satisfaction and a lot of satisfaction) 2 = Not satisfied (totally no satisfaction, no satisfaction and neutral) |
Potential to self-modify posture* | Self-report question: Are you able to change positions regularly during your work? |
Five point Likert scale.
|
Dichotomous 1 = Possible 2 = Impossible |
General factors | |||
Lifestyle Physical activity |
Measured by the activity level according to the Dutch Healthy Exercise Norm | Dived into three categories:
|
Dichotomous 1 = Achieving the Dutch Healthy Exercise Norm (category 3) 2 = Not achieving the Dutch Healthy Exercise Norm (category 1 and 2) |
Smoking | Self-report question: Do you smoke? |
Yes / No | Dichotomous |
Alcohol | Self-report question: Do you drink alcohol? |
Yes / No | Dichotomous |
Length and weight | Self-report question: What is your height? What is your weight? |
Body Mass Index (BMI): weight/(length x length in meters) | Dichotomous |
Sleep quality | Adjusted sleep quality question from the Neck Disability Index (NDI) and is subdivided in 4 domains; (1) wake up rested, (2) number of hours disturbed while sleeping, (3) fall asleep, and (4) personal experience sleep quality | (1) Yes / No (2) 0–5 Higher scores indicate more hours disturbed while sleeping (3) Yes / No difficulty falling asleep (4) Yes / No personal experience difficulty sleeping or falling asleep |
Dichotomous 1 = No negative experience with sleeping (No negative score on one of the four domains) 2 = Negative experience with sleeping (a positive score on one of the four domains) |
Psychological and behavior factors | |||
Catastrophizing | Pain Catastrophizing Scale (PCS) short version is a 6-item questionnaire that assesses catastrophic thoughts or feelings associated with the experience of pain [40] | 0–24 Higher scores indicate more catastrophic thoughts |
Continuous |
Illness beliefs about recovery | Brief Illness Perception Questionnaire-Dutch language version (IPQ-DLV) Two single questions: How long do you think your neck pain will continue? How concerned are you about your illness? |
0–10 0 a very short time– 10 forever Higher scores indicate a maladaptive illness perception 0 not at all concerned– 10 extremely concerned Higher scores indicate a maladaptive illness perception |
Continuous |
Treatment beliefs | Brief Illness Perception Questionnaire-DLV [41] Single question: How much do you think your treatment can help your neck pain? |
0–10 0 not at all—10 extremely helpful A lower score indicates a maladaptive illness perception |
Continuous |
Depression | Depression Anxiety Stress Scale 21-item version (DASS-21) [42] | 0–21 Higher scores indicate a higher degree of depression |
Continuous |
Kinesiophobia | Tampa Scale for Kinesiophobia (TSK) 11-item version [43] | 11–44 Higher scores indicate a higher degree of kinesiophobia |
Continuous |
Distress | Depression Anxiety Stress Scale 21-item version (DASS-21) [42] | 0–21 Higher scores indicate a higher degree of stress |
Continuous |
Coping | Pain Coping Inventory (PCI) [44] is a 33-items questionnaire and is subdivided into six scales: pain transformation, distraction, reducing demands, retreating, worrying, and resting Transforming the classification into an active (pain transformation, distraction and reducing demands) and passive coping strategy (retreating, worrying, resting) | Active coping = 12–48 Passive coping = 21–84 |
Dichotomous |
Illness beliefs about pain identity | Brief Illness Perception Questionnaire-DLV [41] Single question: How well do you feel you understand your illness? |
0–10 0 don’t understand at all—10 understand very clearly A lower score indicates a maladaptive illness perception |
Continuous |
Hypervigilance | Pain Vigilance Awareness Questionnaire (PVAQ) [45] | 0–80 Higher scores indicate a higher degree of vigilance |
Continuous |
Self-efficacy | Pain Self-efficacy Questionnaire 2-item version [46] | 0–12 Higher scores indicate a higher degree of self-efficacy |
Continuous |
Remaining factors | |||
Health care provider attitude* | Two vignettes consisting of 8 multiple choice questions and 4 open questions The open questions focused on the history taking, examination and treatment strategy The multiple-choice questions focus on the advice of the therapist with regard to categorizing of the complaint in type of seriousness, resumption of work and the implementation of daily activities |
Biomedical Biopsychosocial |
Dichotomous |
Therapeutic relation* | Self-report question How much trust do you have in your healthcare provider/ physiotherapist? |
0–10 0 no trust at all– 10 very much confidence |
Continuous |
*Candidate prognostic factors measured by an unvalidated measurement.
Symptoms
The symptoms are current pain intensity (measured with the NPRS), duration of the neck pain in weeks, and whether the patient experiences pain in multiple body regions, all measured with a single question. Duration of pain will be handled as a continuous variable in our statistical analysis since there is no hard cut-off point between ‘acute’ and ‘sub-acute’ pain. Headaches are surveyed using a three-categorical single question to dichotomize specifically ‘headaches that originated together with neck pain’ and ‘no headaches or headaches that exist before the neck pain’.
The Pain Disability Index (PDI) is a 7-item questionnaire that investigates the extent of self-reported pain-related disability [39]. The PDI measures family/home responsibilities, recreation, social activity, occupation, sexual behavior, self-care, and life support. The questionnaire items are assessed on a 0–10 numeric rating scale in which 0 means no disability and 10 is maximum disability.
Work related factors
The questions about happiness at work, job satisfaction, and the potential to self-modify posture during work are non-validated questions of which the psychometric properties are unknown and have been developed and formulated based on a Delphi study [24]. These are all answered on a Likert scale (1–5), which will be dichotomized in the statistical analysis (Table 1).
General factors
Lifestyle is measured with self-reported questions on different lifestyle domains; physical activity, smoking, alcohol, weight, and sleep quality.
Sleep quality is questioned through an adjusted question from the Neck Disability Index (NDI). The question was adjusted based on a Delphi study, which indicates that the NDI does not sufficiently question the ’sleep quality’ factor [24]. For this reason, the statements "I do not wake up in the morning rested" and "I have trouble falling asleep" were added to the existing 9th question of the NDI questionnaire [47]. Since the question was modified, no psychometric properties are known.
Psychological and behavior factors
Catastrophizing is measured with a shortened validated 6-item version of the Pain Catastrophizing Scale (PCS) that assesses catastrophic thoughts or feelings associated with the experience of pain. Participants are asked to think about a recent painful experience and indicate to what extent they experience each of the six thoughts or feelings when they are in pain. The short version of the PCS assesses each dimension to capture the broad construct of catastrophizing; it compromises the lower-order factors labeled as rumination, magnification, and helplessness [40]. It uses a 5-point scale ranging from 0 (not at all) to 4 (always) [48]. A shortened version of the PCS is used to limit the total measurement duration. Internal, construct, and the smallest detectable change (SDC) are highly comparable to the original PCS [40].
Kinesiophobia is measured using the Tampa Scale for Kinesiophobia 11-item version (TSK-11). This short version assesses both dimensions of kinesiophobia; harm and activity avoidance. The eleven questions are scored from 1 (strongly disagree) to 4 (strongly agree). The psychometric properties of the TSK-11 demonstrate good internal consistency (α = 0.79), responsiveness (SRM = -1,11), test-retest reliability (ICC = 0,81, SEM = 2.54), concurrent validity and predictive validity [43].
In a (sub)acute state of pain, a response such as fear of movement or negative orientation toward pain could exist. However, it is not known when this response is a beneficial level of adaptation or an excessive response to (sub)acute pain. Furthermore, whether it is associated with developing chronicity in neck pain, a specific cut-off point to differentiate between these two levels does not exist. Therefore, our analyses will address catastrophizing and kinesiophobia as continuous factors.
The Depression Anxiety Stress Scale– 21 (DASS-21), recommended by Bijker et al. (2020) [49], is used to map the degree of stress and depression. The DASS-21 consists of 21 questions with three subscales: depression, anxiety, and stress. Each subscale consists of 7 questions with the answer ranging from 0 (not applicable at all or never applicable) to 3 (very definitely or mostly applicable) [42]. The internal consistency and test-retest reliability are sufficient for the DASS, and the convergent and divergent validity was supported [42].
The coping strategy of people with pain symptoms is measured through the Pain Coping Inventory List (PCI). This 33-item questionnaire reliably assesses six specific cognitive and behavioral strategies [44, 50]. The sensitivity and reproducibility of the PCI are acceptable [44]. Transforming the classification into an active or passive coping strategy is included in the content and construct validity. However, it has been validated in studies on chronic pain patients who experience physical complaints or (dis)function [50]. The items are scored using an ordinal measurement level from 1 (rarely) to 4 (very common).
The illness perceptions are measured with the Illness Perception Questionnaire–Dutch language version (IPQ-DLV) [41]. The IPQ-K is a cross-culturally adapted Dutch version of the Brief Illness Perception Questionnaire (BIPQ) [51]. Four out of eight questions from the IPQ-DLV were included in this study to measure patients’ illness perceptions about recovery, treatment beliefs, and pain identity. The IPQ-DLV is an easy-to-understand questionnaire for patients and healthcare professionals. Each question represents a different disease perception with a different outcome measure. The items are scored using an ordinal measurement level from 0–10. The questionnaire has moderate to substantial reliability, acceptable face validity, and acceptable content validity [41]. The IPQ-K is an inventory questionnaire that can also be used evaluatively [41]. The reproducibility appeared to be moderate to good [51–53].
The degree of vigilance is assessed by the 16-item Pain Vigilance Awareness Questionnaire (PVAQ). Respondents are asked to think about their behavior in the past two weeks and indicate how often each item is a true reflection of their behavior or feelings. This questionnaire labeled two factors: “attention to pain” and “attention to changes in pain”. The degree of vigilance is rated on a 6-point scale ranging from 0 (never) to 5 (always) [54, 55]. The PVAQ showed good validity, and internal consistency and fair test-retest reliability [45, 54].
The short version of the Pain Self-Efficacy Questionnaire (PSEQ-2) is a robust measure of pain self-efficacy and is recommended by Sleijser-Koehorst et al. (2019) [56]. It appears to be suitable for use in clinical and research settings [46].
Remaining modifiable factors
The therapist’s orientation, biomedical (BM) or biopsychosocial (BPS), is assessed by asking the therapist to fill in two vignettes. Vignettes are a realistic simulation of case situations in daily practice to measure of diagnosis or evaluation by health care providers. It is a promising quality rating for estimating the clinical behavior of care providers and, if constructed correctly, is a valid measuring instrument [57, 58]. Vignette 1 (acute non-specific neck pain) consists of open questions (4) and multiple-choice questions (4). The open questions focus on the history taking, examination, and treatment strategy. The multiple-choice questions focus on the therapist’s advice concerning the complaint in type and seriousness, resumption of work, and of daily activities. Vignette 2 (chronic non-specific neck pain) consist only of the multiple-choice questions (4). The vignettes used are based on standardized vignettes on low back pain [59].
In order to categorize the therapists (BM or BPS), the SCEBS method is used, covering Somatic, Psychological (Cognition, Emotion, and Behavior), and Social dimensions [60]. A therapist with a biomedical orientation believes in a biomedical model of disease, where disability and pain are a consequence of a specific pathology within the spinal tissues, and treatment is aimed at treating the pathology and alleviating the pain [59]. A therapist with a biopsychosocial orientation believes in a biopsychosocial model of disease in which pain does not have to be a consequence of tissue damage and can be influenced by social and psychological factors [59]. The open questions are scored on the emergence of the different dimensions of the SCEBS, whereby the somatic dimension scores as a more biomedical orientation, and the dimensions cognition, emotion, behavior, and social score as biopsychosocial orientation. The multiple-choice questions score as a more biomedical orientation if the therapist is more likely to rate for spinal pathology, recommend a delay in return to work and daily activity [61–63]. The scores are merged at the end to a sum score, which categorize a therapist as BM or BPS. Every therapist is categorized by two researchers individually; after scoring, there will be a consensus meeting between the two researchers. A third reviewer makes the final decision if consensus cannot not be reached.
Therapeutic relation is measured by a self-developed single question of which psychometric properties are unknown and was formulated based on a Delphi study [24].
Sample size
To ensure the sample size is adequate in terms of the number of participants (n) and outcome events (E) relative to the number of predictor parameters (p) considered for inclusion, the minimum number of events per predictor parameter (EPP) is calculated recommended by Riley et al. (2019) [64]. To reduce the risk of overfitting and to ensure that the overall risk is estimated precisely, the following criteria need to be met: (1) small optimism in predictor effect estimated as defined by a global shrinkage factor of ≥ 0.85, (2) small absolute difference of ≤ 0.05 in the model’s apparent and adjusted Nagelkerke’s R2, and (3) precise estimation of the overall risk of rate in the population or similarly, precise estimation of the model intercept when predictors are mean-centered [64]. The calculation of the expected value of the (Cox-Snell) R-squared of the new model is based on two included prognostic models and is estimated at R2 = 0.23 [16, 65, 66]. The outcome events (E) are estimated at 45% based on a systematic review by dividing the included number of patients by the number of non-recovery of pain [16]. The number of included candidate predictor parameters for potential inclusion in the new model is based on a systematic review and a consensus study and is estimated at 26, of which 4 are non-modifiable and 22 are potentially modifiable. The a priori sample size calculation for the prognostic model suggests to include a minimum of 598 participants.
Statistical analysis methods and missing data
The statistical analysis is based on the ‘Prognosis Research Strategy (PROGRESS) framework’ type 3 research [26], in which the step-by-step plan will be roughly as follows:
Analysis of cases with and without the development of the outcome events (whether or not they developed chronic pain, respectively) will be done to determine if there are significant differences. In case > 5% of incomplete records, data will be imputed. A multiple imputation strategy will be followed in case we assume data are at least missing at random. The number of imputations will be set to the percentage of incomplete records. Imputed values for continuous variables will be drawn using predictive mean matching. In case of evidence of data being MAR (or MCAR), the MAR assumption will be assessed by making a missingness indicator and testing whether incomplete patients differ from those that are incomplete.
-
Identifying the independent predictive capacity of the candidate prognostic variables at baseline and the existence or non-existence of chronic pain measured at six weeks, three, and six months by univariable logistic regression analysis. These analyses will not be used to decide which prognostic factors will be included in the multivariable analyses.
If the sample size, as calculated, turns out to be adequate, all variables will be include in the multivariable analyses.
Multicollinearity between candidate predictors will be assessed using the variance inflation factor. In case the variance inflation factor exceeds 10, we will select which candidate predictor add to the modeling phase based on clinical expertise.
The non-variable factors of age, gender, and duration of the pain will be included to strengthen our model. The discriminative ability of the prognostic model will be determined based on the Area Under the receiver operating characteristic Curve (AUC), calibration will be assessed using a calibration plot and formally tested using the Hosmer and Lemeshow goodness-of-fit test, and model fit will be quantified as Nagelkerke’s R2.
Internal validation will be performed using bootstrap resampling to estimate the optimism-corrected AUC and to yield a measure of overfitting (i.e., the shrinkage factor). The shrinkage factor (a constant between 0 and 1) will be used to multiply the regression coefficient by. Generally, regression coefficients (and resulting predictions) are too extreme in case of overfitting, which is counteracted by the shrinking of regression coefficients.
Discussion
This prospective cohort study will be the most extensive study in this field to determines prognostic factors for the chronification of acute- or subacute nonspecific idiopathic, non-traumatic neck pain in primary care physiotherapy. In contrast to most other prognostic research studies, this study has a biopsychosocial view and focuses specifically on potentially modifiable factors by a physiotherapist. By selecting patients in primary care physiotherapy practices, we assume that they will represent the usual population consulting the physiotherapist with neck pain. The results of this study will improve the understanding of prognostic and potential protective factors, which will help clinicians guide their clinical decision making, develop an individualized treatment approach, and predict chronic neck pain more accurately.
The candidate prognostic factors in this study are mostly modifiable. The non-modifiable factors of increasing age, sex, duration of neck pain, and reported pain in different body regions have a known prognostic value for neck pain patients [10, 15, 16, 67]. Therefore these will be included in the model development to strengthen the value of our prognostic model. However, their non-modifiable nature means that they have limited use in potential prevention strategies. To pursue the clinical applicability of the model, other potentially relevant and modifiable factors are selected for inclusion based on our systematic review and international Delphi study.
Strengths and limitations
This study includes critical methodological features in order to minimize bias. These features include sampling a representative cohort from a physiotherapy setting with a high follow-up rate [68]. A new strategy for a representative sample size will be used. The rule-of-thumb events per variable (EPV) of ≥ 10 is widely used in the medical literature as the lower limit for developing prediction models that predict a binary outcome. However, this generally accepted minimal sample size criterion has been found lenient when default stepwise predictor selection strategies develop prognostic models. Earlier critiques on EPV as a sample size criterion have identified its weak theoretical and empirical underpinning [69].
The new strategy to achieve an accurate sample size offers us space for 26 candidate prognostic factors in model development to avoid overfitting in our analyses. Because more candidate prognostic factors can lead to model overfitting in small data sets, spurious observed relationships can occur because of regression value distortion and an overestimating predictive performance [64, 70]. The 26 candidate prognostic factors permitted are selected based on our previous systematic review and Delphi study to include only relevant and potential important factors.
Although this study does not influence the therapy the participants receive, the given therapy may influence the outcome and the accuracy and transportability of the model to be developed [71]. The patients receive standard care based on the Dutch Physiotherapy Guideline for neck pain [34]. They may include therapy to modify our candidate prognostic factors and thereby have a risk-reducing effect on chronicity. In addition, there may also be a form of ‘background treatment’; this could include any other treatment that an individual received during our prognostic study (e.g., psychological care) or changes an individual makes to their lifestyle [71]. We will have no information on this form of treatment during this study; however, it could influence the outcome. Nevertheless, we consider the impact on our study findings to be minimal, given (1) the heterogeneity of the factors to be modified, (2) the multiple modalities used by physiotherapists, and (3) the difference in physiotherapists’ backgrounds. Thereby, we will report the physiotherapy treatment the patient received and discuss the possible impact on our study findings (TRIPOD 5C) but do not include the different treatments as a predictor in our model. Moreover, the current setting does reflect clinical practice as it is. This heterogeneity is likely to remain even after implementing of a well-performing model.
Clinical message and future directions
This study protocol describes only the first phase of prognostic model research; model development (including internal validation). Our model should be externally validated using data from another dataset to assess the generalizability of our prognostic model [72]. Thereafter, investigations of impact on decision-making and patient outcomes have to be done to measure our study’s clinical relevance and impact.
Acknowledgments
We want to thank all the physiotherapists who will include and follow their patients for six months. We would also wish to extend our special thanks to all the patients who will participate in this research.
We want to thank all reviewers, Assoc. Prof. Dr. Farnaza Ariffin, Prof. Alice Kongsted, Prof. Saud M. Al-Obaidi Phd PT, and Ass. Prof. Yousef Alshere, for taking the time and effort necessary to review the manuscript. We sincerely appreciate all valuable comments and suggestions which helped us improve the manuscript’s quality.
Data Availability
Data sharing is not applicable to this article as the current study describes the protocol for the data analysis. For the results paper, the datasets generated during and/or analysed during this study will be made available in an open access repository.
Funding Statement
This PhD trajectory and research is partly supported by the Institute of Movement Studies and partly by the Utrecht University of Applied Sciences research voucher. The funding concerns am internal promotion voucher of the University of Applied Sciences. The funders had no role in the study design, data collection, analysis, decision to publish, or manuscript preparation.
References
- 1.Carroll LJ, Hogg-Johnson S, van der Velde G, Haldeman S, Holm LW, Carragee EJ, et al. Course and Prognostic Factors for Neck Pain in the General Population. Eur Spine J. 2008;17(S1):75–82. [DOI] [PubMed] [Google Scholar]
- 2.Lee H, Hübscher M, Moseley GL, Kamper SJ, Traeger AC, Mansell G, et al. How does pain lead to disability? A systematic review and meta-analysis of mediation studies in people with back and neck pain. Pain. 2015. doi: 10.1097/j.pain.0000000000000146 [DOI] [PubMed] [Google Scholar]
- 3.GBD 2015 Disease and Injury Incidence and Prevalence Collaborators G 2015 D and II and P. Global, regional, and national incidence, prevalence, and years lived with disability for 310 diseases and injuries, 1990–2015: a systematic analysis for the Global Burden of Disease Study 2015. Lancet (London, England) [Internet]. 2016 [cited 2018 Feb 14];388(10053):1545–602. http://www.ncbi.nlm.nih.gov/pubmed/27733282 [DOI] [PMC free article] [PubMed]
- 4.Borghouts JAJ, Koes BW, Vondeling H, Bouter LM. Cost-of-illness of neck pain in The Netherlands in 1996. Pain. 1999;80(3):629–36. doi: 10.1016/S0304-3959(98)00268-1 [DOI] [PubMed] [Google Scholar]
- 5.Cohen SP. Epidemiology, diagnosis, and treatment of neck pain. Mayo Clin Proc [Internet]. 2015;90(2):284–99. Available from: doi: 10.1016/j.mayocp.2014.09.008 [DOI] [PubMed] [Google Scholar]
- 6.Childs JD, Cleland JA, Elliott JM, Teyhen DS, Wainner RS, Whitman JM, et al. Neck Pain: Clinical practice guidelines linked to the international classification of functioning, disability, and health from the orthopedic section of the american physical therapy association. J Orthop Sport Phys Ther [Internet]. 2008. Sep [cited 2018 Feb 14];38(9):A1–34. Available from: http://www.ncbi.nlm.nih.gov/pubmed/18758050 [DOI] [PubMed] [Google Scholar]
- 7.Hurwitz EL, Randhawa K, Yu H, Côté P, Haldeman S. The Global Spine Care Initiative: a summary of the global burden of low back and neck pain studies. Eur Spine J [Internet]. 2018. Sep 26;27(S6):796–801. Available from: http://link.springer.com/10.1007/s00586-017-5432-9 [DOI] [PubMed] [Google Scholar]
- 8.Veldkamp R., Kruisselbrink M., Meijer WM. Nivel Zorgregistraties Eerste lijn—Zorg door de fysiotherapeut; jaarcijfers 2020 en trendcijfers 2017–2020. NIVEL Zorgregistraties. Utrecht; 2022. 1–27 p. [Google Scholar]
- 9.Hush JM, Lin CC, Michaleff ZA, Verhagen A, Refshauge KM. Prognosis of Acute Idiopathic Neck Pain is Poor: A Systematic Review and Meta-Analysis. YAPMR [Internet]. 2011. [cited 2018 Feb 14];92:824–9. Available from: www.archives-pmr.org. doi: 10.1016/j.apmr.2010.12.025 [DOI] [PubMed] [Google Scholar]
- 10.Wingbermühle RW, Chiarotto A, van Trijffel E, Koes B, Verhagen AP, Heymans MW. Development and internal validation of prognostic models for recovery in patients with non-specific neck pain presenting in primary care. Physiother (United Kingdom) [Internet]. 2021;113:61–72. Available from: doi: 10.1016/j.physio.2021.05.011 [DOI] [PubMed] [Google Scholar]
- 11.Geneen LJ SB, Andrew Moore R, Clarke C, Martin D, Colvin LA, Smith BH. Cochrane Database of Systematic Reviews Physical activity and exercise for chronic pain in adults: an overview of Cochrane Reviews (Review) Physical activity and exercise for chronic pain in adults: an overview of Cochrane Reviews (Review) i Physical acti. Cochrane Database Syst Rev [Internet]. 2017. [cited 2018 Feb 14];(4). Available from: www.cochranelibrary.com [Google Scholar]
- 12.Bertozzi L, Gardenghi I, Turoni F, Villafañe JH, Capra F, Guccione AA, et al. Effect of Therapeutic Exercise on Pain and Disability in the Management of Chronic Nonspecific Neck Pain: Systematic Review and Meta-Analysis of Randomized Trials. Phys Ther [Internet]. 2013. [cited 2018 Feb 14];93(8):1026–36. doi: 10.2522/ptj.20120412 [DOI] [PubMed] [Google Scholar]
- 13.Gross A, Langevin P, Burnie SJ, Bédard-Brochu M-S, Empey B, Dugas E, et al. Manipulation and mobilisation for neck pain contrasted against an inactive control or another active treatment. Cochrane Database Syst Rev [Internet]. 2015. Sep 23 [cited 2018 Feb 14];23(9). Available from: http://doi.wiley.com/10.1002/14651858.CD004249.pub4 doi: 10.1002/14651858.CD004249.pub4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Silva PV, Costa LOP, Maher CG, Kamper SJ, Costa LDCM. The new agenda for neck pain research: A modified delphi study. J Orthop Sports Phys Ther. 2019;49(9):666–74. [DOI] [PubMed] [Google Scholar]
- 15.Wingbermühle RW, van Trijffel E, Nelissen PM, Koes B, Verhagen AP. Few promising multivariable prognostic models exist for recovery of people with non-specific neck pain in musculoskeletal primary care: a systematic review. J Physiother. 2018;64(1):16–23. doi: 10.1016/j.jphys.2017.11.013 [DOI] [PubMed] [Google Scholar]
- 16.Verwoerd M, Wittink H, Maissan F, de Raaij E, Smeets RJEM. Prognostic factors for persistent pain after a first episode of nonspecific idiopathic, non-traumatic neck pain: A systematic review. Musculoskelet Sci Pract [Internet]. 2019;42(March 2018):13–37. Available from: doi: 10.1016/j.msksp.2019.03.009 [DOI] [PubMed] [Google Scholar]
- 17.Walton DM. An Overview of Systematic Reviews on Prognostic Factors in Neck Pain: Results from the International Collaboration on Neck Pain (ICON) Project. Open Orthop J [Internet]. 2013;7(1):494–505. Available from: http://benthamopen.com/ABSTRACT/TOORTHJ-7-494 doi: 10.2174/1874325001307010494 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Kelly J, Ritchie C, Sterling M. Clinical prediction rules for prognosis and treatment prescription in neck pain: A systematic review. Musculoskelet Sci Pract. 2017;27:155–64. doi: 10.1016/j.math.2016.10.066 [DOI] [PubMed] [Google Scholar]
- 19.Stenneberg MS, Rood M, de Bie R, Schmitt MA, Cattrysse E, Scholten-Peeters GG. To What Degree Does Active Cervical Range of Motion Differ Between Patients With Neck Pain, Patients With Whiplash, and Those Without Neck Pain? A Systematic Review and Meta-Analysis. Arch Phys Med Rehabil [Internet]. 2017;98(7):1407–34. Available from: doi: 10.1016/j.apmr.2016.10.003 [DOI] [PubMed] [Google Scholar]
- 20.Anstey R, Kongsted A, Kamper S, Hancock MJ. Are People With Whiplash-Associated Neck Pain Different From People With Nonspecific Neck Pain? J Orthop Sport Phys Ther [Internet]. 2016;46(10):894–901. Available from: http://www.jospt.org/doi/10.2519/jospt.2016.6588 doi: 10.2519/jospt.2016.6588 [DOI] [PubMed] [Google Scholar]
- 21.Ris I, Juul-Kristensen B, Boyle E, Kongsted A, Manniche C, Søgaard K. Chronic neck pain patients with traumatic or non-traumatic onset: Differences in characteristics. A cross-sectional study. Scand J Pain. 2017;14:1–8. doi: 10.1016/j.sjpain.2016.08.008 [DOI] [PubMed] [Google Scholar]
- 22.Treede R-D, Rief W, Barke A, Aziz Q, Bennett MI, Benoliel R, et al. A classification of chronic pain for ICD-11. Pain [Internet]. 2015. [cited 2018 Feb 14];156(6):1003–7. Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4450869/pdf/jop-156-1003.pdf doi: 10.1097/j.pain.0000000000000160 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Riley Richard D., Windt van der Danielle A., Croft Peter, Moons KG. Prognosis research in healthcare Concepts, Methods, and Impact. 1st ed. Oxford: Oxford University Press; 2019. [Google Scholar]
- 24.Verwoerd M, Wittink H, Maissan F, Smeets R. Consensus of potential modifiable prognostic factors for persistent pain after a first episode of nonspecific idiopathic, non-traumatic neck pain: results of nominal group and Delphi technique approach. BMC Musculoskelet Disord [Internet]. 2020. Dec 7;21(1):656. Available from: https://bmcmusculoskeletdisord.biomedcentral.com/articles/10.1186/s12891-020-03682-8 doi: 10.1186/s12891-020-03682-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Turk DC OA. Psychological Factors in Chronic Pain: Evolution and Revolution. J Consult Clin Psychol. 2002;70(3):678. doi: 10.1037//0022-006x.70.3.678 [DOI] [PubMed] [Google Scholar]
- 26.Steyerberg EW, Moons KGM, van der Windt DA, Hayden JA, Perel P et al. Prognosis Research Strategy (PROGRESS) 3: Prognostic Model Research. PLoS Med. 2013;10 (2). doi: 10.1371/journal.pmed.1001381 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Collins GS, Reitsma JB, Altman DG, Moons KGM. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): The TRIPOD statement. BMJ [Internet]. 2015;350(January):1–9. Available from: 10.1136/bmj.g7594 [DOI] [PubMed] [Google Scholar]
- 28.Innovero Software Solutions B.V. Formdesk [Internet]. en.formdesk.com
- 29.Van Tulder M, Becker A, Bekkering T, Breen A, Del Real MTG, Hutchinson A, et al. Chapter 3: European guidelines for the management of acute nonspecific low back pain in primary care. Eur Spine J. 2006;15(SUPPL. 2):169–91. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Traeger A, Henschke N, Hübscher M, Williams CM, Kamper SJ, Maher CG, et al. Development and validation of a screening tool to predict the risk of chronic low back pain in patients presenting with acute low back pain: A study protocol. BMJ Open. 2015;5(7). doi: 10.1136/bmjopen-2015-007916 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Hill J, Lewis M, Papageorgiou AC, Dziedzic K, Croft P. Predicting Persistent Neck Pain: A 1-year follow-up of a population cohort. Spine (Phila Pa 1976). 2004;29(15):1648–54. doi: 10.1097/01.brs.0000132307.06321.3c [DOI] [PubMed] [Google Scholar]
- 32.Thoomes EJ, van Geest S, van der Windt DA, Falla D, Verhagen AP, Koes BW, et al. Value of physical tests in diagnosing cervical radiculopathy: a systematic review. Spine J [Internet]. 2018;18(1):179–89. Available from: doi: 10.1016/j.spinee.2017.08.241 [DOI] [PubMed] [Google Scholar]
- 33.Hoy DG, Smith E, Cross M, et al. The global burden of musculoskeletal conditions for 2010: an overview of methods. Ann Rheum Dis. 2014;73:982–9. doi: 10.1136/annrheumdis-2013-204344 [DOI] [PubMed] [Google Scholar]
- 34.BierI JD, Scholten-Peeters GGM, Staal JB, Pool J, van Tulder M, Beekman E, et al. KNGF Guideline Neck Pain. R Dutch Soc Phys Ther. 2016;5. [Google Scholar]
- 35.Bier Jasper D., Scholten-Peeters G.G.M., Staal J.B., Pool J, Tulder van M., Beekman E., et al. KNGF-richtlijn Nekpijn—praktijkrichtlijn. 2016. [Google Scholar]
- 36.Kamper SJ, Maher CG, Herbert RD, Hancock MJ, Hush JM, Smeets RJ. How little pain and disability do patients with low back pain have to experience to feel that they have recovered? Eur Spine J. 2010;19(9):1495–501. doi: 10.1007/s00586-010-1366-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Young IA, Dunning J, Butts R, Mourad F, Cleland JA. Reliability, construct validity, and responsiveness of the neck disability index and numeric pain rating scale in patients with mechanical neck pain without upper extremity symptoms. Physiother Theory Pract. 2019;35(12):1328–35. doi: 10.1080/09593985.2018.1471763 [DOI] [PubMed] [Google Scholar]
- 38.Ferraz MB, Quaresma MR, Aquino LR, Atra E, Tugwell P, Goldsmith C. Reliability of pain scales in the assessment of literate and illiterate patients with rhematoid arthritis. J Rheumatol. 1990;17(8):1022–4. [PubMed] [Google Scholar]
- 39.Pollard CA. Preliminary validity study of the pain disability index. Percept Mot Skills. 1984;59(3):974. doi: 10.2466/pms.1984.59.3.974 [DOI] [PubMed] [Google Scholar]
- 40.McWilliams LA, Kowal J, Wilson KG. Development and evaluation of short forms of the Pain Catastrophizing Scale and the Pain Self-efficacy Questionnaire. Eur J Pain (United Kingdom). 2015;19(9):1342–9. doi: 10.1002/ejp.665 [DOI] [PubMed] [Google Scholar]
- 41.de Raaij EJ, Schröder C, Maissan FJ, Pool JJ, Wittink H. Cross-cultural adaptation and measurement properties of the Brief Illness Perception Questionnaire-Dutch Language Version. Man Ther [Internet]. 2012;17(4):330–5. Available from: doi: 10.1016/j.math.2012.03.001 [DOI] [PubMed] [Google Scholar]
- 42.de Beurs E, Van Dyck R, Marquenie LA, Lange a, Blonk RWB, deBeurs E, et al. De DASS: een vragenlijst voor het meten van depressie, angst en stress. Gedragstherapie. 2001;34(1):35–54. [Google Scholar]
- 43.Woby SR, Roach NK, Urmston M, Watson PJ. Psychometric properties of the TSK-11: A shortened version of the Tampa Scale for Kinesiophobia. Pain. 2005;117(1–2):137–44. doi: 10.1016/j.pain.2005.05.029 [DOI] [PubMed] [Google Scholar]
- 44.Kraaimaat FW, Evers AWM. Pain-Coping Strategies in Chronic Pain Patients: Psychometric Characteristics of the Pain-Coping Inventory (PCI). Int J Behav Med. 2003;10(4):343–63. doi: 10.1207/s15327558ijbm1004_5 [DOI] [PubMed] [Google Scholar]
- 45.Roelofs J, Peters ML, Muris P, Vlaeyen JWS. Dutch version of the Pain Vigilance and Awareness Questionnaire: Validity and reliability in a pain-free population. Behav Res Ther. 2002;40(9):1081–90. doi: 10.1016/s0005-7967(02)00008-6 [DOI] [PubMed] [Google Scholar]
- 46.Nicholas MK, McGuire BE, Asghari A. A 2-item short form of the pain self-efficacy questionnaire: Development and psychometric evaluation of PSEQ-2. J Pain [Internet]. 2015;16(2):153–63. Available from: doi: 10.1016/j.jpain.2014.11.002 [DOI] [PubMed] [Google Scholar]
- 47.Vernon H MS. The Neck Disability Index: a study of reliability and validity. J Manip Physiol Ther. 1991;Sep(14(7)):409–15. [PubMed] [Google Scholar]
- 48.Sullivan MJL, Thorn B, Haythornthwaite JA, Keefe F, Martin M, Bradley LA, et al. Theoretical perspectives on the relation between catastrophizing and pain. Clin J Pain. 2001;17(1):52–64. doi: 10.1097/00002508-200103000-00008 [DOI] [PubMed] [Google Scholar]
- 49.Bijker L, Sleijser-Koehorst MLS, Coppieters MW, Cuijpers P, Scholten-Peeters GGM. Preferred Self-Administered Questionnaires to Assess Depression, Anxiety and Somatization in People With Musculoskeletal Pain–A Modified Delphi Study. J Pain. 2020;21(3–4):409–17. doi: 10.1016/j.jpain.2019.08.006 [DOI] [PubMed] [Google Scholar]
- 50.Brown GK, Nicassio PM. Development of a questionnaire for the assessment of active and passive coping strategies in chronic pain patients. PAIN®. 1987. Oct 1;31(1):53–64. doi: 10.1016/0304-3959(87)90006-6 [DOI] [PubMed] [Google Scholar]
- 51.Moss-Morris R, Weinman J, Petrie K, Horne R, Cameron L, Buick D. The revised Illness Perception Questionnaire (IPQ-R). Psychol Heal. 2002;17(1):1–16. [Google Scholar]
- 52.Witteman C, Bolks L, Hutschemaekers G. Development of the illness perception questionnaire mental health. J Ment Heal. 2011;20(2):115–25. doi: 10.3109/09638237.2010.507685 [DOI] [PubMed] [Google Scholar]
- 53.de Raaij EJ, Ostelo RWJG, Maissan JF, Pool J, Westers P, Wittink H. Illness perceptions associated with patient burden with musculoskeletal pain in outpatient physical therapy practice, a cross-sectional study. Musculoskelet Sci Pract [Internet]. 2020;45(October 2019):102072. Available from: doi: 10.1016/j.msksp.2019.102072 [DOI] [PubMed] [Google Scholar]
- 54.Kunz M, Capito ES, Horn-Hofmann C, Baum C, Scheel J, Karmann AJ, et al. Psychometric Properties of the German Version of the Pain Vigilance and Awareness Questionnaire (PVAQ) in Pain-Free Samples and Samples with Acute and Chronic Pain. Int J Behav Med. 2017;24(2):260–71. doi: 10.1007/s12529-016-9585-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Roelofs J, Peters ML, McCracken L, Vlaeyen JWS. The pain vigilance and awareness questionnaire (PVAQ): Further psychometric evaluation in fibromyalgia and other chronic pain syndromes. Pain. 2003;101(3):299–306. doi: 10.1016/S0304-3959(02)00338-X [DOI] [PubMed] [Google Scholar]
- 56.Sleijser-Koehorst MLS, Bijker L, Cuijpers P, Scholten-Peeters GGM, Coppieters MW. Preferred self-administered questionnaires to assess fear of movement, coping, self-efficacy, and catastrophizing in patients with musculoskeletal pain—A modified Delphi study. Pain. 2019;160(3):600–6. doi: 10.1097/j.pain.0000000000001441 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Peabody JW, Luck J, Glassman P, Jain S, Hansen J, Spell M, et al. Measuring the quality of physician practice by using clinical vignettes: A prospective validation study. Ann Intern Med. 2004;141(10). doi: 10.7326/0003-4819-141-10-200411160-00008 [DOI] [PubMed] [Google Scholar]
- 58.Rutten GMJ, Harting J, Rutten STJ, Bekkering GE, Kremers SPJ. Measuring physiotherapists’ guideline adherence by means of clinical vignettes: a validation study. J Eval Clin Pract [Internet]. 2006. Oct;12(5):491–500. Available from: http://doi.wiley.com/10.1111/j.1365-2753.2006.00699.x doi: 10.1111/j.1365-2753.2006.00699.x [DOI] [PubMed] [Google Scholar]
- 59.Bishop A, Foster NE, Thomas E, Hay EM. How does the self-reported clinical management of patients with low back pain relate to the attitudes and beliefs of health care practitioners? A survey of UK general practitioners and physiotherapists. Pain. 2008;135(1–2):187–95. doi: 10.1016/j.pain.2007.11.010 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Oostendorp RAB, Elvers H, Mikołajewska E, Laekeman M, Van Trijffel E, Samwel H, et al. Manual physical therapists’ use of biopsychosocial history taking in the management of patients with back or neck pain in clinical practice. Sci World J. 2015;2015. doi: 10.1155/2015/170463 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.Simmonds MJ, Derghazarian T, Vlaeyen JWS. Physiotherapists’ knowledge, attitudes, and intolerance of uncertainty influence decision making in low back pain. Clin J Pain. 2012;28(6):467–74. doi: 10.1097/AJP.0b013e31825bfe65 [DOI] [PubMed] [Google Scholar]
- 62.Derghazarian T, Simmonds MJ. Management of low back pain by physical therapists in Quebec: How are we doing? Physiother Canada. 2011;63(4):464–73. doi: 10.3138/ptc.2010-04P [DOI] [PMC free article] [PubMed] [Google Scholar]
- 63.Houben RMA, Gijsen A, Peterson J, De Jong PJ, Vlaeyen JWS. Do health care providers’ attitudes towards back pain predict their treatment recommendations? Differential predictive validity of implicit and explicit attitude measures. Pain. 2005;114(3):491–8. doi: 10.1016/j.pain.2005.01.017 [DOI] [PubMed] [Google Scholar]
- 64.Riley RD, Snell KIE, Ensor J, Burke DL, Harrell FE, Moons KGM, et al. Minimum sample size for developing a multivariable prediction model: PART II—binary and time-to-event outcomes. Stat Med. 2019;38(7):1276–96. doi: 10.1002/sim.7992 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65.Hoving JL, De Vet HCW, Twisk JWR, Devillé WLJM, Van Der Windt D, Koes BW, et al. Prognostic factors for neck pain in general practice. Pain. 2004;110:639–45. doi: 10.1016/j.pain.2004.05.002 [DOI] [PubMed] [Google Scholar]
- 66.Pool JJM, Ostelo RWJG, Knol D, Bouter LM, De Vet HCW. Are psychological factors prognostic indicators of outcome in patients with sub-acute neck pain? Man Ther. 2010;15:111–6. doi: 10.1016/j.math.2009.08.001 [DOI] [PubMed] [Google Scholar]
- 67.Walton DM, MacDermid JC, Giorgianni AA, Mascarenhas JC, West SC, Zammit CA. Risk Factors for Persistent Problems Following Acute Whiplash Injury: Update of a Systematic Review and Meta-analysis. J Orthop Sport Phys Ther [Internet]. 2013. Feb 1 [cited 2018 Feb 14];43(2):31–43. Available from: http://www.jospt.org/doi/10.2519/jospt.2013.4507 doi: 10.2519/jospt.2013.4507 [DOI] [PubMed] [Google Scholar]
- 68.Altman DG. Systematic reviews of evaluations of prognostic variables. BMJ Clin Res. 2001;323(7306):224–8. doi: 10.1136/bmj.323.7306.224 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 69.van Smeden M, Moons KGM, de Groot JAH, Collins GS, Altman DG, Eijkemans MJC, et al. Sample size for binary logistic prediction models: Beyond events per variable criteria. Stat Methods Med Res. 2019;28(8):2455–74. doi: 10.1177/0962280218784726 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 70.Peduzzi Peter, Concato John, Kemper Elizabeth, Holford Theodore R., Feinstein AR. A Simulation Study of the Number of Events per Variable in Logistic Regression Analysis. J Clin Epidemiol. 1996;49(12):1373–9. doi: 10.1016/s0895-4356(96)00236-3 [DOI] [PubMed] [Google Scholar]
- 71.Pajouheshnia R, Damen JAAG, Groenwold RHH, Moons KGM, Peelen LM. Treatment use in prognostic model research: a systematic review of cardiovascular prognostic studies. Diagnostic Progn Res. 2017;1(1):1–10. doi: 10.1186/s41512-017-0015-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 72.Riley RD, Hayden JA, Steyerberg EW, Moons KGM, Abrams K, Kyzas PA, et al. Guidelines and Guidance Prognosis Research Strategy (PROGRESS) 2: Prognostic Factor Research. PLOS Med [Internet]. 2013. [cited 2018 Feb 14];10(2):e1001380. Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3564757/pdf/pmed.1001380.pdf [DOI] [PMC free article] [PubMed] [Google Scholar]