Skip to main content
BMJ Open logoLink to BMJ Open
. 2019 Jul 23;9(7):e025513. doi: 10.1136/bmjopen-2018-025513

Persistent physical symptoms reduction intervention: a system change and evaluation (PRINCE)—integrated GP care for persistent physical symptoms: protocol for a feasibility and cluster randomised waiting list, controlled trial

Meenal Patel 1, Kirsty James 2, Rona Moss-Morris 3, Mujtaba Husain 4, Mark Ashworth 5, Philipp Frank 1, Nicola Ferreira 1, Iris Mosweu 6, Paul McCrone 6, Matthew Hotopf 1, Anthony David 7, Sabine Landau 2, Trudie Chalder 1
PMCID: PMC6661663  PMID: 31340956

Abstract

Introduction

Persistent physical symptoms (PPS), also known as medically unexplained symptoms are associated with profound physical disability, psychological distress and high healthcare costs. England’s annual National Health Service costs of attempting to diagnose and treat PPS amounts to approximately £3 billion. Current treatment relies on a positive diagnosis, life-style advice and drug therapy. However, many patients continue to suffer from ongoing symptoms and general practitioners (GPs) are challenged to find effective treatments. Training GPs in basic cognitive behavioural skills and providing self-help materials to patients could be useful, but availability in primary care settings is limited.

Methods and analysis

A cluster randomised waiting list, controlled trial will be conducted to assess the feasibility of an integrated approach to care in general practice. Approximately 240 patients with PPS will be recruited from 8 to 12 GP practices in London. GP practices will be randomised to ‘integrated GP care plus treatment as usual’ or waiting list control. Integrated GP care plus treatment as usual will include GP training in cognitive behavioural skills, GP supervision and written and audio visual materials for both GPs and participants. The primary objectives will be assessment of trial and intervention feasibility. Secondary objectives will include estimating the intracluster correlation coefficient for potential outcome measures for cluster effects in a sample size calculation. Feasibility parameters and identification of suitable primary and secondary outcomes for future trial evaluations will be assessed prerandomisation and at 12 and 24 weeks’ postrandomisation, using a mixed-methods approach.

Ethics and dissemination

Ethical approval was granted by the Camberwell St Giles Ethics Committee. Results will be disseminated via peer-reviewed publications and conference presentations. This trial will inform researchers, clinicians, patients and healthcare providers about the feasibility and potential cost-effectiveness of an integrated approach to managing PPS in primary care.

Trial registration number

NCT02444520; Pre-results.

Keywords: primary care, persistent physical symptoms, feasibility, cluster randomised controlled trial, cognitive behavioural skills


Strengths and limitations of this study.

  • Persistent Physical Symptoms Reduction Intervention: a System Change and Evaluation in Primary Care is a cluster, randomised, waiting list, controlled trial, designed to evaluate the acceptability and feasibility of an integrated general practitioner (GP) approach to care for adults with persistent physical symptoms (PPS).

  • A new transdiagnostic approach to managing patients with PPS in general practice was developed. This includes a Continuing Professional Development (CPD) accredited basic cognitive behavioural skills training, as well as audio visual and written learning materials for GPs. Participants of GP practices randomised to ‘integrated GP care plus treatment as usual’ will receive tailored self-help materials.

  • This feasibility study is not powered to evaluate efficacy or cost-effectiveness of integrated GP care but intends to identify suitable primary outcomes for an adequately powered future evaluation trial.

Introduction

Medically unexplained symptoms (MUS) are an umbrella term referring to persistent bodily symptoms, which cannot be adequately explained by organic pathology.1 MUS are highly prevalent with ~10%–49% of patients in primary care.2 3 MUS are associated with significant functional impairment, psychological distress and high healthcare costs.4–6 Moreover, ~60% of patients have a comorbid psychiatric condition, including depression, anxiety and panic disorders.7–9 The National Health Service (NHS) in England is estimated to spend approximately £3 billion each year attempting to diagnose and treat MUS, which represented ~10% of the total NHS expenditure in 2008–2009.10

The term MUS is commonly used in healthcare and research. However, it has been argued that using the label persistent physical symptoms (PPS) may be more appropriate for a number of reasons. First, recent surveys indicated that people with such symptoms and healthy respondents preferred the term PPS, as it avoids mind-body dualism and has cross-cultural relevance.11 12 Second, it includes symptoms associated with medically diagnosed long-term conditions, such as diabetes, rheumatoid arthritis and multiple sclerosis, which may present comorbidly with MUS. Third, it concurs with changes in the latest edition of the Diagnostic and Statistics Manual (DSM-5). The DSM-5 has consolidated previous terms including somatisation disorder, conversion disorder and hypochondriasis into a new diagnostic term—somatic symptom disorder. This refers to persistent (6 months) and clinically significant somatic complaints accompanied by excessive and disproportionate health-related thoughts, feelings and behaviours regarding the symptoms.13 In this paper, we will use the term PPS to refer to MUS.

There is an accumulating body of evidence showing that cognitive behavioural interventions can reduce levels of symptoms and improve overall functioning in patients with PPS. Cognitive behavioural therapy (CBT) has demonstrated both short-term and long-term efficacy with small to medium effect sizes for PPS.14 15 Larger treatment effects have been reported for specific PPS syndromes, including non-cardiac chest pain16 17 and irritable bowel syndrome.18–20

Research indicates that the way healthcare professionals deliver interventions and offer treatment to patients with PPS significantly affects health outcomes. For instance, a previous randomised controlled trial (RCT) evaluated the effectiveness of an integrated approach in treating women with chronic pelvic pain in secondary care. This involved an assessment of pain sensation, nociception, pain suffering and pain behaviour, followed by a discussion about possible physical, psychological, dietary and environmental contributions plus physiotherapy, versus routine laparoscopy. The findings revealed that the integrated approach was significantly more effective in reducing pelvic pain compared with routine laparoscopy.21

Evidence supporting the efficacy of psychopharmacological interventions for PPS is less clear. A previous Cochrane review on pharmacological interventions found low-quality evidence for the use of new-generation antidepressants. No evidence was found for other psychotropic drugs, including tricyclic antidepressants and antipsychotics.22 This suggests the need for further research investigating the effectiveness of non-pharmacological treatments in managing PPS, including psychosocial interventions.

General practitioners (GPs) play a major role in identifying and managing patients with PPS. The Royal College of General Practitioners emphasise the importance of GPs in helping patients with PPS to make sense of their symptoms by adopting a biopsychosocial approach to treatment.23 A previous randomised parallel group pilot trial investigated the feasibility (ie, recruitment, retention and acceptability) of implementing a primary care symptoms clinic for patients with PPS.24 The symptoms clinic comprised a structured set of consultations delivered by a specially trained GP with a strong interest in PPS. The intervention included exploring potential biological mechanisms underlying the PPS condition, empathetic support and training patients in symptom management (ie, medication or cognitive behavioural techniques). The results indicated that the symptoms clinic was acceptable to the majority of patients randomised to the intervention group and may have the potential to generate clinically significant benefits. However, this pilot study did not assess feasibility parameters referring to GPs’ willingness to participate in the study and undergo specialised psychological training. Moreover, the intervention was carried out by only one GP, raising questions about the generalisability of the study.

Managing patients with PPS can be highly challenging in general practice. Although GPs recognise the treatment of PPS as a responsibility of primary care, previous studies show that GPs often feel powerless, frustrated and helpless when encountering these patients.25 26 One possible explanation for this is an epistemological incongruence between taught ideal biomedical models of disease, and the reality of meeting patients presenting with subjective PPS, which cannot be fully explained by organic causes.26 Furthermore, GPs frequently report that factors such as time constraints and the lack of psychological training prevents them from effectively addressing patients’ psychosocial needs and developing appropriate doctor–patient communication skills.25

Taken together, there are four strands of evidence:

  1. Psychological interventions may help patients with long-standing PPS.

  2. The way in which investigations are carried out and offered to patients with PPS affects health outcomes and service costs.

  3. Psychopharmacological interventions (ie, antidepressants) have shown no or only small effects on alleviating PPS.

  4. GPs often feel helpless and ill-equipped to manage patients with PPS.

Research objectives

This paper presents a study protocol for the Persistent Physical Symptoms Reduction Intervention: a System Change and Evaluation in Primary Care (PRINCE Primary) trial, which aims to assess the acceptability and feasibility of an integrated care approach in managing adult patients with PPS in primary care. Commissioning Support for London piloted an integrated service model for PPS, which largely focused on commissioning and cost saving.27 We will build on this pilot study by

  1. Assessing the feasibility of trialling a new integrated approach towards the management of patients in primary care, using robust methods, namely a cluster randomised waiting list, controlled trial.

  2. Estimating the intracluster correlation coefficient for potential outcome measures for cluster effects in a sample size calculation.

  3. Measuring patient satisfaction and patient-reported outcomes.

  4. Including a broad range of patient groups in primary care, including those with non-cardiac chest pain, dizziness and fibromyalgia.

  5. Identifying suitable primary outcome measures for a future trial evaluation.

Methods and analysis

Study design

Two arm cluster randomised waiting list, controlled trial.

Method

Approximately 240 patients with PPS will be recruited from 8 to 12 GP practices. These GP practices will be randomised to either ‘integrated GP care plus treatment as usual’ or waiting list control. GP practices randomised to integrated GP care plus treatment as usual will include (1) GP training in cognitive behavioural techniques, (2) GP supervision, (3) audio visual material for GPs and (4) self-help materials for participants. GP practices randomised to the waiting list control arm will continue with treatment as usual. The waiting list control arm will be crossed over at 28 weeks to give 4 weeks to collect measures. This will not be part of the RCT but will contribute to a separate long-term follow-up. A selection of feasibility parameters will be investigated prerandomisation. In addition, to identify suitable primary and secondary outcomes for future trial evaluations measures will be completed at 12 and 24 weeks. GPs who attend the offer of GP training will complete measures pre and post GP training.

Setting

GP practices and participants will be recruited from South London, England. GP training will take place at GP practices. Training will be delivered by clinicians based within King’s Health Partners.

Study population

GP practices/GPs

GP practices within South London which fulfil the following eligibility criteria will be recruited into the study.

  1. At least 50% of GPs within the practice express an interest in completing the training workshop.

  2. The practice manager, partner or other authorised individual is able to give consent for the practice to take part in the study.

  3. The practice is not at risk of closure within the next year.

Patients

Patients who fit the eligibility criteria will be invited to take part in the study. Patients will be considered eligible for inclusion in this study if they fulfil all the following criteria;

  1. Have a PPS (which is medically unexplained).

  2. Are ≥18 and ≤65 years old.

  3. Are registered with a GP practice in South London that has consented to taking part in PRINCE Primary.

  4. Have had six or more consultations in the last year (not necessarily for the same symptom or directly related to PPS).

  5. Have given written informed consent, provided baseline data before randomisation and can speak and read English at a level adequate for participation in the trial.

Patients will be excluded from the study if the patient has

  1. Active psychosis.

  2. Drug or alcohol addiction as indicated in the patient’s medical notes.

  3. Current benzodiazepine use exceeding the equivalent of 10 mg diazepam per day.

  4. Had any psychotherapy treatment within the last year (not inclusive of general visits from community psychiatric teams).

  5. Dissociative seizures.

  6. If they are at imminent risk of self-harm, after psychiatric/psychological assessment.

  7. Taking part in the PRINCE Secondary study or the Assessing Cognitive behavioural Therapy in Irritable Bowel (ACTIB) study.28

Recruitment

GP practice recruitment

Invitation letters will be sent out to GP practices located in South London. If a GP practice is interested, it will be asked to contact the research team for further information. GP practices that fit the eligibility criteria will be enrolled onto the study after providing consent to participate.

Patient recruitment

GP informatics (ie, EMIS Web) will be used to identify potential patients with PPS from GP practices that agreed to participate in the study. Prior to the study, the trial team liaised with GPs to ensure that the search criterion intended to be uploaded onto EMIS Web included a range of PPS as well as incorporating elements of the trial’s eligibility criteria. For those patients identified in the search, the GP practice administration team will send information packs regarding the study and patients will be asked to reply to say whether they are interested or not interested in being contacted by the research team. Patients who express an interest will be contacted.

Study procedure

Patients who give their consent to be contacted will be further screened and checked for eligibility by the research team. If the research team is unsure about their diagnosis, they will contact their GP and ask for confirmation. To formally enrol, patients will be required to complete and return a signed consent form. Once consent is obtained, a baseline questionnaire pack will be sent to participants 4 weeks prior to a prespecified randomisation date. If participants complete the questionnaire pack before this date they will be fully eligible to take part in the study. Participants will be fully informed that if they do not complete the baseline pack before the randomisation date they will not be able to participate in the study. GP practices will be randomised on the prespecified date to one of two arms: integrated GP care plus treatment as usual or waiting list control (please see figure 1 and section on planned intervention for more details). Participants of GP practices randomised to integrated GP care plus treatment as usual should be offered the self-help material within 1 week of randomisation and GP’s should be offered the training within 2 weeks of randomisation. GP practices randomised to the waiting list control arm will continue with treatment as usual until they are crossed over at 28 weeks. Based on these timeframes, a training date for all GP practices will be scheduled in advance. However, GP practices will be fully informed that the GP training session is dependent on the randomisation outcome, that is, only GP practices randomised to integrated GP care will be offered the GP training. Once randomisation is completed both GP practices and participants will be informed of the outcome and this will be week 0 and considered the anchor point for this trial for all the participants. Measures will subsequently be taken at 12 and 24 weeks.

Figure 1.

Figure 1

Flow diagram of the study procedure about here. GP, general practitioner; R&D, Research and Development; RCT, randomised controlled trial.

The recruitment and study procedures will enable us to investigate a selection of feasibility parameters prerandomisation and identify suitable primary and secondary outcomes for future trial evaluations. See figure 1 for a flow diagram showing the study procedure.

Randomisation

Randomisation of the GP practice clusters will take place following recruitment and baseline assessments of patients within each GP practice. The randomisation method will be stratified randomisation at the level of the cluster (ie, GP practice). The randomisation will be stratified by size of GP practice (≤6000 registered patients or >6000 registered patients). GP practice randomisation will occur in pairs; two GP practices will be randomised at the same time with one being randomised to the waiting list control and the other being randomised to integrated GP care plus treatment as usual. Within strata (large or small practices) blocking is used to ensure that numbers allocated to either trial arm balance after each block. To avoid being able to predict the allocation of a GP practice, practices are randomised as pairs rather than sequentially. This ensures that forthcoming allocations cannot be predicted. Participants will have 4 weeks prior to randomisation to complete the baseline questionnaire pack. GP practice randomisation will be coordinated by an independent randomisation service at the United Kingdom Clinical Research Collaboration (UKCRC) registered King’s Clinical Trials Unit (KCTU).

Blinding

Patients and GPs will not be blind to treatment allocation due to the nature of the trial (ie, therapy trial). The trial team member responsible for treatment allocation will be unblind. All outcome data are based on self-report and will be collected either by post or email. The research assistant(s) responsible for contacting participants who have not returned or completed follow-up questionnaires will be unblind. Moreover, the Data Monitoring and Ethics Committee (DMEC) research workers and trial statisticians will remain blind to treatment allocation. If unblinding is deemed to be necessary, the trial manager will use the system for emergency unblinding through the DMEC.

Planned intervention: integrated GP care plus treatment as usual

Our proposal seeks to develop new care pathways for patients with PPS.

The intervention integrated GP care plus treatment as usual will include:

  1. GP training in utilising cognitive behavioural skills during 10 min consultations.

  2. GP supervision.

  3. Audio visual and written materials/guidelines for GP’s.

  4. Written self-help materials for participants.

  5. Animation to illustrate the approach.

  6. Integrated case management discussion prior to secondary care referral. GPs will be encouraged to consult with a colleague before making a referral.

GP training

GP training will be delivered at GP practices by clinicians based within King’s Health Partners. To inform our decision about length of training, we discussed options with the GP’s and offered them anything from 1 hour to 1 day training in behaviour change skills. Most reported that they could spare up to 90 min as a group given their other commitments. For this reason, this is what we settled on. The session will involve a lecture, a role-play demonstrating engagement of a patient in a dialogue which focuses on a behaviour change technique and discussion. The specific content of the session will include background information about PPS and a three systems model of understanding how symptoms might be perpetuated regardless of cause. The link between symptoms, cognitions and behaviour will be described. The emphasis will be on engagement skills and behaviour change interventions, not cognitive re-structuring, as this is more realistic for GP’s with limited time. More specifically, we will focus on techniques that improve sleep routines and the uptake of meaningful activities. In addition, we will demonstrate ways of negotiating the setting of goals that the individual values, as homework. We will ask GP’s to use these skills and techniques in their consultations. We will not be encouraging the GP to see the participants for additional consultations. GPs will therefore use the approach during routine rather than study-specific consultations. To ensure that GPs are aware of which participants are taking part in PRINCE Primary we will upload a file note on the GP practice database for every patient who participates. This means that if a participant has an appointment, the GP will be aware that they are participating in this study. GPs will be provided with study-specific guidance on how to change the nature of consultations. Guidance notes and supporting manuals/documentation will be written which are potentially sustainable and suitable for use in other NHS settings. Information will be tailored to the needs of the patient and will be focused on a range of clinical conditions. Examples include low back pain, dizziness and headaches.

A list of helpful responses in the consultation with patients will be provided. The training will be assessed (before and after) in terms of knowledge of PPS and confidence in diagnosing and managing these symptoms. Knowledge will be assessed via 10 true and false questions referring to the content of the training. GPs will also be asked to rate their confidence in working with patients with persistent symptoms by responding to a series of prespecified questions, using a Likert scale ranging from 1 (not at all confident) to 7 (very confident). Satisfaction with training will be assessed after the training. Open-ended questions will be used to elicit feedback about the workshops. Optional supervision (individual face-to-face, Skype/phone and/or group supervision) will be provided to GPs who request additional support. We will assess the uptake of this. Hand-outs will be available for GPs to give to participants. These will be reviewed for ease of reading by service users before the trial starts.

To summarise we have drawn on Lee David’s approach to GP education29 and our training will include:

  1. How to make use of the cognitive behavioural model in their consultations.

  2. How to overcome barriers to using this approach.

  3. How to develop their consultation skills.

  4. How to use a three systems model to examine relationships between symptoms, thoughts and behaviour.

  5. How to set an agenda and homework.

  6. How to develop a partnership.

  7. How to set some behavioural goals.

  8. How to facilitate the patient in problem solving.

As this intervention does not encourage extra consultations, we recruited frequent attenders based on the likelihood that they are more likely to visit their GP. We will also send participants booklets as we cannot be certain that they will visit their GP after GP training has taken place (ie, we are not just providing GPs with materials we are also providing self-help materials for participants).

Participant information booklets

Participants of GP practices randomised to integrated GP care plus treatment as usual will be offered a series of booklets based on cognitive behavioural principles via the post. These include (1) an introduction to PPS, (2) how to juggle activities, (3) improving sleep, (4) living with uncertainty, (5) emotional well-being and (6) goal setting. Participants will also be sent symptom booklets that include information about their primary symptoms. They will also have access to an animation describing a patient’s experience with chronic pain, via a website set up specifically for the PRINCE Primary trial.

Waiting list control: treatment as usual

GP practices randomised to the waiting list control will not be offered ‘integrated GP care’. Participants of GP practices randomised to the waiting list control arm will continue with treatment as usual. Treatment as usual is defined as the continuation of standard GP medical care for PPS, including usual GP follow-up and pharmacological treatment. The GP practices in the waiting list control arm will be crossed over and offered integrated GP care plus treatment as usual. The cross over will be at 28 weeks to give 4 weeks to collect measures. However, this will not be part of the RCT.

Feasibility parameters, measures and data collection time-points

The aim of this study is to assess the feasibility of conducting a future evaluation trial to assess a new systems approach to PPS in general practice. Tables 1 and 2 provide an overview of data collection time-points. Based on the National Institute for Health Research’s (NIHR) definition of a feasibility study,30 the PRINCE Primary trial will assess the following feasibility parameters:

Table 1.

Overview of participant assessment moments and outcome measurements

Instrument Pre randomisation Baseline 12 weeks 24 weeks
Feasibility parameters
 Interest of patients to be contacted about the study x
 Rate of eligible trial participants x
 Willingness of patients to consent to participate in PRINCE Primary
 Willingness of participants to complete baseline measures before randomisation x
 Participants follow-up rates to questionnaires per group x x
Measures to identify suitable primary outcomes
 Psychosocial functioning WASAS x x x
 Physical symptoms PHQ-15 x x x
 Psychological distress PHQ-9 x x x
 Global outcome CGI x x
 Service use CSRI and EQ-5D-5L x x
Potential mediators
 Treatment outcome CBRQ x x x

CBRQ, Cognitive Behavioural Responses Questionnaire; CGI, Clinical Global Impression; CSRI, Client Service Receipt Inventory; EQ-5D-5L, EuroQol 5 Level; PHQ 9, Patient Health Questionnaire 9; PHQ-15, Patient Health Questionnaire 15; PRINCE Primary, Persistent Physical Symptoms Reduction Intervention: a System Change and Evaluation in Primary Care; WSAS, Work and Social Adjustment Scale.

Table 2.

Overview of GP’s/GP practices assessment moments and outcome measurements

Outcomes Instrument Prerandomisation Pre-training Post-training
Feasibility parameters
 Willingness of GP practices to be contacted about PRINCE Primary x
 Willingness of GP practices to consent and be randomised x
 Availability of data needed and the usefulness and limitations of the general practice databases x
 Interest of GPs to attend the GP training (intervention arm only) x
GP training outcomes
 Knowledge and confidence Self-report x x

GPs, general practitioners; PRINCE Primary, Persistent Physical Symptoms Reduction Intervention: a System Change Evaluation in Primary Care.

  1. Feasibility parameters:
    1. Willingness of GP practices to be contacted about PRINCE Primary (number of GP practices responding out of GP practices approached).
    2. Willingness of GP practices to consent and be randomised (number of GP practices consenting to participate out of GP practices that responded with an interest to participate).
    3. Availability of data needed and the usefulness and limitations of the general practice databases (number of patients identified using GP informatics (search algorithm) out of patients registered with the GP practice).
    4. Interest of patients to be contacted about the study (number of patients responding out of patients identified via the search algorithm).
    5. Rate of eligible participants (number of patients meeting the eligibility criteria out of patients who responded with an interest to participate).
    6. Willingness of patients to consent to participate in PRINCE Primary (number of patients consenting to participate out of patients who met the eligibility criteria).
    7. Willingness of participants to complete baseline measures before randomisation (number of participants sending baseline forms back out of participants that provided consent).
    8. Interest of GPs to attend the GP training (intervention arm only): (number of GPs attending the GP training out of number of GPs working at the GP practices offering training).
    9. Participants follow-up rates to questionnaires per group (number of participants completing questionnaire packs at 12 and 24 weeks, respectively, out participants randomised).
  2. Measures to identify suitable primary and secondary outcomes for future trial evaluations:
    1. Psychosocial functioning: we will use the 5-item Work and Social Adjustment Scale (WSAS)31 to measure patients’ own perceptions of the impact of PPS on their functioning in terms of work, home management, social leisure and private leisure activities, and close relationships.
    2. Physical symptoms: we will measure the number of symptoms with the PHQ-1532 derived from the Patient Health Questionnaire which reflects DSM-IV diagnoses.
    3. Psychological distress: mood will be assessed using the 9-item PHQ.33
    4. Global outcome: the adapted Clinical Global Impression34 change score yields a self-rated global measure of change and has been used in previous trials of CBT interventions.
    5. Satisfaction: we will measure patients’ self-rated satisfaction of the intervention via qualitative interviews (ie, thematic analysis).
    6. Cost effectiveness (service): health service use (including hospital attendances and admissions, GP contacts), informal care, lost work time and financial benefits will be measured via the self-report Client Service Receipt Inventory35 and the EuroQol-5 Dimension (EQ-5D).36 GP medical records will be used as an objective measure to assess the number of consultations and medical examinations patients received.
  3. Process measures: the Cognitive Behavioural Responses Questionnaire37 will be used to assess potential mechanisms of change.

  4. GPs’ knowledge and confidence: GP training will be evaluated for knowledge, skills and confidence using self-reported measures. GPs who attend the offer of GP training will complete this pre and post GP training.

Qualitative component

Participants who consented to participate in a semistructured interview (~45 min) will be contacted after 28 weeks to give 4 weeks’ to provide self-report measures. If the participant is still interested a time and date will be arranged to conduct the interview either via telephone or face to face.

The aim of the qualitative interview will be to discuss the participant’s experiences and opinions of the intervention, in particular (1) what they thought of the intervention, (2) how useful they found the resources and (3) whether they perceived any differences in treatment approach during their GP consultation. Interviews will be audio recorded and transcribed by members of the research team using thematic analysis.

GP’s will also be invited to participate in a semistructured interview (group/individual). The aim of the interview will be to discuss GPs experiences of implementing the intervention as well as discussing any suggestions on how the intervention could be improved. Interviews will be audio recorded and transcribed by members of the research team using thematic analysis.

Data collection plan: retention

Retention rates will be maximised by providing participants with the option of completing questionnaires via post, telephone or email. Furthermore, thank you cards will also be sent at various stages of the trial.

Proposed sample size

A selection of 8–12 GP practices stratified by size (<6000 or >6000) (clusters) will be recruited, with an expected patient sample size of 240. This would mean that 120 patients will receive the integrated GP care by 24 weeks and will complete measures. As this trial is a feasibility study, no formal power calculation has been carried out. Instead, the number of GP practices was chosen, such that we have sufficient replicates to estimate feasibility parameters at the practice level.

Data management

Data will be collected on paper source data worksheets. Data will then be entered onto the InferMed MACRO online data entry system, on a study-specific database designed and hosted at the KCTU. The system is compliant with Good Clinical Practice and Title 21 Part 11 of the Code of Federal Regulations (CFR) that establishes the United States Food and Drug Administration (FDA) regulations on electronic records and electronic signatures (FDA 21 CFR Part 11). Data exports will be provided to the trial statistician on request.

The web-based randomisation system will maintain an accurate record of randomisations and data can be exported from this system for reports. Postrandomisation data can be readily extracted from the MACRO trial database for the preparation of DMEC reports and a front-end search function is available to support data checking and cleaning.

Central data entry and data cleaning will be undertaken by a designated research worker. Major issues in staff training or data quality will be raised with the trial manager, who will perform source data checking against the data collection forms. Discrepancies can be raised in the system for resolution by site staff. Source data verification will be recorded on the system and any changes to data subsequent to verification will automatically generate an alert in the system. Individual user access to the InferMed MACRO system will be co-ordinated via the trial manager, who will submit requests to the KCTU. No direct requests from sites will be accepted.

The chief investigator will act as custodian for the trial data. The following guidelines will be strictly adhered to (1) patient data will be pseudo-anonymised (allocation of a unique personal identification number) and (2) all pseudo-anonymised data will be stored on a password-protected computer. All trial data will be stored in line with the General Data Protection Regulation and archived in line with sponsor requirements. Consent forms and other paper records will be stored in swipe-card accessed offices in locked filing cabinets.

Statistical analysis

A Consolidated Standards of Reporting Trials (CONSORT) diagram will be constructed including various feasibility parameters: the number of eligible practices and patients, number of practices and patients agreeing to enter the trial, number of GP practices randomised, then by treatment arm: the number of patients continuing through the trial, the number withdrawing from the study at various time-points. The feasibility parameters will be estimated using the CONSORT diagram and will be presented as proportions accompanied by 95% CIs to provide a measure of estimator precision.

Inferential analyses will be used to estimate intervention effects in terms of outcome variables. The formal statistical analyses will estimate the difference in mean outcomes between patients from GP practices randomised to integrated GP care plus treatment as usual and waiting list control by intention to treat at 12 and 24 weeks’ follow-up. We will provide estimates of trial arm differences with associated 95% CIs and will also translate these effects into standardised effects sizes to enable comparisons across measures and time-points. This information can help the planning of a future evaluation trial by providing guidance as to promising outcome measures and likely effect sizes. No formal significance testing will be carried out. Standardised effect sizes will be calculated by dividing estimated mean differences by the respective baseline SDs. Analysis will be based on the intention-to-treat principle and we plan to use linear mixed modelling with maximum likelihood estimation. A random effect for participant will be entered in the model to account for correlations between repeated measures. Additionally, a random effect for cluster will also be included to allow for correlations between patients within a practice. Bias in estimates of trial arm differences will be avoided by use of randomisation and blinding of the outcome assessors.

All efforts will be made to avoid missing baseline data (ie, requiring completion of baseline data before randomisation), but missing values will be imputed according to current recommendations.38 Missing scale item data will be handled as per questionnaire specific recommendations. We will aim to support participating practices to minimise loss to follow-up by encouraging a number of approaches: adopting other evidence-based procedures for recruiting and maintaining participation in the study and encouraging patients to return outcome measures (eg, contacting people before sending out questionnaires, sending personalised cover letters using colour printing and keeping measures short in terms of completion time).39 40

Health economics

The main objective of the health economic aspect of the feasibility study is to assess what services are being used and this will inform the collection of service use data in a full trial.

Data monitoring

The Programme Management Group will be responsible for ensuring the appropriate, effective and timely implementation of the study. The DMEC and Programme Steering Committee (PSC) have been formed as independent committees to oversee the study. The committees will be responsible for the independent oversight of the progress of the trial, the investigation of serious adverse events (SAEs) and for determination of trial progress.

Procedures for recording and reporting SAEs

Adverse events are any clinical change, disease or disorder experienced by the participant during their participation in the trial, whether or not considered related to the use of treatments being studied in the trial. Any SAEs, serious adverse reaction (SAR) or suspected unexpected serious adverse reaction will be recorded by the research worker at 12 and 24 weeks’ postbaseline. An adverse event is defined as serious if it:

  1. Results in death.

  2. Is life-threatening (with an immediate not hypothetical risk of death at the time of the event).

  3. Requires hospitalisation (but not including elective hospitalisation for pre-existing condition).

  4. Results in a new persistent or new significant disability or incapacity defined as:
    1. Severe=a significant deterioration in the participant’s ability to carry out their important activities of daily living (eg, employed person no longer able to work, caregiver no longer able to give care, ambulant participant becoming bed bound).
    2. Persistent=4 weeks’ continuous duration.
  5. Any other important medical condition which, though not included in the above, may jeopardise the participant and may require medical or surgical intervention to prevent one of the outcomes listed.

  6. Any new episode of deliberate self-harm.

We will require two clinically trained scrutinisers to review all SAEs and reactions, independently from the trial team. They will be blind to the treatment group and will be required to establish whether events reported constituted SAEs. The scrutinisers would then be unblinded to treatment allocation so that they can then establish whether any SAEs were SARs to the system approach.

Stopping rules

The trial may be prematurely discontinued by the sponsor or chief investigator on the basis of new safety information or for other reasons given by the DMEC/PSC or Research Ethics Committee (REC) concerned. The trial may also be prematurely discontinued due to lack of recruitment or on advice from the PSC (if applicable), who will advise on whether to continue or discontinue the study and make a recommendation to the sponsor. If the study is prematurely discontinued, active participants will be informed and no further participant data will be collected.

Auditing

The investigator(s) will permit trial-related monitoring, audits and REC review by providing the sponsor(s) and REC direct access to source data and other documents. Monitoring of this study will be to ensure compliance with Good Clinical Practice and scientific integrity will be managed by the study team. The study will be compliant with the research governance framework and MRC Good Clinical Practice Guideline.41 We will institute a rigorous programme of quality control. The trial manager will be based at the Institute of Psychiatry, Psychology and Neuroscience, King’s College London and line-managed and supervised by the chief investigator. The trial manager will prepare study specific standard operating procedures (SOPs) for the study. The trial manager will supervise a designated research worker to undertake data management/cleaning, so that they can provide regular reports on data quality to the chief investigator and the other coapplicants. Quality assurance checks will be undertaken by the trial team to monitor the level of missing data and timeliness of data entry and check for illogical or inconsistent data. The trial manager will monitor data collection procedures, ensure that study data entry procedures are followed and undertake source data verification against the paper data collection forms. The trial statisticians will be affiliated with KCTU, and will be responsible for producing DMEC reports, drafting of the statistical analysis plan and for carrying out primary analyses. We will ask the DMEC to take on this role of monitoring participating GP practices at recruitment. Our KCTU has SOPs that guide the trial statistician’s reporting to the DMEC.

Patient and public involvement

In the early stages of this study, we developed links with key stakeholders including patients with PPS, commissioners and a national charity. The first meeting entailed an open discussion to ensure that the trial was not burdensome for patients and to also gain a better understanding of what GP’s felt was possible. We continue to involve these stakeholders during the study. Patients were not involved with the recruitment of participants into the study. Peer-reviewed results will be disseminated to participating GP practices and study participants.

Ethics and dissemination

Ethical and research governance approval

This feasibility study is funded by Guy’s and St Thomas’ Charity. Ethical approval has been granted by the Camberwell St Giles Ethics Committee (Reference 15/LO/0057) and King’s College London and South London and Maudsley (SLaM) Hospital will act as sponsors for the research. The study will be managed via a central co-ordinating team. The study was also submitted to NHS Clinical Research Network, South London for research governance and approval was received on 13 April 2015.

Confidentiality

All patient data will be pseudo-anonymised. All pseudo-anonymised data will be stored on a password-protected computer. All trial data will be stored in line with the Data Protection Act. Consent forms and other paper records will be stored in locked filing cabinets within swipe-card access offices.

Insurance/indemnity

Standard procedures for insurance of University and NHS employees and sites, and NHS patients will apply.

Dissemination policy

We anticipate that there will be different target audiences for our dissemination activities:

  1. Professionals: we will disseminate findings to healthcare professionals (eg, rheumatologists/neurologists/cardiologists, psychiatrists, GPs, nurses, psychologists, CBT therapists) via papers in high impact peer-reviewed journals and presentations at local, national and international scientific meetings. We will also disseminate findings via the recently established UK Functional Neurological Symptoms group. Findings will also be presented at the British Association of Behavioural and Cognitive Psychotherapies conference and GP conferences within the UK. We will make available written materials and offer training workshops for other NHS clinical services, and at meetings if appropriate.

  2. Service planners and commissioners: if our study is successful, we anticipate that our findings will have relevance for the provision of care for patients with PPS, and therefore we will disseminate our findings to those who plan and commission care for people with PPS.

  3. Voluntary sector: we will make our findings available to PPS charities, which already disseminate information on PPS. We will offer summaries of our findings to websites for the public which already provide information on PPS and to charities offering information on other MUS but not currently PPS.

Discussion

This cluster randomised waiting list, controlled trial aims to investigate the feasibility of an integrated GP care approach plus treatment as usual for patients with PPS in primary care versus waiting list control. The intervention primarily operates at the GP practice (cluster) level and hence a cluster randomised trial design is employed. This means GP practices randomised to integrated GP care plus treatment as usual will include (1) GP training in cognitive behavioural skills, (2) GP supervision, (3) audio visual material for GPs and (4) self-help materials for participants. GP practices randomised to the waiting list control arm will continue with treatment as usual (ie, GP practices will not be offered the intervention initially but will be crossed over and offered the intervention at 28 weeks to give 4 weeks’ time to collect measures). Cluster randomised trials can be subject to selection bias when patients are recruited after allocation of the intervention to the clusters (GP practices). Hence, our design ensures that patients are recruited before their GP practice is randomised so their decision to take part in the trial cannot be informed by knowledge of whether the GP practice receives the intervention. To avoid participants having to wait a long time only those who frequently attended their GP will be eligible to participate in this study (please see eligibility criteria). Patients will not be dropped if they are not seen by a trained GP as the integrated care approach also includes self-help materials for patients. This study aims to mimic a real-life setting in which a patient may not see the same GP on a regular basis.

Given the prevalence of PPS and their costs to health services, there is an urgent need to develop easily accessible and affordable treatments for this patient group. Although previous studies have examined the efficacy of CBT-based approaches in treating patients with PPS, most studies were conducted in secondary care and focused on specific conditions.14 15 Taken together, evidence suggests positive effects of CBT-based group intervention on PPS. However, group interventions and bringing in secondary care healthcare professionals may not always be feasible and time efficient. The present trial attempts to address these challenges by evaluating the feasibility of training GPs in delivering behaviour change interventions in a 10 min consultation and providing patients with self-help materials.

There are limitations to this study. It is unlikely that all GPs will attend all of the training. However, we will organise the training at times that suit as many GPs as possible. We cannot be sure in any case that GPs will use the skills they may have acquired during the training. GPs consultations will not be recorded as GP’s themselves feel it is too burdensome. In order to mitigate these shortcomings, we will conduct semistructured qualitative interviews with a random selection of patients to assess whether they had seen a GP and whether they felt that a behaviour change intervention had been delivered.

In conclusion, this RCT aims to assess the feasibility of an integrated GP approach for treating patients with PPS. Based on the results of the study, a fully powered RCT will be considered in order to assess the clinical effectiveness of this approach in changing identified health-related outcomes.

Supplementary Material

Reviewer comments
Author's manuscript

Acknowledgments

DMEC: Duncan Dymond (chair), Helen Poole, Anisur Rahman, Rebecca Walwyn. PSC: Alan Carson (chair), Niels Detert, Rebecca Liu, Ruth Pickering. Patient representative: Lindsay Gibbs. PRINCE Primary Trial Team: all authors and Katie Watts, Richard Turner, Alisia Carnemolla, Jennifer Robertson, Shinal Patel, Paige Fisher-Smith and Abigale Childs. PRINCE Trial CBT Therapists: Claire Willis and Fabio Simiao. PRINCE Trial Clinical Psychologist: Dr David McCormack.

Footnotes

Contributors: TC, RM-M, MA, PM, MHotopf, AD and SL were involved in the design of the study and were coapplicants for funding. TC leads the grant application and is chief investigator. TC, MHusain, MP, MA, NF and RM-M developed the intervention (ie, integrated GP care). PM and IM lead on the Health Economic evaluation. SL and KJ lead on statistical analysis. NF and PF lead on the qualitative component. All the authors read and approved the final manuscript.

Funding: The study is funded by Guy’s and St Thomas’ Charity (Reference MAJ130202). Sponsor information: King’s College London; South London and Maudsley NHS Foundation Trust. TC, RM-M, MHotopf, SL, AD acknowledge the financial support of the Department of Health via the National Institute for Health Research (NIHR) Specialist Biomedical Research Centre for Mental Health award to the South London and Maudsley NHS Foundation Trust (SLaM) and the Institute of Psychiatry at King’s College London.

Disclaimer: The views expressed in this article are those of the authors and not necessarily those of the NHS, the NIHR or the Department of Health.

Competing interests: MHotopf reported grants from Innovative Medicines Initiative and European Federation of Pharmaceutical Industries and Associations, outside the submitted work. In addition, TC and RM-M declared the following; organisational financial interests: TC received ad hoc payments for conducting workshops on evidence-based treatments for persistent physical symptoms. TC has received grants from NIHR programme grants, HTA, RfPB, Guy’s and St Thomas Charity, King’s Challenge Fund, Muscular Dystrophy, Multiple Sclerosis Society. King’s College London received payment from Taylor and Francis for editorial role. RM-M currently receives grant funding from NIHR programme grants, Breast Cancer Now, Crohn’s and Colitis UK, and National MS Society. In the previous 36 months, RM-M received funding from MS society UK and NIHR HTA. In 2019, payments from Taylor and Francis to King’s College London for RMM’s role as Editor of Health Psychology Review. Payments for adhoc lectures and workshops on long-term conditions. Personal financial interests: TC is the author of several self-help books on chronic fatigue and received royalties in the past. TC received expenses and ad hoc payment for role as external examiner NUI Galway and Waterford Institute of Technology. TC received expenses for keynote speeches at UK Society for Behavioural Medicine, BABCP Conferences (travel and accommodation). TC received ad hoc payments for conducting workshops on evidence-based treatments for persistent physical symptoms. RM-M received payments for her role as National Advisor to NHS England for Increasing Access to Psychological Therapies (IAPT) for people with long-term conditions from 2011 to 2016. RM-M received ad hoc payments for workshop training in IBS in 2017 and 2018 and this will continue in 2019. RM-M receives ad hoc consultancy payments from Mahana therapeutics and this is likely to continue in 2019. RM-M has stock options in Mahana therapeutics. RM-M received travel expenses for keynote speech to Internal Society of Behavioural Medicine. In 2019, RM-M will be a keynote speaker for Association for Researchers in Psychology and Health (the Netherlands), European Health Psychology Society Annual Conference (Croatia) and the 9th World Congress of Behavioural and Cognitive Therapies (Germany). Travel and accommodation expenses will be reimbursed.

Ethics approval: Camberwell St Giles Ethics Committee REC 15/LO/0057.

Provenance and peer review: Not commissioned; externally peer reviewed.

Collaborators: PRINCE Primary Trial Team.

Patient consent for publication: Not required.

References

  • 1. Deary V, Chalder T, Sharpe M. The cognitive behavioural model of medically unexplained symptoms: a theoretical and empirical review. Clin Psychol Rev 2007;27:781–97. 10.1016/j.cpr.2007.07.002 [DOI] [PubMed] [Google Scholar]
  • 2. Haller H, Cramer H, Lauche R, et al. Somatoform disorders and medically unexplained symptoms in primary care: a systematic review and meta-analysis of prevalence. Deutsches Ärzteblatt International 2015;112:279. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3. Swanson LM, Hamilton JC, Feldman MD. Physician-based estimates of medically unexplained symptoms: a comparison of four case definitions. Fam Pract 2010;27:487–93. 10.1093/fampra/cmq051 [DOI] [PubMed] [Google Scholar]
  • 4. Barsky AJ, Orav EJ, Bates DW. Somatization increases medical utilization and costs independent of psychiatric and medical comorbidity. Arch Gen Psychiatry 2005;62:903–10. 10.1001/archpsyc.62.8.903 [DOI] [PubMed] [Google Scholar]
  • 5. Nimnuan C, Hotopf M, Wessely S. Medically unexplained symptoms: an epidemiological study in seven specialities. J Psychosom Res 2001;51 361–7. [DOI] [PubMed] [Google Scholar]
  • 6. Dirkzwager AJ, Verhaak PF. Patients with persistent medically unexplained symptoms in general practice: characteristics and quality of care. BMC Fam Pract 2007;8:33 10.1186/1471-2296-8-33 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7. Henningsen P, Zimmermann T, Sattel H. Medically unexplained physical symptoms, anxiety, and depression: a meta-analytic review. Psychosom Med 2003;65:528–33. [DOI] [PubMed] [Google Scholar]
  • 8. Smith RC, Gardiner JC, Lyles JS, et al. Exploration of DSM-IV criteria in primary care patients with medically unexplained symptoms. Psychosom Med 2005;67:123–9. 10.1097/01.psy.0000149279.10978.3e [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9. Smith RC, Lyles JS, Gardiner JC, et al. Primary care clinicians treat patients with medically unexplained symptoms: a randomized controlled trial. J Gen Intern Med 2006;21:671–7. 10.1111/j.1525-1497.2006.00460.x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10. Bermingham SL, Cohen A, Hague J, et al. The cost of somatisation among the working-age population in England for the year 2008-2009. Ment Health Fam Med 2010;7:71. [PMC free article] [PubMed] [Google Scholar]
  • 11. Marks EM, Hunter MS. Medically Unexplained Symptoms: an acceptable term? Br J Pain 2015;9:109–14. 10.1177/2049463714535372 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12. Picariello F, Ali S, Moss-Morris R, et al. The most popular terms for medically unexplained symptoms: the views of CFS patients. J Psychosom Res 2015;78:420–6. 10.1016/j.jpsychores.2015.02.013 [DOI] [PubMed] [Google Scholar]
  • 13. Association AP. Diagnostic and statistical manual of mental disorders (DSM-5): American Psychiatric Pub, 2013. [DOI] [PubMed] [Google Scholar]
  • 14. van Dessel N, den Boeft M, van der Wouden JC, et al. Non-pharmacological interventions for somatoform disorders and medically unexplained physical symptoms (MUPS) in adults. Cochrane Database Syst Rev 2014:CD011142 10.1002/14651858.CD011142.pub2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15. Kleinstäuber M, Witthöft M, Hiller W. Efficacy of short-term psychotherapy for multiple medically unexplained physical symptoms: a meta-analysis. Clin Psychol Rev 2011;31:146–60. 10.1016/j.cpr.2010.09.001 [DOI] [PubMed] [Google Scholar]
  • 16. Jonsbu E, Dammen T, Morken G, et al. Short-term cognitive behavioral therapy for non-cardiac chest pain and benign palpitations: a randomized controlled trial. J Psychosom Res 2011;70:117–23. 10.1016/j.jpsychores.2010.09.013 [DOI] [PubMed] [Google Scholar]
  • 17. Kisely SR, Campbell LA, Skerritt P, et al. Psychological interventions for symptomatic management of non-specific chest pain in patients with normal coronary anatomy. Cochrane Database Syst Rev 2010:CD004101 10.1002/14651858.CD004101.pub3 [DOI] [PubMed] [Google Scholar]
  • 18. Altayar O, Sharma V, Prokop LJ, et al. Psychological therapies in patients with irritable bowel syndrome: a systematic review and meta-analysis of randomized controlled trials. Gastroenterol Res Pract 2015;2015:1–19. 10.1155/2015/549308 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19. Kennedy TM, Chalder T, McCrone P, et al. Cognitive behavioural therapy in addition to antispasmodic therapy for irritable bowel syndrome in primary care: randomised controlled trial. Health Technol Assess 2006;10:iii-iv, ix-x, 1-67 10.3310/hta10190 [DOI] [PubMed] [Google Scholar]
  • 20. Reme SE, Stahl D, Kennedy T, et al. Mediators of change in cognitive behaviour therapy and mebeverine for irritable bowel syndrome. Psychol Med 2011;41:2669–79. 10.1017/S0033291711000328 [DOI] [PubMed] [Google Scholar]
  • 21. Peters AA, van Dorst E, Jellis B, Hermans J, et al. A randomized clinical trial to compare two different approaches in women with chronic pelvic pain. Obstet Gynecol 1991;77:740–4. [PubMed] [Google Scholar]
  • 22. Kleinstäuber M, Witthöft M, Steffanowski A, et al. Pharmacological interventions for somatoform disorders in adults. Cochrane Database Syst Rev 2014;32 10.1002/14651858.CD010628.pub2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23. Practitioners RCoG. Mental Health Toolkit, 2018. [Google Scholar]
  • 24. Burton C, Weller D, Marsden W, et al. A primary care Symptoms Clinic for patients with medically unexplained symptoms: pilot randomised trial. BMJ Open 2012;2:e000513 10.1136/bmjopen-2011-000513 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25. Salmon P, Peters S, Clifford R, et al. Why do general practitioners decline training to improve management of medically unexplained symptoms? J Gen Intern Med 2007;22:565–71. 10.1007/s11606-006-0094-z [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26. Johansen ML, Risor MB. What is the problem with medically unexplained symptoms for GPs? A meta-synthesis of qualitative studies. Patient Educ Couns 2017;100:647–54. 10.1016/j.pec.2016.11.015 [DOI] [PubMed] [Google Scholar]
  • 27. London CSf. Medically Unexplained Symptoms (MUS). Project implementation report. 2011. http://www.necn.nhs.uk/wp-content/uploads/2015/09/MUS-Project-Implementation-Report.pdf.
  • 28. Everitt H, Landau S, Little P, et al. Assessing Cognitive behavioural Therapy in Irritable Bowel (ACTIB): protocol for a randomised controlled trial of clinical-effectiveness and cost-effectiveness of therapist delivered cognitive behavioural therapy and web-based self-management in irritable bowel syndrome in adults. BMJ Open 2015;5:e008622 10.1136/bmjopen-2015-008622 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29. David L. Using CBT in general practice: the 10 minute consultation: Royal College of General Practitioners, 2006. [Google Scholar]
  • 30. Arain M, Campbell MJ, Cooper CL, et al. What is a pilot or feasibility study? A review of current practice and editorial policy. BMC Med Res Methodol 2010;10:67 10.1186/1471-2288-10-67 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31. Mundt JC, Marks IM, Shear MK, et al. The work and social adjustment scale: a simple measure of impairment in functioning. Br J Psychiatry 2002;180:461–4. 10.1192/bjp.180.5.461 [DOI] [PubMed] [Google Scholar]
  • 32. Kroenke K, Spitzer RL, Williams JB. The PHQ-15: validity of a new measure for evaluating the severity of somatic symptoms. Psychosom Med 2002;64:258–66. 10.1097/00006842-200203000-00008 [DOI] [PubMed] [Google Scholar]
  • 33. Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med 2001;16:606–13. 10.1046/j.1525-1497.2001.016009606.x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34. Guy W. Clinical Global Impressions (CGI) Scale Modified from: Rush J. et al Psychiatric Measures. Washington, DC: American Psychiatric Association, 2000. [Google Scholar]
  • 35. Beecham J, Knapp M. Costing psychiatric interventions. Measuring mental health needs 2001;2:200–24. [Google Scholar]
  • 36. Brooks R. EuroQol: the current state of play. Health Policy 1996;37:53–72. 10.1016/0168-8510(96)00822-6 [DOI] [PubMed] [Google Scholar]
  • 37. Moss-Morris R, Chalder T. Illness perceptions and levels of disability in patients with chronic fatigue syndrome and rheumatoid arthritis. J Psychosom Res 2003;55:305–8. 10.1016/S0022-3999(03)00013-8 [DOI] [PubMed] [Google Scholar]
  • 38. White PD, Goldsmith KA, Johnson AL, et al. Comparison of adaptive pacing therapy, cognitive behaviour therapy, graded exercise therapy, and specialist medical care for chronic fatigue syndrome (PACE): a randomised trial. Lancet 2011;377:823–36. 10.1016/S0140-6736(11)60096-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39. Edwards P, Roberts I, Clarke M, et al. Increasing response rates to postal questionnaires: systematic review. BMJ 2002;324:1183–83. 10.1136/bmj.324.7347.1183 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40. Treweek S, Mitchell E, Pitkethly M, et al. Strategies to improve recruitment to randomised controlled trials. Cochrane Database Syst Rev 2010;1:Mr000013 10.1002/14651858.MR000013.pub5 [DOI] [PubMed] [Google Scholar]
  • 41. MRC guidelines for management of global health trials Medical Research Council. 2017. [Available from: https://mrc.ukri.org/documents/pdf/guidelines-for-management-of-global-health-trials/ (Accessed 02 Jul 2018).

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Reviewer comments
Author's manuscript

Articles from BMJ Open are provided here courtesy of BMJ Publishing Group

RESOURCES