Skip to main content
PLOS One logoLink to PLOS One
. 2022 Sep 15;17(9):e0273030. doi: 10.1371/journal.pone.0273030

Exploring the feasibility of a network of organizations for pain rehabilitation: What are the lessons learned?

Cynthia Lamper 1,*, Ivan P J Huijnen 1,2,*, Mariëlle E A L Kroese 3, Albère J Köke 1,2, Gijs Brouwer 3, Dirk Ruwaard 3, Jeanine A M C F Verbunt 1,2
Editor: Jianhong Zhou4
PMCID: PMC9477302  PMID: 36107861

Abstract

Background and aims

Integration of care is lacking for chronic musculoskeletal pain patients. Network Pain Rehabilitation Limburg, a transmural health care network, has been designed to provide integrated rehabilitation care from a biopsychosocial perspective to improve patients’ levels of functioning. This feasibility study aims to provide insight into barriers and facilitators for the development, implementation, and transferability.

Methods

This study was conducted with a three-phase iterative and incremental design from October 2017 to October 2018. The network comprises two rehabilitation practices, and three local primary care networks, with a general practitioner together with, a mental health practice nurse, and a physiotherapist or exercise therapist. These stakeholders with a random sample of participating patients took part in evaluations, consisting of interviews, focus groups, and observations. Field notes and observations were recorded during meetings. The Consolidated Framework for Implementation Research guided data collection and analysis. Results were used to refine the next phase.

Results

According to health care professionals, guidelines and treatment protocols facilitate consistency and transparency in collaboration, biopsychosocial language, and treatment. One mentioned barrier is the stigmatization of chronic pain by the general population. In regular care, approaches are often more biomedical than biopsychosocial, causing patients to resist participating. The current organization of health care acts as a barrier, complicating implementation between and within practices. Health care professionals were enthusiastic about the iterative, bottom-up development. A critical mass of participating organizations is needed for proper implementation.

Conclusion

Network Pain Rehabilitation Limburg is feasible in daily practice if barriers are overcome and facilitators of development, implementation, and transferability are promoted. These findings will be used to refine Network Pain Rehabilitation Limburg. A large-scale process and effect evaluation will be performed. Our implementation strategies and results may assist other health care organizations aspiring to implement a transmural network using a similar model.

Trail registration

Registration number: NTR6654 or https://trialsearch.who.int/Trial2.aspx?TrialID=NTR6654.

Introduction

Nineteen percent of adults in Europe have moderate to severe chronic pain [1]. The most widely reported complaint is chronic musculoskeletal pain (CMP), representing a complex interaction of biopsychosocial components, varying in complexity between patients [2,3]. CMP can have a significant impact on patients’ daily activities and, therefore, rehabilitative treatments are needed [4]. Most patients with CMP have had this pain for more than two years [5]. Due to a high burden of disease and work absence in these patients, the direct and indirect costs of CMP are estimated at 20 billion euros in the Netherlands yearly [69]. While 60–74% of Dutch CMP patients receive treatment, 34–79% of these patients feel that this is inadequate [1,4,10,11]. Such patients continue seeking a solution for their CMP, resulting in high medical resource consumption by this group [12].

A possible explanation for the level of resource consumption is that the complexity of the patient’s pain problem does often not match the treatment delivered, resulting in over- or under-treatment [13]. This mismatch can be explained by three factors. Firstly, understanding of biopsychosocial treatment of CMP varies amongst health care professionals (HCPs), decision-makers, and the public. Secondly, clinical decision-making, classification of complexity, and referrals are based on medical history and clinical experience, with huge inter-physician variation. Although earlier studies have shown inter-rater reliability in classifying the complexity of pain problems by rehabilitation physicians (RPs) to be at least questionable, the use of objective measures by general practitioners (GPs) and RPs to diagnose and classify patients with complex problems is scarce [1417]. Thirdly, treatment approaches, including dosage and content, delivered through all types of care providers, are often not adequately tailored to the level of complexity of the pain problem [18]. Therefore, patients with CMP often do not receive the right care, at the right place, at the right time, as described in the National Care Standard for Chronic Pain, the Netherlands [6].

To overcome this problem, integrated transmural health care networks, including all health care settings, might have a beneficial role [19]. Integrated transmural care is what is described by the World Health Organization as ‘‘the management and delivery of health services so that clients receive a continuum of preventive and curative services, according to their needs over time and across different levels of the health system”[20]. It is most often directed towards bridging the gap between care providers in different levels of care, for example between primary and secondary care. The World Health Organization recommends networks in integrated transmural rehabilitation care as future developments [21].

The transmural Network Pain Rehabilitation Limburg (NPRL) was designed to implement rehabilitation care according to the National Care Standard for Chronic Pain in the province of Limburg in the Netherlands [6]. To overcome mismatches in current CMP rehabilitation care, NPRL has an unambiguous view: integrated matched care, biopsychosocial treatment protocols for primary, secondary and tertiary care, guidelines for referral and coordination, and a continuous focus on improvement of care. Matched care comprises identifying patients at higher risk. However, unlike stratified care, it tailors the intervention to the individual patient’s specific existing complaints and risk [22,23]. In NPRL, patients can be referred by their GP, a primary care physical therapist or the RP. In the Netherlands, patients can also visit a primary care therapist (e.g. physiotherapist or occupational therapist) directly without a referral. If patients enter the health care system in this way, therapists can screen the patient as to their suitability for treatment within NPRL. Treatment is offered, based on complexity profiles, by primary, secondary or tertiary care members of the NPRL. In order to develop and implement NPRL in daily care, a feasibility study was performed. Details of the protocol of this study are described elsewhere [24].

The aim of the feasibility study was to provide insight into barriers and facilitators for the development, implementation, and transferability of NPRL, and to provide insight into its perceived value and acceptability.

Methods

Study design

This feasibility study had an iterative and incremental design based on key principles of user-centred design [25]. It was conducted from October 2017 to October 2018 in the South-East region of the province of Limburg in the Netherlands. As NPRL is a complex intervention, the UK Medical Research Council (MRC) Framework was used as guidance for development (Phase 1), implementation (Phase 2), and transferability (Phase 3) of NPRL [26]. The barriers and facilitators that emerged during the evaluations of previous phases were used to refine elements of NPRL in the next phase. HCPs and patients actively participated in evaluations, leading to adjustments in daily health care practice.

Topic lists for individual interviews and focus group sessions were constructed, and the results were analysed deductively, in accordance with the Consolidated Framework for Implementation Research (CFIR), following a directed content analysis method [27]. This framework, published by Damschroder et al. (2009), is an overarching list of constructs to verify the design’s efficacy across multiple contexts when implementing a complex multi-component intervention such as NPRL, with rapid-cycle evaluation [27,28]. It consists of five major domains (intervention characteristics, outer setting, inner setting, characteristics of individuals, and process of implementation) with 39 underlying constructs and sub-constructs that can potentially influence implementation efforts. The study was reported using the COnsolidated criteria for REporting Qualitative research items (COREQ) [29].

Ethics and dissemination

Written and verbal informed consent was obtained from all patients and HCPs before the start of the interview or focus group. The verbal informed consent was recorded. Ethical approval for this study was granted by the Medical Ethics Committee Z, the Netherlands, METC 17-N-133. Dissemination includes publications and presentations at regional, national and international conferences.

Organization of care in Network Pain Rehabilitation Limburg

NPRL is described more extensively in Lamper et al. (2019) (a summery can be found in S1 File): it was developed by a project team consisting of the authors CL, IH, AK, JV and an advisory board consisting of interested HCPs [24]. The project team as well as advisory board consisted of HCPs of different disciplines and they had experience in the development of treatment protocols. The main aim of NPRL was to provide integrated, biopsychosocial rehabilitation care for the right patients with CMP at the right place and at the right time [22]. The content is based on the National Care Standard for Chronic Pain, which proposes a matched care approach in an integrated transmural network for patients with CMP [6]. Based on the matched care approach, HCPs from different disciplines participated and provided several treatments. For a detailed overview of the structure and organization of the health care system in NPRL see Fig 1 published in Lamper et al. (2019) [24]. Elements were integrated into NPRL to reach the overall goal. Two assessment tools supported the decision-making for problem and complexity mapping and treatment selection, based on the patient’s biopsychosocial profile. GPs and therapists in primary care used Assessment Tool 1 (S2 File); Assessment Tool 2 was used by RPs in secondary and tertiary care. In the individualized treatment plan, the patient together with the HCP set activity- and participation-related goals. An e-health application was integrated into matched care protocols for every setting with the primary goal of supporting pain education and self-management by the patient.

Fig 1. Consolidated framework for integrated care adjusted for Network Pain Rehabilitation Limburg.

Fig 1

Health care professionals

In this transmural NPRL, HCPs from all health care levels with a prior interest in CMP were included as participants. In primary care, local networks were set up in villages or city districts with local HCPs. For inclusion in a local network, it was necessary to have a GP (general practitioner, family doctor) participating, with in addition at least one physiotherapist (PT) or exercise therapist (ET), and, optionally, a mental health practice nurse (MHPN). Initially, six local networks were contacted for participation of which three were included in this study (1: one GP, two PTs; 2: one GP, one MHPN, one PT, one ET; 3: one GP, two PTs). One local network stopped participating because of lack of time, but their PT participated in focus groups. The other two local networks were not included because they did not meet the inclusion criteria. GPs were excluded if they participated in fewer than two out of three education days; therapists were excluded if they participated in fewer than three out of four education days.

In addition, a private outpatient rehabilitation clinic (two RPs; one psychologist (PSY)) and a specialized rehabilitation clinic in tertiary care (two RPs; one physician assistant (PA); one nurse practitioner (NP); one treatment coach (TC)) participated in this study. One outpatient rehabilitation clinic did not meet the inclusion criteria, but its RP participated in this study. HCPs were educated in the clinical guidelines as described in the National Care Standard for Chronic Pain and in the study process before its start and participated in focus groups at the end of each phase. Moreover, every six to eight weeks, all HCPs within one local network in primary care received supervision at their own practice. Secondary and tertiary care organizations had to meet the criteria of the Position Paper ‘Medical Specialist Rehabilitation for chronic musculoskeletal pain’ (2017) [30]. Practices and organizations were excluded when they were unable to implement the different elements of NPRL.

Patients

Of the 58 patients participating in NPRL, nine registered in primary care were randomly asked by telephone to participate in a focus group, with six agreeing. They had to be older than 18 years at the start of the study, have musculoskeletal pain that was (expected to become) chronic as indicated by a HCP, and be treated by participating HCPs who also participated in a focus group. Their treatment aim had to be improvement of daily functioning despite pain. They were excluded from the study if there was any suspicion of a biomedical (orthopaedic, rheumatic, or neurological) disease that could explain the current pain complaints and could be treated by adequate existing therapy. In addition, they were excluded if there was any (underlying) psychiatric disease (Personality disorder, schizophrenia, or clinical depression) that limit the possibility for behavioral change. Pregnancy and inadequate Dutch literacy were also exclusion criteria.

Data collection

To achieve triangulation, data were collected with different methods, such as field notes or observations during meetings, individual interviews, focus groups, and questionnaires, which were all combined to get more insight into barriers and facilitators (S3 File) [31]. The observations and individual interviews were conducted by CL. The focus groups were all led by GB, an independent researcher not aligned with the project; CL, the main researcher of the project, was the observer and made field notes during and after the focus groups. At the time of data collection, CL and GB were PhD students and had 1–2 years of experience in health care sciences. Both the individual interviews and focus groups, for which semi-structured guides were made based on CFIR, were audio-recorded and transcribed verbatim. All interviews took place at the work place of the HCP; all focus groups were organized in the tertiary care organization.

Phase 1: Development of NPRL

Phase 1 was conducted from October 2017 to February 2018. The goal of the phase was to design and develop the content of NPRL and to educate participating HCPs. In the evaluation, the focus was on the perceived barriers and facilitators of this development process. Focus groups were held with HCPs from the local networks, and interviews were held with HCPs from secondary and tertiary care organizations at the end of the phase to gather information about their experiences with the informative meetings and education days, and about their expectations and current experiences of working in NPRL.

Phase 2: Implementation of NPRL

Phase 2 was conducted from February to June 2018. The goal during this phase was to specify the content and to implement NPRL in daily practice. During the evaluations, barriers and facilitators regarding the implementation of NPRL were identified. Focus groups were held with HCPs from the local networks and secondary and tertiary care practices combined, and the individual interviews with the MHPN and a RP. The focus was on their current experiences of working in NPRL, and implications and recommendations for the implementation strategy in the practices.

Phase 3: Transferability of NPRL

Phase 3 was conducted from June to October 2018. The goal of this phase was to organize care in daily practice. Evaluations focused on barriers and facilitators for the transferability of NPRL beyond the pilot region. At the end of the phase, focus groups and interviews were organized with the HCPs to collect more information on current experiences of working with NPRL, and implications and recommendations for the implementation strategy regarding the transferability of NPRL to practices. Additionally, information was gathered about satisfaction with NPRL and its effect on work life. Moreover, a focus group with six patients was organized to develop more insight into the perceived quality of care, their experiences with NPRL, and barriers and facilitators associated with different elements of NPRL observed by them.

Overall

After completing treatments, HCPs submitted predefined questionnaires or logbooks about the treatment (number of consultations, barriers and facilitators during treatment, achievement of treatment goal) of each individual patient. In addition to the information collected in the three phases, CL kept a logbook of barriers and facilitators of NPRL mentioned by participants, the field notes and observations in these logbooks being the result of discussions with different HCPs, patients, and researchers.

Data analysis

A content analysis with mostly a deductive approach was used, with the CFIR as coding framework [27,32]. After familiarization with the data, definitions for the CFIR constructs based on NPRL were compiled (Fig 1) and used to guide data analysis. For each construct, CL composed codes based on the data, using NVivo software (NVivo version 11.1.0.411). After analyzing all data, the codes were summarized in barriers and facilitators per construct. GB performed a peer review of the analysis by verifying 20% of the interviews and focus groups. When disagreement occurred, the research team was consulted. The coding process was guided by consensual qualitative research methods [33,34]. Moreover, two HCPs performed a cross-check for interim findings by providing feedback on the results.

Results

Table 1 displays the content, duration, and disciplines involved in each interview and focus group. Five focus groups and six interviews with 21 HCPs from different disciplines, and one focus group with six patients were held. The results were analysed and described, based on the domains of the CFIR (Fig 1).

Table 1. Description of the content, duration, and discipline involved for the focus groups and interviews.

Phase 1 Phase 2 Phase 3
FG 1 FG 2 INT 1 INT2 INT 3 INT 4 FG 3 FG 4 INT 5 INT 6 FG 5 FG 6
Duration 1h45m 1h26m 37m 36m 29m 28 m 1h35m 1h24m 27m 49m 1h34m 1h48m
Goal
Experiences with the organization of rehabilitation care for patients with CMP before participating in NPRL x x x x x x x
Expectations for participation in NPRL x x x x x x x
Barriers and facilitators of the development process x x x x
Barriers and facilitators of the implementation strategy x x x
Expected barriers and facilitators of the transferability phase x
Current experiences being a patient in NPRL (eg. eHealth, healthcare professional skills, referral, treatment, feeling of collaboration) x
Discipline Gender Exp. (yrs)
P1 PT F 2.5 x x
P2 PT M 0.5 x x
P3 PT M 34 x x
P4 PT M 38 x
P5 PT F 7 x x
P6 PT M 30 x
P7 PT M 33 x
P8 ET F 25 x x
P9 PNMH F - x
P10 GP M 10 x x
P11 GP M 31 x
P12 GP M 8 x x
P13 PSY-2 F - x
P14 RP-2 F 6 x x
P15 RP-2 M - x x
P16 RP-3 F - x
P17 RP-3 F <1 x
P18 PA-3 M 15 x x
P19 NP-3 F 6 x x
P20 TC-3 F - x
P21 RP-2 M - x
P30 PNT F n.a x
P31 PNT F n.a x
P32 PNT F n.a x
P33 PNT M n.a x
P34 PNT F n.a x
P35 PNT M n.a x

FG: Focus group; INT: Interview; EXP: Vears experience; PT: Physiotherapist; ET: Exercise therapist; PNMH; practice nurse mental health; GP: General practitioner; PSY-2: Psychologist secondary care; RP-2: Rehabilitation physician secondary care; RP-3: Rehabilitation physician tertiary care; PA-3: Physician assistant tertiary care; NP-3: Nurse practitioner tertiary care; TC-3: Treatment coach tertiary care; PNT: Patient; F: Female; M: Male; -: Unknown; n.a.: Not applicable.

Intervention

Assessment Tool 1 & Assessment Tool 2

HCPs in primary care found Assessment Tool 1 too time-consuming, because of the extra burden for the patient and the extra time for the consultation itself. A further consultation to discuss the results with patients was not desirable. “I have no time to discuss the results with the patient in an extra consultation.” (P12: GP, FG2). In addition, several HCPs thought that the results of Assessment Tool 1 were not in line with their conclusions, based on their observations, experience, and assessments of patients. All secondary and tertiary rehabilitation physicians reported that Assessment Tool 2 supported their knowledge and assessments, but found its administration too time-consuming.

Treatment protocols and guidelines

According to most of the HCPs, the treatment protocols and guidelines within NPRL provide a common biopsychosocial language and transparency in treatment duration, intensity, and content: “In my opinion, in NPRL the treatment approach is more explicit and I know these are the steps to take to achieve a result compared to usual care.” (P2: PT, focus group 5). HCPs in local networks indicate that the protocols and guidelines provide a clear overview of the total approach in CMP management. Patients are more familiar and better informed about the content of various treatments in transmural care, compared with those treated before NPRL started. Due to the restricted number of consultations prescribed in the treatment protocol of NPRL as compared to care as usual, some therapists in primary care indicated fear that this would lead to a drop in income from that achieved before NPRL’s start.

HCPs have different personal preferences and opinions about the freedom in implementation of the treatment protocol and guidelines. Some HCPs felt that this freedom was desirable as it could be adjusted to the local organization of the primary care practices: “Currently, it is not a tight protocol, of which we are the executors, searching for patients who fit. And I think the strength lies in the fact that we as HCPs can decide how to implement the knowledge that we have gained in the area of chronic pain, in a way that will fit into our daily care routines. That is an essential difference, as P10 [GP] said” (P3: PT, FG1)). This freedom might be an important facilitator, according to the HCPs, if NPRL is to be implemented in the Netherlands. Other HCPs underlined the importance of standardization, with fixed treatment protocols, as they wanted more control of the treatment of this complex patient population.

eHealth application

The participants indicated that e-health has a central position in NPRL: it facilitates and supports the patient in the treatment process, and collects biopsychosocial information about the patient. According to primary HCPs, the eHealth application is user-friendly and the collected information derived from assessment reduces the duration of consultations. However, some GPs see the collection of extra information as an extra burden for patients. Other barriers of the eHealth application mentioned were: the slow speed of the two-step authentication log-in facility, lack of an overview of the steps in the treatment, and difficulties in using the chat function in daily practice because no HCP is assigned to keep track of it. These barriers meant that some HCPs had little experience of using the eHealth application. RPs saw no added value of the diary function in the eHealth application as they did not see patients frequently enough during rehabilitation to integrate it into treatment.

All patients agreed that the eHealth application (existing of pain education and self-management exercises) stimulated them to adhere to the treatment. Both the graphs of their daily activity and the education material provided were especially motivating: “The most important advantage of the eHealth application is the diaries: they keep me motivated. I like the competition with myself to be more active” (SP35, patient, FG6). On the other hand, it was hard for some patients to complete the diary daily so they missed the added value of this daily returning questionnaire. Also, some patients could not participate in this study because they had no internet connection.

Collaboration

Some therapists appreciated the fact that interdisciplinary collaboration with GPs and MHPNs working closely together is a major pillar of NPRL. However, collaboration with GPs was perceived as difficult as it takes a lot of effort to contact them for consultation and discussion. At the end of Phase 1, some HCPs reported no change in levels of collaboration in local networks of NPRL. In Phases 2 and 3, more change in collaboration was reported, though this was still not optimal. Better interdisciplinary collaboration was achieved in local networks based in one site, compared to those in which the GP and MHPN were located at a different address from the therapists. According to the HCPs in primary care, interdisciplinary collaboration in a local network will facilitate treatment of patients with more complex pain complaints, leading to a decrease in referrals to secondary or tertiary care. Also, they felt that young and dynamic teams would facilitate implementation. In the future, it is hypothesized by the HCPs that local networks and the use of eHealth applications would encourage further collaboration.

HCPs perceive a barrier when a patient needed to be referred to a non-participating practice or HCP. For these treatments, patients may be less well served as practitioners outside NPRL would not have such a detailed insight into the treatment protocols. Patients might get more biomedically oriented treatments, leading to confusion. HCPs in secondary and tertiary care thought that NPRL would especially have advantages for primary care since interdisciplinary teamwork with a focus on CMP patients is already regular care in secondary and tertiary organizations.

Education days and practice meetings

At the end of Phase 1, HCPs found the education days somewhat confusing. Using their feedback during these education days, the taught treatment protocol was further improved and made flexible, but it seemed that HCPs preferred a more defined protocol. Therefore, in later phases, the project team composed a more fixed treatment protocol, which was found to be clearer. Overall, they instituted a clearer layout of the education days. HCPs indicated that the visits of the project team to the primary care practices gave added value. They changed mindsets and encouraged active participation. However, after the project team left, it was difficult to maintain focus on NPRL in daily practice.

Inner setting

Mission and vision

According to some HCPs, most Dutch health care practices have a more biomedical oriented vision which clashes with the biopsychosocial vision of NPRL. This may be caused by the biomedical education which they had received, as described in paragraph Dutch culture, laws, and regulations (see below). For this reason, some HCPs may feel misunderstood by their colleagues in their CMP treatment approach.

Local laws and regulations

Due to personnel shortages (for example MHPNs) and the increased workload associated with transition from secondary to primary care, HCPs in primary care have a full schedule. This hinders recruitment and active participation. In the future, the organization of care will shift towards the enlargement of primary care practices with more HCPs for the same number of patients, which could be an advantage for implementing NPRL. “Our practice is large enough to divide projects among staff, resulting in enough time and funding to participate. I think the reorganization of general practice care towards practice enlargement will be important. With more GPs in one practice, you have time for multidisciplinary collaboration” (P10, GP, FG1).

Additionally, current daily general practice care is unsuitable for networking on a large scale. There is a growing number of GPs with specializations but patients are connected to a practice based on geographical location, not on specialization, and often they are connected to only one GP in a practice. Primary HCPs do not often refer their patients to colleague GPs based on their specializations. Some HCPs in primary care commented on the complexity of NPRL. They said it was hard to implement all the new desired elements and protocols at once, finding it difficult to learn different tools at the same time when the general workload was also heavy.

Collaboration with local partners

Multidisciplinary care is not feasible for small practices in primary care because of restrictions in financing, according to the HCPs employed: i.e. their financial buffer is smaller. Some GPs have a preference for a specific therapist practice in their local network. Moreover, HCPs experience competition between physiotherapy practices and commercial rehabilitation treatment centres. As a result, practice owners neglect the screening of patients with a specific level of complexity on the assumption that this would negatively influence the number of patients able to be treated. “I have a patient who can be treated better elsewhere, but I do not work there. I think it is good if you can neglect that, I can do that, but I am not the director who is responsible for the finance. But I think this will be a barrier for the future” (P15, RP, FG5).

Outer setting

Health care insurance

Health insurance policies in the Netherlands restrict the number of physiotherapy consultations that they will reimburse. HCPs and patients saw this as a pitfall for implementing NPRL as the consultations paid for are often insufficient to learn and apply the new self-management principles. In Dutch health care in 2018, patients may purchase additional insurance packages to cover extra physiotherapy sessions. Several different packages for different numbers of therapy sessions are available but HCPs are aware that patients with a low socioeconomic status cannot afford these. Unfortunately, the highest prevalence of CMP is amongst those patients. This affects the motivation of HCPs as well when it is already known at the beginning of treatment that the number of available consultations is insufficient.

Reimbursing health care practices and organizations

Multidisciplinary patient-related meetings between HCPs in primary care are not financially covered, which is a barrier for implementation. Financing and attending multidisciplinary meetings regularly is an especial problem for small practices with only a few staff members. Besides, when practices participate in more networks for various diseases, all with additional multidisciplinary meetings, this results in even heavier workloads and burdens for a primary care practice. As patients with CMP are often confronted with comorbidities, HCPs are required to attend several meetings for the same patient, making treatment and collaboration challenging.

MHPNs have an important role in NPRL as they can reduce burdens on GP. However, GPs point out that they receive little funding for deployment of a MHPN, which is not enough to cover all CMP patients who need their help. RPs, GPs, and therapists advocate future bundled payments to facilitate multidisciplinary meetings. “I think, there should be bundled payments which also cover multidisciplinary meetings. These meetings are often with a limited number of PTs and GPs, while meetings with more disciplines and structure are needed. I think if you do not structure it with bundled payments, due to the bustle of the day, NPRL will not be rolled out more broadly.” (P4, PT, FG1).

Dutch culture, laws, and regulations

HCPs indicated that diagnosing someone with CMP makes the patient feel they are not being taken seriously. As CMP is an abstract phenomenon with large inter-individual variations in perception, patients often feel they are not understood by their HCPs, family, and friends. “Patients perceive difficulties with the fact that they are diagnosed with fibromyalgia [a subgroup of CMP]. When you bring this message, they are staring at you: they think that something is wrong with them” (P12, GP, FG2).

Overall, current health care is biomedically oriented and HCPs not participating in NPRL often share this orientation. This makes it challenging for professionals working to NPRL guidelines to discuss the patient from a biopsychosocial viewpoint. “I have problems with the fact that the practice I work in has a more hands-on view of treatment… It is difficult to convince my colleagues [of the need] for CMP rehabilitation” (P5, PT, FG3). Also, CMP is not recognized as a disease in itself, causing a lack of clarity in defining which kind of care suits these patients. During HCPs’ education, little attention is paid to the biopsychosocial model and/or patients with unexplained complaints. In addition, the content and amount of information varies per discipline. HCPs still have to check for red flags which indicate an underlying medical disease needing further treatment. This necessary biomedical screening is an important part of a proper biopsychosocial approach, but HCPs often see this as different to biopsychosocial screening. RPs felt that there were large number of unjustified referrals from primary care, indicating a lack of knowledge of CMP among GPs.

HCPs stated that they were more willing to participate in NPRL if the workload was not too heavy, as there was a pleasant ambiance in the collaboration with colleagues.

Additionally, frequently mentioned laws and regulations which hinder the implementation of eHealth include the new general data protection regulations (GDPR) and the inability to link ICT-systems, as these hinder data transferal.

Individual characteristics

Knowledge and beliefs

Matched care is perceived as an added value by HCPs. Due to stigmatization and large variations in complexity between patients, HCPs in primary care may see patients with CMP as difficult to guide. Even after participation in the educational meetings, they wanted more training to increase their competencies to refer and treat these patients adequately. “Maybe, more training about CMP education is necessary, so that we receive more tools to increase certainty” (P1, PT, FG1).

In Phase 1, the HCPs in primary care reported difficulties in recognizing and quantifying the level of complexity of patients with CMP. They estimated that they only recognized 10–20% of the CMP population during consultations, as they tended to have a prototype patient with CMP in mind. “Personally, I was frantically searching for the ideal patient to include him, following the protocol” (P3, PT, FG1). They felt uncertain and afraid to make a false diagnosis of someone suspected to have CMP as they did not want to burden the patient unnecessarily. The fact that the group of patients in primary care is diverse with a wide variety of complaints makes recognition of CMP more difficult. In Phase 3, after additional training, HCPs found recognition easier but they still desired more experience. Also, some HCPs thought that not all patients were eager to participate in a study with questionnaires and/or eHealth and for this reason they did not invite all patients to participate.

Background experiences

The difference in the level of knowledge about CMP at the start of NPRL made it difficult to adjust the content and duration of training to everyone’s needs. Some HCPs had prior experience with projects addressing CMP and with collaboration in primary care. This could have facilitated the implementation as they already had a more biopsychosocial orientation and collaborative experience but they were disappointed that the results of these previous projects had not been integrated into daily care processes.

Motivation

Reasons for HCPs to participate included providing evidence-based health care, keeping health care affordable, increasing their personal network by multidisciplinary collaboration in a matched care setting, earlier involvement in projects for patients with CMP, the scientific basis of NPRL, or the fact that their practice owners agreed to participate. HCPs saw challenges in motivating patients to participate in a biopsychosocial treatment as, in general, patients had a more biomedical focus. For example, in physiotherapy, therapists indicated that patients expected a biomedical therapy such as massage. This led to rather low participation rates. However, some patients in the final focus group emphasized the added value of exercises. “I really like my physiotherapist because I get a few exercises, such as riding the bike, walking, and exercises with a machine. That is going well. Afterwards I get also a massage, also really helpful” (SP34, patient, FG6). HCPs stated that patients already receiving biomedical treatment, often for years, are less open to a change of approach. Therapists thought that, with some patients, starting treatment with a biopsychosocial approach decreased their credibility, which made them reluctant to invite them for participation. Moreover, not all patients want to be referred to secondary or tertiary care, although this might better suit the complexity of their pain complaints, because of their good relationship with their primary care therapist.

A facilitator for recruitment is an enthusiastic HCP, which makes it easier to motivate patients to participate. Conversely, when patients are eager to participate in the biopsychosocial treatment and research study, it enthuses the HCPs. “My therapist let me see the connection between being more physically active after practising, despite the pain. When I saw this link, that was nice to see” (P34, patient, FG6).

Process

Development

According to HCPs, the iterative, bottom-up implementation strategy suits those in primary care working in CMP as it allows adjustments to situations in daily practice. “Most innovations use window dressing, first a lot of participating organizations, and after that development of the content. In NPRL, it looks like the other way around. First, the content development in a small network, which fits better with daily care” (P18: PA, FG4).

An advisory board before the start of the project and the recruitment methods of HCPs were seen as facilitators. HCPs were attracted to participate in NPRL by the project group, other participating HCPs, practice owners, a local physiotherapist network, or an advertisement. HCPs found it important that a tertiary rehabilitation centre, which has expertise in pain rehabilitation, was the intervention source of NPRL. Also, multidisciplinary meetings with the project team were seen as facilitators as they changed HCPs’ mindsets and reminded them of the active participation aspects. However, the subject of the meetings was often about getting started with NPRL, instead of experiences of working in NPRL. According to the HCPs, the project team used their input, had a fixed protocol, and communicated well. During the recruitment of health care practices, two local networks declined participation due to lack of time in their practice. They stated that they were too busy to implement a new project adequately.

Implementation

Only three local networks participated in this study, which was however perceived as positive because, in a pilot study for complex interventions, a small group of HCPs is recommended. However, the small number of networks was also a barrier as it was difficult to collaborate and refer patients efficiently. Therefore, a critical mass of health care organizations is needed for proper implementation. Non-participating practices, organizations or colleagues lacked the multidisciplinary collaboration and shared biopsychosocial vision. For example, therapists found difficulties in the collaboration when patients, entering their practice by direct access, had to be referred for additional diagnostics to a non-participating GP.

Transferability

HCPs believe that NPRL is a solution for the current gap in care for patients with CMP and they have the confidence that NPRL will be embedded in daily care. However, at the end of Phase 3, they still felt as if they were in separate practices instead of part of a local network. “Currently, it is not a common work method” (P12, GP, FG5). According to the participating HCPs, in further implementation of NPRL, it will be challenging to attract HCPs with less interest in a biopsychosocial view. Nevertheless, they were willing to assist in the recruitment of new HCPs from their network of colleagues when NPRL is expanded. They also indicated that, as the organization of primary care in general shifts towards practice enlargement with more HCPs for the same amount of patients, this could be an advantage for NPRL.

Summary

As most findings are related to several CFIR domains and constructs, extra analyses were performed. This resulted in four summaries pertaining to biopsychosocial treatment protocols and guidelines, stigmatization of CMP in society, organization of health care, and the bottom-up implementation strategy. These summaries and main findings, along with the CFIR domains and constructs, are presented in Table 2. An extensive overview can be found in S1 Table.

Table 2. Summary and main findings assigned to CFIR domains and constructs.

Summary Main findings CFIR
Domain Construct
1. Within NPRL, treatment protocols and guidelines provide consistency and transparency in collaboration of HCPs regarding biopsychosocial language and treatment intensity, duration, and content. However, the implementation of guidelines and protocols has different barriers in daily practice 1A. The guidelines and protocols stimulate intensive collaboration between HCPs, such as consistency in biopsychosocial language and transparency in treatment duration, intensity, and content Intervention characteristic
  • Design Quality & Packaging

  • Cost

Outer setting -
Inner setting
  • Networks & Communications

Characteristics of individuals
  • Knowledge & Beliefs about the intervention

  • Self-efficacy

Process -
1B. HCPs experience tension between a fixed protocol and the freedom to adjust the protocol into daily practice. This is influenced by their professional preferences Intervention characteristic
  • Adaptability

  • Complexity

  • Design Quality & Packaging

  • Cost

Outer setting -
Inner setting
  • Readiness for implementation

  • Self-efficacy

Characteristics of individuals
  • Knowledge & Beliefs about the intervention

Process
  • Executing

1C. It is difficult to apply the guidelines about the eHealth application and assessment tools for satisfactory use in daily care Intervention characteristic
  • Relative advantage

  • Trialability

  • Complexity

  • Design Quality & Packaging

  • Cost

Outer setting
  • Patient Needs & Resources

Inner setting
  • Structural characteristics

  • Readiness for implementation

Characteristics of individuals
  • Knowledge & Beliefs about the intervention

  • Self-efficacy

Process
  • Executing

2. Participation and implementation are hindered because of stigmatization of CMP in society. Moreover, HCPs’ approaches are often more biomedically oriented than biopsychosocially. 2A. In Dutch society, CMP is stigmatized because the pain is not visible. Intervention characteristic -
Outer setting
  • Patient needs & Resources

Inner setting -
Characteristics of individuals
  • Knowledge & beliefs about the intervention

Process -
2B. Because the biopsychosocial vision is less common, HCPs have difficulties with (early) recognition of patients with CMP in primary care. Intervention characteristic
  • Complexity

  • Design Quality & Packaging

Outer setting
  • Patient needs & Resources

Inner setting
  • Culture

  • Implementation climate

Characteristics of individuals
  • Knowledge & beliefs about the intervention

  • Self-efficacy

  • Individual stage of change

Process
  • Executing

2C. HCPs have difficulties motivating patients for a biopsychosocial treatment because the attitudes of both are more biomedically focused. Intervention characteristic
  • Complexity

  • Design Quality & Packaging

Outer setting -
Inner setting -
Characteristics of individuals
  • Self-efficacy

Process -
3. The current organization of health care for patients with CMP, such as the culture, structure, and financing of health care practices, complicates the implementation between and within the practices. 3A. The culture of health care practices, such as the ambiance and attitude, determines the success of the collaboration between HCPs. Intervention characteristic -
Outer setting
  • Cosmopolitanism

  • External policy & incentives

Inner setting
  • Structural characteristics

  • Culture

  • Implementation Climate

Characteristics of individuals
  • Self-efficacy

Process -
3B. The current organization of financing health care in the Netherlands hinders the implementation of NPRL. Intervention characteristic
  • Complexity

  • Cost

Outer setting
  • Patients’ needs & Resources

  • Cosmopolitanism

  • External Policy & Incentives

Inner setting
  • Structural Characteristics

  • Network & Communications

Characteristics of individuals -
Process -
3C. The structure of the organization of health care practices in primary care is complex. Intervention characteristic
  • Adaptability

  • Trialability

  • Complexity

  • Cost

Outer setting
  • Cosmopolitanism

  • Peer pressure

  • External Policy & Incentives

Inner setting
  • Structural Characteristics

  • Networks & Communications

  • Implementation Climate

  • Readiness for Implementation

Characteristics of individuals
  • Self-efficacy

Process -
4. The iterative, bottom-up implementation strategy fits with the HCPs in CMP. However, a critical mass of health care organizations is needed for proper implementation. 4A. The active iterative, bottom-up development and participation of HCPs and the project team in the implementation process of NPRL is seen as an advantage. Intervention characteristic
  • Intervention source

  • Evidence strength & Quality

  • Relative Advantage

  • Adaptability

  • Design Quality & Packaging

Outer setting
  • Implementation Climate

Inner setting -
Characteristics of individuals
  • Knowledge & Beliefs about the intervention

  • Self-efficacy

  • Individual identification with Organization

Process
  • Engaging

  • Executing

4B. A critical mass of health care organizations is necessary for properly implementing NPRL. Intervention characteristic
  • Complexity

  • Design Quality & Packaging

Outer setting -
Inner setting
  • Structural characteristics

  • Network & Communications

  • Culture

  • Implementation Climate

Characteristics of individuals -
Process -
4C. HCPs believe that NPRL is a solution to the current gap in care for patients with CMP. Intervention characteristic
  • Evidence strength & Quality

  • Relative Advantage

  • Adaptability

Outer setting -
Inner setting
  • Structural characteristics

Characteristics of individuals
  • Knowledge & Beliefs about the intervention

Process -

Discussion

The aim of this feasibility study was to provide insight into barriers and facilitators for the development, implementation, and transferability of NPRL, and to provide insight into its perceived value and acceptability. Intervention characteristics and implementation processes appeared to have a major positive impact on NPRL implementation. The treatment protocols and guidelines within NPRL provide consistency and transparency in the collaboration as they guide a common biopsychosocial language and consensus in treatment duration, intensity, and content (see Summary 1, Table 2). Earlier studies found that successful implementation of new knowledge takes place at the individual, group and organizational levels [35]. This requires complex changes in clinical routines, collaboration among disciplines, and changes in the organization of care, or even in cultural beliefs and attitudes [36]. However, in the review of Holopainen et al. (2020), it was found that most biopsychosocial interventions to improve health care are focused on the individual skills of HCPs instead of on collaboration [37]. An added value of our study was the multidisciplinary transmural education days and practice meetings with all HCPs from primary, secondary, and tertiary care together, which also stimulated implementation at the group and organizational levels. One barrier encountered was the difference in preferences for fixed or flexible treatment protocols and guidelines. Other studies found that the professional autonomy of HCPs underlies these differences in preferences, which causes difficulties in implementation [38,39].

An important facilitator of the development and implementation of NPRL in normal rehabilitation care was the iterative and incremental design, based on key principles of user-centred design (see Summary 4, Table 2). This bottom-up strategy increases the focus on patients’ and HCPs’ needs. When primary users are incorporated into the iterative design process, this leads to greater usability and acceptance. However, the project team had limited experience with this design and a longer duration of the phases might have been valuable. Some of the challenges, such as the difference in terminologies and theoretical bases, seen in user-centred design with digital health records, can also be seen in this study, due to the very diverse group of HCP disciplines, heavy workloads, and varying levels of complexity of CMP [40,41].

A barrier to participation and implementation is the stigmatization of CMP in society (see Summary 2, Table 2). Earlier research found that 38% of patients living with CMP endorse internalized stigma, which reflects feelings of alienation, social withdrawal, and discriminatory experiences based on pain [42]. This may be caused by the fact that most CMP complaints are without underlying disease, which deviates from the widely held biomedical model. The review of De Ruddere et al. (2016) reports that individuals in the general population and HCPs such as physiotherapists and GPs, discount pain reports, take patients less seriously, and express doubt about the credibility of patients with nonmalignant pain [43]. HCPs’ approaches during consultations were often more biomedical than biopsychosocial, before their participation in NPRL. In contrast to the increasing evidence for the biopsychosocial model of CMP, the majority of the HCPs have received a biomedical-focused training or education [4446]. This biomedical training is likely to shape their attitudes and core beliefs toward CMP [47]. In our study, it has been shown that different views exist between GPs, therapists, or RPs about the biopsychosocial treatment of patients with CMP. Therapists with a biomedical orientation are more likely to advise patients to limit activities, and the attitudes and beliefs of GPs towards CMP are characterized by underuse of exercise referrals [4851]. Where therapists hold strong biomedical beliefs about CMP, patients will tend to adopt these beliefs accordingly [48]. A finding of this study is that dynamic and flexible teams with young personnel make implementation easier as they are more likely to have been trained with a biopsychosocial vision, and they are more comfortable implementing treatment protocols. Due to this tension between biomedical and biopsychosocial visions, and the fact that primary care is more generic than specialized secondary and tertiary care, collaboration in a transmural network is challenging.

A second barrier is the organization of health care for patients with CMP, including the culture, structure, and financing of health care practices, which complicates implementation between and within practices (see Summary 3, Table 2). An optimal organization of outer and inner settings is important when implementing a new e-health technology [52]. However, in line with another study, several barriers are mentioned in the outer setting, such as a lack of integration with other electronic systems, and time constraints [53]. One reason for these time constraints is the heavier workload entailed in NPRL. Forty-four percent of the Dutch HCPs reported a heavy workload in 2019 [54]. And as many as 72% of Dutch general practices and primary health care centres reported their workloads to have increased in the last year. Because of these workloads, they had limited time to implement a new complex intervention, such as NPRL. If HCPs had more time per patient, requiring another way of financing health care, this would lead to fewer referrals [55]. Therefore, a different way of financing health care could lead to better implementation of NPRL. This is in line with Singer et al. (2011), who declared that most health care and payment systems are not designed to achieve integrated patient care [19]. Therefore, a case-manager in primary care is recommended to overcome barriers with time constraints and follow-up of patients, as they will have the resources for this [6].

Additionally, a critical mass of health care organizations is needed for proper implementation. The study sample seems to be representative of HCPs working in primary, secondary, and tertiary care with considerable variation in the context of where and how the HCPs practised. However, our convenience sample of three local networks only covers a small number of practices and is from one geographic area, and therefore may not be representative of other populations. One barrier could be that not all HCPs are open to multidisciplinary treatment in primary care or multidisciplinary collaboration with secondary and tertiary care. Moreover, not all HCPs are interested in specializing in treatment for patients with CMP, which makes the enlargement of NPRL with more HCPs difficult. However, a facilitator could be the increase of medical staff in primary care practices, with the same number of patients, which is expected to be the future in primary care [56].

A strength of this study is that it follows MRC guidance for complex interventions, which advises non-randomized feasibility studies [26]. Moreover, the iterative method is recommended to progressively refine the design before embarking on a full-scale evaluation. The HCPs felt involved in the development of NPRL because adjustments based on the barriers and facilitators found were made after each iterative cycle. However, for further research, it is important to involve HCPs even more in the development of the intervention, which can be executed with Design Thinking. The review of Altman et al. (2018) indicates that Design Thinking may result in more usable, acceptable, and effective interventions, compared to traditional expert-driven methods [57]. And they describe Design Thinking as a promising approach for the development, implementation, and transferability of an intervention. In a further study with Design Thinking, it will be important to treat all participants as equal, reimburse them for time spent, and give them equal control over decision-making, which was not the case in this study.

In our study, patients are included via the eHealth application. The fact that some HCPs and patients did not know all the functions of the application resulted in suboptimal integration of NPRL in daily care and this may have limited the number of inclusions of patients. The eHealth application was a sub-intervention of NPRL. Because of the complexity of all sub-interventions, such as assessment tools, treatment protocol and focus on collaboration, implementation of the eHealth application in daily care was limited. Proper implementation in daily care is important before using eHealth as a recruiting strategy for patients. Besides, it is recommended that sub-interventions be implemented step-by-step instead of all at once to stimulate effective implementation in daily care. Sub-interventions must be developed based on the inner setting, which is more easily adapted to use in daily care than factors in the outer setting.

The CFIR is a comprehensive model for understanding implementation barriers and facilitators: it was used in this study to develop the topic lists and analyse the qualitative data [27]. Because of the complex interactions in the implementation of NPRL, there was an overlap in the use of domains and constructs for some results. In particular, the differences between inner and outer settings were sometimes difficult to distinguish. An example of this is the size, geographical location, and attitude towards CMP of GP and therapist practices in primary care. On the one hand, this is determined by the inner setting, the way practices develop their business plans. On the other hand, the government and authorities in the outer setting can create laws and regulations to steer these business plans. Therefore, data were assigned to all domains and constructs which were related to that part of data but summarized in the domain which reflected the best that theme. In our experience, the CFIR must be used as a flexible framework, in line with the findings of another recent study [58].

It can be concluded that NPRL seems feasible if the identified barriers and facilitators are anticipated. This study contributes to understanding factors that influence the development, implementation, and transferability of NPRL. Currently, international and national guidelines mention network collaborations as the future of care in (pain) rehabilitation, which is in line with NPRL [21,59,60]. Our implementation strategies, as well as barriers and facilitators, may assist managers and therapists in other clinical settings who aspire to implement NPRL using a similar model. Moreover, it forms the basis for refinements of NPRL. The barriers will be broken down as much as possible and facilitators will be used to plan a large-scale process and effect evaluation on Quadruple Aim outcomes such as health of the patients, (cost-)effectiveness, the satisfaction of patients with care, and meaning in the work of HCPs.

Supporting information

S1 Checklist

(PDF)

S1 Table. Overview of main barrier and facilitator nodes per CFIR domain and construct.

(PDF)

S1 File. Protocol of NPRL.

(PDF)

S2 File. Assessment Tool 1: Primary care.

(PDF)

S3 File. Topic list focus groups and interviews.

(PDF)

Acknowledgments

We would like to thank Mario Geilen, physician assistant Adelante Centre of Expertise in Rehabilitation and Audiology, Hoensbroek, The Netherlands, for his contribution to the development of the treatment protocols and the education of the HCPs. We would like the patients for participating in the focus group. Moreover, we would like to thank Jasper Trietsch, general practitioner, and Pascalle Welman, physiotherapist, both at Gezondheidscentrum Terwinselen, Kerkrade, The Netherlands, for their reading and cross-checking of this article. Thanks also to Les Hearn for scientific and English mother-tongue proofreading and editing (les_hearn@yahoo.co.uk).

Data Availability

Most relevant data are within the paper and Supporting information files. The other data for this study consist of transcripts of focus groups and interviews with participants and contain identifying items, and are therefore sensitive to privacy issues. As participants only allowed the interviews under promise of anonymity, we are expressly forbidden by the participants to make the full content of the focus groups and interviews public. Anonymized excerpts from the full transcripts can be made available to qualified researchers by request to the medical ethical committee of Zuyderland, who can be contacted at metc@zuyderland.nl.

Funding Statement

Funding was received from the non-profit private health insurers: CZ (in Dutch: Centraal Ziekenfonds; https://www.cz.nl), VGZ (in Dutch: Stichting Volksgezondheidszorg Zuid Nederland; https://www.vgz.nl/), Zilveren Kruis (https://www.zilverenkruis.nl). This applies for: Ivan P.J. Huijnen Albère J. Köke, Jeanine A.M.C.F. Verbunt.

References

  • 1.Bekkering GE, Bala MM, Reid K, Kellen E, Harker J, Riemsma R, et al. Epidemiology of chronic pain and its treatment in The Netherlands. Neth J Med. 2011;69(3):141–53. . [PubMed] [Google Scholar]
  • 2.Gatchel RJ, Peng YB, Peters ML, Fuchs PN, Turk DC. The biopsychosocial approach to chronic pain: scientific advances and future directions. Psychol Bull. 2007;133(4):581–624. doi: 10.1037/0033-2909.133.4.581 . [DOI] [PubMed] [Google Scholar]
  • 3.Bushnell MC, Ceko M, Low LA. Cognitive and emotional control of pain and its disruption in chronic pain. Nat Rev Neurosci. 2013;14(7):502–11. doi: 10.1038/nrn3516 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Breivik H, Eisenberg E, O’Brien T, Openminds. The individual and societal burden of chronic pain in Europe: the case for strategic prioritisation and action to improve knowledge and availability of appropriate care. BMC Public Health. 2013;13:1229. doi: 10.1186/1471-2458-13-1229 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Breivik H, Collett B, Ventafridda V, Cohen R, Gallacher D. Survey of chronic pain in Europe: prevalence, impact on daily life, and treatment. Eur J Pain. 2006;10(4):287–333. doi: 10.1016/j.ejpain.2005.06.009 . [DOI] [PubMed] [Google Scholar]
  • 6.Zorgstandaard Chronische Pijn 2017 [23/07/2018]. https://www.pijnpatientennaar1stem.nl/wp-content/uploads/2017/04/ZorgStandaard_Chronische_Pijn_versie_2017_03_28.pdf.
  • 7.Huisstede BM, Wijnhoven HA, Bierma-Zeinstra SM, Koes BW, Verhaar JA, Picavet S. Prevalence and characteristics of complaints of the arm, neck, and/or shoulder (CANS) in the open population. Clin J Pain. 2008;24(3):253–9. doi: 10.1097/AJP.0b013e318160a8b4 . [DOI] [PubMed] [Google Scholar]
  • 8.Jackson T, Wang Y, Wang Y, Fan H. Self-efficacy and chronic pain outcomes: a meta-analytic review. J Pain. 2014;15(8):800–14. doi: 10.1016/j.jpain.2014.05.002 . [DOI] [PubMed] [Google Scholar]
  • 9.Lerman SF, Rudich Z, Brill S, Shalev H, Shahar G. Longitudinal associations between depression, anxiety, pain, and pain-related disability in chronic pain patients. Psychosom Med. 2015;77(3):333–41. doi: 10.1097/PSY.0000000000000158 . [DOI] [PubMed] [Google Scholar]
  • 10.Krol M, de Boer D, Plass A, Rademakers J. CQ-index module Pijn: meetinstrumentontwikkeling. Utrecht: NIVEL; 2013.
  • 11.Niv D, Devor M, European Federation of IC. Position paper of the European Federation of IASP Chapters (EFIC) on the subject of pain management. Eur J Pain. 2007;11(5):487–9. Epub 2007/04/17. doi: 10.1016/j.ejpain.2007.03.005 . [DOI] [PubMed] [Google Scholar]
  • 12.Köke AJ, Smeets RJ, Schreurs KM, van Baalen B, de Haan P, Remerie SC, et al. Dutch Dataset Pain Rehabilitation in daily practice: Content, patient characteristics and reference data. Eur J Pain. 2017;21(3):434–44. Epub 2016/09/17. doi: 10.1002/ejp.937 . [DOI] [PubMed] [Google Scholar]
  • 13.Peerenboom PBG, Spek J. Medisch Specialistische Revalidatie; Aanspraak en praktijk. Elst, The Netherlands: Tangram Zorgadviseurs, 2013.
  • 14.Boonstra AM, Schiphorst Preuper HR, Brouwer M, Weerdt de M, Knol DL, Köke A. Classificatie van patiënten met chronische pijnklachten; onderzoek naar de betrouwbaarheid van de WPN niveaus. Nederlandstalig Tijdschrift Pijnbestrijding [Internet]. 2011; 30(46). [Google Scholar]
  • 15.Jellema P, van der Windt DA, van der Horst HE, Blankenstein AH, Bouter LM, Stalman WA. Why is a treatment aimed at psychosocial factors not effective in patients with (sub)acute low back pain? Pain. 2005;118(3):350–9. doi: 10.1016/j.pain.2005.09.002 . [DOI] [PubMed] [Google Scholar]
  • 16.van Tulder M, Becker A, Bekkering T, Breen A, del Real MT, Hutchinson A, et al. Chapter 3. European guidelines for the management of acute nonspecific low back pain in primary care. Eur Spine J. 2006;15 Suppl 2:S169–91. doi: 10.1007/s00586-006-1071-2 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Waterschoot FP, Bennen E, van der Woude LH, Schiphorst Preuper HR, Reneman MF. Case complexity in patients with chronic nonspecific musculoskeletal pain: a Delphi and feasibility study. Int J Rehabil Res. 2016;39(1):48–56. doi: 10.1097/MRR.0000000000000144 . [DOI] [PubMed] [Google Scholar]
  • 18.Regieraad Kwaliteit van Zorg. Chronische pijn. Den Haag: 2011.
  • 19.Singer SJ, Burgers J, Friedberg M, Rosenthal MB, Leape L, Schneider E. Defining and measuring integrated patient care: promoting the next frontier in health care delivery. Med Care Res Rev. 2011;68(1):112–27. Epub 2010/06/18. doi: 10.1177/1077558710371485 . [DOI] [PubMed] [Google Scholar]
  • 20.World Health Organisation. Integreated Health Services—What and Why? 2008.
  • 21.World Health Organization. Rehabilitation in health systems. Geneva 2017.
  • 22.Linton SJ, Nicholas M, Shaw W. Why wait to address high-risk cases of acute low back pain? A comparison of stepped, stratified, and matched care. Pain. 2018;159(12):2437–41. Epub 2018/06/16. doi: 10.1097/j.pain.0000000000001308 . [DOI] [PubMed] [Google Scholar]
  • 23.Nijs J, George SZ, Clauw DJ, Fernández-de-las-Peñas C, Kosek E, Ickmans K, et al. Central sensitisation in chronic pain conditions: latest discoveries and their potential for precision medicine. The Lancet Rheumatology. 2021. doi: 10.1016/S2665-9913(21)00032-1 [DOI] [PubMed] [Google Scholar]
  • 24.Lamper C, Kroese M, Köke A, Ruwaard D, Verbunt J, Huijnen I. Developing the Network Pain Rehabilitation Limburg: a feasibility study protocol. BMJ Open. 2019;9(6):e025962. doi: 10.1136/bmjopen-2018-025962 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Gulliksen J, Göransson B, Boivie I, Persson J, Blomkvist S, Cajander Å. Key Principles for User-Centred Systems Design. In: Seffah A, Gulliksen J, Desmarais MC, editors. Human-Centered Software Engineering—Integrating Usability in the Software Development Lifecycle. Dordrecht: Springer Netherlands; 2005. p. 17–36. [Google Scholar]
  • 26.Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M, et al. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337:a1655. Epub 2008/10/01. doi: 10.1136/bmj.a1655 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50. Epub 2009/08/12. doi: 10.1186/1748-5908-4-50 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Keith RE, Crosson JC, O’Malley AS, Cromp D, Taylor EF. Using the Consolidated Framework for Implementation Research (CFIR) to produce actionable findings: a rapid-cycle evaluation approach to improving implementation. Implement Sci. 2017;12(1):15. Epub 2017/02/12. doi: 10.1186/s13012-017-0550-7 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Tong A, Sainsbury P, Craig J. Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. Int J Qual Health Care. 2007;19(6):349–57. Epub 2007/09/18. doi: 10.1093/intqhc/mzm042 . [DOI] [PubMed] [Google Scholar]
  • 30.Werkgroep Pijnrevalidatie Nederland. Medisch Specialistische Revalidatie bij chronische pijn aan het houdings- en bewegingsapparaat. Utrecht: 2017.
  • 31.Heale R, Forbes D. Understanding triangulation in research. Evid Based Nurs. 2013;16(4):98-. doi: 10.1136/eb-2013-101494 [DOI] [PubMed] [Google Scholar]
  • 32.Forman J, Damschroder L, Jacoby L, Siminoff L. Empirical research for bioethics: a primer. Oxford: Elsevier Publishing; 2008. [Google Scholar]
  • 33.Sandelowski M, Barroso J. Writing the proposal for a qualitative research methodology project. Qual Health Res. 2003;13(6):781–820. doi: 10.1177/1049732303013006003 [DOI] [PubMed] [Google Scholar]
  • 34.Hill CE, Knox S, Thompson BJ, Williams EN, Hess SA, Ladany N. Consensual qualitative research: An update. J Couns Psychol. 2005;52(2):196. [Google Scholar]
  • 35.Zidarov D, Thomas A, Poissant L. Knowledge translation in physical therapy: from theory to practice. Disability and rehabilitation. 2013;35(18):1571–7. Epub 2013/01/24. doi: 10.3109/09638288.2012.748841 . [DOI] [PubMed] [Google Scholar]
  • 36.Grol RP, Bosch MC, Hulscher ME, Eccles MP, Wensing M. Planning and studying improvement in patient care: the use of theoretical perspectives. Milbank Q. 2007;85(1):93–138. Epub 2007/02/27. doi: 10.1111/j.1468-0009.2007.00478.x . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Holopainen R, Simpson P, Piirainen A, Karppinen J, Schütze R, Smith A, et al. Physiotherapists’ perceptions of learning and implementing a biopsychosocial intervention to treat musculoskeletal pain conditions: a systematic review and metasynthesis of qualitative studies. Pain. 2020. doi: 10.1097/j.pain.0000000000001809 . [DOI] [PubMed] [Google Scholar]
  • 38.Polder JJ, Jochemsen H. Professional autonomy in the health care system. Theor Med Bioeth. 2000;21(5):477–91. Epub 2001/01/06. doi: 10.1023/a:1009977407106 . [DOI] [PubMed] [Google Scholar]
  • 39.Hoogland J, Jochemsen H. Professional autonomy and the normative structure of medical practice. Theor Med Bioeth. 2000;21(5):457–75. Epub 2001/01/06. doi: 10.1023/a:1009925423036 . [DOI] [PubMed] [Google Scholar]
  • 40.Alwashmi MF, Hawboldt J, Davis E, Fetters MD. The Iterative Convergent Design for Mobile Health Usability Testing: Mixed Methods Approach. JMIR Mhealth Uhealth. 2019;7(4):e11656. Epub 2019/04/27. doi: 10.2196/11656 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Pagliari C. Design and Evaluation in eHealth: Challenges and Implications for an Interdisciplinary Field. J Med Internet Res. 2007;9:e15. doi: 10.2196/jmir.9.2.e15 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Waugh OC, Byrne DG, Nicholas MK. Internalized stigma in people living with chronic pain. J Pain. 2014;15(5):550.e1–10. Epub 2014/02/20. doi: 10.1016/j.jpain.2014.02.001 . [DOI] [PubMed] [Google Scholar]
  • 43.De Ruddere L, Craig KD. Understanding stigma and chronic pain: a-state-of-the-art review. Pain. 2016;157(8):1607–10. Epub 2016/02/10. doi: 10.1097/j.pain.0000000000000512 . [DOI] [PubMed] [Google Scholar]
  • 44.Guzman J, Esmail R, Karjalainen K, Malmivaara A, Irvin E, Bombardier C. Multidisciplinary rehabilitation for chronic low back pain: systematic review. BMJ. 2001;322(7301):1511–6. Epub 2001/06/23. doi: 10.1136/bmj.322.7301.1511 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Foster NE, Thomas E, Bishop A, Dunn KM, Main CJ. Distinctiveness of psychological obstacles to recovery in low back pain patients in primary care. Pain. 2010;148(3):398–406. Epub 2009/12/22. doi: 10.1016/j.pain.2009.11.002 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Pool JJ, Ostelo RW, Knol DL, Vlaeyen JW, Bouter LM, de Vet HC. Is a behavioral graded activity program more effective than manual therapy in patients with subacute neck pain? Results of a randomized clinical trial. Spine. 2010;35(10):1017–24. Epub 2010/04/16. doi: 10.1097/BRS.0b013e3181c212ee . [DOI] [PubMed] [Google Scholar]
  • 47.Domenech J, Sanchez-Zuriaga D, Segura-Orti E, Espejo-Tort B, Lison JF. Impact of biomedical and biopsychosocial training sessions on the attitudes, beliefs, and recommendations of health care providers about low back pain: a randomised clinical trial. Pain. 2011;152(11):2557–63. Epub 2011/09/16. doi: 10.1016/j.pain.2011.07.023 . [DOI] [PubMed] [Google Scholar]
  • 48.Darlow B, Fullen BM, Dean S, Hurley DA, Baxter GD, Dowell A. The association between health care professional attitudes and beliefs and the attitudes and beliefs, clinical management, and outcomes of patients with low back pain: a systematic review. Eur J Pain. 2012;16(1):3–17. Epub 2011/07/02. doi: 10.1016/j.ejpain.2011.06.006 . [DOI] [PubMed] [Google Scholar]
  • 49.Houben RM, Ostelo RW, Vlaeyen JW, Wolters PM, Peters M, Stomp-van den Berg SG. Health care providers’ orientations towards common low back pain predict perceived harmfulness of physical activities and recommendations regarding return to normal activity. Eur J Pain. 2005;9(2):173–83. Epub 2005/03/02. doi: 10.1016/j.ejpain.2004.05.002 . [DOI] [PubMed] [Google Scholar]
  • 50.Holden MA, Nicholls EE, Young J, Hay EM, Foster NE. UK-based physical therapists’ attitudes and beliefs regarding exercise and knee osteoarthritis: findings from a mixed-methods study. Arthritis Rheum. 2009;61(11):1511–21. Epub 2009/10/31. doi: 10.1002/art.24829 . [DOI] [PubMed] [Google Scholar]
  • 51.Cottrell E, Roddy E, Foster NE. The attitudes, beliefs and behaviours of GPs regarding exercise for chronic knee pain: a systematic review. BMC Fam Pract. 2010;11:4. Epub 2010/01/20. doi: 10.1186/1471-2296-11-4 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Ross J, Stevenson F, Lau R, Murray E. Factors that influence the implementation of e-health: a systematic review of systematic reviews (an update). Implement Sci. 2016;11(1):146. Epub 2016/10/27. doi: 10.1186/s13012-016-0510-7 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Murray E, Burns J, May C, Finch T, O’Donnell C, Wallace P, et al. Why is it difficult to implement e-health initiatives? A qualitative study. Implementation Science. 2011;6(1):6. doi: 10.1186/1748-5908-6-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Mooren vd, F., Gielen W. Werkgeversenquete zorg en welzijn: Uitkomsten 1e meting 2019. Onderzoeksprogramma Arbeidsmarkt Zorg en Welzijn, 2019.
  • 55.Jung H.P, Jung T., Liebrand S., Huber M., Stupar-Rutenfrans S., Wensing M. Meer tijd voor patiënten, minder verwijzingen. Huisarts en Wetenschap. 2018;61(3):39–41. https://www.henw.org/files/2018-07/H%26W%202018-3.pdf. [Google Scholar]
  • 56.van der Horst H, Bindels P, Assendelft P, Berger M, Muris JWM, Numans M, et al. Hoogste tijd voor minder patiënten per huisarts. Huisarts en Wetenschap. 2018;(3):30–1. Epub 2018, 3. doi: 10.1007/s12445-018-0056-9 [DOI] [Google Scholar]
  • 57.Altman M, Huang TTK, Breland JY. Design Thinking in Health Care. Prev Chronic Dis. 2018;15:E117. Epub 2018/09/29. doi: 10.5888/pcd15.180128 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.Hanna J, Kubiak S, Pasman E, Gaba A, Andre M, Smelson D, et al. Evaluating the implementation of a prisoner re-entry initiative for individuals with opioid use and mental health disorders: Application of the consolidated framework for implementation research in a cross-system initiative. J Subst Abuse Treat. 2020;108:104–14. Epub 2019/07/10. doi: 10.1016/j.jsat.2019.06.012 . [DOI] [PubMed] [Google Scholar]
  • 59.Boonstra A.M., Swaan J.L. Onmisbaar in stepped en matched care: klinische pijnrevalidatie. Nederlands Tijdschrift voor Revalidatiegeneeskunde. 2019;41(3):22–6. [Google Scholar]
  • 60.Federatie Medisch Specialisten. Handreiking ‘Implementatie Juiste zorg op de juiste plek’. Utrecht: 2019.

Decision Letter 0

Danielle Poole

7 Apr 2021

PONE-D-20-32156

Exploring the feasibility of a network of organizations for pain rehabilitation: what are the lessons learned?

PLOS ONE

Dear Dr. Huijnen,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

The manuscript has been evaluated by two reviewers, and their comments are available below. You will see Reviewer 2 has commented on the timeliness of your manuscript. However, both reviewers have raised concerns and the manuscript will need significant revision before it can be considered for publication – you should anticipate that the reviewers will be re-invited to assess the revised manuscript, so please ensure that your revision is thorough. I have outlined some of the key concerns noted by the reviewers below, but you should respond to all concerns mentioned by the reviewers in your response-to-reviewers document. 

The key concerns noted by the reviewers are the need to expand definitions of the study terminology (e.g., “matched care approach” and “integrated transmural network”), additional information about the assessment tools, and clarity about the study sample and setting. Specifically, Reviewer 2 noted a discrepancy between the study sample and the sample size calculation presented in the previously published protocol. These issues impact the interpretation of the results and should be explored.

Please submit your revised manuscript by May 20 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Danielle Poole

Staff Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. PLOS requires an ORCID iD for the corresponding author in Editorial Manager on papers submitted after December 6th, 2016. Please ensure that you have an ORCID iD and that it is validated in Editorial Manager. To do this, go to ‘Update my Information’ (in the upper left-hand corner of the main menu), and click on the Fetch/Validate link next to the ORCID field. This will take you to the ORCID site and allow you to create a new iD or authenticate a pre-existing iD in Editorial Manager. Please see the following video for instructions on linking an ORCID iD to your Editorial Manager account: https://www.youtube.com/watch?v=_xcclfuvtxQ

3. Please include additional information regarding the content validation survey or questionnaire used in the study to assess the HCPs  views on patients with CMP, their current referral pattern, and patient characteristics and ensure that you have provided sufficient details that others could replicate the analyses. Furthermore please provide a copy of the questionnaire as supporting information.

4. Please provide additional details regarding participant consent. In the ethics statement in the Methods and online submission information, please ensure that you have specified what type you obtained (for instance, written or verbal, and if verbal, how it was documented and witnessed). If your study included minors, state whether you obtained consent from parents or guardians. If the need for consent was waived by the ethics committee, please include this information.

5. Please remove the "CONFIDE" watermark that you currently have in the background of your manuscript pages.

6. Your ethics statement should only appear in the Methods section of your manuscript. If your ethics statement is written in any section besides the Methods, please delete it from any other section.

7. We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. For information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions.

In your revised cover letter, please address the following prompts:

a) If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially identifying or sensitive patient information) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent.

b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings as either Supporting Information files or to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. Please see http://www.bmj.com/content/340/bmj.c181.long for guidelines on how to de-identify and prepare clinical data for publication. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories.

We will update your Data Availability statement on your behalf to reflect the information you provide.

8. We note that Figure 1 in your submission contain copyrighted images. All PLOS content is published under the Creative Commons Attribution License (CC BY 4.0), which means that the manuscript, images, and Supporting Information files will be freely available online, and any third party is permitted to access, download, copy, distribute, and use these materials in any way, even commercially, with proper attribution. For more information, see our copyright guidelines: http://journals.plos.org/plosone/s/licenses-and-copyright.

We require you to either (1) present written permission from the copyright holder to publish these figures specifically under the CC BY 4.0 license, or (2) remove the figures from your submission:

1.         You may seek permission from the original copyright holder of Figure 1 to publish the content specifically under the CC BY 4.0 license.

We recommend that you contact the original copyright holder with the Content Permission Form (http://journals.plos.org/plosone/s/file?id=7c09/content-permission-form.pdf) and the following text:

“I request permission for the open-access journal PLOS ONE to publish XXX under the Creative Commons Attribution License (CCAL) CC BY 4.0 (http://creativecommons.org/licenses/by/4.0/). Please be aware that this license allows unrestricted use and distribution, even commercially, by third parties. Please reply and provide explicit written permission to publish XXX under a CC BY license and complete the attached form.”

Please upload the completed Content Permission Form or other proof of granted permissions as an "Other" file with your submission. 

In the figure caption of the copyrighted figure, please include the following text: “Reprinted from [ref] under a CC BY license, with permission from [name of publisher], original copyright [original copyright year].”

2.         If you are unable to obtain permission from the original copyright holder to publish these figures under the CC BY 4.0 license or if the copyright holder’s requirements are incompatible with the CC BY 4.0 license, please either i) remove the figure or ii) supply a replacement figure that complies with the CC BY 4.0 license. Please check copyright information on all replacement figures and update the figure caption with source information. If applicable, please specify in the figure caption text when a figure is similar but not identical to the original image and is therefore for illustrative purposes only.

9. We noted in your submission details that a portion of your manuscript may have been presented or published elsewhere.

[Figure 1 Construction of the health care system in Network Pain Rehabilitation Limburg. Published in Lamper et al. (2019) [22]. Inclusion of this figure in the current submission does not constitute dual publication as the information in this figure is about the content of the intervention. The previous publication was in the protocol article. And logically, the intervention in this results article did not change from the version published in the protocol article.]

Please clarify whether this [conference proceeding or publication] was peer-reviewed and formally published. If this work was previously peer-reviewed and published, in the cover letter please provide the reason that this work does not constitute dual publication and should be included in the current manuscript.

10. Thank you for stating the following in the Competing Interests section:

[IH, AK, and JV report grants from Health Insurance Companies CZ, VGZ and Achmea, during the conduct of the study. The other authors declare that there is no conflict of interest. ].

Please confirm that this does not alter your adherence to all PLOS ONE policies on sharing data and materials, by including the following statement: "This does not alter our adherence to  PLOS ONE policies on sharing data and materials.” (as detailed online in our guide for authors http://journals.plos.org/plosone/s/competing-interests).  If there are restrictions on sharing of data and/or materials, please state these. Please note that we cannot proceed with consideration of your article until this information has been declared.

Please include your updated Competing Interests statement in your cover letter; we will change the online submission form on your behalf.

Please know it is PLOS ONE policy for corresponding authors to declare, on behalf of all authors, all potential competing interests for the purposes of transparency. PLOS defines a competing interest as anything that interferes with, or could reasonably be perceived as interfering with, the full and objective presentation, peer review, editorial decision-making, or publication of research or non-research articles submitted to one of the journals. Competing interests can be financial or non-financial, professional, or personal. Competing interests can arise in relationship to an organization or another person. Please follow this link to our website for more details on competing interests: http://journals.plos.org/plosone/s/competing-interests

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: N/A

Reviewer #2: N/A

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: No

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: No

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Exploring the feasibility of a network of organizations for pain rehabilitation: what are the lessons learned?

Abstract: Avoid abbreviations in the abstract

Abstract, results: “One barrier is stigmatization…” Barrier for what?

Abstract, results: What are “non-participating” HCPs? Are these people who did not agree to participate in your study? If yes, how did you collect and analyzed their data?

Abstract, results: I do not understand what is the link between a HCP that uses approached more biomedical to lead to patients resist participating in NPRL? Was this an hypothesis of the study?

Abstract, results: The sentence that cultural, structural and financial aspects are barriers, this sentence needs a bit more details to explain what exactly are these barriers.

Abstract, results: “HCPs preferred the iterative, bottom-up strategy”. They preferred this as opposed to what other strategy?

Introduction

Line 68. Do we all know and do we all agree what is the right care, at the right place and the right time? This is a jargon that is often quoted by politicians, but I am not sure there is agreement about what this means. If this is the case, then, perhaps the right place to start would be to work on a document that outlines exactly what this right care, at the right place and right time means.

Page 75, can you please explain what “transmural” means? It is not a term commonly used where I am.

The use of abbreviations really make this introduction hard to read.

Line 79. What is the meaning of “integrated matched care”?

METHODS

Line 122. What is a “matched care approach” and what is “integrated transmural network”?

Line 124 starts explaining what is “matched care approach”, but it does not explain what is matched? Are the patients matched to a HCP and they stay with this same professional along all the way? Is this what the “matched” implies?

Line 125 starts explaining what “integrated” means, and I am still not clear what it is. Does this implies that al patients completed the same sorts of questionnaires and were all examined the same way? And that all these questionnaires were available to everyone in the same electronic medical records?

Line 138. What is transmural?

Line 140. Are GPs the same as family doctors in The Netherlands?

Line 141. Were nurse practitioners and pharmacists excluded from participating?

Line 142. What is a “local network”? Is this the same as a group practice where the physicians and non-physicians receive a fixed salary and are not reimbursed as a fee-for-service type of payment?

Line 157. Was there any accreditation or training for these HCPs in order to teach them on the best practices and clinical practice guidelines related to the management of patients with chronic musculoskeletal pain?

Line 157. Are there “pain clinics” in The Netherlands? Are these mostly for interventional pain procedures offered by anesthetists? Could patients have access to interventional pain medicine if they needed?

Line 200. I do not understand why the goal of this phase was “to organize care in daily practice”. I would say that this should be the goal of Phase 1.

Line 211. What do you mean by “small questionnaires”?

Line 240. Is this “Results”? If yes, there should be a subheading here?

Line 240. This is the first time that “Assessment tool 1 and tool 2” appear in the manuscript. Should they be described in the methods? Please describe in terms of what are they, who uses them, when they use them and why.

Line 250. Can a brief explanation of these treatment protocols and guidelines be provided in the methods?

Line 256. “reduced number of consultations prescribed”. I am not sure what this means. Can people prescribe consultations?

Line 271. This is the first time that Ehealth is mentioned in the manuscript. I suggest to describe this in the methods.

Line 282. What is the link between eHealth application and adherence to treatment? Do patients have access to their own medical records? I thought the patients were only entering data for questionnaires.

Line 286. Are patients asked to complete daily questionnaires about pain and pain intensity? Is it ethical to ask patients to do this? There is a strong body of evidence showing that the more time a person spend thinking about their pain, the higher the chances of this pain becoming chronic, it is like creating a permanent memory of pain in the brain.

Line 290. It is not clear how the collaboration was achieved. Were the patients seen by the different professionals individually in different occasions (multi-professional approach), or where the patients seen by all professions simultaneously (inter-professional approach)?

Line 299. “young and dynamic” How do you define that?

Line 300. What is a local network? Is it based on a geographical area? A funding model? A group of professionals connected by the same eHealth system? The same source of funding?

Line 304. What is a “more biomedically oriented treatment”? Could these be things like acupuncture, massage, modalities, injections, oral medications, topical creams?

Line 310. Please give details about what these education days offered.

Line 311. Who developed these protocols? Were they developed with input from primary care professionals?

Line 321. Mission and vision. Are these mission and vision for the feasibility study? For the network?

Line 322. “most health care practices” – does this refer to the practices included in the feasibility study? Or is this about practices in general in The Netherlands?

Line 468. This is the first time an advisory board is mentioned. Please mention in the methods that an advisory board was employed.

Reviewer #2: Dear authors: thank you for letting me to comment on your work

The topic of this manuscript is timely because it deals with a topic with potential for improvement in the treatment of patients with chronic musculoskeletal pain.

This study can help in the process of improving the organization of healthcare for patients with chronic pain and emphasizes the biopsychosocial approach in the management of patients.

The manuscript is well written and understandable. I just have to make a few small observations that may help improve the manuscript

The authors have followed COREG criteria for reporting qualitative research. I am happy to know this because this is a good quality criteria. Please provide response to the 32 item checklist. Most of the items are considered in the manuscript, but some are not

Another aspect that denotes quality and rigor is that the authors have previously published the protocol of the study they planned to do (BMJ Open. 2019; 9 (6): e025962). However, in this protocol it was intended to evaluate approximately 100 patients that would receive questionnaires regarding satisfaction with care and their health status and pain-related disability, and 10 patients for the focus group. Finally only 58 patients participated in the program, and 6 of them in the focus group. It would be interesting to have information about satisfaction of patients and disability to know the impact of the program on them. Also Please explain the reason, if any, for not having reached the planned number of patients

In general the writing style is friendly and well written. However the phrase about the inclusion criteria is confusing for me (page 6; lines 163-166) “They were excluded from the study if there was any suspicion of a medical (orthopaedic, rheumatic, or neurological) disease or (underlying) psychiatric disease that could explain the current pain complaints (e.g. rheumatism or hernia) and/or that could be treated by adequate existing therapy”. The conjunction and/or is misleading. If the conjunction "or" is used, it is implied that those patients with a medical diagnosis that explains symptoms will be excluded, regardless of whether they do not have effective treatment of their condition. If this is the case, for example an epicondylitis or a spondylolisthesis (both specific diagnoses, but in many cases without effective treatment) would be excluded. Please explain exclusion criteria

The author used Assessment tool 1 for HCP in primary care and Assessment tool 2 for secondary and tertiary care. I can not find Assessment tool 2 in supplementary material

In Assessment tool 1 for Primary Care, the flow chart for classifying patients is in Dutch. Please provide a translation

In conclusion, it is a very interesting article that I would like to see published. It is a feasibility study that can help clinicians and managers to implement an integrative network program for the management of patients with chronic pain

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: Yes: Julio Domenech

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2022 Sep 15;17(9):e0273030. doi: 10.1371/journal.pone.0273030.r002

Author response to Decision Letter 0


2 Jun 2021

Danielle Poole

Staff Editor

PLOS ONE

Maastricht, the Netherlands, June 2, 2021

Manuscript title: Exploring the feasibility of a network of organizations for pain rehabilitation: what are the lessons learned?

Manuscript ID: PONE-D-20-32156

Dear Mrs. Poole,

Thank you very much for considering our paper “Exploring the feasibility of a network of organizations for pain rehabilitation: what are the lessons learned?” for PLOS ONE and for having it reviewed by two reviewers in the field of chronic pain. We have carefully considered the journal requirements and reviewers’ comments, and made revisions to the paper as suggested. We appreciate the helpful feedback that was provided and believe that these comments were relevant and useful to improve our manuscript. The changes in the text are visible by track changes. Please find our reaction to the reviewers and summary of the adaptations below. Our reactions are indicated with symbol ‘>’.

We are not able to share the data (transcripts of the focus groups and interviews) publicly as there are ethical restrictions. Due to the small number of participations, geographical area, and information at our website (www.netwerkpijnrevalidatie.nl), the participations could be traceable, even if we anonymize the transcripts. Data requests can be sent to the Medical Ethics Committee Z, the Netherlands, METC 17-N-133.

As suggested by the editorial office we decided to remove fig1 from the manuscript and we refer to the original publication of the figure within the manuscript. This figure is published in our peer-reviewed and published protocol article in BMJ Open: [23]. Lamper C, Kroese M, Köke A, Ruwaard D, Verbunt J, Huijnen I. Developing the Network Pain Rehabilitation Limburg: a feasibility study protocol. BMJ Open. 2019;9(6):e025962. doi: 10.1136/bmjopen-2018-025962.

Additionally, based on the journal requirements, we have updated the competing interests section:

L857-860. IH, AK, and JV report grants from Health Insurance Companies CZ, VGZ and Achmea, during the conduct of the study. The other authors declare that there is no conflict of interest. This does not alter our adherence to PLOS ONE policies on sharing data and materials.

We hope you will reconsider our manuscript for publication.

On behalf of all authors,

Yours sincerely,

Ivan Huijnen, PhD and Cynthia Lamper, MSc

Maastricht University

Faculty of Health, Medicine and Life Sciences

Department of Rehabilitation Medicine

P.O. Box 616, 6200 MD Maastricht

The Netherlands

E-mail: ivan.huijnen@maastrichtuniversity.nl & cynthia.lamper@maastrichtuniversity.nl

Journal requirements and reviewer(s)' Comments to Author:

Comment 1: Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming.

> We have checked and applied the style requirements.

Comment 2: PLOS requires an ORCID iD for the corresponding author in Editorial Manager on papers submitted after December 6th, 2016. Please ensure that you have an ORCID iD and that it is validated in Editorial Manager. To do this, go to ‘Update my Information’ (in the upper left-hand corner of the main menu), and click on the Fetch/Validate link next to the ORCID field. This will take you to the ORCID site and allow you to create a new iD or authenticate a pre-existing iD in Editorial Manager. Please see the following video for instructions on linking an ORCID iD to your Editorial Manager account: https://www.youtube.com/watch?v=_xcclfuvtxQ .

>We, as corresponding authors, have added our ORCID IDs.

Comment 3: Please include additional information regarding the content validation survey or questionnaire used in the study to assess the HCPs views on patients with CMP, their current referral pattern, and patient characteristics and ensure that you have provided sufficient details that others could replicate the analyses. Furthermore please provide a copy of the questionnaire as supporting information.

> We did not report the outcomes on the questionnaire in the result section of the manuscript. We only used the outcome on the self-constructed questionnaire as input for the focus group topics. We did not use it for evaluation purposes and therefore, it is not mentioned in the other parts of the article. For further clarification and avoiding ambiguities, we choose to remove this sentence in the manuscript (L191-193. are removed).

Comment 4: Please provide additional details regarding participant consent. In the ethics statement in the Methods and online submission information, please ensure that you have specified what type you obtained (for instance, written or verbal, and if verbal, how it was documented and witnessed). If your study included minors, state whether you obtained consent from parents or guardians. If the need for consent was waived by the ethics committee, please include this information.

> We agree that the information about the informed consent procedure could be improved. Therefore, we adjusted the ethics and dissemination section:

L117-118. Written and verbal informed consent was obtained from all patients and HCPs before the start of the interview or focus group. The verbal informed consent was recorded.

Comment 5: Please remove the "CONFIDE" watermark that you currently have in the background of your manuscript pages.

> We have removed the watermark.

Comment 6: Your ethics statement should only appear in the Methods section of your manuscript. If your ethics statement is written in any section besides the Methods, please delete it from any other section.

> We deleted the ethics section from p32 L860.

Comment 7: We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. For information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. In your revised cover letter, please address the following prompts:

a) If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially identifying or sensitive patient information) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent.

b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings as either Supporting Information files or to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. Please see http://www.bmj.com/content/340/bmj.c181.long for guidelines on how to de-identify and prepare clinical data for publication. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories.

We will update your Data Availability statement on your behalf to reflect the information you provide..

> We are not able to share the data (transcripts of the focus groups and interviews) publicly as there are ethical restrictions. Due to the small number of participations, geographical area, and information at our website (www.netwerkpijnrevalidatie.nl), the participations could be traceable, even if we anonymize the transcripts. Data requests can be sent to the Medical Ethics Committee Z, the Netherlands, METC 17-N-133.

Comment 8: We note that Figure 1 in your submission contain copyrighted images. All PLOS content is published under the Creative Commons Attribution License (CC BY 4.0), which means that the manuscript, images, and Supporting Information files will be freely available online, and any third party is permitted to access, download, copy, distribute, and use these materials in any way, even commercially, with proper attribution. For more information, see our copyright guidelines: http://journals.plos.org/plosone/s/licenses-and-copyright .

We require you to either (1) present written permission from the copyright holder to publish these figures specifically under the CC BY 4.0 license, or (2) remove the figures from your submission.

> As suggested by the editorial office we decided to remove fig1 from the manuscript and we refer to the original publication of the figure within the manuscript.

23. Lamper C, Kroese M, Köke A, Ruwaard D, Verbunt J, Huijnen I. Developing the Network Pain Rehabilitation Limburg: a feasibility study protocol. BMJ Open. 2019;9(6):e025962. doi: 10.1136/bmjopen-2018-025962.

Comment 9: We noted in your submission details that a portion of your manuscript may have been presented or published elsewhere.

As suggested by the editorial office we decided to remove fig1 from the manuscript and we refer to the original publication of the figure within the manuscript. 23. Lamper C, Kroese M, Köke A, Ruwaard D, Verbunt J, Huijnen I. Developing the Network Pain Rehabilitation Limburg: a feasibility study protocol. BMJ Open. 2019;9(6):e025962. doi: 10.1136/bmjopen-2018-025962.

Comment 10: Thank you for stating the following in the Competing Interests section: [IH, AK, and JV report grants from Health Insurance Companies CZ, VGZ and Achmea, during the conduct of the study. The other authors declare that there is no conflict of interest. ].

Please confirm that this does not alter your adherence to all PLOS ONE policies on sharing data and materials, by including the following statement: "This does not alter our adherence to PLOS ONE policies on sharing data and materials.” (as detailed online in our guide for authors http://journals.plos.org/plosone/s/competing-interests). If there are restrictions on sharing of data and/or materials, please state these. Please note that we cannot proceed with consideration of your article until this information has been declared.

Please include your updated Competing Interests statement in your cover letter; we will change the online submission form on your behalf.

Please know it is PLOS ONE policy for corresponding authors to declare, on behalf of all authors, all potential competing interests for the purposes of transparency. PLOS defines a competing interest as anything that interferes with, or could reasonably be perceived as interfering with, the full and objective presentation, peer review, editorial decision-making, or publication of research or non-research articles submitted to one of the journals. Competing interests can be financial or non-financial, professional, or personal. Competing interests can arise in relationship to an organization or another person. Please follow this link to our website for more details on competing interests: http://journals.plos.org/plosone/s/competing-interests.

> We have updated the competing interests section:

L857-860. IH, AK, and JV report grants from Health Insurance Companies CZ, VGZ and Achmea, during the conduct of the study. The other authors declare that there is no conflict of interest. This does not alter our adherence to PLOS ONE policies on sharing data and materials.

Reviewer 1:

Comment 1: Abstract: Avoid abbreviations in the abstract.

> We thank the reviewer for reviewing our manuscript and his/her comments. In order to increase the readability of the abstract, we have removed the abbreviations.

Comment 2: Abstract, results: “One barrier is stigmatization…” Barrier for what?.

> We have changed the sentence to make it easier understandable.

One mentioned barrier is the stigmatization of chronic pain by the general population.

Comment 3: Abstract, results: What are “non-participating” HCPs? Are these people who did not agree to participate in your study? If yes, how did you collect and analyzed their data?.

> With non-participating HCPs we mean the HCPs working in regular care. For clarity we have changed the sentence.

In regular care, approaches are often more biomedical than biopsychosocial, causing patients to resist participating.

Comment 4: Abstract, results: I do not understand what is the link between a HCP that uses approached more biomedical to lead to patients resist participating in NPRL? Was this an hypothesis of the study?.

> Regular care is often more biomedical oriented, searching for a physical cause of the pain. As in patients with CMP often no physical cause can be found, a biopsychosocial approach seems more suitable. However, patients do not expect a biopsychosocial approach from their HCP. Therefore, HCPs experienced barriers in convincing patients for a biopsychosocial treatment as purposed in the Network Pain Rehabilitation Limburg. This caused a lower number of patients treated in the network than expected.

The aim of this study was to provide insight into barriers and facilitators for the development, implementation, and transferability of NPRL. The recruitment of patients was found to be a barrier for implementation and transferability of NPRL, but the resistance of patients to participate was not a hypothesis of this study..

Comment 5: Abstract, results: The sentence that cultural, structural and financial aspects are barriers, this sentence needs a bit more details to explain what exactly are these barriers.

> We agree that this sentence needs more explanation. Due to the word limit of the abstract we have chosen to remove the part: with cultural, structural, and financial aspects. More information about this topic can be found in the results section of the manuscript.

Comment 6: Abstract, results: “HCPs preferred the iterative, bottom-up strategy”. They preferred this as opposed to what other strategy?

> To improve the clarity, we changed the sentence:

Health care professionals were enthusiastic about the iterative, bottom-up development.

Comment 7: Line 68. Do we all know and do we all agree what is the right care, at the right place and the right time? This is a jargon that is often quoted by politicians, but I am not sure there is agreement about what this means. If this is the case, then, perhaps the right place to start would be to work on a document that outlines exactly what this right care, at the right place and right time means.

> We agree that different definitions exists for the right care, at the right place, at the right time. The Dutch National Care Standard for Chronic Pain has described this. In this study, and in the conduct of NPRL, we used this document as guideline. We have changed the sentence by adding this document as reference:

L. 67-69. Therefore, patients with CMP often do not receive the right care, at the right place, at the right time, as described in the National Care Standard for Chronic Pain, the Netherlands [6].

Comment 8: Page 75, can you please explain what “transmural” means? It is not a term commonly used where I am..

> Transmural means across different level of care, for example between primary, secondary, and tertiary care. The complete definition is explained in this whole paragraph. To be consisted, we have added the word integrated in sentence 76:

The World Health Organization recommends networks in integrated transmural rehabilitation care as future developments [21].

Comment 9: The use of abbreviations really make this introduction hard to read.

> We concur that the number of abbreviations in the introduction is high. Therefore, we have removed the abbreviations: World Health Organization (WHO) and National Care Standard for Chronic Pain (NCSCP).

Comment 10: Line 79. What is the meaning of “integrated matched care”?

> The definition of matched care was indeed not clearly explained. Therefore, we have added this definition with a reference:

L83-84. Matched care comprises identifying patients at higher risk. However, unlike stratified care, it tailors the intervention to the individual patient's specific existing complaints and risk factors [22, 23].

22. Linton SJ, Nicholas M, Shaw W. Why wait to address high-risk cases of acute low back pain? A comparison of stepped, stratified, and matched care. Pain. 2018;159(12):2437-41. Epub 2018/06/16. doi: 10.1097/j.pain.0000000000001308. PubMed PMID: 29905653.

23. Nijs J, George SZ, Clauw DJ, Fernández-de-las-Peñas C, Kosek E, Ickmans K, et al. Central sensitisation in chronic pain conditions: latest discoveries and their potential for precision medicine. The Lancet Rheumatology. 2021. doi: https://doi.org/10.1016/S2665-9913(21)00032-1.

Comment 11: Line 122. What is a “matched care approach” and what is “integrated transmural network”?

> For the definition of a matched care approach, see our response to comment 10. For the definition of an integrated transmural network, see our response to comment 8.

Comment 12: Line 124 starts explaining what is “matched care approach”, but it does not explain what is matched? Are the patients matched to a HCP and they stay with this same professional along all the way? Is this what the “matched” implies?

> We want to refer to our response at comment 10. This means that a patient is treated by the best suitable treatment for these patient, fitting his/her existing CMP complaints and risk factors. And not, as in stratified care, starting with a treatment in primary care and when not successful followed by referral succeeded to secondary or tertiary care. In a matched care approach, patients are directly referred to a HCP in tertiary care, when this matches their complaints and is thus needed.

Comment 13: Line 125 starts explaining what “integrated” means, and I am still not clear what it is. Does this implies that all patients completed the same sorts of questionnaires and were all examined the same way? And that all these questionnaires were available to everyone in the same electronic medical records?

> We explained the term ‘integrated’ in the Introduction (L.70-77). We follow the definition of the World Health Organization: the management and delivery of health services so that clients receive a continuum of preventive and curative services, according to their needs over time and across different levels of the health system’’. This means that the different levels of health care work together (are ‘integrated’) to deliver treatment for patients with CMP.

Comment 14: Line 138. What is transmural?

> For the explanation of transmural, we want to refer to our answer at comment 8.

Comment 15: Line 140. Are GPs the same as family doctors in The Netherlands?

> In the Netherlands, GPs are indeed the family doctors in primary care. To increase the clarity and to make it easier comparable for other countries with different health care systems, we have added this to the sentence:

L147. For inclusion in a local network, it was necessary to have a GP (general practitioner, family doctor) participating, with in addition at least one physiotherapist (PT) or exercise therapist (ET), and, optionally, a mental health practice nurse (MHPN).

Comment 16: Line 141. Were nurse practitioners and pharmacists excluded from participating?

> At the moment, nurse practitioners and pharmacists are not involved in the rehabilitation treatment for patients with CMP in primary care in the Netherlands. It is expected that they will get involved in the future. However, as they have no prominent role in rehabilitation, we have not in- or excluded them in this study. In our discussion, we refer to the increase of medical staff in primary care practices (L.584). A nurse practitioner or pharmacists could be one of the disciplines working in primary care in the future.

Comment 17: Line 142. What is a “local network”? Is this the same as a group practice where the physicians and non-physicians receive a fixed salary and are not reimbursed as a fee-for-service type of payment?

> We mean with a local network the HCPs in the same village or city district. (L.143. In primary care, local networks were set up in villages or city districts with local HCPs.) They exists of GPs, PTs, ETs, or MHPNs, depending on the availability of the disciplines in the area. It could be a joint practice were a GP, a PT and a MHPNs are working, but it could also be separate practices in the same area. They are non financed or reimbursed in the same way. This depends on their discipline.

Comment 18: Line 157. Was there any accreditation or training for these HCPs in order to teach them on the best practices and clinical practice guidelines related to the management of patients with chronic musculoskeletal pain?

> We agree that the process of accreditation or training the HCPs is not described clearly. Therefore, we have added this in L155-157. Moreover, in the exclusion criteria of the healthcare professionals (L149-151) is mentioned how many education days they had to follow in order to participate.

L159. HCPs were educated in the clinical guidelines as described in the National Care Standard for Chronic Pain and in the study process before its start and participated in focus groups at the end of each phase.

Comment 19: Line 157. Are there “pain clinics” in The Netherlands? Are these mostly for interventional pain procedures offered by anesthetists? Could patients have access to interventional pain medicine if they needed?

> In the Netherlands, ‘pain clinics’ exists and they offer different kind of treatments such as interventional pain medicine by anesthetists. As this is not the goal of Network Pain Rehabilitation Limburg, we did not include these pain clinics in our study. In our study only rehabilitation centers are included which focusses on improving daily activities and participation of patients. When patients had a preference for treatment at an anesthetists, they were referred to them outside the Network Pain Rehabilitation Limburg.

Comment 20: Line 200. I do not understand why the goal of this phase was “to organize care in daily practice”. I would say that this should be the goal of Phase 1

> In phase 1 (development phase) the goal was to develop the way this care has to be organized. Subjects included were: which HCPs need to participate, what will be the referral patterns, which treatments will be offered. In phase 3 (transferability phase) the goal was to organize this care in daily practice so the HCPs could work with the developed NPRL of phase 1. In phase 3 the focus is on the practical aspects of participating and working in NPRL.

Comment 21: Line 211. What do you mean by “small questionnaires”?

> We mean that the HCPs filled in a questionnaire with a few predefined questions about the treatment of each patient. These questions comprised subjects as; number of consultations, did the patient reach the treatment goal, and barriers or facilitators of the treatment. To clarify this in the manuscript, we have adjusted the sentence:

L220. After completing treatments, HCPs submitted predefined questionnaires or logbooks about the treatment (number of consultations, barriers and facilitators during treatment, achievement of treatment goal) of each individual patient.

Comment 22: Line 240. Is this “Results”? If yes, there should be a subheading here?

> Yes, this is the results section, the subheading “Results” is placed at L.236, before the table. PLOS ONE requires this type of subheadings.

Comment 23: Line 240. This is the first time that “Assessment tool 1 and tool 2” appear in the manuscript. Should they be described in the methods? Please describe in terms of what are they, who uses them, when they use them and why.

> Assessment tool 1 and assessment tool 2 are described in the “Methods” section:

L133. Two assessment tools supported the decision-making for problem and complexity mapping and treatment selection, based on the patient’s biopsychosocial profile. GPs and therapists in primary care used Assessment Tool 1 (Supplementary file 1); Assessment Tool 2 was used by RPs in secondary and tertiary care.

Comment 24: Line 250. Can a brief explanation of these treatment protocols and guidelines be provided in the methods?

> A brief explanation of the treatment protocols and guidelines is provided in the Methods section:

L.137. In the individualized treatment plan, the patient together with the HCP set activity- and participation-related goals.

Moreover, an extended explanation can be found in our published protocol article:

23. Lamper C, Kroese M, Köke A, Ruwaard D, Verbunt J, Huijnen I. Developing the Network Pain Rehabilitation Limburg: a feasibility study protocol. BMJ Open. 2019;9(6):e025962. doi: 10.1136/bmjopen-2018-025962

Comment 25: Line 256. “reduced number of consultations prescribed”. I am not sure what this means. Can people prescribe consultations?

> We mean, the number of consultations as prescribed in the treatment protocol. To improve the clarity of the sentence, we have adjusted it:

L.267. Due to the restricted number of consultations prescribed in the treatment protocol of NPRL as compared to care as usual, some therapists in primary care indicated fear that this would lead to a drop in income from that achieved before NPRL’s start.

Comment 26: Line 271. This is the first time that Ehealth is mentioned in the manuscript. I suggest to describe this in the methods.

> We described the eHealth application in L.134-136. More information can also be found in our protocol article.

L138. An e-health application was integrated into matched care protocols for every setting with the primary goal of supporting pain education and self-management by the patient.

23. Lamper C, Kroese M, Köke A, Ruwaard D, Verbunt J, Huijnen I. Developing the Network Pain Rehabilitation Limburg: a feasibility study protocol. BMJ Open. 2019;9(6):e025962. doi: 10.1136/bmjopen-2018-025962

Comment 27: Line 282. What is the link between eHealth application and adherence to treatment? Do patients have access to their own medical records? I thought the patients were only entering data for questionnaires.

> We mean that the eHealth application is an extra element of the treatment. It supports the treatments in primary care as it provides pain education and self-management exercises for patients (L134-136; see also comment 26). We made adjustments to clarify this sentence:

L293. All patients agreed that the eHealth application (existing of pain education and self-management exercises) stimulated them to adhere to the treatment.

Comment 28: Line 286. Are patients asked to complete daily questionnaires about pain and pain intensity? Is it ethical to ask patients to do this? There is a strong body of evidence showing that the more time a person spend thinking about their pain, the higher the chances of this pain becoming chronic, it is like creating a permanent memory of pain in the brain.

> The diaries in the eHealth application comprised questions about their activity level and participation during that day, which are rehabilitation goals. Only, once a week a question was asked about the pain intensity. We do not think that asking pain intensity in this frequency influences the chance of pain becoming chronic.

Comment 29: Line 290. It is not clear how the collaboration was achieved. Were the patients seen by the different professionals individually in different occasions (multi-professional approach), or where the patients seen by all professions simultaneously (inter-professional approach)?

> Patients were seen interdisciplinary, simultaneously with the same treatment goal and interim consultation, by different HCPs in the local networks. For clarification, we adjusted some sentences:

L302. Some therapists appreciated the fact that interdisciplinary collaboration with GPs and MHPNs working closely together is a major pillar of NPRL

L306. Better interdisciplinary collaboration was achieved in local networks based in one site, compared to those in which the GP and MHPN were located at a different address from the therapists.

Comment 30: Line 299. “young and dynamic” How do you define that?

> The HCPs mentioned that a team with young and dynamic staff members facilitates implementation, as they are often more flexible in adapting their treatment strategy and are more willing to interdisciplinary collaboration. This is how the HCPs perceived it themselves.

Comment 31: Line 300. What is a local network? Is it based on a geographical area? A funding model? A group of professionals connected by the same eHealth system? The same source of funding?

> See our response to comment 17.

Comment 32: Line 304. What is a “more biomedically oriented treatment”? Could these be things like acupuncture, massage, modalities, injections, oral medications, topical creams

> With a “more biomedically oriented treatment” we indeed mean one of the treatments you mention. While in a biopsychosocial treatment also attention is paid to the psychosocial status and possible complaints of the patient.

Comment 33: Line 310. Please give details about what these education days offered.

> The content of the education days is mentioned in L155 of the Methods section and in our protocol article:

L159. HCPs were educated in the clinical guidelines as described in the National Care Standard for Chronic Pain and in the study process before its start and participated in focus groups at the end of each phase.

23. Lamper C, Kroese M, Köke A, Ruwaard D, Verbunt J, Huijnen I. Developing the Network Pain Rehabilitation Limburg: a feasibility study protocol. BMJ Open. 2019;9(6):e025962. doi: 10.1136/bmjopen-2018-025962

Comment 34: Line 311. Who developed these protocols? Were they developed with input from primary care professionals?

> The protocols were developed by the project team with input from the advisory board, based on the National Care Standard for Chronic Pain before the start of the study. The project team consisted of researchers and health care professionals with prior knowledge of the development of treatment protocols for patients with CMP. The advisory board consisted of working in primary, secondary, as well as tertiary care. During Phase 1, these protocols were adjusted based on practical usage by the HCPs.

Comment 35: Line 322. “most health care practices” – does this refer to the practices included in the feasibility study? Or is this about practices in general in The Netherlands?

> We mean the health care practices in the Netherlands. Therefore, we adjusted L329:

L333. According to some HCPs, most Dutch health care practices have a more biomedical oriented vision which clashes with the biopsychosocial vision of NPRL

Comment 36: Line 468. This is the first time an advisory board is mentioned. Please mention in the methods that an advisory board was employed.

> We agree that this is not mentioned in the Methods section, therefore we have adjusted L124:

L125: NPRL is described more extensively in Lamper et al. (2019): it was developed by a project team consisting of the authors CL, IH, AK, JV and an advisory board consisting of interested HCPs. The project team as well as advisory board consisted of HCPs of different disciplines and they had experience in the development of treatment protocols.

Reviewer 2:

Comment 1: Dear authors: thank you for letting me to comment on your work. The topic of this manuscript is timely because it deals with a topic with potential for improvement in the treatment of patients with chronic musculoskeletal pain. This study can help in the process of improving the organization of healthcare for patients with chronic pain and emphasizes the biopsychosocial approach in the management of patients. The manuscript is well written and understandable. I just have to make a few small observations that may help improve the manuscript.

> We thank Mr. Julio Domenech for reviewing our manuscript and his compliments on our manuscript.

Comment 2: The authors have followed COREG criteria for reporting qualitative research. I am happy to know this because this is a good quality criteria. Please provide response to the 32 item checklist. Most of the items are considered in the manuscript, but some are not.

> We did not provide information about the repeat interviews (No 18). In this iterative design we conducted several focus groups with the same HCPs, and at least two focus groups at the same time. Therefore, repeat interviews were not necessary to conduct. Moreover, we did not provide information about the return of transcripts to the participants (No 23), as we did not consider this. We did perform a member-check with two HCPs of our manuscript (L. 233). They read the results section and checked if it reflected the discussions during the focus groups. Additionally, in our case, No 22 about data saturation was not applicable, as we interviewed all HCPs participating in NPRL at least once. We assumed that, due to the variation in HCPs participating in NPRL, all different views were discussed. As we interviewed all HCPs, it was not possible to recruit more HCPs in case data-saturation was not reached.

Comment 3: Another aspect that denotes quality and rigor is that the authors have previously published the protocol of the study they planned to do (BMJ Open. 2019; 9 (6): e025962). However, in this protocol it was intended to evaluate approximately 100 patients that would receive questionnaires regarding satisfaction with care and their health status and pain-related disability, and 10 patients for the focus group. Finally only 58 patients participated in the program, and 6 of them in the focus group. It would be interesting to have information about satisfaction of patients and disability to know the impact of the program on them. Also Please explain the reason, if any, for not having reached the planned number of patients.

> It has to be taken into account that, in our protocol article, a study was described to get insight into the barriers and facilitators, perceived value, acceptability and implementation strategies for the development, implementation and transferability of the NPRL. In this manuscript we reflect only on the barriers and facilitators of NPRL, which is a part of the total study as described in the protocol article. Therefore, in this manuscript, no data on their health status and pain-related disability is published. Furthermore, questionnaire data on satisfaction with care was only available of a small number of patients. As this is not representative for the patient sample presented in this study, we choose not to include these results in this article. The eHealth application was not good integrated in daily practice, and the questionnaires were collected via this eHealth application, which could be the reason of this loss-of-follow-up data. In our discussion we reflect on the fact that only a small number of patients participated in the study of NPRL:

L607. In our study, patients are included via the eHealth application. The fact that some HCPs and patients did not know all the functions of the application resulted in suboptimal integration of NPRL in daily care and this may have limited the number of patients included.

We expected to ask approximately 10 patients for the focus group of this study. We found eight patients who agreed for attendance. However, on the day of the focus group one patient was ill, and one patient did forget the appointment. Due to the short time available, it was not possible to invite more patients. After evaluation of the data we found that six patients was enough to reach data-saturation. Therefore, we did not execute an additional focus group.

Comment 4: In general the writing style is friendly and well written. However the phrase about the inclusion criteria is confusing for me (page 6; lines 163-166) “They were excluded from the study if there was any suspicion of a medical (orthopaedic, rheumatic, or neurological) disease or (underlying) psychiatric disease that could explain the current pain complaints (e.g. rheumatism or hernia) and/or that could be treated by adequate existing therapy”. The conjunction and/or is misleading. If the conjunction "or" is used, it is implied that those patients with a medical diagnosis that explains symptoms will be excluded, regardless of whether they do not have effective treatment of their condition. If this is the case, for example an epicondylitis or a spondylolisthesis (both specific diagnoses, but in many cases without effective treatment) would be excluded. Please explain exclusion criteria.

> We agree that this sentence needs clarification. Therefore, we rephrased the sentence:

L 172. They were excluded from the study if there was any suspicion of a biomedical (orthopaedic, rheumatic, or neurological) disease that could explain the current pain complaints and could be treated by adequate existing therapy. In addition, they were excluded if there was any (underlying) psychiatric disease (Personality disorder, schizophrenia, or clinical depression) that limit the possibility for behavioral change.

Comment 5: The author used Assessment tool 1 for HCP in primary care and Assessment tool 2 for secondary and tertiary care. I can not find Assessment tool 2 in supplementary material.

> Assessment tool 2 is not added to the supplementary materials. This assessment tool was developed from our group and, in the future, we would like to publish this tool in an upcoming publication. Therefore, we are not able to share or publish the content of this tool at the moment.

Comment 6: In Assessment tool 1 for Primary Care, the flow chart for classifying patients is in Dutch. Please provide a translation.

> An updated, translated, version of the assessment tool 1 is uploaded as supplementary material.

Comment 7: In conclusion, it is a very interesting article that I would like to see published. It is a feasibility study that can help clinicians and managers to implement an integrative network program for the management of patients with chronic pain

> We would like to thank you for your comment.

Attachment

Submitted filename: Rebuttal_ExpFeasNetwOrgPainRehab_v3.docx

Decision Letter 1

Jianhong Zhou

4 May 2022

PONE-D-20-32156R1Exploring the feasibility of a network of organizations for pain rehabilitation: what are the lessons learned?PLOS ONE

Dear Dr. Lamper,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Jun 18 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Jianhong Zhou

Staff Editor

PLOS ONE

Journal Requirements:

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #3: (No Response)

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #3: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #3: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #3: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #3: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #3: The study was extensively revised. However, to make it more understandable in my opinion it could be useful to add as supporting information what is written in the published protocol: in particular, the explanation of the primary, secondary and tertiary care with the short related protocol.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #3: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2022 Sep 15;17(9):e0273030. doi: 10.1371/journal.pone.0273030.r004

Author response to Decision Letter 1


2 Jun 2022

Journal requirements and reviewer(s)' Comments to Author:

Comment 1: Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

> We have checked all references and they are all still existing.

Reviewer 3:

Comment 1: The study was extensively revised. However, to make it more understandable in my opinion it could be useful to add as supporting information what is written in the published protocol: in particular, the explanation of the primary, secondary and tertiary care with the short related protocol.

> We thank reviewer 3 for this comment. We agree that an explanation of the healthcare lines and content of NPRL is of added value for the understandability of our study. Therefore, we have added a summary of our published protocol in Supplementary file 1.We adjusted L124 with a referral to the Supporting file.

L124. NPRL is described more extensively in Lamper et al. (2019) (a summery can be found in Supporting file 1): it was developed by a project team consisting of the authors CL, IH, AK, JV and an advisory board consisting of interested HCPs

Attachment

Submitted filename: Rebuttal_ExpFeasNetwOrgPainRehab_May2022.pdf

Decision Letter 2

Jianhong Zhou

13 Jul 2022

PONE-D-20-32156R2Exploring the feasibility of a network of organizations for pain rehabilitation: what are the lessons learned?PLOS ONE

Dear Dr. Lamper,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Specifically, the in-house editorial staff feels that your study should be registered as a clinical trial. In particular, the participants were subject to changes in treatment approach, and health related outcomes were collected as part of the study. There is no need to provide clinical trial related documents (e.g. trial protocol or the CONSORT flow diagram) and to report the work as a clinical trial (i.e. no need to change article type into "clinical trial"), but we do request having your study registered before we proceed. Please see the WHO list of approved registries at http://www.who.int/ictrp/network/primary/en/index.html and more information on trial registration at http://www.icmje.org/about-icmje/faqs/clinical-trials-registration/). Please state the name of the registry and the registration number (e.g. ISRCTN or ClinicalTrials.gov) in the

submission data and on the title page of your manuscript when you resubmit. If you do not feel your study should be registered, please contact the journal office (plosone@plos.org) and explain your reasons.

Please submit your revised manuscript by Aug 26 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Jianhong Zhou

Staff Editor

PLOS ONE

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #3: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #3: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #3: N/A

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #3: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #3: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #3: The revised form of this study has been extensively modified. In this way in my opinion the study can be published

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #3: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2022 Sep 15;17(9):e0273030. doi: 10.1371/journal.pone.0273030.r006

Author response to Decision Letter 2


21 Jul 2022

Jianhong Zhou

Staff Editor

PLOS ONE

Maastricht, the Netherlands, July 21, 2022

Manuscript title: Exploring the feasibility of a network of organizations for pain rehabilitation: what are the lessons learned?

Manuscript ID: PONE-D-20-32156

Dear Jianhong Zhou,

Thank you very much for considering our paper “Exploring the feasibility of a network of organizations for pain rehabilitation: what are the lessons learned?” for PLOS ONE and for having it reviewed a third reviewer in the field of chronic pain. Please find our reaction to the reviewer and summary of the adaptations below. Our reactions are indicated with symbol ‘>’.

We have added the study registration data on the title page of the manuscript. The study is registered at the Netherlands Trial Register at 18/08/2017 (Registration number: NTR6654 or https://trialsearch.who.int/Trial2.aspx?TrialID=NTR6654).

We hope we have met all requirements for publication of the manuscript and we hope to receive a positive response to our re-submission soon.

On behalf of all authors,

Yours sincerely,

Cynthia Lamper, MSc

Maastricht University

Faculty of Health, Medicine and Life Sciences

Department of Rehabilitation Medicine

P.O. Box 616, 6200 MD Maastricht

The Netherlands

E-mail: cynthia.lamper@maastrichtuniversity.nl

Journal requirements and reviewer(s)' Comments to Author:

Comment 1: Specifically, the in-house editorial staff feels that your study should be registered as a clinical trial. In particular, the participants were subject to changes in treatment approach, and health related outcomes were collected as part of the study. There is no need to provide clinical trial related documents (e.g. trial protocol or the CONSORT flow diagram) and to report the work as a clinical trial (i.e. no need to change article type into "clinical trial"), but we do request having your study registered before we proceed.

> We have added the study registration data on the title page of the manuscript. The study is registered at the Netherlands Trial Register at 18/08/2017 (Registration number: NTR6654 or https://trialsearch.who.int/Trial2.aspx?TrialID=NTR6654).

Reviewer 3:

Comment 1: The revised form of this study has been extensively modified. In this way in my opinion the study can be published

> We thank reviewer 3 for this comment

Attachment

Submitted filename: Rebuttal_ExpFeasNetwOrgPainRehab_July2022.pdf

Decision Letter 3

Jianhong Zhou

2 Aug 2022

Exploring the feasibility of a network of organizations for pain rehabilitation: what are the lessons learned?

PONE-D-20-32156R3

Dear Dr. Lamper,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Jianhong Zhou

Staff Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Acceptance letter

Jianhong Zhou

26 Aug 2022

PONE-D-20-32156R3

Exploring the feasibility of a network of organizations for pain rehabilitation: what are the lessons learned?

Dear Dr. Lamper:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Jianhong Zhou

Staff Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Checklist

    (PDF)

    S1 Table. Overview of main barrier and facilitator nodes per CFIR domain and construct.

    (PDF)

    S1 File. Protocol of NPRL.

    (PDF)

    S2 File. Assessment Tool 1: Primary care.

    (PDF)

    S3 File. Topic list focus groups and interviews.

    (PDF)

    Attachment

    Submitted filename: Rebuttal_ExpFeasNetwOrgPainRehab_v3.docx

    Attachment

    Submitted filename: Rebuttal_ExpFeasNetwOrgPainRehab_May2022.pdf

    Attachment

    Submitted filename: Rebuttal_ExpFeasNetwOrgPainRehab_July2022.pdf

    Data Availability Statement

    Most relevant data are within the paper and Supporting information files. The other data for this study consist of transcripts of focus groups and interviews with participants and contain identifying items, and are therefore sensitive to privacy issues. As participants only allowed the interviews under promise of anonymity, we are expressly forbidden by the participants to make the full content of the focus groups and interviews public. Anonymized excerpts from the full transcripts can be made available to qualified researchers by request to the medical ethical committee of Zuyderland, who can be contacted at metc@zuyderland.nl.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES