Abstract
Background
Improving access to specialty care has been identified as a critical issue in the delivery of health services, especially given an increasing burden of chronic disease. Identifying and addressing problems that impact access to specialty care for patients referred to speciality care for non-emergent procedures and how these deficiencies can be managed via health system delivery interventions is important to improve care for patients with chronic conditions. However, the primary-specialty care interface is complex and may be impacted by a variety of potential health services delivery deficiencies; with an equal range of interventions developed to correct them. Consequently, the literature is also diverse and difficult to navigate. We present a narrative review to identify existing literature, and provide a conceptual map that categorizes problems at the primary-specialty care interface with linkages to corresponding interventions aimed at ensuring that patient transitions across the primary-specialty care interface are necessary, appropriate, timely and well communicated.
Methods
We searched MEDLINE and EMBASE databases from January 1, 2005 until Dec 31, 2014, grey literature and reference lists to identify articles that report on interventions implemented to improve the primary-specialty care interface. Selected articles were categorized to describe: 1) the intervention context, including the deficiency addressed, and the objective of the intervention 2) intervention activities, and 3) intervention outcomes.
Results
We identified 106 articles, producing four categories of health services delivery deficiencies based in: 1) clinical decision making; 2) information management; 3) the system level management of patient flows between primary and secondary care; and 4) quality-of-care monitoring. Interventions were divided into seven categories and fourteen sub-categories based on the deficiencies addressed and the intervention strategies used. Potential synergies and trade-offs among interventions are discussed. Little evidence exists regarding the synergistic and antagonistic interactions of alternative intervention strategies.
Conclusion
The categorization acts as an aid in identifying why the primary-specialty care interface may be failing and which interventions may produce improvements. Overlap and interconnectedness between interventions creates potential synergies and conflicts among co-implemented interventions.
Electronic supplementary material
The online version of this article (10.1186/s12913-018-3745-y) contains supplementary material, which is available to authorized users.
Keywords: Health system, Chronic illness, Intervention, Primary care, Secondary care, Specialty care, Referral
Background
In response to the increasing prevalence of chronic conditions and the associated shift in the global burden of disease [1] there is pressure to improve chronic care [2–5]. New models for the delivery of care have been proposed, emphasising better integration between primary and specialty care, coupled with systems for better patient self-management. The goal is a patient centric system, easily navigable, with seamless transitions, that ensures patients receive appropriate services in a timely manner [6–8]. Achieving this goal requires reshaping of the health system through health services delivery interventions; transitioning from a compartmentalized system that is structured in terms of health care services, to an integrated system that is restructured in terms of patient focused chronic care pathways.
Improving access to specialty care, which includes any specialized medical services that can only be provided by a physician specialist, has been identified as an important system level issue, as patient outcomes may be compromised when disease management is delayed. However, accessibility is not easily decoupled from the broader need for the co-ordination of primary and speciality care [9] to ensure that patients are diagnosed and receive timely and effective treatment to manage their conditions, as early as possible. Access to specialty care requires that such services can be provided either locally or remotely. Here, we focus only on the former, as the latter case is deserving of focused consideration. Given that specialty care is locally available, the management of the primary-specialty care interface is important both at a patient level, as a determinant of health outcomes, experience, and satisfaction, and at a systems level as a determinant of patient flows as this interface is prone to inefficiencies [10].
The primary-specialty care interface centres on the referral. There are many reasons a patient might be referred to specialty care including diagnosis, management advice, and treatment beyond the scope of the primary care physician [11]. With growing demand for specialty care, but limited resources to meet demand, referral quality is increasingly important to ensure efficient patient flow across the primary-specialty care interface; referrals should be necessary, appropriate, timely, and well communicated [12]. In addition, the health system must support the referral process by maintaining efficient information exchange and patient flow, especially given the broader need for the co-ordination of primary and speciality care [9].
The primary-specialty care interface is complex [13], with a breadth of potential deficiencies impacting the patient journey through the primary-specialty care interface and an equal breadth of interventions. Previous reviews [10, 14, 15] have synthesized evidence on interventions to improve the primary-specialty care interface. However, while in practice, symptoms of a poorly functioning primary-specialty care interface may be easy to recognize, their causes may not be. In addition, the primary-specialty care interface may be impacted by a breadth of potential deficiencies; with an equal breadth of interventions developed to correct them. The complexity of the primary-specialty care interface requires consideration for both multitude of influencing factors and potential consequences of any given intervention, as well as the interactions amongst interventions, both synergistic and antagonistic [15]. Theory driven approaches are necessary [16]; approaches that consider mechanisms of causality [17, 18] by mapping out the deficiencies, why they arise, and which strategies can be used to intervene based on evidence showing effectiveness.
In this review we deconstruct the primary-specialty care interface to produce a conceptual map between deficiencies that impact access of patients with chronic conditions who are referred to specialty care for non-emergent procedures, interventions and subsequent impacts. The objective is to create an organizational structure that enables system deficiencies to be identified and linked to potential intervention strategies, while considering potential interactions amongst intervention strategies, both synergistic and antagonistic. We focus on the system perspective, where the objective is to optimize the system to improve access to specialty care for non-emergent patients. Consequently, the patient and provider experience are not captured explicitly in this context. The practical outcome is the creation of a resource for health care organizations seeking to optimize the primary care/specialty care interface to improve access to specialty care for non-emergent patients.
Methods
The categorization was developed through an iterative two staged process.
Stage 1: Narrative literature review
Narrative literature reviews provide a flexible methodology to collect, map and summarize current state of knowledge amongst diverse studies, where a key advantage of the narrative review is the ability to examine a wide breadth of literature and to address multiple research topics [19]. This is appropriate here, as we seek to understand a wide range of problems that impact the necessity, appropriateness, timeliness and communication of the referral, as well as how the health system supports the referral process by maintaining efficient information exchange and patient flow. It is important to note that an inherent trade-off with narrative reviews is possible subjectivity in study selection that potentially leads to biases and non-replicability. To maintain transparency, the search strategy is appended. However, the goal of our search is not to inform a comprehensive systematic review, but rather serves to capture a representative sample of the literature sufficient to inform our categorization [20]. An iterative search strategy was developed to capture interventions that address deficiencies at the primary-specialty care interface that impact patient access to specialty care. Given our broad focus on the primary-specialty care interface we sought to limit our search to ensure a manageable number of results. Specifically, we limited our search to peer-reviewed literature published over the most recent 10 year time frame (from January 1, 2005 until May 31, 2014, at time of search), indexed in the MEDLINE and EMBASE databases (see Additional file 1). Medline and EMBASE were selected due to their broad subject coverage including clinical care, public health, health policy development and health services research. Databases such as the CINAHL database, which is a database of nursing and allied health literature, were not included. A grey literature search was also conducted. Studies of interventions meeting all inclusion criteria were considered to be eligible for review: 1) in English 2) report on intervention to correct deficiencies that impact the necessity, appropriateness, timeliness and communication of patient transitions across the primary-specialty care interface, and 3) report on human subjects via primary data, secondary data (review articles) or data validated computer simulation of a health system. Articles were screened by two reviewers at three sequential levels: title, abstract and full text. Quality criteria were not used as our objective was to be inclusive. Selected articles were categorized to identify broad classes of interventions to improve the necessity, appropriateness, timeliness, and communication of referrals. This initial categorization was completed in December 2014. Following this initial categorization, we conducted targeted searches of MEDLINE and EMBASE databases to locate peer-reviewed literature up to December 31, 2014, and searched reference lists of included articles to identify additional relevant articles.
We captured pertinent information from each selected article using a data extraction form, including: specialty, intervention strategy, intervention objective, study design, methods, reported impacts, limitations, and conclusions. Quality of evidence was not scored. Data extractions were completed by a single reviewer and reviewed by a second.
Stage 2: Categorization development
To develop our categorization we described the change process, beginning with contextualizing the need for change, and then detailing the mechanisms for change, including contextual factors which are associated or influence outcomes [21]. The purpose was to assimilate and categorize a broad range of interventions to both highlight their individual functions as well as their relationships. Our end-goal was to develop a categorization based on the broad types of deficiencies that are observed at the primary-specialty care interface. The practical difficulty encountered was that much of the reviewed literature describes the causal mechanisms through which the intervention operates with a forward focus; providing explanations of how the intervention generates change via the intervention’s actions. Explanations and evidence as to why the performance of the primary-specialty care interface is failing were not always provided. As such, to achieve our objective, backwards extrapolation was used to identify deficiencies in the primary-specialty care interface and their causes based on the form of intervention and its actions. The process proceeded through four steps.
In the first step the intervention objectives and activities were recorded as reported in the reviewed articles. Accordingly, we described: 1) the context and the objective of the intervention; 2) intervention activities; and 3) intervention outcomes. In the second step, root causes were extrapolated by considering each intervention action in the context of its objective and identifying the root causes the identified action served to remedy. The data extracted from the included papers were then synthesized as themes and categorized with a focus on high level deficiencies and their causes thereby creating the categorization scheme [20]. In step three, the previously recorded intervention objectives and activities were remapped within the new categorization scheme. In the final step, a summary of reported impacts were linked to the intervention activities and we finished by discussing potential synergies and conflicts among intervention strategies. Although the above process is presented as linear, in practice the four steps were iterative allowing the categorization to evolve to its final form.
Results
Stage 1: Narrative literature review
The results of the literature search are presented in Fig. 1 (PRISMA diagram). The search returned 4893 records (Medline: 1679, Embase 3010, Articles Identified through targeted and citation searches 204). In total, 4787 records were identified as not meeting the inclusion criteria based on their title. Abstracts were reviewed in the remaining 368 articles. In total, 228 articles were excluded based on the information found in the abstract. 140 articles were extracted and reviewed in full text, with 106 of those included in this review.
Reviewed articles included systematic reviews, data validated computer simulations and empirical studies ranging from quality improvement reports, to time series analyses, and randomized controlled trials. Given the wide range of studies included in this review, the quality of the evidence reported varies among the reviewed articles. As previously noted, quality of evidence was not formally assessed here, as our objective is to provide an organizational structure that enables system deficiencies to be identified and linked to potential intervention strategies. Once the categories of intervention strategies are identified, evidence demonstrating intervention effectiveness can be reviewed as a next step. In particular, it will be important to determine if available evidence for a given category of intervention is highly context specific, or if there is a broad base of evidence that demonstrates the effectiveness of the intervention in variety of health services delivery applications and contexts.
Stage 2: Categorization
Four categories of health services delivery deficiencies were identified: deficiencies based in 1) clinical decision making, 2) information management, 3) the system level management of patient flows between primary and secondary care, 4) quality-of-care monitoring. Each is detailed below and mapped to intervention strategies, and reported impacts. Interventions were divided into seven categories and fourteen sub-categories based on the deficiencies addressed and the intervention strategies used. Figure 2 presents an overview of the categorization, with details captured in Tables 1 and 2.
Table 1.
Intervention Context Identified deficiency in Health services delivery •Impact of deficiency •Intervention types and objectives | |||
D.1. Deficiencies based in clinical decision making – Referral error | |||
Deficiency | Sub-types and root cause | Impact of deficiency | Intervention types and Objectives (see Table 1B) |
Referral errors as a natural consequence of diagnosis as a probabilistic process. | 1. Unnecessary and inappropriate referrals (False positives) - Referral is unnecessary or inappropriate. | Poor patient experience, delay in receipt of diagnosis/care, compromised patient outcome. Impeded patient flows at the primary-specialty care interface and decreased efficiency of the health system. Potential impacts include: access delays, increased short term costs, increased long term costs as a result of a higher proportion of patients with severe conditions |
Preventive interventions to reduce the occurrence of Type I errors, Type II errors, triaging errors and communication delays Screening interventions – to detect Type I errors, Type II errors, triaging errors and communication delays that have occurred. |
2. Delayed referrals (False negatives) - Referral is warranted, but not made. | |||
3. Triaging Errors - Improper prioritization of patients based on urgency. | |||
4. Communication delays - Referrals are delayed due to missing information and/or diagnostics. | |||
D.2. Deficiencies based in information management- Technologies | |||
Deficiency | Root cause | Impact of deficiency | Intervention types and Objectives (see Table 1B) |
Delays due to outdated communication systems | Referrals and subsequent correspondence, forwarding of diagnostics, etc. via standard mail or fax. | Poor patient experience, delay in receipt of diagnosis/care, compromised patient outcome. | Electronic referral systems (e-referrals) and electronic medical records (EMRs) to expedite information sharing |
D.3. Deficiencies based in system level management of patient flows between primary and secondary care – Supply and demand management | |||
Deficiency | Root cause | Impact of deficiency | Intervention types and Objectives (see Table 1B) |
Delays due to care pathway structure and management | 1. Care pathway management Inefficient care pathway structure and resource use hinders patient flows. |
Poor patient experience, delay in receipt of diagnosis/care, compromised patient outcome. Impeded patient flows at the primary-specialty care interface and decreased efficiency of the health system. Potential impacts include: access delays, increased short term costs, increased long term costs as a result of a higher proportion of patients with severe conditions |
Care pathway management - streamlining |
Delays due to human resource management | 2. Role management (Inter-professional workload imbalance) Creation of bottlenecks within the care pathway as a result of insufficient specialty care providers (Short term and sustained). |
Human resource management - Scope of practice restructuring at primary-specialty care interface to increase supply of services | |
Delays due to queue/referral management | 3. Queue/Referral management Intra-professional workload imbalance Disproportionate allocation of referrals amongst specialists producing an imbalance in specialist utilizations. |
Queue/referral management - Centralized intake of referrals to improve access to specialty care. | |
D.4. Deficiencies based in quality/performance monitoring | |||
Deficiency | Root cause | Impact of deficiency | Intervention types and Objectives (see Table 1B) |
Inability for performance improvement due to Insufficient data capture | Lack of a measurement framework to adequately track system performance | Decreased efficacy of operational decision making | Continuous quality improvement frameworks |
Table 2.
Core intervention strategies Identified Health services delivery interventions •Strategy, objective, target population, Target impact, Reported Impacts | ||||
I.1. Interventions to reduce referral error | ||||
1. Preventive interventions to reduce the occurrence of false positives, false negatives, triaging errors and communication delays. | ||||
Strategy | Objective | Target population | Target impact | Reported impact |
Referral Guidelines | Clinical Guidelines: guidance on necessity, appropriateness and timeliness of referrals. Clerical guidance: guidance on completeness of referrals. |
Referring physicians | Improve referral decisions: reduce false positives (unnecessary and inappropriate referrals), reduce false negatives (delayed referrals). Improve the communication of the referral. | Passive introduction of guidelines produces little change [36–47]. Guidelines with feedback may be effective [43, 53–56]. Coordinated introduction of guidelines, with standardized referral process can improve referral appropriateness and potentially lower wait times [64–70]. |
Standardized referral process | Set standards for referral quality. Aids include: standard referral forms, criteria checklists, diagnostic checklists, scoring systems. |
|||
Shared/Supported patient assessment | Improved sensitivity/specificity of referral decision through decision support via professional networks: primary care groups, and multidisciplinary groups. | Referring physicians and allied health workers | Improved referral appropriateness while decision support is available [14, 58–61]. | |
Primary care clinical education programmes and clinical screening tools | Improve sensitivity/specificity of referral decision through improved primary care disease specific knowledge and diagnostic screening tools | Referring physicians | Primary care education programmes and clinical screening tools. Reduction in number of delayed referrals, and improved referral appropriateness [48, 49, 64–70]. | |
2. Screening interventions – to detect false positives, false negatives, triaging errors and communication delays. | ||||
Strategy | Objective | Target population | Target impact | Reported impact |
Public awareness campaigns, community case finding strategies, community screening programs | Improved public awareness as to when to seek care with primary care provider, or direct public outreach. | Patient population. | Improved identification of patients in need of specialist care and reduction in number of delayed referrals | Improved identification of patients in need of specialist care and reduction in number of delayed referrals [87, 88]. |
Clerical screening of referrals | Screening of incoming referrals, to ensure referral completeness and triage referrals based on urgency. | Specialty care referral administration | Identify incomplete referrals, and request missing information from referring physician. Reduce scheduling of incomplete referrals. | Reduction of incomplete referrals being scheduled [75]. Improved triaging of referrals based on urgency [77–80]. |
Clinical screening of referrals | Confirm necessity and appropriateness of referral based on patient’s diagnostic images/test results that are requisite for the referral. Triage appropriate referrals. | Specialists/consultants | Identify and redirect false positives (unnecessary and inappropriate referrals), triage referrals based on urgency as indicated by diagnostic images/test results. | Redirection of unnecessary/ inappropriate referrals [10, 76]. |
Clinical screening of patients | Confirm necessity and appropriateness of referral based on clinical assessment of the patient. Identify appropriate care alternatives when specialist care is not required (e.g. conservative management for OA not requiring arthroplasty). Triage appropriate referrals. | Specialists/consultants, referring physicians and allied health workers | Identify and redirect false positives (unnecessary and inappropriate referrals), triage referrals based on urgency as indicated by clinical assessment. | Redirection of unnecessary/ inappropriate referrals |
I.2. Interventions to improve information management- Information technologies | ||||
Electronic referral systems (e-referrals) and electronic medical records (EMRs) to expedite information sharing | ||||
Strategy | Objective | Target population | Target impact | Reported impact |
Electronic referral systems and Electronic Medical records | Provide a standardized electronic referral process that ensures completeness of relevant information and diagnostics with the referral, and timely communication. | System level change affecting Primary care through specialty care. | Improve efficiency of referral submission. Reduce wait time between the time the referral is made and the time it is received and appointment is scheduled. | Electronic referral systems and electronic health records Improved workflow efficiency from referral submission, to screening and scheduling resulting from higher quality referral, improved access to diagnostics, and efficient communications [28, 29, 95]. Improved necessity/appropriateness of referrals due improved referral quality and enabling improved clerical/clinical screening of referrals [48, 92–94]. |
I.3 Interventions to improve system level patient flows between primary and secondary care – Supply and demand management | ||||
1. Care pathway management - streamlining | ||||
Strategy | Objective | Target population | Target impact | Reported impact |
Direct/open access to diagnostics and specialty services | Provide direct, or open access, to specialty services by eliminating one or more steps along the traditional referral pathway. | System level change affecting primary care through specialty care. | Improved access to diagnostics, and specialty care. | Improved access to diagnostics and or specialty services, reduced waiting times [97–104]. |
2. Human resource management - Scope of practice restructuring at primary-specialty care interface to increase supply of service | ||||
Strategy | Objective | Target population | Target impact | Reported impact |
Altered scopes of practice | Increased focus on specialty services by specialists supported with expanded scope of practice by non-specialist care providers. | Specialists and non-specialist care providers such as nurse practitioners, allied care and primary care. | Improved access to specialists via creation of capacity through alternative service delivery methods | Nurse led clinics/services: Reduced workload for physicians. Increased attention and timely care to patients. Evidence has shown nurse-led clinics can provide equivalent care with no greater risk of poorer outcomes [113, 114, 116] Similar outcomes reported for Primary care physicians with extended roles [119, 120]. |
Multi-disciplinary team based care | Coordinated care providing patient improved access to a broad range of complimentary care services. | Specialists and non-specialist care providers such as nurse practitioners, allied care and primary care. | Improved Quality of care. Improved access to specialists via creation of capacity through alternative service delivery methods. | Multi-disciplinary team based care: Better patient access to a wide range, but increasingly specialized health care services that may be required for effective disease management [123, 124]. Evidence regarding the cost-effectiveness of multidisciplinary team based care is lacking, and further studies are required [148]. |
3. Queue/referral management - Centralized intake of referrals to improve access to specialty care. | ||||
Strategy | Objective | Target population | Target impact | Reported impact |
Referral management centres | Pooled intake and subsequent scheduling of all incoming referrals for all specialties | System level intervention, requiring critical buy-in from referring physicians and specialists. | Decreased wait times. | Systematic evaluations of referral management centres are needed [73]. |
Specialty specific triaging clinics | Pooled intake and subsequent scheduling of all incoming referrals for specific specialty (or sub-specialty) | System level intervention, requiring critical buy-in from referring physicians and specialists. | Decreased wait times. | Improved referral processes, improved patient triaging, improved appropriateness, improved wait times to specialist consult [58, 121, 132–134], unchanged wait times to downstream benchmarks such as surgery [135, 136], provider satisfaction may be low [135]. |
I.4 Interventions to monitor and improve quality and/or performance | ||||
Continuous quality improvement | ||||
Strategy | Objective | Target population | Target impact | Reported impact |
Quality/performance improvement frameworks | Provide capacity for strategic decision making using information that relates operational and management decisions to their outcomes | System, Hospital, Clinic level targets | Improve strategic decision making, and management of operations. | Performance measures of referral processes and outcomes including the adequacy and appropriateness of coordination of referrals and the quality, resource use and outcomes of referrals are lacking [138] |
Identified deficiencies at the primary-specialty care interface (Table 1)
D.1. Deficiencies based in clinical decision making encompass referral errors that pertain to the necessity, appropriateness, timeliness and communication of referrals. Note that the parameters defining the necessity, appropriateness and timeliness of a referral, as well as the information and diagnostics needed to support the referral vary between specialities and are set by current standards of care. Referral errors deviations from the defined parameters that are the result of the diagnostic process, which is probabilistic in nature and implies uncertainty and error. Four types of error were identified:
Unnecessary and inappropriate referrals are the product of false positives, which occur when the patient is inappropriately/unnecessarily identified as needing a referral to specialty care.
Delayed referrals are the product of false negatives, which occur when a referral to specialty care is necessary but is not made, resulting in patients not being referred until their condition reaches late stages [22–24].
Triaging errors result when patients are improperly prioritized based on the severity of their condition.
Communication errors result when sufficient information and diagnostics are not provided [25–27].
D.2. Deficiencies based in information management encompass delays that result due to technological communication breakdowns at the primary-specialist care interface. Traditionally the referral letter has been the principal means of communication and its importance is well recognized [10]. However, unnecessary delays result from the reliance on antiquated communication technologies as a means of transmitting referral requests and subsequent communications and diagnostics between primary and specialty care. Modern information technologies can facilitate improved linkages between primary care providers and specialists [28, 29] and help limit communication delays.
D.3. Deficiencies based in the management of patient flows between primary and specialty care (Supply and demand management) encompass both the organization of care pathways traversing the primary-specialty interface and their management. The care pathway is a key determinant of the patient flows from primary to specialty care, dictating the options available to primary care providers and influencing how demand is distributed across specialty care providers and diagnostic service providers. Care pathways are designed to incorporates all relevant factors necessary to provide quality care, but should be as efficient as possible, ensuring that patients receive the appropriate care as quickly as possible. Three types of issues were identified in the management of patient flows between primary and specialty care:
Care pathway management. Inefficient care pathway structure and resource use hinders patient flows.
Role management (Inter-professional workload imbalance). Surplus demand placed on specialty care providers, creates bottlenecks within the care pathway (Short term and sustained).
Queue/Referral management (Intra-professional workload imbalance). Unmanaged distribution of referrals amongst specialty care providers may create an imbalance in specialist utilizations that unnecessarily increases average wait times.
D.4. Deficiencies in the monitoring of quality-of-care and system performance result when measurement frameworks, needed to provide decision makers the capability for strategic decision making, are lacking. Quality-of-care/performance improvement is promoted as a core value in the healthcare field, with numerous frameworks developed to measure and track the performance of health systems [30–32].
The impact of these four categories of deficiencies is significant, creating unnecessary delays to appropriate specialty services. At a system level, such deficiencies impact the efficiency of the health system, creating access delays for all referred patients, increased costs and extra strain on care providers. At a patient level, such errors result in a poor patient experience, and potential delays in diagnosis and therapy initiation compromising patient outcomes (e.g. rheumatoid arthritis [33, 34] and chronic kidney disease [35]). A lack of quality-of-care/performance monitoring compounds these issues, making it difficult to identify, evaluate the severity, and prioritise problems that arise at the primary-specialty care interface.
Intervention strategies and outcomes (Table 2)
I.1. Interventions to reduce referral error
1. Preventive interventions to reduce the occurrence of false positives, false negatives, triaging errors and communication delays.
Preventive interventions serve to improve referral quality and reduce the occurrence of referral errors. Referral guidelines [36–47] and education programs [48–52] targeting primary care providers generally serve as the foundation for such interventions. However, guidelines and education alone may be ineffective without feedback opportunities [43, 53–56] and relationship building [57]. Similarly, peer review or shared/supported patient assessment may also reduce rates of unnecessary/inappropriate or delayed referrals and can be implemented via primary care triage clinics [58, 59], multidisciplinary team based diagnosis [14], and peer consult groups [60, 61]. The introduction of a referral process that employs standard referral forms, criteria checklists, diagnostic checklists, scoring systems [14, 62, 63] and assessment tools developed specifically for primary care use [64–72] serves to improve referral quality. Local health services providers should be included in dissemination activities, allowing the intervention to adapt to local circumstances [10, 50, 73].
2. Screening interventions to detect false positives, false negatives, triaging errors and communication delays.
Screening interventions serve to catch referral errors that do occur. Reassessing patients on wait lists for need and appropriateness can reduce wait lists [74]. Clerical screening of referrals ensures completeness in terms of needed information and diagnostics [75]. Clinical screening of diagnostics prior to a specialist consult may redirect unnecessary or inappropriate referrals [10, 76]. Screening referrals also allows referrals be triaged based on urgency. Triaging may be conducted through various means, from reviewing clinical findings and diagnostic test results to the development of specific scoring systems [77–80, 81, 82]. Previous reviews of triaging systems concluded that further evidence is required regarding the effectiveness and reliability of triaging [83], and whether triaging improves patient outcomes [84] and waiting times [83, 85]. It is difficult to identify interventions developed to catch type II errors. Since type II error results when a patient should be referred to specialty care but is not, such errors must be caught by the patient themselves. Improved patient awareness may encourage patients to voice their concerns with their primary care provider, or seek a second opinion. Various strategies are outlined for Rheumatoid arthritis [86]. For example, internet based education sites and public awareness campaigns can be used to raise patient awareness. Community screening/outreach programmes provide patients direct access to healthcare professionals and provide alternative means for undiagnosed patients to enter specialist care [87, 88].
I.2. Interventions to improve information management- electronic referral systems and electronic medical records to expedite information sharing
Electronic referral systems (eReferrals), supplemented with electronic medical records (EMRs) enable improved information management, improving workflow efficiency and quality-of-care through better linkages between primary and specialty care, improved dialogue, and better coordination of primary and specialty care resources [28, 29, 89]. eReferrals also help facilitate transmision of diagnostics [28, 90], reduce duplicate testing [91] and in some cases enable referral triaging, which can improve the appropriate use of clinic time and significantly improve wait times for patients needing to see specialists [48, 92–94]. While eReferral systems hold great promise, in practice, the successful development and implementation of such systems has been difficult [95]. Barriers include the high cost and extensive strategic planning required for development, privacy and data security, and technical barriers such as interoperability between proprietary EMRs [28]. The benefits of eReferrals may well outweigh these costs but further empirical evidence is required.
I.3 Interventions to improve system level patient flows between primary and secondary care
1. Care pathway management - streamlining
Patient flows between primary and secondary care may be improved by the removal of unnecessary gatekeeping along the referral pathway, providing direct or open access. Examples include allowing patients to self-refer for follow up on uncertain diagnoses [96], allied health workers to refer directly to specialists [27], and allowing primary care physicians to circumvent preliminary specialist assessments in favour of proceeding straight to advanced diagnostics [26, 97–104, 105, 106] and even surgery [107]. A similar strategy involves specialties running rapid access clinics to triage and provide care to urgent patients [108–111]. The inherent trade-off that comes with providing direct or open access is the potential for increased rate of inappropriate referrals or diagnostic requests. For example, one study found that in an open access system for endoscopic procedures, agreement between GPs and specialists was poor to moderate, with specialists viewing 22.1% of referrals as inappropriate [105].
2. Human resource management - Scope of practice restructuring.
In systems constrained by workforce shortages, improved patient flows may be achieved by allocating selected tasks to alternative health care professionals with similar scopes of practice (e.g. [112]). For example, extending the roles of nurses and nurse practitioners in specialty areas such as rheumatology [113], cardiology [114, 115] and oncology [116] can reduce demand for specialists while providing equivalent care with no greater risk of poorer outcomes. Similar roles may be played by allied health care providers such as physiotherapists [117, 118], and primary care physicians [119, 120]. The formation of multi-disciplinary care teams (MDTs) that provide an integrated approach to healthcare and may improve load sharing between medical and allied health professionals who work collaboratively (e.g. [121]). MDTs have become the standard of care in Oncology [122], enabling better patient access to a wide range, but increasingly specialized health care services for disease management [123, 124], but are also thought to be an effective model for chronic diseases requiring complex management strategies [125]. Current evaluations of MDT care focus on clinical benefit to the patient [126, 127] and information on system level outcomes and cost-effectiveness is lacking [128].
3. Queue/referral management - Centralized intake of referrals to improve access to specialty care.
Referral management via centralized intake provides a mechanism for manage demand intra-professionally [121, 129–131] and to mitigate the effects of fluctuations in staffing, facility availability, and caseload (emergent, urgent, non-urgent, etc.). Centralized intake has been implemented through dedicated referral management centres, which are tasked with handling all incoming referrals for all specialties, and specialty based clinical assessment clinics. Systematic evaluations of referral management centres are lacking [10, 14]. There is evidence showing speciality based clinics offer improved urgency-based access to specialists [58, 121, 132–134]. While specialty based clinics have demonstrated a decreased wait period from referral to first consult, other wait periods may remain unchanged, such as the wait period from referral to surgery [135, 136]. Specialty triage clinics may also reduce the overall rate of unnecessary and inappropriate referrals, resulting in patients being appropriately diverted from specialist care [137].
I.4 Interventions to monitor and improve quality and/or performance - continuous quality improvement
Guavara et al. [138] review performance measures for the specialty referral process, categorizing performance measures into 4 principle domains: 1) referral initiation (reason and rates of referral), 2) accessibility to specialty care 3) coordination of primary and secondary care, and 4) quality (timeliness and satisfaction), with the majority of measures reporting on referral structures. Performance measures for referral processes and outcomes are lacking, and although most of the reviewed measures included assessments of validity, few reported on reliability.
Synergies and trade-offs
We end by identifying potential synergies and conflicts among intervention strategies. Recognizing synergies or trade-offs is important when attempting to manage multiple intervention strategies that may seek to achieve common or conflicting objectives [139].
Potential synergies amongst the reviewed interventions were identified. For example, centralized intake of referrals may facilitate the introduction of a standardized referral process, with supporting guidelines, especially if implemented with eReferrals [93, 140–142] improving workflow efficiency by ensuring the completeness of the referral and providing access to relevant information and diagnostics thus hastening the screening of the referral [28, 90]. In addition, standardized referral forms ensure the patient’s information, history, physical exams, laboratory tests and urgency are communicated to the specialist [143–145], improving triaging. Centralized intake may also facilitate the introduction of both preventive and screening interventions to reduce inappropriate/unnecessary referrals. When coupled with EMRs, referrals can be clinically screened, reducing the need for face-to-face assessment, instead allowing referrals and diagnostics to be reviewed remotely [48, 93, 94]. Triaging may be coupled with rapid access services to reduce wait times between referral and patient assessment [110].
Identifying potential conflicts between intervention strategies requires an understanding of the mechanisms of causality that explain why deficiencies arise, and how they are corrected via intervention. For example, our discussion of referral errors (false positives and false negatives) and the corresponding corrective interventions would not be complete without acknowledging that in many cases a trade-off will need to be made between inappropriate /unnecessary referrals and delayed referrals. Indeed, a decreased specificity and increased sensitivity will result in fewer false negatives but increased false positives, which will increase the demand for specialty services. Alternatively, an increased specificity and decreased sensitivity will result in fewer false positives but an increased number of false negatives which will increase the number of patients remaining undiagnosed and improperly managed. Interventions are needed to not only improve the sensitivity and/or specificity of the decision process, but also to optimise the balance between the sensitivity and specificity. Similarly, interventions designed to reduce or catch referral errors (sometimes called gatekeeping) may be in conflict with accessibility. For example, screening interventions to reduce rates of unnecessary and inappropriate and/or delayed referrals may introduce additional waiting periods. Such processes must be effective in redirecting inappropriate referrals in order to offset additional delays and costs that are introduced. If the false positive/negative error rates are sufficiently low, then it may be of benefit to move towards a more direct, or open access, referral system that eliminates one or more screening steps along the traditional referral pathway. Conversely, removal of screening processes to improve access times to diagnostics and specialty services may increase the frequency of inappropriate/unnecessary referral to these services, increasing wait times for all patients (appropriately and inappropriately referred). Finally, balance between system, provider, and patient perspectives is always needed. For example, when assessing referral management strategies such as centralized intake, caution is required not to limit focus purely to system efficiency. Both primary and specialist provider participation is crucial for effective centralized intake systems. Reasons for non-participation include loss of autonomy, loss of primary-specialist care relationships, and loss of control over case-loads [135]. Patients may prefer the option to have input into the scheduling of appointments [146], but appropriateness may decrease [147]. Interestingly our search revealed little if any discussion regarding the strategic balancing of these effects.
Discussion
There is a large literature pertaining to interventions that impact the necessity, appropriateness, timeliness and communication of patient transitions across the primary-specialty care interface. The literature is broad and can be difficult to navigate due to complexity of the primary-specialty care interface, the breadth of potential deficiencies, and the equal breadth of interventions developed to correct them. As such, we present a narrative review that describes linkages between deficiencies at the primary-specialty care interface, which impact access to specialty services for non-emergent patients, with interventions and subsequent effects.
This review was focussed only on deficiencies at the primary-specialty care interface that impact access to specialty services to address our objective on these specific problems. The review does not consider deficiencies at the primary-specialty care interface that impact the broader patient and service provider experience. While improving access to specialty care is a critical issue in the delivery of health services, more broadly, health system performance is measured in terms of quality of care criteria in multiple dimensions. Improving access to care must be done in the context of the broader objective of improving the overall quality of care provided to patients suffering from chronic diseases.
Limitations
This review is unlikely to be complete, especially given the broad scope of our topic. The literature on health services interventions applied at the primary-specialty care interface is vast, spanning many fields from clinical practice to economics and operations research. Inevitably there are bodies of work that will be revealed to have been left out. For example, the omission of CINAHL in our search strategy may have resulted in missed studies pertaining to the roles and impact of allied health care workers and nurse practitioners in reducing wait times for specialist services when the service the patient required could be provided by a nurse practitioner or an allied health care provider. Moreover, as the primary-specialty care interface continues to evolve, new problems will inevitably arise and future research will produce new innovative health system interventions.
We did not summarise the context and assess the quality of each study. Our aim and focus were to note that from a system perspective, the literature is fragmented. Specifically, the studies reviewed were generally highly context specific; developed to document improvements to in-use, specialty specific, referral systems experiencing specific difficulties (e.g. long wait times). Such an approach does not lend itself to establish the effectiveness of the intervention in the broader health systems context. Consequently, it is not clear if the available evidence pertaining to intervention effectiveness can be taken out of context. The reviewed studies were not developed to demonstrate intervention effectiveness in variety of applications and contexts.
Value
The key strength of this review is its emphasis on the identification and categorization of deficiencies in the primary-specialty care interface by cause. Within the literature, interventions are commonly framed in terms the practical actions taken to create improvements in system performance as measured through specific outcomes such as reduced wait times between referral and consult. However, simply detailing an intervention’s actions and outcomes without describing the deficiencies the intervention is designed to correct can lead to potential mis-application. The potential issue here is one of logical verification; the logic that supports the adaptation and implementation of the reviewed interventions to new contexts can only be verified through an understanding as to why the performance of the primary-specialty care interface is failing in the first place. The intention is that such a causal approach will facilitate the development of complex integrated health system interventions that consist of multiple coordinated intervention components, managing different shortfalls in the referral system that arise at the primary-specialty care interface. The categorization serves as a necessary first step to facilitate the development and evaluation of such complex interventions. The practical outcome is the creation of a resource for health care organizations seeking to optimize the primary care/specialty care interface to improve access to specialty care for non-emergent patients from a systems perspective.
Conclusion
The results of this review demonstrate the breadth of deficiencies that impact access to specialty services for non-emergent patients via primary-specialty care interface and an equal breadth of corrective interventions. Although interventions developed to improve the referral process at the primary-specialty care interface hold great promise, much work remains to better understand the potential utility of such interventions. Deficiencies that limit access to specialty care for non-emergency patients, as outlined here, arise independent of context. As such, general intervention strategies that can be adapted and applied in broad range of contexts are needed.
Additional file
Acknowledgements
JGL was employed a research associate at the University of Calgary during this project and funded by the PRIHS grant awarded to DM and LW. LJ was employed as a research assistant at the University of Calgary on this project and funded by the A.E Child Chair grant awarded to DM. Thank you to Yoojin Kwon, MLS (Master of Library Science), for her assistance developing the search strategy for this review.
Funding
This project was funded by a Partnership for Research and Innovation in the Health System (PRIHS) grant provided by Alberta Innovates Health Solutions DM is supported by a Canada Research Chair, Health Services and Systems Research and the Arthur J.E. Child Chair in Rheumatology Outcomes Research. LJ was supported through the Arthur J.E. Child Chair in Rheumatology Outcomes Research.
Availability of data and materials
Data sharing not applicable to this article as no datasets were generated or analysed during the current study.
Abbreviations
- EMRs
Electronic medical records
Authors’ contributions
JGL had the original idea and led the drafting of the paper. Early drafts were developed between LJ and JGL. DM and LW provided comments and helped refine the categorization. All authors read and approved the final manuscript.
Ethics approval and consent to participate
Not Applicable.
Consent for publication
Not Applicable.
Competing interests
JGL and LJ declare the following interests: None
DM declares the following interests: Ad hoc consulting for Optum, a health economics and outcomes research global company. Honoraria and travel expenses as a member of Pfizer HTA Advisory Board, honoraria and travel expenses for a seminar for Abbvie, honoraria and travel expenses for a presentation for Novartis, honoraria and travel expenses for a presentation for Janssen.
Unpaid officerships - President and member of Board of Directors, International Society for Pharmacoeconomics and Outcomes Research, and member of Board of Directors, Health Technology Assessment International, Editorial Board The Patient, Editorial Board, International Society for Technology Assessment in Health Care.
LW declares the following interests: Funding from Eli Lilly for myostatin trial design and serving on an advisory board for myostatin development.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Contributor Information
James Greenwood-Lee, Email: jgreenwoodlee@athabascau.ca.
Lauren Jewett, Email: lauren.jewett@mail.utoronto.ca.
Linda Woodhouse, Email: linda.woodhouse@ualberta.ca.
Deborah A. Marshall, Email: damarsha@ucalgary.ca
References
- 1.Vos T, et al. Years lived with disability (YLDs) for 1160 sequelae of 289 diseases and injuries 1990-2010: a systematic analysis for the global burden of disease study 2010. Lancet. 2012;380(9859):2163–2196. doi: 10.1016/S0140-6736(12)61729-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Pruitt S, Annandale S, World Health Organization . Noncommunicable diseases and mental health. Geneva: World Health Organization; 2002. Noncommunicable Disease and Mental Health Cluster., Innovative care for chronic conditions building blocks for action : global report. [Google Scholar]
- 3.Institute of Medicine (U.S.). Committee on Quality of Health Care in America. and ebrary Inc. Crossing the quality chasm a new health system for the 21st century. Washington, D.C: National Academy Press; 2001. [Google Scholar]
- 4.Institute of Medicine (U.S.) and ebrary Inc . Crossing the quality chasm, in Richard and Hinda Rosenthal lectures 2001. Washington, D.C: National Academy Press; 2003. [PubMed] [Google Scholar]
- 5.Bodenheimer T. Coordinating care - a perilous journey through the health care system. N Engl J Med. 2008;358(10):1064–1071. doi: 10.1056/NEJMhpr0706165. [DOI] [PubMed] [Google Scholar]
- 6.Wagner EH, Austin B, VonKorff M. Organizing care for patients with chronic illness. Milbank Q. 1996;74(4):511–544. doi: 10.2307/3350391. [DOI] [PubMed] [Google Scholar]
- 7.Wagner EH, et al. Quality improvement in chronic illness care: a collaborative approach. J Qual Improv. 2001;27(2):63–80. doi: 10.1016/S1070-3241(01)27007-2. [DOI] [PubMed] [Google Scholar]
- 8.Koh H, et al. Analysis & commentary: a proposed ‘health literate care model’ would constitute a systems approach to improving patients’ engagement in care. Health Aff. 2013;32(2):357–367. doi: 10.1377/hlthaff.2012.1205. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.McDonald KS, Sundaram V, Bravata DM, Lewis R, Lin N, Kraft SA, McKinnon M, Paguntalan H, Owens DK. In: Shojania KM, Wachter RM, Owens DK, editors. Closing the Quality Gap: A Critical Analysis of Quality Improvement Strategies. Rockville: Agency Healthc Res Qual; 2007. [PubMed]
- 10.Imison C, Naylor C. Referral management: Lessons for success. London: The King’s fund; 2010. [Google Scholar]
- 11.Redfern J, Bowling A. Efficiency of care at the primary-secondary interface: variations with GP fundholding. Health Place. 2000;6(1):15–23. doi: 10.1016/S1353-8292(99)00026-X. [DOI] [PubMed] [Google Scholar]
- 12.Blundell N, Clarke A, Mays N. Interpretations of referral appropriateness by senior health managers in five PCT areas in England: a qualitative investigation. Qual Saf Health Care. 2010;19(3):182–186. doi: 10.1136/qshc.2007.025684. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Baxter SK, et al. Using logic model methods in systematic review synthesis: describing complex pathways in referral management interventions. BMC Med Res Methodol. 2014;14:62. doi: 10.1186/1471-2288-14-62. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Akbari A, et al. Interventions to Improve outpatient referrals from primary care to secondary care [Systematic Review]: The Cochrane collaboration. Wiley; 2011. 4 CD005471. 8 Oct. 2008, 10.1002/14651858.CD005471.pub2 [DOI] [PMC free article] [PubMed]
- 15.Blank L, et al. Referral interventions from primary to specialist care: a systematic review of international evidence. Br J Gen Pract. 2014;64(629):e765–e774. doi: 10.3399/bjgp14X682837. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.De Silva MJ, et al. Theory of change: a theory-driven approach to enhance the Medical Research Council’s framework for complex interventions. Trials. 2014;15:267. doi: 10.1186/1745-6215-15-267. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Campbell M, Fitzpatrick R, Haines A, Kinmonth AL, Sandercock P, Spiegelhalter D, et al. Framework for design and evaluation of complex interventions to improve health. BMJ. 2000;321:694. [DOI] [PMC free article] [PubMed]
- 18.Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M, et al. Developing and evaluating complex interventions: the new Medical Research Council guidance BMJ. 2008;337:a1655. [DOI] [PMC free article] [PubMed]
- 19.Ferrari R. Writing narrative style literature reviews. Med Writing. 2015;24(4):230. doi: 10.1179/2047480615Z.000000000329. [DOI] [Google Scholar]
- 20.Thomas J, Harden A. Methods for the thematic synthesis of qualitative research in systematic reviews. BMC Med Res Methodol. 2008;8:45. doi: 10.1186/1471-2288-8-45. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Anderson LM, et al. Using logic models to capture complexity in systematic reviews. Res Synth Methods. 2011;2(1):33–42. doi: 10.1002/jrsm.32. [DOI] [PubMed] [Google Scholar]
- 22.Roderick P, et al. Late referral for end-stage renal disease: a region-wide survey in the south west of England. Nephrol Dial Transplant. 2002;17(7):1252–1259. doi: 10.1093/ndt/17.7.1252. [DOI] [PubMed] [Google Scholar]
- 23.Clark M, Thomas J. Delay in referral to a specialist soft-tissue sarcoma unit. Eur J Surg Oncol. 2005;31(4):443–448. doi: 10.1016/j.ejso.2004.11.016. [DOI] [PubMed] [Google Scholar]
- 24.Khattak I, Eardley N, Rooney P. Colorectal cancer - a prospective evaluation of symptom duration and GP referral patterns in an inner city teaching hospital. Color Dis. 2006;8(6):518–521. doi: 10.1111/j.1463-1318.2006.00967.x. [DOI] [PubMed] [Google Scholar]
- 25.Gandhi TK, et al. Communication breakdown in the outpatient referral process. J Gen Intern Med. 2000;15(9):626–631. doi: 10.1046/j.1525-1497.2000.91119.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Jack C, Hazel E, Bernatsky S. Something’s missing here: a look at the quality of rheumatology referral letters. Rheumatol Int. 2012;32(4):1083–1085. doi: 10.1007/s00296-011-1832-z. [DOI] [PubMed] [Google Scholar]
- 27.Foot CN, Imison C. The quality of GP Diagnosis and Referral. London: The King’s Fund; 2010. [Google Scholar]
- 28.Fontaine P, et al. Systematic review of health information exchange in primary care practices. J Am Board Fam Med. 2010;23(5):655–670. doi: 10.3122/jabfm.2010.05.090192. [DOI] [PubMed] [Google Scholar]
- 29.Chen AH, Murphy EJ, Yee HF. eReferral - a new model for integrated care. N Engl J Med. 2013;368(26):2450–2453. doi: 10.1056/NEJMp1215594. [DOI] [PubMed] [Google Scholar]
- 30.Musgrove P, Creese A, Preker A, Baeza C, Anell A, Prentice T. With contributions from Cassels A, Lipson D, Tenkorang DA and Wheeler M. Link to report: http://www.who.int/whr/2000/en/whr00_en.pdf.
- 31.OECD (2010). Improving Value in Health Care: Measuring Quality, OECD Health Policy Studies. Paris: OECD Publishing; 10.1787/9789264094819-en.
- 32.Mongan JJ. Framework for a high-performance health system for the United States. New York: Commonwealth Fund; 2006. https://www.commonwealthfund.org/sites/default/files/documents/___media_files_publications_fund_report_2006_aug_framework_for_a_high_performance_health_system_for_the_united_states_commission_12.
- 33.Choy E, et al. Treating rheumatoid arthritis early with disease modifying drugs reduces joint damage: a randomised duble blind trial of sulphasalzaine vs diclofenac sodium. Clin Exp Rheumatol. 2002;20(3):351–358. [PubMed] [Google Scholar]
- 34.van der Linden M, et al. Long-term impact of delay in assessment of patients with early arthritis. Arthritis Rheumatol. 2010;62:3537–3546. doi: 10.1002/art.27692. [DOI] [PubMed] [Google Scholar]
- 35.Smart NA, Titus TT. Outcomes of early versus late nephrology referral in chronic kidney disease: a systematic review. Am J Med. 2011;124(11):1073–1080. doi: 10.1016/j.amjmed.2011.04.026. [DOI] [PubMed] [Google Scholar]
- 36.Emery P, et al. Early referral recommendation for newly diagnosed rheumatoid arthritis: evidence based development of a clinical guide. Ann Rheum Dis. 2002;61(4):290–297. doi: 10.1136/ard.61.4.290. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Hulsemann J, et al. Early diagnosis of arthritis and spondyloarthritis within the framework of integrated health care in Lower Saxony. Zeitschrift Fur Rheumatologie. 2006;65(1):70–74. doi: 10.1007/s00393-005-0020-5. [DOI] [PubMed] [Google Scholar]
- 38.Potter S, et al. Referral patterns, cancer diagnoses, and waiting times after introduction of two week wait rule for breast cancer: prospective cohort study. BMJ. 2007;335(7614):288. doi: 10.1136/bmj.39258.688553.55. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Imkampe A, Bendall S, Chianakwalam C. Two-week rule: has prioritisation of breast referrals by general practitioners improved? Breast. 2006;15(5):654–658. doi: 10.1016/j.breast.2006.02.002. [DOI] [PubMed] [Google Scholar]
- 40.Hill VA, Wong E, Hart CJ. General practitioner referral guidelines for dermatology: do they improve the quality of referrals? Clin Exp Dermatol. 2000;25(5):371–376. doi: 10.1046/j.1365-2230.2000.00665.x. [DOI] [PubMed] [Google Scholar]
- 41.Matowe L, et al. Effects of mailed dissemination of the Royal College of Radiologists’ guidelines on general practitioner referrals for radiography: a time series analysis. Clin Radiol. 2002;57(7):575–578. doi: 10.1053/crad.2001.0894. [DOI] [PubMed] [Google Scholar]
- 42.Eccles M, et al. Effect of audit and feedback, and reminder messages on primary-care radiology referrals: a randomised trial. Lancet. 2001;357(9266):1406–1409. doi: 10.1016/S0140-6736(00)04564-5. [DOI] [PubMed] [Google Scholar]
- 43.Elwyn G, et al. Influencing referral practice using feedback of adherence to NICE guidelines: a quality improvement report for dyspepsia. Qual Saf Health Care. 2007;16(1):67–70. doi: 10.1136/qshc.2006.019992. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Griffiths CE, et al. The impact of psoriasis guidelines on appropriateness of referral from primary to secondary care: a randomized controlled trial. Br J Dermatol. 2006;155(2):393–400. doi: 10.1111/j.1365-2133.2006.07354.x. [DOI] [PubMed] [Google Scholar]
- 45.Dey P, et al. Implementation of RCGP guidelines for acute low back pain: a cluster randomised controlled trial. Br J Gen Pract. 2004;54(498):33–37. [PMC free article] [PubMed] [Google Scholar]
- 46.Engers AJ, et al. Implementation of the Dutch low back pain guideline for general practitioners: a cluster randomized controlled trial. Spine. 2005;30(6):559–600. doi: 10.1097/01.brs.0000155406.79479.3a. [DOI] [PubMed] [Google Scholar]
- 47.Jiwa M, et al. Implementing referral guidelines: lessons from a negative outcome cluster randomised factorial trial in general practice. BMC Fam Pract. 2006;7:65. doi: 10.1186/1471-2296-7-65. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Fautrel B, et al. Early referral to the rheumatologist for early arthritis patients: evidence for suboptimal care. Results from the ESPOIR cohort. Rheumatology. 2010;49(1):147–155. doi: 10.1093/rheumatology/kep340. [DOI] [PubMed] [Google Scholar]
- 49.Fautrel B, et al. Early arthritis: early act. A community-based knowledge transfer program to improve ability of general practitionner to rapidly detect and refer to the rheumatologist patients with early arthritis. Arthritis Rheum. 2010;62:984. doi: 10.1002/acr.20146. [DOI] [Google Scholar]
- 50.Adams SG, et al. Effect of a primary care continuing education program on clinical practice of chronic obstructive pulmonary disease: translating theory into practice. Mayo Clin Proc. 2012;87(9):862–870. doi: 10.1016/j.mayocp.2012.02.028. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Lester H, et al. REDIRECT: cluster randomised controlled trial of GP training in first-episode psychosis. Br J Gen Pract. 2009;59(563):e183–e190. doi: 10.3399/bjgp09X420851. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Suris X, et al. A rheumatology consultancy program with general practitioners in Catalonia, Spain. J Rheumatol. 2007;34(6):1328–1331. [PubMed] [Google Scholar]
- 53.Wright J, Wilkinson J. General practitioners’ attitudes to variations in referral rates and how these could be managed. Fam Pract. 1996;13(3):259–263. doi: 10.1093/fampra/13.3.259. [DOI] [PubMed] [Google Scholar]
- 54.Gagliardi A. Use of referral reply letters for continuing medical education: a review. J Contin Educ Heal Prof. 2002;22(4):222–229. doi: 10.1002/chp.1340220406. [DOI] [PubMed] [Google Scholar]
- 55.Junghans C, et al. Effect of patient-specific ratings vs conventional guidelines on investigation decisions in angina: appropriateness of referral and investigation in angina (ARIA) trial. Arch Intern Med. 2007;167(2):195–202. doi: 10.1001/archinte.167.2.195. [DOI] [PubMed] [Google Scholar]
- 56.Sibbald B, McDonald R, Roland M. Shifting care from hospitals to the community: a review of the evidence on quality and efficiency. J Health Serv Res Policy. 2007;12(2):110–117. doi: 10.1258/135581907780279611. [DOI] [PubMed] [Google Scholar]
- 57.Berendsen AJ, et al. Collaboration with general practitioners: preferences of medical specialists--a qualitative study. BMC Health Serv Res. 2006;6:155. doi: 10.1186/1472-6963-6-155. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.Maddison P, et al. Improved access and targeting of musculoskeletal services in Northwest Wales: targeted early access to musculoskeletal services (TEAMS) programme. Br Med J. 2004;329(7478):1325–1327. doi: 10.1136/bmj.329.7478.1325. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.Rymaszewski L, et al. A team approach to musculo-skeletal disorders. Ann R Coll Surg Engl. 2005;87(3):174–180. doi: 10.1308/1478708051793. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Evans E. The Torfaen referral evaluation project. Qual Prim Care. 2009;17(6):423–429. [PubMed] [Google Scholar]
- 61.Evans E, Aiking H, Edwards A. Reducing variation in general practitioner referral rates through clinical engagement and peer review of referrals: a service improvement project. Qual Prim Care. 2011;19(4):263–272. [PubMed] [Google Scholar]
- 62.Arnett G, Hadorn DC, Steering Committee of the Western Canada waiting list project Developing priority criteria for hip and knee replacement: results from the Western Canada Waiting List Project. Can J Surg. 2003;46(4):290–296. [PMC free article] [PubMed] [Google Scholar]
- 63.Fitzgerald A, et al. Relative urgency for referral from primary care to rheumatologists: the priority referral score. Arthritis Care Res. 2011;63(2):231–239. doi: 10.1002/acr.20366. [DOI] [PubMed] [Google Scholar]
- 64.Maksymowych W, Rheumatologists A. Development of a web-based screening tool for early rheumatoid arthritis - ERASE: the E-triage RA study in early arthritis. J Rheumatol. 2008;35(6):1205–1206. [Google Scholar]
- 65.Bell M, et al. Validation of early inflammatory arthritis detection tool within primary care practices in Canada. J Rheumatol. 2010;37(6):1317. [Google Scholar]
- 66.Tavares R, Wells GA, Bykerk VP, Guillemin F, Tugwell P, Bell MJ. Validation of a self-administered inflammatory arthritis detection tool for rheumatology triage. J Rheumatol. 2010;37(6):1277. [DOI] [PubMed]
- 67.Bell MJ, et al. Development of a self-administered early inflammatory arthritis detection tool. BMC Musculoskelet Disord. 2010;11:50. doi: 10.1186/1471-2474-11-50. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 68.Beattie K, et al. The GALS screening tool: a quick and easy screen for MSK conditions in the primary care setting. Arthritis Rheum. 2008;58(9):S749–S750. [Google Scholar]
- 69.Beattie K, et al. The sensitivity and specificity of the GALS (gait, arms, legs, spine) examination when used by physiotherapists to detect rheumatoid arthritis. J Rheumatol. 2010;37(6):1338. doi: 10.1016/j.physio.2010.11.008. [DOI] [PubMed] [Google Scholar]
- 70.Beattie KA, et al. Validation of the GALS musculoskeletal screening exam for use in primary care: a pilot study. BMC Musculoskelet Disord. 2008;9:115. doi: 10.1186/1471-2474-9-115. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 71.Campbell S, et al. Bridging the gap between primary and secondary care: use of a clinical pathway for the investigation and management of deep vein thrombosis. J Health Services Res Policy. 2008;13(SUPPL. 1):15–19. doi: 10.1258/jhsrp.2007.007015. [DOI] [PubMed] [Google Scholar]
- 72.Hobbs JA, et al. Development of a unique triage system for acute care physical therapy and occupational therapy services: an administrative case report. Phys Ther. 2010;90(10):1519–1529. doi: 10.2522/ptj.20090166. [DOI] [PubMed] [Google Scholar]
- 73.Naylor C, Imison C. Referral management. Rational ways to rein in referrals. Health Serv J. 2010;120(6230):22–23. [PubMed] [Google Scholar]
- 74.Stainkey LA, et al. The challenge of long waiting lists: how we implemented a GP referral system for non-urgent specialist’ appointments at an Australian public hospital. BMC Health Serv Res. 2010;10:303. doi: 10.1186/1472-6963-10-303. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 75.Fyie K, et al. Evaluating the primary-to-specialist referral system for elective hip and knee arthroplasty. J Eval Clin Pract. 2014;20(1):66–73. doi: 10.1111/jep.12080. [DOI] [PubMed] [Google Scholar]
- 76.Moya M, et al. The impact of a telehealth web-based solution on neurosurgery triage and consultation. Telemed J E Health. 2010;16(9):945–949. doi: 10.1089/tmj.2010.0044. [DOI] [PubMed] [Google Scholar]
- 77.Sathi N, Whitehead E, Grennan D. Can a rheumatologist accurately prioritize patients on the basis of information in the general practitioner referral letters? Rheumatology. 2003;42(10):1270–1271. doi: 10.1093/rheumatology/keg336. [DOI] [PubMed] [Google Scholar]
- 78.Graydon S, Thompson A. Triage of referrals to an outpatient rheumatology clinic: analysis of referral information and triage. J Rheumatol. 2008;35(7):1378–1383. [PubMed] [Google Scholar]
- 79.Barbour J, et al. Evaluation of a screening tool for inflammatory joint disease. Ann Rheum Dis. 2003;62(2):187–188. doi: 10.1136/ard.62.2.187. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 80.Harrington J, Walsh M. Pre-appointment management of new patient referrals in rheumatology: a key strategy for improving health care delivery. Arthritis Care Res. 2001;45(3):295–300. doi: 10.1002/1529-0131(200106)45:3<295::AID-ART263>3.0.CO;2-3. [DOI] [PubMed] [Google Scholar]
- 81.Chandratreya AP, Spalding TJ, Correa R. Development and efficiency of an acute knee trauma list. Injury. 2006;37(6):502–506. doi: 10.1016/j.injury.2005.09.012. [DOI] [PubMed] [Google Scholar]
- 82.Kindrachuk D, Fourney D. Spine surgery referrals redirected through a multidisciplinary care pathway: effects of non-surgeon triage including MRI utilization. J Neurosurg Spine. 2014;20:87–92. doi: 10.3171/2013.10.SPINE13434. [DOI] [PubMed] [Google Scholar]
- 83.Harding KE, et al. Effect of triage on waiting time for community rehabilitation: a prospective cohort study. Arch Phys Med Rehabil. 2012;93(3):441–445. doi: 10.1016/j.apmr.2011.09.021. [DOI] [PubMed] [Google Scholar]
- 84.Harding K, Taylor N, Leggat S. Do triage systems in healthcare improve patient flow? A systematic review of the literature. Aust Health Rev. 2011;35:371–383. doi: 10.1071/AH10927. [DOI] [PubMed] [Google Scholar]
- 85.Harding KE, et al. Reducing waiting time for community rehabilitation services: a controlled before-and-after trial. Arch Phys Med Rehabil. 2013;94(1):23–31. doi: 10.1016/j.apmr.2012.08.207. [DOI] [PubMed] [Google Scholar]
- 86.Villeneuve E, et al. A systematic literature review of strategies promoting early referral and reducing delays in the diagnosis and management of inflammatory arthritis. Ann Rheum Dis. 2013;72:13–22. doi: 10.1136/annrheumdis-2011-201063. [DOI] [PubMed] [Google Scholar]
- 87.Deane KD, et al. Identification of undiagnosed inflammatory arthritis in a community health fair screen. Arthritis Rheum. 2009;61(12):1642–1649. doi: 10.1002/art.24834. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 88.Eberhardt K, et al. Detection of suspected inflammatory joint disease with a new simple self-administered hand test. Br J Rheumatol. 1988;27(6):457–461. doi: 10.1093/rheumatology/27.6.457. [DOI] [PubMed] [Google Scholar]
- 89.Williams L, et al. A web-based electronic neurology referral system: a solution for an overburdened healthcare system? Ir Med J. 2012;105(9):301–303. [PubMed] [Google Scholar]
- 90.Dennison J, et al. An effective electronic surgical referral system. Ann R Coll Surg Engl. 2006;88(6):554–556. doi: 10.1308/003588406X130642. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 91.Collin S, et al. Implementation of computerised physician order entry (CPOE) and picture archiving and communication systems (PACS) in the NHS: quantitative before and after study. BMJ. 2008;337:a939. doi: 10.1136/bmj.a939. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 92.Patterson V, et al. Email triage is an effective, efficient and safe way of managing new referrals to a neurologist. Qual Saf Health Care. 2010;19(5):e51. doi: 10.1136/qshc.2009.038513. [DOI] [PubMed] [Google Scholar]
- 93.Aziz SR, Ziccardi VB. Telemedicine using smartphones for oral and maxillofacial surgery consultation, communication, and treatment planning. J Oral Maxillofac Surg. 2009;67(11):2505–2509. doi: 10.1016/j.joms.2009.03.015. [DOI] [PubMed] [Google Scholar]
- 94.Borooah S, et al. Using electronic referral with digital imaging between primary and secondary ophthalmic services: a long term prospective analysis of regional service redesign. Eye. 2013;27(3):392–397. doi: 10.1038/eye.2012.278. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 95.Heimly V. Electronic referrals in healthcare: a review. Stud Health Technol Inform. 2009;150:327–331. [PubMed] [Google Scholar]
- 96.Pace AV, Dowson CM, Dawes PT. Self-referral of symptoms (SOS) follow-up system of appointments for patients with uncertain diagnoses in rheumatology out-patients. Rheumatol. 2006;45(2):201–203. doi: 10.1093/rheumatology/kei122. [DOI] [PubMed] [Google Scholar]
- 97.Hemingway DM, et al. Straight to test: introduction of a city-wide protocol driven investigation of suspected colorectal cancer. Color Dis. 2006;8(4):289–295. doi: 10.1111/j.1463-1318.2005.00935.x. [DOI] [PubMed] [Google Scholar]
- 98.Prades J, et al. Implementing a Cancer fast-track Programme between primary and specialised care in Catalonia (Spain): a mixed methods study. Br J Cancer. 2011;105(6):753–759. doi: 10.1038/bjc.2011.308. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 99.Team DT. Cost-effectiveness of magnetic resonance imaging of the knee for patients presenting in primary care. Br J Gen Pract. 2008;58(556):e10–e16. doi: 10.3399/bjgp08X342660. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 100.Shaw IS, et al. Limited impact on endoscopy demand from a primary care based ‘test and treat’ dyspepsia management strategy: the results of a randomised controlled trial. Br J Gen Pract. 2006;56(526):369–374. [PMC free article] [PubMed] [Google Scholar]
- 101.Simpson GC, et al. Impact of GP direct-access computerised tomography for the investigation of chronic daily headache. Br J Gen Pract. 2010;60(581):897–901. doi: 10.3399/bjgp10X544069. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 102.Simpson GC, Forbes K, Teasdale E, Tyagi A, Santosh C. Primary care access to computed tomography for chronic headache. Br J Gen Pract. 2010;60(575):426–30. [DOI] [PMC free article] [PubMed]
- 103.Eley KA, Fitzgerald JE. Quality improvement in action. Direct general practitioner referrals to audiology for the provision of hearing aids: a single Centre review. Qual Prim Care. 2010;18(3):201–206. [PubMed] [Google Scholar]
- 104.Gough-Palmer AL, Burnett C, Gedroyc WM. Open access to MRI for general practitioners: 12 years’ experience at one institution -- a retrospective analysis. Br J Radiol. 2009;82(980):687–690. doi: 10.1259/bjr/88267089. [DOI] [PubMed] [Google Scholar]
- 105.Mariotti G, et al. Improving the appropriateness of referrals and waiting times for endoscopic procedures. J Health Services Res Policy. 2008;13(3):146–151. doi: 10.1258/jhsrp.2008.007170. [DOI] [PubMed] [Google Scholar]
- 106.Mukherjee S, et al. The ‘straight to test’ initiative reduces both diagnostic and treatment waiting times for colorectal cancer: outcomes after 2 years. Colorectal Dis. 2010;12(10 Online):e250–e254. doi: 10.1111/j.1463-1318.2009.02182.x. [DOI] [PubMed] [Google Scholar]
- 107.Ali R, et al. Efficacy of a direct booking system: a prospective cohort study. Ambul Surg. 2010;16(2):28–33. [Google Scholar]
- 108.Beiri A, et al. Trauma rapid review process: efficient out-patient fracture management. Ann R Coll Surg Engl. 2006;88(4):408–411. doi: 10.1308/003588406X106513. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 109.Forde JC, et al. A rapid access diagnostic clinic for prostate cancer: the experience after one year. Ir J Med Sci. 2011;180(2):505–508. doi: 10.1007/s11845-011-0695-3. [DOI] [PubMed] [Google Scholar]
- 110.Gartner M, et al. Immediate access rheumatology clinic: efficiency and outcomes. Ann Rheum Dis. 2012;71(3):363–368. doi: 10.1136/annrheumdis-2011-200315. [DOI] [PubMed] [Google Scholar]
- 111.Valentin-Lopez B, et al. Assessment of a rapid referral pathway for suspected colorectal cancer in Madrid. Fam Pract. 2012;29(2):182–188. doi: 10.1093/fampra/cmr080. [DOI] [PubMed] [Google Scholar]
- 112.Suter E, et al. Optimizing the interprofessional workforce for centralized intake of patients with osteoarthritis and rheumatoid disease: case study. Hum Resour Health. 2015;13:41. doi: 10.1186/s12960-015-0033-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 113.Ndosi M, et al. The effectiveness of nurse-led care in people with rheumatoid arthritis: a systematic review. Int J Nurs Stud. 2011;48(5):642–654. doi: 10.1016/j.ijnurstu.2011.02.007. [DOI] [PubMed] [Google Scholar]
- 114.Schadewaldt V, Schultz T. Nurse-led clinics as an effective service for cardiac patients: results from a systematic review. Int J Evid Based Healthc. 2011;9(3):199–214. doi: 10.1111/j.1744-1609.2011.00217.x. [DOI] [PubMed] [Google Scholar]
- 115.Harris MD. Shared medical appointments after cardiac surgery-the process of implementing a novel pilot paradigm to enhance comprehensive postdischarge care. J Cardiovasc Nurs. 2010;25(2):124–129. doi: 10.1097/JCN.0b013e3181beb124. [DOI] [PubMed] [Google Scholar]
- 116.Lewis R, et al. Nurse-led vs. conventional physician-led follow-up for patients with cancer: systematic review. J Adv Nurs. 2009;65(4):706–723. doi: 10.1111/j.1365-2648.2008.04927.x. [DOI] [PubMed] [Google Scholar]
- 117.MacKay C, et al. Expanding roles in orthopaedic care: a comparison of physiotherapist and orthopaedic surgeon recommendations for triage. J Eval Clin Pract. 2009;15(1):178–183. doi: 10.1111/j.1365-2753.2008.00979.x. [DOI] [PubMed] [Google Scholar]
- 118.MacKay C, et al. A single group follow-up study of non-surgical patients seen by physiotherapists working in expanded roles in orthopaedic departments: recall of recommendations, change in exercise and self-efficacy. BMC Res Notes. 2012;5:669. doi: 10.1186/1756-0500-5-669. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 119.Salisbury C, et al. Evaluation of a general practitioner with special interest service for dermatology: randomised controlled trial. BMJ. 2005;331(7530):1441–1446. doi: 10.1136/bmj.38670.494734.7C. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 120.Levell NJ, Penart-Lanau AM, Garioch JJ. Introduction of intermediate care dermatology services in Norfolk, England was followed by a 67% increase in referrals to the local secondary care dermatology department. Br J Dermatol. 2012;167(2):443–445. doi: 10.1111/j.1365-2133.2012.10850.x. [DOI] [PubMed] [Google Scholar]
- 121.Bungard T, et al. Cardiac EASE (ensuring access and speedy evaluation) - the impact of a single-point-of-entry multidisciplinary outpatient cardiology consultation program on wait times in Canada. Can J Cardiol. 2009;12:697–702. doi: 10.1016/S0828-282X(09)70530-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 122.Prades J, et al. Is it worth reorganising cancer services on the basis of multidisciplinary teams (MDTs)? A systematic review of the objectives and organisation of MDTs and their impact on patient outcomes. Health Policy. 2014;119. 10.1016/j.healthpol.2014.09.006. [DOI] [PubMed]
- 123.Nouraei SA, et al. Reducing referral-to-treatment waiting times in cancer patients using a multidisciplinary database. Ann R Coll Surg Engl. 2007;89(2):113–117. doi: 10.1308/003588407X155455. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 124.Lee A, et al. A UK hospital based multidisciplinary balance clinic run by allied health professionals: first year results. J Laryngol Otol. 2011;125(7):661–667. doi: 10.1017/S0022215111000624. [DOI] [PubMed] [Google Scholar]
- 125.Baker DP, Day R, Salas E. Teamwork as an essential component of high-reliability organizations. Health Serv Res. 2006;41(4 Pt 2):1576–1598. doi: 10.1111/j.1475-6773.2006.00566.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 126.Tan SB, Williams AF, Kelly D. Effectiveness of multidisciplinary interventions to improve the quality of life for people with Parkinson’s disease: a systematic review. Int J Nurs Stud. 2014;51(1):166–174. doi: 10.1016/j.ijnurstu.2013.03.009. [DOI] [PubMed] [Google Scholar]
- 127.Crossland V, et al. Is there evidence to support multidisciplinary healthcare working in rheumatology? A Systematic Review of the Literature. Musculoskeletal Care. 2015;13:51–66. 10.1002/msc.1081 [DOI] [PubMed]
- 128.Villeneuve E, et al. A systematic literature review of strategies promoting early referral and reducing delays in the diagnosis and management of inflammatory arthritis. Postgrad Med J. 2013;89(1050):231–240. doi: 10.1136/postgradmedj-2011-201063rep. [DOI] [PubMed] [Google Scholar]
- 129.Fomundam S, Hermann J. A Survey of Queuing Theory Applications in Healthcare. ISR technical Report. Maryland: The Institute for Systems Research, University of Maryland; 2007. [Google Scholar]
- 130.Cattani K, Schmidt G, The Pooling Principle INFORMS Trans Educ. 2005;5:17–24. doi: 10.1287/ited.5.2.17. [DOI] [Google Scholar]
- 131.Singh N, et al. The Auburn elective surgery pilot project. ANZ J Surg. 2005;75:768–775. doi: 10.1111/j.1445-2197.2005.03526.x. [DOI] [PubMed] [Google Scholar]
- 132.Cox JM, et al. Do referral-management schemes reduce hospital outpatient attendances? Time-series evaluation of primary care referral management. Br J Gen Pract. 2013;63(611):e386–e392. doi: 10.3399/bjgp13X668177. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 133.Kim C, et al. Referral management and the care of patients with diabetes: the translating research into action for diabetes (TRIAD) study. Am J Manag Care. 2004;10(2 Pt 2):137–143. [PubMed] [Google Scholar]
- 134.Novak K, Veldhuyzen Van Zanten S, Pendharkar SR. Improving access in gastroenterology: the single point of entry model for referrals. Can J Gastroenterol. 2013;27(11):633–635. doi: 10.1155/2013/519342. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 135.LLP, D.a.T . Evaluation of Central Intake and Assessment Centres for Hip and Knee Replacement: Final Report. 2011. [Google Scholar]
- 136.Vaskalis CS, Sobolev B, Kuramoto L, Levy A. A simulation study of scheduling clinic appointments in surgical care: individual surgeon versus pooled lists. J Oper Res Soc. 2011;58:202–211. [Google Scholar]
- 137.University, C.R.C . Referral Management Pilots In Wales - Follow Up Review. Final Report. Cardiff: National Leadership and Innovation Agency for Healthcare; 2007. [Google Scholar]
- 138.Guevara J, Hsu D, Forrest C. Performance measures of the specialty referral process: a systematic review of the literature. BMC Health Serv Res. 2011;11:168. doi: 10.1186/1472-6963-11-168. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 139.Shiell A, Hawe P, Gold L. Complex interventions or compex systems? Implications for health economic evaluation. BMJ. 2008;336:1281–1283. doi: 10.1136/bmj.39569.510521.AD. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 140.Angstman KB, et al. Impact of e-consults on return visits of primary care patients. Health Care Manag. 2009;28(3):253–257. doi: 10.1097/HCM.0b013e3181b3efa3. [DOI] [PubMed] [Google Scholar]
- 141.Hofstetter PJ, et al. The impact of telehealth on wait time for ENT specialty care. Telemed J E-Health. 2010;16(5):551–556. doi: 10.1089/tmj.2009.0142. [DOI] [PubMed] [Google Scholar]
- 142.Roberts NJ, Partridge MR. Telephone consultations in secondary care. Respir Med. 2007;101(8):1665–1669. doi: 10.1016/j.rmed.2007.03.003. [DOI] [PubMed] [Google Scholar]
- 143.Thompson A, Graydon S, Zibrowski E. The Canadian arthritis referral study (CARS): an initial evaluation of the Canadian arthritis referral tool (CART) Arthritis Rheum. 2009;60:323. [Google Scholar]
- 144.Hazlewood G, Martin L, Barr S. The impact of a centralized referral system in rheumatology. Arthritis Rheum. 2009;60:326. [Google Scholar]
- 145.Gormley G, et al. Can diagnostic triage by general practitioners or rheumatology nurses improve the positive predictive value of referrals to early arthritis clinics? Rheumatol. 2003;42(6):763–768. doi: 10.1093/rheumatology/keg213. [DOI] [PubMed] [Google Scholar]
- 146.Bentley J, Fletcher D. Choosing and using: patient choice in ‘Choose and Book’. Br J Community Nurs. 2007;12(12):558–562. doi: 10.12968/bjcn.2007.12.12.27742. [DOI] [PubMed] [Google Scholar]
- 147.Pisipati S, Chow K, Payne SR. Choose and book: an audit of the appropriateness of referrals and their effect on patients’ attendance to an inner city hospital secondary care provider. Br J Med Surg Urol. 2009;2(3):111–116. doi: 10.1016/j.bjmsu.2008.12.008. [DOI] [Google Scholar]
- 148.Ke KM, et al. Are multidisciplinary teams in secondary care cost-effective? A systematic review of the literature. Cost Eff Resour Alloc. 2013;11(1):7. doi: 10.1186/1478-7547-11-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
Data sharing not applicable to this article as no datasets were generated or analysed during the current study.