Skip to main content
PLOS One logoLink to PLOS One
. 2022 Dec 6;17(12):e0270234. doi: 10.1371/journal.pone.0270234

Granular analysis of pathways to care and durations of untreated psychosis: A marginal delay model

Walter S Mathis 1,2,*,#, Maria Ferrara 1,2,#, Shadie Burke 1,2,, Emily Hyun 1,2,, Fangyong Li 3,, Bin Zhou 3,, John Cahill 1,2,, Emily R Kline 4,5,, Matcheri S Keshavan 4,5,, Vinod H Srihari 1,2,#
Editor: Giuseppe Carrà6
PMCID: PMC9725156  PMID: 36472968

Abstract

Objective

An extensive international literature demonstrates that understanding pathways to care (PTC) is essential for efforts to reduce community Duration of Untreated Psychosis (DUP). However, knowledge from these studies is difficult to translate to new settings. We present a novel approach to characterize and analyze PTC and demonstrate its value for the design and implementation of early detection efforts.

Methods

Type and date of every encounter, or node, along the PTC were encoded for 156 participants enrolled in the clinic for Specialized Treatment Early in Psychosis (STEP), within the context of an early detection campaign. Marginal-delay, or the portion of overall delay attributable to a specific node, was computed as the number of days between the start dates of contiguous nodes on the PTC. Sources of delay within the network of care were quantified and patient characteristic (sex, age, race, income, insurance, living, education, employment, and function) influences on such delays were analyzed via bivariate and mixed model testing.

Results

The period from psychosis onset to antipsychotic prescription was significantly longer (52 vs. 20.5 days, [p = 0.004]), involved more interactions (3 vs. 1 nodes, [p<0.001]), and was predominated by encounters with non-clinical nodes while the period from antipsychotic to STEP enrollment was shorter and predominated by clinical nodes. Outpatient programs were the greatest contributor of marginal delays on both before antipsychotic prescription (median [IQR] of 36.5 [1.3–132.8] days) and (median [IQR] of 56 [15–210.5] days). Sharper functional declines in the year before enrollment correlated significantly with longer DUP (p<0.001), while those with higher functioning moved significantly faster through nodes (p<0.001). No other associations were found with patient characteristics and PTCs.

Conclusions

The conceptual model and analytic approach outlined in this study give first episode services tools to measure, analyze, and inform strategies to reduce untreated psychosis.

Introduction

The Duration of Untreated Psychosis (DUP), or interval between onset of psychosis and initiation of treatment [1], has emerged as an important metric for services targeting recent onset schizophrenia spectrum disorders [2]. Observational studies across varied healthcare systems have confirmed a robust association between prolonged DUP and poorer long-term outcomes [3]. A seminal Scandinavian quasi-experimental test of an early detection (ED) campaign demonstrated that reduction of DUP resulted in a range of positive outcomes, including reduced symptom severity and suicidality at presentation to care, and improved functioning up to 10 years later [4]. However, most ED campaigns have failed to reduce DUP [5, 6]. A challenge inherent to reducing DUP is that it has multi-factorial determinants including patient, illness, family, societal, and treatment system factors [7]. Also, the variety of interacting sets of actors with varying influence across different regions limits extrapolation from one ED campaign to another.

The concept of pathways to care (PTC) [8], has catalyzed a wide range of investigations and revealed myriad factors that impact patients’ journeys to and through health systems. As such, knowledge of PTC offers an intuitively compelling way to understand and potentially modify some of the multifactorial determinants of DUP. However, a lack of conceptual clarity and standardized measurement—such as focusing on only certain segments of the PTC or inconsistently defining sub-parts of the PTC—have limited interpretation of findings [912]. Also, the often regionally idiosyncratic mixtures of specific determinants have meant that prior reports of PTC can be of little practical value in designing ED for a specific target community [13]. What is called for instead is robust, agnostic PTC collection combined with a formulation and analytic technique that responds to the provincial differences of varied settings.

From an interventionist perspective, early detection efforts need to target local and modifiable sources of delay to impact community level DUP. We conceptualized two broad domains of DUP: a ‘Demand’ side, that included all factors affecting a patient’s help-seeking journey until their psychosis was identified by a healthcare provider able to initiate treatment; and a ‘Supply’ side that included all factors affecting subsequent delay within the healthcare system until entry into specialty team-based First Episode Psychosis (FEP) services. A further concept was borrowed from microeconomics. Marginal analysis explores the impacts of making a small change to an overall system—e.g., “marginal cost” or the additional cost of producing one more unit [14]. Analogously, marginal delay is conceptualized here as the additional delay attributable to a single interaction on a PTC (e.g., how many days a particular visit to the Emergency Department added to DUP).

This paper illustrates a conceptual approach to assessing and analyzing PTCs that was implemented within an active early detection study. We aimed to increase practical utility for future ED efforts by developing a generalizable template that would also permit local adaptation to specific sources of delay. PTCs have been measured and analyzed with an emphasis on: (i) discovering and characterizing sources of delay within a local network of care; (ii) assessing their impact on overall and differential delay for patient subgroups; and (iii) revealing actionable information to refine ongoing ED.

Methods

Setting and sampling

The clinic for Specialized Treatment Early in Psychosis (STEP) in New Haven, Connecticut provides an evidence-based model of specialty team-based care for first-episode psychosis to patients aged 16–35, within three years of onset of a schizophrenia-spectrum disorder, and residing in a surrounding 10-town target catchment (population ~400,000, mixed urban and suburban) [15]. Data for this analysis were drawn from a convenience sample of consecutive enrollees (February 1, 2014, to January 31, 2019) during an Early Detection campaign targeting STEP’s catchment [13, 16]. All subjects provided informed consent within a protocol approved by the Yale Human Investigations Committee.

Measures

An adapted version of the Pathways to Care Interview [17] was used to systematically gather information from participants, caregivers, and clinical records about each help-seeking attempt, its symptomatic or behavioral precipitant, to whom participants turned for help, the date, the outcome of the help-seeking attempt, and perceived barriers to accessing care [available upon request]. When the precise date of an interaction could not be recalled, this was approximated to the 1st or 15th of the month.

The date of psychosis onset was operationalized as when Presence of Psychotic Syndrome (POPS) criteria were met on the Structured Interview for Psychosis-Risk Syndromes (SIPS) [18]. Global Assessment of Functioning (GAF) [19] scores, both at the time of enrollment and retrospectively 12 months prior, and Global Functioning: Role and Social [20] scores were also computed during SIPS administration. The SIPS was administered by trained raters who reviewed medical records and interviewed subjects, family members, and referring clinicians. Retrospective scores were based on data collected from SIPS, the screening assessment, and medical records. A medication log included queries for the name, indication, and dose of all antipsychotics prescribed between psychosis onset and enrollment in STEP.

From these intake data, electronic medical records, and patient and family reports we assembled a PTC for each participant, starting with onset of psychosis, proceeding through help-seeking, prescription of first antipsychotic for psychosis, and ending with STEP enrollment (Fig 1). Discrepancies or ambiguities in the data from these structured assessments were reviewed by two trained psychiatrists (WSM, MF). If PTC data defied reconciliation, the participant was excluded from this analysis.

Fig 1. Conceptual and analytic model of Pathway to Care (PTC) with example values.

Fig 1

This figure depicts the pathway to care described by the following narrative (durations are shorter than sample data for illustrative purposes): Peter began experiencing concerning auditory hallucinations on Day 0 (Onset). Two days later, his mother observes him responding to internal stimuli (first community node) and takes him to an urgent care clinic (first clinical node) the same day. They recommend watchful waiting and outpatient follow up. The next day, Peter is more bothered with the hallucinations and makes an appointment for himself (second community node) at an urgent care psychiatric service the next day. On that visit on Day 4 (second clinical node), Peter is prescribed an antipsychotic to help with his symptoms and an appointment is made for an outpatient psychiatrist, whom he sees 3 days later (third clinical node). On Day 8, Peter’s father observes increasingly concerning behaviors (third community node) and takes him to see a youth counselor at their church (fourth community node) who recommends taking him to the local Emergency Department, which they do (fourth clinical node). The ED refers Peter to STEP and he is enrolled the next day, Day 9 (STEP). DUP-total: Duration of Untreated Psychosis. DUP-demand: Demand-side duration of untreated psychosis, number of days from Onset until antipsychotic. DUP-supply: Supply-side duration of untreated psychosis, number of days from antipsychotic until STEP. Onset: Onset of psychosis, as ascertained by POPS criteria on the SIPS scale. STEP: Enrollment in Specialized Treatment Early in Psychosis clinic. Onset delay: Time in days from onset of psychosis first help-seeking node. Marginal-delay: Time in days until the next node.

Each participant’s PTC was conceived of as a string of interactions, or nodes, with individuals or agencies providing clinical care (e.g. emergency departments, primary care providers, therapists) or those with the capacity to facilitate access to treatment (e.g. family members, police officers, teachers). The former we classified as clinical caregiver nodes, the latter community caregiver nodes. These nodes variably utilized these capacities by hastening (or delaying) access to the local FEP. They thus constituted a de facto regional network of stakeholders that STEP could leverage to reduce DUP.

Global measures

We computed three global measures of DUP (Fig 1). DUP-total was defined as the duration in days from onset of psychosis to enrollment in STEP. This was conceptualized as including delays in successive stages of ‘Demand’ (i.e., from illness onset to first contact with a healthcare provider who identified and initiated treatment for psychosis) and ‘Supply’ (i.e., subsequent delays within the healthcare system until engagement with the local FEP or STEP) [13]. DUP-demand was operationalized as days from the onset of psychosis to the first administration of an antipsychotic to specifically treat psychosis (e.g., excluding off-label prescriptions for sleep). The latter event was used as a proxy for the first recognition of psychosis by a healthcare provider, and signaling the beginning of DUP-supply, which in turn ends with enrollment at STEP. For cases still antipsychotic-naïve at enrollment, DUP-supply was zero (i.e., the entire delay was attributed to Demand side delays).

Initiation of antipsychotic medication is often used in first episode psychosis research to signify that the illness has transitioned into the treatment phase [21, 22]. The prescribing of an antipsychotic for psychosis is a pragmatic and reliable way to index when a healthcare provider, who also has the ability to treat psychosis, has identified psychosis—and hence serves as the transitional event from Demand to Supply.

Node-level measures

To better understand how subcategories of nodes differentially affected delay, we computed marginal-delay for each node encounter as the time from the start of each node to the start of the subsequent node (Fig 1). Analyzing these marginal-delays across all nodes on each PTC, and all PTCs within the study, allowed us to examine how DUP was impacted by each node type, and if this varied across participant characteristics.

To assess if global delay measures (DUP-total, DUP-demand, DUP-supply) were influenced by participant characteristics at admission, the following covariates were analyzed: sex, race, age at psychosis onset, reported household income, insurance status, living situation, level of education, employment status, school enrollment status, GAF scores for the month of enrollment (GAF-e), GAF retrospectively assessed for 12 months prior to STEP enrollment (GAF-12), the arithmetic difference between these two (GAF-Δ), Global Functioning: role score (GF-r), and Global Functioning: social score (GF-s). Spearman rank testing was used for continuous independent variables and Kruskal-Wallis testing for categorical independent variables. Given the small sample size, effect size was inferred from the Spearman rho coefficient and computed from the Kruskal H statistics respectively.

An aggregate of all PTCs was used to compute node counts and encounter frequency and marginal-delay for each node type. The contribution to delay by specific node type was described by computing median days of marginal-delay by node type on the Demand and Supply sides across all PTCs.

To understand how participant characteristics influenced delay in transitioning through specific node types, mixed model repeated measures analysis was applied to the participant characteristics with marginal-delay as the outcome measure. Mixed model analyses are useful for analyzing longitudinal data where both fixed and random effects need to be considered, and within- and between-subjects variance can be properly dealt with.

R version 4.0.3 and SAS version 9.4 were used for modelling the data and statistical analyses. A p-value < 0.05 was used to infer statistical significance except in multiple-comparison contexts when a Bonferroni correction was used.

Results

Sample

During the study period, there were 1,356 inquiries to STEP, 1,148 were assessed for eligibility, 199 determined eligible, and 171 (85.9%) enrolled. Among enrolled cases, fifteen (8.8%) were excluded from this analysis because of discrepant PTC data. These participants (Table 1) did not differ significantly from the remaining subjects in age, race, or gender (Wilcoxon Rank Sum Test and Pearson’s Chi-squared Test respectively). Twelve of the 156 remaining subjects (7.7%) were antipsychotic-naïve at enrollment.

Table 1. Demographic and clinical characteristics of participants.

(n = 156).

Mean (SD) or Count (%)
Gender, male 113 (72.4%)
Race & Ethnicity
 Black, non-Hispanic 67 (43%)
 White, non-Hispanic 40 (26%)
 Hispanic 30 (19%)
 Multi-racial, non-Hispanic 16 (10%)
 Other 3 (5%)
Age at Psychosis Onset 21.6 (3.8)
Household Income
 Less than $39,999 63 (40%)
 $40,000 to $59,999 25 (16%)
 $60,000 to $99,999 24 (15%)
 $100,000 and above 27 (17%)
 Don’t know or refused 17 (11%)
Insurance
 Public 84 (54%)
 Private 57 (37%)
 Uninsured 7 (4%)
 Other 2 (1%)
Living Situation
 With Family 138 (88%)
 Alone 7 (4%)
 With spouse or partner 2 (1%)
 Other 7 (4%)
Highest Level of Education
 Less than high school 31 (20%)
 High school 101 (65%)
 Technical School/College/University 24 (15%)
In School Full-time 25 (16%)
Employed 29 (25%)
GAF*
 GAF-e 31.1 (10.9)
 GAF-12 53.7 (17.5)
 GAF-Δ -22.5 (19.3)
 GF-r 4.4 (2.2)
 GF-s 5.1 (1.5)

GAF: Global Assessment of Functioning.

GAF-e: Total GAF at enrollment

GAF-12: Total GAF 12 months prior to enrollment.

GAF-Δ: Difference between GAF-12 and GAF-e

GF-r: Global Functioning: Role Scale

GF-s: Global Functioning: Social Scale

Network

Aggregating all PTCs identified six community and nine clinical caregiver node types that constituted the regional network of care (Fig 2). The community nodes included family members, police officers, educational representatives such as teachers or counsellors, and nodes that did not fit any other type. The ‘Self’ community node denotes participants who initiated their own pathway to the next node, without assistance from others. The clinical nodes fell into types reflective of regional services: emergency departments, inpatient psychiatric units, outpatient mental health clinics, intensive outpatient programs, walk-in evaluations in an urgent care outpatient setting, primary care providers, urgent evaluations in walk-in clinics or by mobile outreach teams, mental health clinical care in settings other than those already outlined, and non-mental health clinical care not already outlined.

Fig 2. A directional graph of all PTCs collected in this study.

Fig 2

Arrows depict the sequential progression individuals took from Onset to STEP enrollment. Clinical nodes are on the top, community nodes on the bottom. The thickness of the edge (line) between nodes reflects the frequency of traffic between them, and the size of each node reflects the cumulative number of interactions with the node type across all PTCs. Abbreviations: Self—self-presented; Education—teacher or school counsellor; Other—community caregiver not otherwise included; ED—Emergency Department; Inpt—Inpatient Admission; Outpt—Outpatient Mental Health; IOP—Intensive Outpatient; Acute—Acute Evaluation; PCP—Primary Care Provider; Mobile—Mobile Evaluation; OtherMH—Prison mental health, in-home psychiatric services, substance use disorder inpatient and outpatient; OtherMed—Outpatient non-psychiatric, non-PCP (e.g., neurologist), Inpatient medical.

Measures of overall network performance

Overall, there were more clinical than community nodes (661 vs. 456). Most community nodes (317/456, 70%) were encountered within the Demand side of the PTC while the majority of clinical nodes (433/661, 66%) were encountered within the Supply side—before and after recognition of psychosis by the clinical care network respectively. This is consistent with our formulation of Demand and Supply. A substantial number of clinical nodes (228/661) interacted with FEP patients on Demand side, but we infer did not recognize psychosis. After psychosis onset, it took relatively longer and required more interactions to be prescribed an antipsychotic (DUP-Demand) than to be subsequently referred to STEP (DUP-Supply). Median (IQR) DUP-Demand was more than twice median DUP-supply (52.0 [15–196.2] vs. 20.5 [9–127.8] days, p = 0.004, Wilcoxon rank sum test). On the Demand side each patient encountered a greater number of nodes (median 3 vs. 1 on Supply side, p<0.001, Wilcoxon rank sum test) (Table 2). More total nodes correlated with longer DUP-total and more Supply nodes correlated with longer DUP-supply (both p<0.001), but Demand nodes did not correlate with DUP-demand. Onset delay, or the time from psychosis onset to help-seeking by the patient or others, accounted for 37.5% of DUP-total and 67.4% of DUP-demand.

Table 2. Descriptive statistics of node counts and global delay measures delay with correlation testing.

Sum (%) Median (IQR)
Node Counts Total 1,117 5 (4–9) *
 Community  456 (40.8%) 2 (1–4)
 Clinical  661 (59.2%) 3 (2–6)
Demand 545 3 (2–4)
 Community  317 (58.2%) 2 (1–2)
 Clinical  228 (41.8%) 1 (1–2)
Supply 572 1 (1–5)
 Community  139 (24.3%) 0 (0–1)
 Clinical  433 (75.7%) 1 (1–3)
Delays (days) DUP-total 43,107 151.0 (51.8–444.3) *
DUP-demand  24,019 (55.7%) 52.0 (15.0–196.2)
DUP-supply  19,088 (44.3%) 20.5 (9.0–127.8)
Onset delay 16,178 21.5 (2.75–116.8)

Spearman’s rank correlations:

* p < 0.001

p = 0.15

p < 0.001

‘Demand’: between psychosis onset and antipsychotic medication prescription

‘Supply’: between antipsychotic prescription and study enrollment

‘Onset delay’: time from psychosis onset to first help-seeking node

IQR: interquartile range

Patient factors and delay

Sex, age at psychosis onset, race, household income, insurance status, living situation, educational attainment, school status, and employment status were not significantly associated (and with small effect sizes) with global measures of delay—DUP-total, DUP-demand, or DUP-supply (Table 3). While GAF at enrollment did not correlate with global measures of delay, higher GAF-12 scores correlated significantly with shorter DUP-total, meaning faster access to STEP for subjects with higher functioning in the year preceding clinic enrollment. Higher GAF-Δ scores, or greater functional decline in the year before enrollment, correlated significantly with increased DUP-total and DUP-supply. GF-r and GF-s scores did not predict global measures of delay.

Table 3. Association and effect size testing of patient factors with global delay measures.

DUP-total DUP-demand DUP-supply
Sex * p = 0.14 p = 0.54 p = 0.40
η2 = 0.008 η2 = 0 η2 = 0
Age at Psychosis Onset p = 0.33 p = 0.73 p = 0.23
rs = -0.08 rs = -0.03 rs = -0.10
Race or Ethnicity * p = 0.35 p = 0.50 p = 0.72
η2 = 0.003 η2 = 0 η2 = 0
Household Income * p = 0.20 p = 0.21 p = 0.96
η2 = 0.01 η2 = 0.01 η2 = 0
Insurance * p = 0.87 p = 0.97 p = 0.76
η2 = 0 η2 = 0 η2 = 0
Living Situation * p = 0.50 p = 0.99 p = 0.37
η2 = 0 η2 = 0 η2 = 0.001
Max Education * p = 0.32 p = 0.19 p = 0.20
η2 = 0.002 η2 = 0.009 η2 = 0.008
In School * p = 0.94 p = 0.56 p = 0.61
η2 = 0 η2 = 0 η2 = 0
Employed Full-time * p = 0.89 p = 0.80 p = 0.06
η2 = 0 η2 = 0 η2 = 0.02
GAF-e p = 0.08 p = 0.23 p = 0.29
rs = 0.14 rs = 0.10 rs = 0.09
GAF-12 p < 0.001 p = 0.12 p = 0.008
rs = -0.35 rs = -0.13 rs = -0.21
GAF-Δ p < 0.001 p = 0.05 p = 0.001
rs = 0.43 rs = 0.16 rs = 0.27
GF-r p = 0.67 p = 0.84 p = 0.047
rs = 0.03 rs = -0.02 rs = -0.16
GF-s p = 0.89 p = 0.13 p = 0.51
rs = 0.01 rs = -0.12 rs = 0.05

* Categorical variable analyzed with Kruskal-Wallis testing; η2 computed from H-statistic.

Continuous variable analyzed using Spearman’s rank correlation testing

GAF-e: Global Assessment of Functioning, the month before enrollment

GAF-12: GAF 12 months prior to enrollment in clinic.

GAF-Δ: arithmetic difference between GAF-e and GAF-12

GF-r: Global Functioning: Role Score

GF-s: Global Functioning: Social Score

Mixed model repeated measures analysis was used to interrogate the impact of patient characteristics on marginal-delay by node type. GAF-12 was an independent predictor with higher scores associated with less marginal-delay (p<0.001) [S1 Table]. Since no other patient characteristic was found to be a significant predictor of marginal-delay, there was no indication to run a subsequent moderation analysis of the association between node type and other variables.

Node categories

Family was the most frequently utilized community node, both in total number of encounters (198/456, 43.4%) and number of participants (121/156, 77.6%) (Fig 2 and Table 4). Interactions with police and self-referral were also common (40% of participants in each category). While, as noted, community node encounters skewed toward the Demand side (317/456), the distribution of community node types changed between the Demand and Supply time periods, with ‘self’ occurring relatively more frequently, and the other node types occurring less frequently on the Supply side. Community nodes had little marginal-delay.

Table 4. Descriptive statistics of node type encounter frequency and marginal-delay contribution.

Total Encounters Unique participant encounters Demand encounters Marginal-delay per Demand encounter Supply encounters Marginal-delay per Supply encounter
(days) (days)
(n = 1,117) (n = 156) Median IQR Range Median IQR Range
Community Family 198 17.7% 121 77.6% 140 44.2% 0 0–0 0–519 58 42% 0 0–0 0–126
Self 121 10.8% 62 40% 72 23% 0 0–0 0–61 49 35% 0 0–0 0–14
Police 84 7.5% 63 40% 63 20% 0 0–0 0–149 21 15% 0 0–0 0–30
Other 41 3.7% 31 20% 32 10% 0 0–0 0–388 9 6% 0 0–0 0–24
Education 12 1.1% 10 6.4% 10 3.2% 0 0–0 0–954 2 1% 8.5 4.3–12.8 0–17
Total 456 40.8% 317 139
Clinical ED 255 22.8% 137 87.8% 131 57.5% 0 0–1 0–69 124 28.6% 0 0–2 0–187
Inpt 191 17.1% 122 78.2% 25 11% 12 9–18 3–335 166 38.3% 13 9–21 0–820
Outpt 101 9.0% 65 42% 30 13% 36.5 1.3–132.8 0–584 71 16% 56 15–210.5 0–724
IOP 44 3.9% 28 18% 2 0.9% 19.5 9.8–29.3 0–39 42 9.7% 29 17.8–46 1–896
Acute 30 2.7% 26 17% 14 6.1% 5.5 2.3–19.5 0–305 16 3.7% 5.5 0.75–24.5 0–333
PCP 23 2.1% 19 12% 17 7.5% 2 0–6 0–354 6 1% 1.5 0.25–46.3 0–129
OtherMH 7 0.6% 4 3% 3 1% 0 0–0 0–0 4 1% 107.5 28.5–191 21–212
Mobile 6 0.5% 6 4% 5 2% 0 0–1 0–1 1 0.2% 0 -- --
OtherMed 4 0.4% 4 3% 1 0.4% 109 -- -- 3 1% 41 24.5–95.5 8–150
Total 661 59.2% 228 433

Emergency department was the clinical node type encountered most frequently (255/661, 38.6%) and by the largest number of participants (137/156, 87.8%). Moreover, it was encountered repeatedly (median [IQR] of 1 [12] encounters per participant with ED encounter), as were inpatient psychiatric units (median [IQR] of 1 [12] admissions per participant with inpatient admission). Emergency departments were a larger percentage of Demand side clinical nodes than Supply side (57.5% vs 28.6%) while the reverse was true for inpatient admissions (11% vs 38.3%). Among highly utilized clinical nodes, outpatient mental health was the biggest contributor of marginal-delay on both Demand (median [IQR] of 36.5 [1.3–132.8] days) and Supply sides (median [IQR] of 56 [15–210.5] days).

Discussion

This study aimed to conceptualize, measure, and analyze PTCs in a manner that can provide actionable information for ED initiatives across diverse settings. Recognizing that DUP is an important global measure with many contributors, other ED efforts have devised approaches for subdividing delay by partitioning the PTC by key events [23]. But our more granular approach can reveal node-specific regional patterns and suggest interventions for either immediate implementation within a performance improvement framework, or research to develop novel approaches for refractory sources of delay.

Global delay

Onset delay, or the time from psychosis onset to help-seeking, was comparable to previous work using similar methods [24] and a large contributor to DUP which might help explain why so many PTCs went through ED and inpatient settings and why Demand nodes did not add much to delay (i.e., help-seeking may be initiated so long after psychosis begins that symptom acuity can only be safely managed in an ED or inpatient setting). These settings are not always conducive to FEP engagement and our data show multiple interrupted healthcare contacts on the Supply side. This validates the utility of multi-component ED campaigns [4, 13] that can target both willing patients and, when this is not the case, those around them who could facilitate their access to care. As frequently utilized community nodes, families, and police are logical targets for specific messaging in our region.

Onset delay is a difficult metric to reduce because it predates interactions with the mental health system and contributions to this delay are multifactorial, including insight into early symptomatology, healthcare access disparities and previous aversive experiences with healthcare, individual and family views of mental health treatment and stigmatized views of mental illness [7, 25]. As such, this suggests that ED campaigns need to incorporate lay-facing psychoeducation campaigns to help identify early symptoms and recommend first steps toward care [13].

We had previously reported more self-initiation and shorter DUP-demand amongst those who sought help during the prodromal illness phase when insight is relatively preserved [26]. In this study, individuals, once identified as having psychosis, were shuffled more quickly through predominantly clinical caregivers, but also appeared to play a larger role in initiating these encounters themselves, albeit suffering multiple interrupted healthcare interactions en route to STEP. Possible mechanisms for this include interactions between participant or illness factors (e.g., increased symptom severity interfering with treatment engagement, or increased experience with the healthcare system enabling more help-seeking), treatment system factors (e.g., challenges in transitioning care from inpatient to outpatient settings), and care experiences that can be aversive (e.g., criminal justice interactions or involuntary hospitalization).

Participant factors

Our finding that sex, race, insurance status, employment status, GAF at enrollment do not correlate with global measures of delay aligns with similar studies in the US [12, 21]. But those studies did find correlations with age, living situation, education level, and school status that we did not. These discrepant findings possibly result from differences in cohort characteristics or methods of tabulation (e.g., grouping ages instead of treating as continuous). There are methodological limitations that limit the strength of these conclusions, especially around race [27], such that larger sample sizes within and across regions are necessary to fully interrogate disparities in access.

Those with better functioning 12 months prior to enrollment and, even more so, those with greater functional decline during that period, had significantly lower DUP. The first observation is not surprising in that higher functioning participants may be better able to navigate local pathways. The second suggests a salutary interaction between a greater need for care resulting in a quicker response from the healthcare system. Both features of the network can inform future outreach efforts to community and clinical nodes.

Node type and marginal-delay

There was high variability of marginal-delay from clinical nodes, exemplified by the difference in delay from emergency departments (short, often admitting quickly to inpatient units) and the long delays from outpatient mental health. This result calls for direct outreach to outpatient providers to both recommend referral to FEP and better understand factors that have slowed referrals.

The high utilization of emergency departments and inpatient units both highlights the importance of working with these local care centers to facilitate connection with FEP when clinically appropriate and speaks to the symptomatic acuity of the participants. However, resources that are designed to more proactively manage high acuity in the community (e.g., urgent care outpatient evaluations or mobile evaluations) were not highly utilized. This suggests that the availability and/or awareness of these resources was less than that of the emergency departments, as reported for other regions [28]. Furthermore, reducing the proportion of individuals who require urgent/emergent care before starting their treatment at an FEP could improve the experience of entering care, minimizing unnecessary aversive experiences that might interfere with future treatment engagement.

Contrary to reports, mainly from the UK, that primary care providers (PCPs) were the most common first PTC contact [29], and/or the main source of referrals to FEP [30], in our sample only 12% of participants attributed PCP involvement in their PTC, despite 25/30(83%) consecutive participants surveyed (for internal audit purposes) reporting visiting a PCP within the two years prior to enrollment. This finding points to PCPs as a focus for improvement in clinical node outreach, with lessons available from other countries [31, 32].

Strengths and limitations

The approach outlined above improved upon previous PTC analyses in two domains. The absence of common terminology and metrics makes comparing and synthesizing DUP research difficult. Some studies have focused on the impact of DUP from key parts of the PTC such as number of clinical nodes or type of first clinical interaction [12, 33], while others have subdivided the PTC by threshold events (e.g., first mental health worker, first antipsychotic, or FEP enrollment) to define transition between phases of PTC (eg “help-seeking” and “referral pathways”) [24, 25].

But, by being inclusive and agnostic about the relative importance of particular nodes when collecting PTCs, we were able to construct a model of the actual local network of care—both community and clinical—that brought enrollees to our FEP, and discover gaps in expected participation (e.g., by PCPs). Quantitatively, this also permits us a more nuanced understanding of the relationship between DUPs and node counts. Some of these findings were intuitive—such as more total nodes correlating with longer DUP (an analogue of which was also found in Marino, et al. [12])—or less so—such as the number of Demand side nodes not significantly correlating with DUP-demand. Further, the shift of community nodes dominating Demand side to clinical nodes dominating Supply side not only informs intervention strategies but is a finding that previous analyses could not produce.

While we feel that antipsychotic prescription is a pragmatic and reliable liminal event between Demand and Supply, there are conceivable situations where it might not appropriately detect this transition. For instance, given the young age of our sample, one could imagine a prescriber recognizing psychosis in a patient but being reluctant to prescribe an antipsychotic or the patient or patient’s family being uninterested in taking it—either concern over side effects, stigma, or perhaps feeling they could manage their current symptoms without pharmacological intervention. In either case, our model would miss a conceptual transition to Supply. But it would be impossible to infer such thinking from prescribers in our retrospective assessment and we did not ask participants about these more nuanced points.

Marginal-delay analysis is the other unique aspect of this study which we believe brings important quantitative findings essentially undiscoverable in previous work. Marginal-delay allows us to model the impact on delay at the more granular level of node type which is especially important when formulating delay-reducing interventions, where specificity allows tailoring of messaging as well as better allocation of limited financial and logistical resources.

A strength of this study is the collection of granular PTC data from multiple sources, circumventing the assumptions and data limitations of studies analyzing extractions from singular electronic medical records. While we incorporated data from many sources, reporting from participants and their families played a major part in reconstructing PTCs. As such, our data is vulnerable to recall bias to the exact timing of events and variability of which events are more likely (e.g. emergency room visit) or less likely recalled. Even with multiple sources, 8.8% of participants were excluded because their full PTCs could not be reliably reconstructed. Also, the PTC data collected and analyzed were limited to those enrolled in the STEP program. Only a small percentage of those referred to STEP were deemed appropriate for enrollment and the true FEP incidence in the STEP catchment is likely larger than that enrolled in STEP. We do now know how the PTC and delay data of these groups compare to our sample and should be careful when generalizing our findings.

A potential limitation to this study is the treatment of all node types as internally homogeneous (e.g, all Outpatient providers as one group). This is an approach similar to other studies when treating interaction types categorically [12]. We felt it struck an appropriate balance of granularity between overly broad categorization of “healthcare provider” and the overly specific individual provider yet still lends real world applicability to findings by distinguishing coherent targets for specific messaging and outreach efforts within a local network (e.g., emergency departments, educational counsellors, or even primary care providers).

This method of analysis focuses heavily on the systems-related factors and less on other individual and family factors that influence DUP and PTCs [7]. Evidence suggests that individual, family, and stigma factors impact help seeking, and the quality of experiences with mental health services expedite or delay entry into specialty care [25]. As such, further analysis is warranted to better understand how patient and family factors influence navigation along PTCs. This would extend the current literature on attitudinal barriers to help seeking [25, 34, 35]. Also of interest is how community caregivers moderate delay by influencing which clinical caregivers are visited, as well as how participant factors influence referral/routing decisions. Further, this approach can be combined with other assessments of network performance such as spatial analysis [36].

In keeping with our conceptualization of how to quantify and analyze nodes and delays, the particular factors found to be associated with increased delays may not generalize to other settings or even persist over time in our catchment. Rather, our methodological approach offers a template for FEP to implement ED in a manner that is ecologically inclusive, responsive to the local network, and can support performance improvement. We hope to encourage the collection of PTC data from research and clinical first episode psychosis settings. The approach outlined can be replicated in other systems, providing a progressively detailed map of PTC to CSCs across the US and beyond. Comparisons across clinics within this common framework would allow for sharing of lessons and performance improvement, consistent with the concept of learning healthcare systems [37].

Conclusion

A considerable body of evidence demonstrates the negative impact of lengthy DUP, and great effort is being put into reducing it via ED initiatives. The robust PTC data collection, conceptual model, and analytic approach outlined in this study give first episode services specific, actionable insights on how to best measure, analyze, and focus ED efforts as well as provide a tool for further research on DUP reduction strategies.

Supporting information

S1 Table. Mixed model repeated measure analysis of effect of patient characteristics on marginal-delay as outcome measure.

The unadjusted model tests for correlation of individual predictors with the dependent variable marginal-delay. The adjusted or multivariate model test for correlation of each predictor when other predictors occur.

(DOCX)

S1 Data. Raw pathway to care data.

Dates of services are redacted for confidentiality.

(CSV)

Data Availability

The main content of our data involves patient dates of service, protected health information under US HIPAA laws. Both our IRB and Office of Sponsored Projects agreed that we could not share such information without a formal Data Use Agreement. As a compromise, we have added our raw csv -- with dates redacted -- to our supplementary materials. This gives an essence of how we encoded and computed our data. The points of contact at the Yale Office in Institutional Research is Marta Boeke (marta.boeke@yale.edu) and at Office of Sponsored Projects is Oluma Onuma (uloma.onuma@yale.edu).

Funding Statement

None of the authors have any conflicts of interest of financial support to report. This work was supported by National Institutes of Health (R01MH103831) and the Gustavus and Louise Pfeiffer Research Foundation. The funding sources had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication. This work was also funded by the State of Connecticut, Department of Mental Health and Addiction Services, but this publication does not express the views of the Department of Mental Health and Addition Services or the State of Connecticut. The views and opinions expressed are those of the authors.

References

  • 1.McGlashan TH. Duration of untreated psychosis in first-episode schizophrenia: marker or determinant of course? Biol Psychiatry. 1999;46(7):899–907. doi: 10.1016/s0006-3223(99)00084-0 [DOI] [PubMed] [Google Scholar]
  • 2.Srihari VH. Working toward changing the Duration of Untreated Psychosis (DUP). Schizophr Res. 2017;193: 39–40. doi: 10.1016/j.schres.2017.07.045 [DOI] [PubMed] [Google Scholar]
  • 3.Penttilä M, Jääskeläinen E, Hirvonen N, Isohanni M, Miettunen J. Duration of untreated psychosis as predictor of long-term outcome in schizophrenia: systematic review and meta-analysis. Br J Psychiatry. 2014;205: 88–94. doi: 10.1192/bjp.bp.113.127753 [DOI] [PubMed] [Google Scholar]
  • 4.Hegelstad WT, Larsen TK, Auestad B, Evensen J, Haarh U, Joa I, et al. Long-term follow-up of the TIPS early detection in psychosis study: effects on 10-year outcome. Am J Psychiatry. 2012;169: 374–380. doi: 10.1176/appi.ajp.2011.11030459 [DOI] [PubMed] [Google Scholar]
  • 5.Lloyd-Evans B, Crosby M, Stockton S, Pilling S, Hobbs L, Hinton M, et al. Initiatives to shorten duration of untreated psychosis: systematic review. Br J Psychiatry. 2011;198: 256–63. doi: 10.1192/bjp.bp.109.075622 [DOI] [PubMed] [Google Scholar]
  • 6.Oliver D, Davies C, Crossland G, Lim S, Gifford G, McGuire P, et al. Can We Reduce the Duration of Untreated Psychosis? A Systematic Review and Meta-Analysis of Controlled Interventional Studies. Schizophr Bull. 2018;44: 1362–1372. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Compton MT, Broussard B. Conceptualizing the multifaceted determinants of the duration of untreated psychosis. Curr Psychiatry Rev. 2011;7(1): 1–11. doi: 10.2174/157340011795945865 [DOI] [Google Scholar]
  • 8.Rogler LH, Cortes DE. Help-seeking pathways: a unifying concept in mental health care. Am J Psychiatry. 1993;150: 554–61. doi: 10.1176/ajp.150.4.554 [DOI] [PubMed] [Google Scholar]
  • 9.Lincoln CV, McGorry P. Who cares? Pathways to psychiatric care for young people experiencing a first episode of psychosis. Psychiatr Serv. 1995;46: 1166–71. doi: 10.1176/ps.46.11.1166 [DOI] [PubMed] [Google Scholar]
  • 10.Singh SP, Grange T. Measuring pathways to care in first-episode psychosis: a systematic review. Schizophr Res. 2006;81: 75–82. doi: 10.1016/j.schres.2005.09.018 [DOI] [PubMed] [Google Scholar]
  • 11.Anderson KK, Fuhrer R, Malla AK. The pathways to mental health care of first-episode psychosis patients: a systematic review. Psychol Med. 2010;40: 1585–97. doi: 10.1017/S0033291710000371 [DOI] [PubMed] [Google Scholar]
  • 12.Marino L, Scodes J, Ngo H, Nossel I, Bello I, Wall M, et al. Determinants of pathways to care among young adults with early psychosis entering a coordinated specialty care program. Early Interv Psychiatry. 2020;14(5): 544–552. doi: 10.1111/eip.12877 [DOI] [PubMed] [Google Scholar]
  • 13.Srihari VH, Tek C, Pollard J, Zimmet S, Keat J, Cahill J, et al. Reducing the duration of untreated psychosis and its impact in the U.S.: the STEP-ED study. BMC Psychiatry. 2014;14: 335. doi: 10.1186/s12888-014-0335-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Henderson JV, Poole W. Principles of Microeconomics. Boston, Mass.: D.C. Heath and Company; 1991.
  • 15.Srihari VH, Tek C, Kucukgoncu S, Phutane VH, Breitborde NJK, Pollard J, et al. First-episode services for psychotic disorders in the U.S. Public sector: A pragmatic randomized controlled trial. Psychiatr Serv. 2015;66(7): 705–712. doi: 10.1176/appi.ps.201400236 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Srihari VH, Ferrara M, Li F, Kline E, Gülöksüz S, Pollard JM, et al. Reducing the Duration of Untreated Psychosis (DUP) in a US Community: A Quasi-Experimental Trial. Schiz Bull Open. 2022;3: sgab057 doi: 10.1093/schizbullopen/sgab057 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Judge AM, Perkins DO, Nieri J, Penn DL. Pathways to care in first episode psychosis: A pilot study on help-seeking precipitants and barriers to care. J Ment Health. 2005;14: 465–469. [Google Scholar]
  • 18.Miller TJ, McGlashan TH, Rosen JL, Cadenhead K, Cannon T, Ventura J, et al. Prodromal assessment with the structured interview for prodromal syndromes and the scale of prodromal symptoms: predictive validity, interrater reliability, and training to reliability. Schizophr Bull. 2003;29: 703–715. doi: 10.1093/oxfordjournals.schbul.a007040 [DOI] [PubMed] [Google Scholar]
  • 19.Hall RC: Global assessment of functioning. A modified scale. Psychosomatics. 1995;36: 267–75. doi: 10.1016/S0033-3182(95)71666-8 [DOI] [PubMed] [Google Scholar]
  • 20.Cornblatt BA, Auther AM, Niendam T, Smith CW, Zinberg J, Bearden C, et al. Preliminary findings for two new measures of social and role functioning in the prodromal phase of schizophrenia. Schizophr Bull. 2007;33(3): 688–702. doi: 10.1093/schbul/sbm029 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Addington J, Heinssen RK, Robinson DG, Schooler NR, Marcy P, Brunette MF, et al. Duration of Untreated Psychosis in Community Treatment Settings in the United States. Psychiatr Serv. 2015;66: 753–756. doi: 10.1176/appi.ps.201400124 [DOI] [PubMed] [Google Scholar]
  • 22.Correll CU, Galling B, Pawar A, Krivko A, Bonetto C, et al. Comparison of Early Intervention Services vs Treatment as Usual for Early-Phase Psychosis: A Systematic Review, Meta-analysis, and Meta-regression. JAMA Psych. 2018;75:555–565. doi: 10.1001/jamapsychiatry.2018.0623 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Connor C, Birchwood M, Freemantle N, Palmer C, Channa S, Barker C, et al. Don’t turn your back on the symptoms of psychosis: the results of a proof-of-principle, quasi-experimental intervention to reduce duration of untreated psychosis. BMC Psychiatry. 2016;16: 127. doi: 10.1186/s12888-016-0816-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Bechard-Evans L, Schmitz N, Abadi S, Joober R, King S, Malla A. Determinants of help-seeking and system related components of delay in the treatment of first-episode psychosis. Schizophr Res. 2007;96: 206–214. doi: 10.1016/j.schres.2007.07.017 [DOI] [PubMed] [Google Scholar]
  • 25.Cabassa LJ, Piscitelli S, Haselden M, Lee RJ, Essock SM, Dixon LB. Understanding Pathways to Care of Individuals Entering a Specialized Early Intervention Service for First-Episode Psychosis. Psychiatr Serv. 2018;69: 648–656. doi: 10.1176/appi.ps.201700018 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Ferrara M, Guloksuz S, Mathis WS, Li F, Lin I, Syed S, et al. First help-seeking attempt before and after psychosis onset: measures of delay and aversive pathways to care. Soc Psychiatry Psychiatr Epidemiol. 2021;56: 1359–1369. doi: 10.1007/s00127-021-02090-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Schoer N, Huang CW, Anderson KK. Differences in duration of untreated psychosis for racial and ethnic minority groups with first-episode psychosis: an updated systematic review and meta-analysis. Soc Psychiatry Psychiatr Epidemiol. 2019;54(10): 1295–1298. doi: 10.1007/s00127-019-01737-3 [DOI] [PubMed] [Google Scholar]
  • 28.Zeller SL. Treatment of psychiatric patients in emergency settings. Prim Psychiatry. 2010;17: 35–41. [Google Scholar]
  • 29.Etheridge K, Yarrow L, Peet M. Pathways to care in first episode psychosis. J Psychiatr Ment Health Nurs. 2004;11: 125–8. doi: 10.1111/j.1365-2850.2003.00673.x [DOI] [PubMed] [Google Scholar]
  • 30.Ferrara M, Tedeschini E, Baccari F, Musella V, Vacca F, Mazzi F, et al. Early intervention service for first episode psychosis in Modena, Northern Italy: The first hundred cases. Early Interv Psychiatry. 2019;13: 1011–1017. doi: 10.1111/eip.12788 [DOI] [PubMed] [Google Scholar]
  • 31.Power P, Iacoponi E, Reynolds N, Fisher H, Russell M, Garety P, et al. The Lambeth Early Onset Crisis Assessment Team Study: general practitioner education and access to an early detection team in first-episode psychosis. Br J Psychiatry Suppl. 2007;51: s133–9. doi: 10.1192/bjp.191.51.s133 [DOI] [PubMed] [Google Scholar]
  • 32.Oppetit A, Bourgin J, Martinez G, Kazes M, Mam-Lam-Fook C, Gaillard R, et al. The C’JAAD: a French team for early intervention in psychosis in Paris. Early Interv Psychiatry. 2018;12: 243–249. doi: 10.1111/eip.12376 [DOI] [PubMed] [Google Scholar]
  • 33.Ehmann TS, Tee KA, MacEwan GW, Dalzell KL, Hanson LA, Smith GN, et al. Treatment delay and pathways to care in early psychosis. Early Interv Psychiatry. 2014. Aug;8(3): 240–6. doi: 10.1111/eip.12051 [DOI] [PubMed] [Google Scholar]
  • 34.Myers N, Sood A, Fox KE, Wright G, Compton MT. Decision Making About Pathways Through Care for Racially and Ethnically Diverse Young Adults with Early Psychosis. Psychiatr Serv. 2019;70: 184–190. doi: 10.1176/appi.ps.201700459 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Yarborough BJ, Yarborough MT, Cavese JC. Factors that hindered care seeking among people with a first diagnosis of psychosis. Early Interv Psychiatry. 2019;13: 1220–1226. doi: 10.1111/eip.12758 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Mathis WS, Woods S, Srihari VH. Blind Spots: Spatial analytics can identify nonrandom geographic variation in first episode psychosis program enrollments. Early Interv Psychiatry. 2018;12: 1229–1234. doi: 10.1111/eip.12681 [DOI] [PubMed] [Google Scholar]
  • 37.Srihari VH, Cahill JD. Early intervention for schizophrenia: building systems of care for knowledge translation. In: Uhlhaas PJ, Wood SW, editors. Youth Mental Health: Vulnerability and Opportunities for Prevention and Early Intervention. Strungmann Forum Rep Vol 28. Cambridge, MA: MIT Press; 2019. [Google Scholar]

Decision Letter 0

Giuseppe Carrà

9 Feb 2022

PONE-D-21-32200Granular analysis of pathways to care and durations of untreated psychosis: A marginal delay modelPLOS ONE

Dear Dr. Mathis,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Mar 26 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Giuseppe Carrà, PhD

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at 

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Partly

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: No

Reviewer #2: No

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Strengths of the paper: Well justified background. Data from a well-established and methodologically sound programme for first episode psychosis. Conceptual model is very well developed. The network node analysis is particularly interesting and novel – it certainly adds value to the field as it indicates likely nodes that both affect PTC and delay. The functioning results are also very interesting.

The issues below require addressing in a revised version – for the most part these should be straightforward to do. My most substantive comment is the last – I think there needs to be some substantive reworking of the discussion to give credence to some possible limitations of the work. Other areas of the discussion could be shortened (particularly the initial summary) to keep the good flow and precision which this work otherwise exhibits.

1. In general, take care throughout in using the term “significant”. It should generally be reserved to denote a statistically significant result (with test statistics reported), with another word used to describe other important findings. i.e. P12 “However, a significant number of Clinical nodes interacted with FEP patients but did not appear to recognize psychosis.” Here this is interesting, but perhaps “substantial” is a more appropriate qualifier – make sure to back up such claims with the actual data.

2. Please report IQR alongside any medians reported in the paper (including abstract).

3. Please report the type of statistical tests used when reporting p-values.

4. In abstract, first sentence of results could be deleted, or values that are reported in second sentence could be integrated into first sentence, to shorten. Report how much longer (in days) the DUP was for those with sharper functional decline.

5. P5, preference to use First Episode Psychosis [FEP] services as the nomenclature to distinguish this type of specialism from first episode programmes for other disorders, and more consistently used in the (at least European) literature.

6. P6, methods: When was the GAF measured on participants? This is stated on p9, but I recommend moving it to where this is first introduced. More detail of how GAF 12 months prior to STEP enrolment should be given.

7. P8, methods: I recommend removing “age at STEP enrolment” from the analyses and paper. This cannot influence delay, and any associations here will be uninformative because they will be perfectly correlated with age at symptom onset and DUP.

8. P9, please report the corresponding statistical test and p-values for the statement “These participants did not differ significantly from the remaining subjects in age, race, or gender.”

9. P13, Table 2 – it’s unclear from the table whether the correlations are for DUP-total to total nodes, DUP-demand to Demand nodes, DUP-supply to Supply nodes. I assume this is the case, but this should be clarified in the table, and text on P12.

10. P13, Table 3: Please retitle the table to avoid the use of the word “correlations” – technically I think only the continuous-continuous associations are correlations; associations is preferred.

11. P16: For consistency it is probably easier to report the median ED encounters per participant than the mean number (with IQR).

12. Discussion: repetition of results (i.e. values) should be avoided in the discussion.

13. Discussion: a separate “strengths and limitations” section should be provided with a subheading. In particular, the paper should discuss:

a. The extent to which data collected in their study (i.e. the reconstruction of PTC) was reliant on clinical records versus patient and caregiver reports. The former are collected prospectively, and thus minimise recall, whereas the latter may be affected by recall, which may act differentially – particularly by level of functioning which could have the potential to bias the results. If the authors have data on the proportions of PTC records rated from these sources, this would be helpful additional information; if this was not recorded, a more detailed discussion on this general point will suffice.

b. The validity of defining DUP-supply as the date from the initiation of antipsychotics. It is possible for clinical contacts before this point to “fail” to prescribe Aps, which could (retrospectively) be seen as a supply-side delay in treatment. Alternatively, is a clinical contact (without Aps) a possible treatment in itself – i.e. if they received psychological interventions at this point or some other form of active monitoring?

c. Detection bias – the sample is, by definition, restricted to those who are referred to and enrolled in STEP. There may be other FEP cases in the community (i.e. the true incidence) that have not yet been referred to STEP. Although the extent of this is unknown, a comment on it is worthwhile – in the true population with FEP in the STEP catchment, could it be that the true DUP was even longer than observed here.

d. Given the high proportion of “false positive” referrals to STEP (i.e. 199/1356 enrolled) could STEP be a significant supply-side node contributing to marginal delays for people with other (non-psychotic) psychopathologies that require onward referral to other specialised mental health programmes (where available)?

e. Could the absence of variation in delays by demographic characteristics be a function of statistical power and the small sample size? Table 3 only reports P-values, but could more helpfully report effect sizes / differences between the comparator groups.

Reviewer #2: The authors have developed an approach to analyze delays in the pathways to care for patients with psychosis. They developed and tested this method on data from 156 participants enrolled in an early treatment program. This proof of concept on a specific sample provides insight into the associations between certain events and delayed care, and is an interesting approach to quantify and analyze pathways to care. The manuscript could benefit from clarifying the assumptions and approach so that the importance become more clear.

Abstract:

From the information in the abstract, it is not immediately clear what “Community nodes” are. The abstract should be interpretable without having to read the manuscript. After reading the manuscript, I think it could be clarified partially by defining the antipsychotic prescription as the switch from demand to supply.

“referred to the clinic” -> does this mean STEP?

Choose “v” or “vs” when comparing two items, not both.

It seems like the words community, clinical, outpatient programs don’t need to be capitalized, as they’re used as-is in this context, and it makes it harder to read. Later on in the manuscript, the same applies to marginal delay. I’m still on the fence regarding Demand and Supply, but see comments in introduction and methods on using these terms in general. Regardless, without defining Demand and Supply, these terms are currently meaningless in the abstract.

“Other associations” should be defined here or in the methods section of the abstract.

The manuscript only provides “actionable insights on how to focus efforts on strategies to reduce untreated psychosis”, but not “how to best measure or analyze strategies”; Only one approach is analyzed in the manuscript and so there is no head-to-head analytical (nor descriptive) comparison of this approach with other methods.

Furthermore, what are the actionable insights? Please state that instead of just mentioning that there are actionable insights.

Introduction:

The paragraph “The concept of pathways…” hints at prior studies that dissect pathways to care (beyond just measuring the DUP), but some specifics would be good to have here. It is not immediately clear that this study will be any different from the prior literature; why would it not have the same shortcomings? In this paragraph, the most recent citation is from 2014 – has there been no more efforts in this field after this year?

The PTC of patients is complex, multifaceted and heterogeneous, and I commend the authors for attempting to create a general measure that captures all aspects. The assumptions of the approach, however, could use some clarification. The following paragraph “From an interventionist perspective…” is not defining the treatment. Later it becomes clear that this treatment event only consists of being prescribed antipsychotic prescription drugs. Why exactly is anti-psychotic prescription the defining moment where it switches from demand to supply? As DUP could be defined in multiple ways, the authors may wish to expand this section to provide the underpinnings of what is considered the end of the DUP (i.e. why would only STEP and not any other treatments be considered the start of the treatment). What if the patient receives outpatient care from a psychiatrist (with or without medication) before being enrolled in STEP, wouldn’t this be considered the end of the untreated period, especially if STEP wasn’t an option? Some of these details may be better suited for the methods section, but overall, more justification is needed for the general approach, and why it is better than everything else that has been published before. If the authors’ main purpose is provide a proof of concept, and not derive any conclusions from the content because of these assumptions, this should be more clearly mentioned.

Methods:

What is the size and type of catchment area of STEP, is it rural, urban, suburban etc?

Were there any differences in recall rates between the place of care? E.g. an emergency room visit is more memorable than perhaps mentioning symptoms at a yearly physical exam.

Enrolment should be enrollment (also in legend of Table 1, and discussion).

From the examples in the legend of figure 1, it becomes somewhat clear what kind of agents define a community node and clinical node, but these terms should be explained in the text of the methods with a comprehensive definition (or a list in the supplement of all the possible types of events that were mentioned by the patients).

Furthermore, the authors later on make a distinction between community and clinical nodes that, later on, appears to be a critical concept in the analysis. The importance should be described in the introduction.

Related to a comment on the introduction - what happens when the patient does not get, want, need, or take anti-psychotics? Especially considering the younger age of the sample, anti-psychotics may not be a desirable intervention for all patients. If they get only a one-month fill of anti-psychotics during the DUP period, and don’t get a refill, according to the current definition, shouldn’t they switch back from supply to demand?

Did the patients provide information on when they had an unmet need of care, or whether symptoms were manageable without care during the DUP period? Would it be possible to inquire with the participants to find out at what stages they considered to be in the demand/supply period? I am not necessarily dismissing the assumptions that are admittedly hard to define and generalize among all patients, but it appears that the authors are making generalized decisions about the patients’ needs without their direct input. With the current level of detail it is hard to determine whether that is a reasonable approach to the problem. I am now aware that other papers describing STEP have used the demand/supply terms, but it appears that these words were defined differently: ‘Demand’: identification of illness and initiation of help-seeking; and ‘Supply’: correct identification of diagnosis and referral to first-episode services (from Srihari et al, BMC Psychiatry 2014). Perhaps a better choice of words in this context would be pre-medication/post-medication. This would also make it clear to the readers (who may not read the methods carefully) that that event is defined as the switch. Or a different approach would be to follow the original definition.

Figure 1 shows a very short DUP, considering that the median DUP in the study sample was 151 days. What was the range? It would be more representative to show a longer DUP in the figure, or at the very least acknowledge in the legend that the duration is short for illustrative purposes. If allowed for privacy reasons, I think it would be interesting if the timelines for all or a representative subset of patients could be shown in a figure (probably in a supplemental section), since there are only 156 patients. This would give a better idea of the distribution of DUP time, and the sequences and kind of nodes that occurred in the whole sample. For researchers who wish to apply the approach developed by the authors, this may give a better idea of whether it would be an informative and feasible approach for their own group of patients, especially considering the general heterogeneity of patient samples and enrollment in a specialized treatment program in this study.

A delay is described as the days after the event until the next. However, the counterfactual is not known. A community node may slow down or speed up the next event if the event had not occurred, but this is unobserved. How do the authors reconcile not knowing the counterfactual?

A few more details on the mixed model methods would be helpful.

The authors would be encouraged to share their R and SAS code used for the analyses to enable other researchers to apply their approach.

Results

The word note in the “Network” section should be node.

The results in the sentence “Unsurprisingly, the majority…” are not surprising because they’re in part mechanical. It might be good to add this, for those who did not read the methods carefully. Similarly, the sentence “While community node encounters skewed toward the demand side” later on in the Node category section, may be clarified.

In the sentence “However, a significant number of clinical nodes…” it would be good to quantify this in some way.

The sentence “Interactions with police…” makes it initially seem like the authors combined police and self-referral while these are very different from each other. After inspecting the table, it appears that it’s just the percentages that are the same. This could be clarified with writing “(40% of participants in each category)” or something similar.

“… the relative frequency of encounters per node type…” doesn’t appear stable -as mentioned to a certain extent- as the self category is higher, and all the other categories are lower. Perhaps the sentence should read: The distribution of the community node types changed between the demand and supply time period, with ‘self’ occurring relatively more frequently, and the other node types occurring less frequently on the supply side.

In general, delays seem to be causally attributed to nodes in this manuscript, but causality cannot be inferred from these methods . Throughout the text the wording (e.g. “contribute” to delay, or making the jump to delay-reducing interventions) should be changed to reflect that

Discussion:

The results don’t necessarily “illustrate robustness of the approach”. I didn’t see any sensitivity analyses, which is acceptable for the purposes of this manuscript, but this sentence should probably be left out. The results also don’t “validate the analytical approach”. The results are very interesting and informative from an explorative viewpoint, but the authors should be careful not to overstate the conclusions and implications of the study. First and foremost, more research is needed before it is clear that this method would be equally informative with other patients or in other contexts (e.g. no enrollment in the STEP program). An explanation of why the results may not generalize would be helpful.

The structure of the sentence “This validates the utility of multi-component ED campaigns…” could be improved.

A sensitivity analysis that includes the partially known PTCs of currently excluded participants may be informative, as in other contexts it is likely not clear whether PTCs are complete or not.

Conclusion

See comments regarding the conclusion in the abstract section.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Prof James B. Kirkbride

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2022 Dec 6;17(12):e0270234. doi: 10.1371/journal.pone.0270234.r002

Author response to Decision Letter 0


20 May 2022

We appreciate the close reading and thoughtful comments by editorial staff and both reviewers. Below you will find an item-by-item response to each recommendation.

Attachment

Submitted filename: Reviewer Comments.docx

Decision Letter 1

Giuseppe Carrà

7 Jun 2022

Granular analysis of pathways to care and durations of untreated psychosis: A marginal delay model

PONE-D-21-32200R1

Dear Dr. Mathis,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Giuseppe Carrà, PhD

Academic Editor

PLOS ONE

Acceptance letter

Giuseppe Carrà

21 Jun 2022

PONE-D-21-32200R1

Granular analysis of pathways to care and durations of untreated psychosis: A marginal delay model

Dear Dr. Mathis:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Giuseppe Carrà

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Table. Mixed model repeated measure analysis of effect of patient characteristics on marginal-delay as outcome measure.

    The unadjusted model tests for correlation of individual predictors with the dependent variable marginal-delay. The adjusted or multivariate model test for correlation of each predictor when other predictors occur.

    (DOCX)

    S1 Data. Raw pathway to care data.

    Dates of services are redacted for confidentiality.

    (CSV)

    Attachment

    Submitted filename: Reviewer Comments.docx

    Data Availability Statement

    The main content of our data involves patient dates of service, protected health information under US HIPAA laws. Both our IRB and Office of Sponsored Projects agreed that we could not share such information without a formal Data Use Agreement. As a compromise, we have added our raw csv -- with dates redacted -- to our supplementary materials. This gives an essence of how we encoded and computed our data. The points of contact at the Yale Office in Institutional Research is Marta Boeke (marta.boeke@yale.edu) and at Office of Sponsored Projects is Oluma Onuma (uloma.onuma@yale.edu).


    Articles from PLOS ONE are provided here courtesy of PLOS

    RESOURCES