Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2018 Nov 1.
Published in final edited form as: Res Social Adm Pharm. 2016 Nov 15;13(6):1055–1061. doi: 10.1016/j.sapharm.2016.11.005

BEHAVIORAL, MENTAL, AND PHYSICAL HEALTH CHARACTERISTICS AND OPIOID MEDICATION MISUSE AMONG COMMUNITY PHARMACY PATIENTS: A LATENT CLASS ANALYSIS

Gerald Cochran a,b, Valerie Hruschak a, Jennifer L Bacci c, Kenneth C Hohmeier d, Ralph Tarter e
PMCID: PMC5815164  NIHMSID: NIHMS940875  PMID: 27876595

Abstract

Background

Community pharmacists are well-positioned to address the US opioid medication crisis, which has created a need to detect misuse risk in order to provide optimal patient care.

Objectives

This study sought to identify community pharmacy patient subgroups at risk for opioid medication misuse.

Methods

This study was a cross-sectional survey that examined behavioral, mental, and physical health characteristics among patients filling opioid pain medications. A convenience sample of adult patients filling opioid pain medications who were not receiving cancer treatment were screened in 2 urban and 2 rural community pharmacies in southwestern Pennsylvania. Patient subgroups were identified using latent class analysis. Latent class regression analysis was used to examine the association between subgroup membership and misuse.

Results

A total of 333 patients completed the survey (response rate 71.4%). Latent class analysis results showed that a 3-class solution best fit the data, which were labeled: mental health (8.4%, n=28), poor health (79.6%, n=265), and hazardous alcohol use (12%, n=40). Individuals within the mental health subgroup had an increased risk for opioid medication misuse (Odds Ratio=6.23, 95% CI=5.13–7.33).

Conclusion

These findings demonstrate heterogeneity of this population receiving prescribed opioids and the potential to identify subgroups with high misuse risk. These findings also support routine screening of patients filling opioid medications and suggest the need for evidence-based patient-centered intervention development.

Keywords: Opioid medication misuse, screening, community pharmacy, latent class analysis

Introduction

Community pharmacists are continuing to position themselves as major contributors to addressing the opioid medication epidemic in the US. Advancements in the proliferation of pharmacist training to identify and provide interventions to patients who misuse opioid medications are rapidly moving forward.18 This response is crucial given the serious threat posed to public health by continued misuse and overdose.9 Previous research demonstrated that in 2014 approximately 4.3 million individuals were engaged in the non-medical use of pain medications in the US.10 Furthermore, between 2001–2013, there was a >300% growth in opioid medication overdose deaths,11 with 44 individuals currently experiencing fatal overdose daily.12 Analyses of Medicaid data show, for instance, a marked increase for opioid medication overdose among those who misuse compared to those who do not.13 Individuals involved in opioid medication misuse have a number of behavioral, mental, and physical health issues that increase risk for misuse, including co-occurring substance use disorders, 1419 mental health/psychiatric conditions, 17, 18, 2022 severe and chronic pain,16, 19, 2224 and poor general health/quality of life.17, 24

Typical approaches for identifying patient risk characteristics for misuse employ null hypothesis testing statistical methods. Limitations associated with these approaches include sensitivity to sample size, lack of clinical significance despite achieving “statistical significance,”25 and narrow ability to accurately represent multifactorial individual risk. Latent variable modeling can, in contrast, identify nuanced patient characteristics, develop theoretical and practical knowledge,2528 and elucidate complex health problems.29 In latent class analyses (LCA), the variable of interest is unobserved but characterized by multiple observed indicators.”27, 30 An important property of LCA is that it is a model-based approach for identifying homogeneous classes or “subgroups” according to a shared pattern of responses.27, 29, 31, 32 A main advantage of LCA is that it enables modeling of multiple variables with precision to characterize a subgroup of individuals’ unique current or potential risk. Given the present national opioid crisis and the urgency to identify and provide care for patients engaged in or at risk for misuse, the application of LCA, therefore, is highly appropriate.

LCA may be especially useful for understanding misuse risk considering that individuals engaging in opioid misuse possess a variety of characteristics that have differential etiological salience. Aggregating individuals into distinct subgroups based on their particular configuration of risk characteristics enables accurate matching of interventions to the particular factors promoting and maintaining opioid misuse. Accordingly, the pharmacist has a unique opportunity to both accurately specify the pattern and severity of risk as well as inform intervention.

The purpose of the current project was to identify risk subgroups based on mental, behavioral, and physical health characteristics of patients filling opioid medications in community pharmacies. This study further sought to identify which subgroups of patients possessed the highest risk for reporting misuse of their opioid pain medications. The knowledge produced herein provides clinical pharmacists with valuable insight into characteristics of patients with the highest risk for misuse. The results of this study also have the capacity to provide clinical researchers with a foundation for further exploration of methods to identify individual and distinct health needs.

Materials and Methods

Sample, Recruitment, and Survey

This study was a cross-sectional survey in 4 community pharmacies in southwestern Pennsylvania between September, 2015 and June, 2016, which methods have been described in detail elsewhere.33 Patients dropping off new and/or refill prescriptions for any opioid pain medication were identified by pharmacists or pharmacy staff and asked if they were interested in completing a health screening questionnaire. Interested patients were handed a computer tablet wherein they were asked to confirm they were ≥18 years of age, not receiving treatment for cancer, and had not previously completed the survey. Qualified and interested individuals were prompted to continue to the next page where they were: informed about the purpose of the survey, given assurances of anonymity, and provided with contact information for the study Principal Investigator. Patients were also informed that they were not required to complete any of the questions, and if they chose to not participate in the study, their services at the pharmacy location would not be effected. Patients were also provided health and social services information if they wished to receive additional assistance. In order to enhance acceptability in the community pharmacy settings, the survey was brief, consisting of 45 multiple-choice or yes/no demographic, behavioral, mental, and physical health questions. Upon completing the survey, participants were given a $20 gift card. This study was designated exempt by the University of Pittsburgh Institutional Review Board.

Measurement Model Indicators

Five self-report measures of behavioral, mental, and physical health characteristics commonly associated with opioid medication misuse were administered: 1) the Alcohol Use Disorders Identification Test-C (AUDIT-C)34 assesses hazardous alcohol consumption. This 3-item screener for hazardous drinking has a cut-off score of ≥3 for women and ≥4 for men.3436 2) Drug use was screened using the Drug Abuse Screening Test-10 (DAST-10). The DAST is comprised of 10 items and assesses substance use severity.37 A cut-off score of ≥1 indicates a need for intervention.37 3) Depression was screened using the 2-item Patient Health Questionnaire-2 (PHQ-2). A score of ≥3 indicates a positive screen.38, 39 4) Posttraumatic stress disorder (PTSD) was assessed using the 4-item Primary Care-Posttraumatic Stress Disorder (PC-PTSD) screen, with a score of ≥3 indicating PTSD.4042 5) Health was assessed using the Short-Form-12 Health Survey (SF-12).43 The SF-12 contains valid single-item general health and pain subscales.44 Variables were included in the measurement model as binary indicators (i.e., a positive/negative screen) to identify subgroups.

Opioid Misuse and Use Indicators

Opioid medication misuse was assessed using the 6-item Prescription Opioid Misuse Index (POMI). 45 This measure asks about behaviors pertaining to mediation misuse, such as doctor shopping, taking medication at higher doses or more frequently than prescribed, and consumption to obtain psychological relief from stress/anxiety or to experience euphoria. A score of ≥2 affirmative responses indicates opioid medication misuse.45 Patients were also asked to list their prescription opioid medication(s) they were obtaining in their visit to the pharmacy.

Analyses

Delineating unique subgroups was undertaken using LCA.27 This statistical method has been frequently employed in substance abuse,4653 health services,5459 and mental health research.6063 Fit criteria and likelihood ratio tests were used to estimate an increasing number of subgroups until the optimum number was determined,27, 64 which included the Akaike Information Criterion,65 Adjusted Bayesian Information Criterion (ABIC), in which lower values are better; and the Bootstrapped Likelihood Ratio Test (BLRT), in which 1 class minus a non-significant p-value (i.e., p<0.05) indicates the optimal number of classes.27, 64 Using the behavioral, mental, and physical health screening instruments described above, the LCA method assigns each patient to a subgroup. A common convention for latent variable modeling suggests roughly 5 to 10 cases per parameter estimated in order to adequately power analyses.66

In order to identify the relationships between patients having a positive screen for prescription opioid medication misuse, demographic indicators, and subgroup membership; analyses also included a one-step latent class regression analysis.6769 Medication type was not included in the latent class regression analysis given lack of variability in medication use among some subgroups. The LCA estimation and regression analysis were conducted using Mplus 7.11.70 Descriptive demographic and opioid medication filling information by subgroup are also presented.

Results

A total of 333 patients completed the screening survey (response rate 71.4%). A 3-class model best fit the data (Table 1). The 3-class solution estimated a total of 20 parameters, thus having sufficient numbers of cases per parameter (N=333 participants/20 parameters). Figure 1 displays the conditional item probabilities for most likely class membership (i.e., the likelihood for respondents endorsing an item). Overall model entropy was high, 0.8068 (an entropy of 1.0 represents perfect overall model classification), and the average individual latent class probabilities for subgroup membership were between 0.73–0.95 (i.e., probability of correct individual class assignment). This high level of model entropy provides necessary diagnostic support for the selection of a one-step method for the latent class regression analysis as appropriate.69

Table 1.

Latent Class Analysis Model Fit Statistics

Classes AIC a ABIC b BLRT c Entropy
2 1567.17 1575.44 0.00 0.77
3 1551.56 1564.28 0.00 0.80
4 1555.99 1573.17 0.33 0.83
a

AIC=Akaike Information Criterion,

b

ABIC=Adjusted Bayesian Information Criterion,

c

BLRT=Bootstrapped Likelihood Ratio Test

Figure 1.

Figure 1

Patient Mental, Behavioral, and Physical Health Subgroups

Discriminating features of subgroups included pain and other key health features, which key features were used to label subgroups (subgroup labels are not intended to be definitive names for each subgroup). The hazardous alcohol use subgroup (12% of the sample, n=40) consisted of individuals who endorsed hazardous drinking (58%) and having pain in the last four weeks that interfered with their daily functioning above national norms (81%). The mental health subgroup (8.4% of the sample, n=28) consisted of individuals who were 100% likely to screen positive for depression, PTSD, and to have pain in the last four weeks that interfered with their daily functioning above national norms. The poor health subgroup (79.6% of the sample, n=265) consisted of individuals who reported generally poor health that interfered with their daily functioning above national norms (98%) and pain in the last 4 weeks that interfered with their daily functioning above national norms (96%). Following detection of these classes or subgroups, this study examined whether any pharmacy site was over represented regarding the subgroups (results not shown). Of the 2 urban and 2 rural pharmacy sites from which the patients were recruited, 1 urban site was overrepresented (24%, n=24, standardized residual=3.5) and 1 rural site was underrepresented (4.1%, n=4, standardized residual=−2.3) in the hazardous alcohol use subgroup (χ2=24.9, df=5, p<0.001). All other proportional distributions of the subgroups were not over/underrepresented (standardized residuals<2.0).

Hazardous Alcohol Use Subgroup

Table 2 displays participant demographic and medication data according to each particular subgroup. Individuals in the hazardous alcohol use subgroup were the youngest participants (Mean=44 years, Standard Deviation SD=16.4). Just under half of this subgroup were female (47.5%, n=19), were more likely to have education beyond high school (65.5%, n=25), and reported current employment (70%, n=28) relative to the two other subgroups. Hazardous alcohol use subgroup members were screened least frequently in the rural pharmacy setting compared to the other subgroups (20.0%, n=8). Members of this subgroup most often reported filling hydrocodone (37.5%, n=15) and oxycodone (37.5%, n=15). Notably, this group had the smallest portion of patients who screened positive for opioid misuse (10.3%, n=4). In terms of individual behaviors of misuse, the largest portion of the total sample who reported feeling high/buzzed from their opioid were members of the hazardous alcohol use subgroup (15%, n=6).

Table 2.

Bivariate Analyses of Demographics, Opioid Medication, and Misuse by Subgroup (N=333)

Indicators Total % (n) % Hazardous alcohol use (n) % Mental health (n) % Poor health (n) χ2 df p
Demographics

Age a,b 49.8 (12.4) 44.0 (16.4) 49.2 (9.0) 50.8 (11.7) 5.5 2 0.01
Female 56.6 (188) 47.5 (19) 60.7 (17) 57.9 (152) 1.6 2 0.44
Rural pharmacy 52.0 (173) 20.0 (8) 64.3 (18) 55.5 (147) 19.4 2 <0.000
>High school education 43.8 (145) 62.5 (25) 32.1 (9) 42.2 (111) 7.5 2 0.02
Employed 31.0 (103) 70.0 (28) 25.0 (7) 25.8 (68) 32.3 2 <0.000

Pain Medication

Hydrocodone 39.3 (131) 37.5 (15) 42.9 (12) 39.3 (265) 0.2 2 0.90
Hydromorphonec 3.6 (12) 0.0 (0) 0.0 (0) 4.5 (12) 3.2 2 0.39
Oxycodone 36.9 (123) 37.5 (15) 42.9 (12) 36.2 (96) 0.5 2 0.79
Morphine c 7.5 (25) 0.0 (0) 7.1 (2) 8.7 (23) 3.8 2 0.12
Methadone c 3.3 (11) 0.0 (0) 3.6 (1) 3.8 (10) 1.6 2 0.52
Fentanyl c 3.9 (13) 2.5 (1) 3.6 (1) 4.2 (11) 0.2 2 1.00
Oxymorphonec 4.8 (16) 0.0 (0) 7.1 (2) 5.3 (14) 2.5 2 0.30

Misuse and class assignment

Prescription opioid misuse c 15.1 (49) 10.3 (4) 44.4 (12) 12.7 (33) 20.0 2 <0.001

Misuse behavior and class assignment

Taking higher dosages 12.8 (42) 7.5 (3) 40.7 (11) 10.7 (28) 21.0 2 <0.001
Shorten time between dosages 23.6 (78) 17.5 (7) 57.1 (16) 20.9 (55) 19.4 2 <0.001
Early refills c 11.8 (39) 5.0 (2) 32.1 (9) 10.7 (28) 13.2 2 0.003
Feel high or get a buzz c 9.4 (31) 15.0 (6) 10.7 (3) 8.4 (22) 1.8 2 0.34
Taking medication when upset or to cope/relieve problems other than pain c 3.3 (11) 0.0 (0) 7.1 (2) 3.5 (9) 2.6 2 0.28
Going to multiple physicians seeking medication c 1.8 (6) 0.0 (0) 7.1 (2) 1.5 (4) 5.3 2 0.14
a

Mean (SD), f statistic.

b

Bonferroni correction showed poor health subgroup was significantly different than hazardous alcohol subgroup,

c

p value based on Fisher exact.

Mental Health Subgroup

Average age of the mental health subgroup was 49.2 years (SD=9), and 60.7% (n=17) were female. The largest portion of members of this group compared to the other two groups were screened in the rural pharmacy settings (64.3%, n=18). This subgroup had the lowest portion of members relative to the other groups who possessed more than a high school education 32.1% (n=9) and were currently employed (25%, n=7). Opioid medication consumption was primarily hydrocodone (42.9%, n=12) and oxycodone use (42.9%, n=12). Members of this subgroup had the highest percentage of positive screens for opioid misuse (44.4%, n=12) compared to the other subgroups. For specific opioid misuse behaviors, this subgroup reported the highest rates compared to the other groups of taking larger dosages than prescribed (40.7%, n=11), shortening time between dosages (57.1%, n=16), obtaining early refills (32.1%, n=9), taking their opioids when upset or to cope with problems (7.1%, n=2), and doctor shopping (7.1%, n=2).

Poor Health Subgroup

Members of the poor health subgroup were, on average, 50.8 years old (SD=11.7), and most often female (57.9%, n=152). The majority of group members were screened in the rural pharmacy settings (55.5%, n=147). Less than half of subgroup members possessed more than a high school education (42.2), n=111), and approximately one-quarter were employed (25.8%, n=68). This subgroup primarily used hydrocodone (39.3%, n=265) and oxycodone (36.2%, n=96). The percentage of patients positive for misuse was second highest in the poor health subgroup (12.7%, n=33), and the most common misuse behavior was shortening the time between dosages (20.9%, n=55).

Multivariable Analysis of Subgroup Membership and Opioid Misuse

Associations between subgroup membership, opioid medication misuse, and demographic characteristics are reported in Table 3. Individuals within the mental health subgroup had a 6.23 times higher odds (OR 95% CI=5.13–7.33) for obtaining a positive misuse screen compared to patients the poor health subgroup. Patients in the hazardous alcohol use subgroup did not have elevated risk for a positive opioid medication misuse screening (OR=0.61, 95% CI=−0.63–1.88). Analyses also involved re-estimating the latent class regression analysis with the hazardous alcohol use subgroup as the reference category. In this analysis, the substantive model interpretation was identical, with exception that the odds for the mental health subgroup having a positive opioid medication misuse screen increased (Table 3).

Table 3.

Observed Indicators Predicting Subgroup Membership a

Mental health Subgroup Estimate SE OR (95% CI) p
Prescription opioid misuse 1.83 0.56 6.23 (5.13–7.33) <0.001
Age −0.01 0.02 1.00 (0.95–1.04) 0.82
Female 0.39 0.59 1.48 (0.32–2.63) 0.51
>High school education −0.10 0.60 0.91 (−0.26–2.08) 0.87
Employed 0.05 0.62 1.05 (−0.15–2.26) 0.93
Rural Pharmacy 0.46 0.61 1.58 (0.38–2.78) 0.45

Hazardous alcohol use subgroup

Prescription opioid misuse −0.49 0.65 0.61 (−0.66–1.88) 0.45
Age −0.02 0.02 0.98 (0.95–1.02) 0.33
Female −0.34 0.43 0.71 (−0.14–1.56) 0.43
>High school education 0.32 0.45 1.38 (0.49–2.26) 0.48
Employed 1.06 0.45 2.89 (2.02–3.77) 0.02
Rural Pharmacy −1.15 0.48 0.32 (−0.62–1.25) 0.02
a

Reference group=Poor health subgroup. Note, as mentioned in the text, changing the reference group to the Hazardous alcohol use subgroup did not change the model interpretation, with the exception of an increase in the magnitude of relationship between misuse and the mental health subgroup membership: OR=10.17, 95%CI=8.57–11.78.

Discussion

As community pharmacy continues to advance patient care for addressing the opioid medication misuse and overdose epidemic, it is imperative pharmacists possess knowledge regarding patients who are at the highest risk for and possess the characteristics that increase probability for developing misuse.2 Pharmacists have a distinct and comprehensive knowledgebase regarding the safe and effective use of medications, including adverse medication effects and inappropriate use.71 When dispensing opioid medications, pharmacists have a responsibility to ensure that patients obtain appropriately prescribed medications. This responsibility must be balanced with preventing misuse and/or diversion of controlled substances. One fundamental component of this role is identifying patients who are at high risk for opioid misuse.72

Common null hypothesis statistical methods employed to assess risk among patients can provide a linear understanding of relationships between exposure/risk indicators and dependent variables. LCA, on the other hand, is an analytical advancement that permits identification of homogeneous subgroups within a heterogeneous population.27, 29, 31, 32 The current study analyzed data from a community pharmacy-based study that surveyed patients filling opioid medications. LCA was utilized to identify risk-related subgroups based on mental, behavioral, and physical health characteristics of patients filling opioid medications. Further, this study sought to identify which subgroup of patients had the highest risk for reporting misuse of their opioid medications.

Screening Patients

Results showed that a 3-class (subgroup) model best fit the data, which subgroups were labeled mental health, poor health, and hazardous alcohol use. These data provide valuable information for community pharmacists to better understand the patients to whom they dispense opioid medications. Results show that patients receiving opioids have diverse needs considering their health profiles. Bivariate analyses demonstrated that nearly 45% of those within the mental health subgroup screened positive for misuse. Regression analyses indicated that the members of this subgroup had the highest odds for opioid misuse and were the only subgroup associated with a positive report for misuse. Depression, PTSD, and pain diagnoses have been previously linked to opioid medication misuse,17, 18, 2022 and the current analyses show that positive screens for these conditions were universally present among members of the mental health subgroup. Mental health and psychiatric problems often exacerbate physical disorders and may complicate overall patient management, including medication adherence.73 Identification of individuals in this subgroup thus offers a valuable opportunity for early intervention, including referral for dually-diagnosed patients to specialized care.1 Such at risk patient identification may be guided by surrogate markers for the mental health subgroup, such as prior prescription fills for antidepressants utilizing claims data or patient prescription profiles recorded within pharmacy dispensing software. Furthermore, this study indicates that screening in the community pharmacy setting can identify undetected mental health and medical problems that require intervention.

It is important to note that the while misuse was detected in the poor health (12.7%) and hazardous alcohol use (10.3%) subgroups, a relationship between membership in these subgroups and a positive misuse screening was not observed. Despite previous literature that has reported associations between those with pain,16, 19, 2224 poor general health,17, 24 and misuse; it appears the combination of these indicators as primary characteristics of subgroup membership did not elevate risk to the level of patients currently misusing their opioid medication. It may be the case, however, that these conditions are markers for subsequent misuse behaviors and require further prospective monitoring in the population of community pharmacy patients. Notably, previous research has documented a significant increase in misuse among patients who have alcohol use disorder.16 Whether employing more comprehensive, albeit labor intensive, clinical diagnostic measures of alcohol use disorders rather than screening for hazardous use provides a better understanding of this subgroup must be further investigated.

There are currently limited resources to assist community pharmacists in the identification of patients who are at risk for opioid medication misuse.4 Despite guidelines that recommend routine deployment of screening tools, previous reports have indicated that current tools (e.g., Opioid Risk Tool,74 Screener and Opioid Assessment for Patients with Pain Version 1,75 and Brief Risk Interview76) have limitations for identifying opioid misuse.77 The results of the current study suggest the importance of potentially developing and implementing algorithm-based risk stratification tools. Such tools would require pharmacists to enter patient information into secure databases, which would analyze and produce risk subgroups according to patient characteristics. Such algorithms could be housed and operated, for example, within prescription monitoring program databases or Medicare Quality of Patient Care Star Rating analysis programs.

Need for Intervention Research

Community pharmacists working in the frontline of healthcare are in an exceptional position to provide the first response to prevent and intervene with opioid misuse.78 The pharmacy profession has quickly expanded into clinical pharmacotherapy, information services, disease management, and other health services.79 Combined with specialized knowledge of medications, pharmacists are uniquely positioned for taking an active role in misuse prevention. Toward this goal, it is noteworthy that there are various interactive tools and guidelines available to support the delivery of care to patients who are prescribed opioids. Some of the more recent tools include: a buprenorphine treatment physician locator;80, 81 Medicare Part D opioid mapping tool;81 the CDC’s opioid prescribing guidelines;77 and the American Pharmacist Association Opioid Use, Abuse, and Misuse Resource Center.82 While there are no existing evidence-based intervention protocols for community pharmacy that are specific to opioid medication misuse, it is clear from sources, such as the recently released CDC Guidelines for Opioid Prescribing, that multimodal interventions ought to be considered for patients who do not respond to single-modality therapy, with combinations being tailored to the patient’s needs.77 Data presented herein support the need for multimodal patient-centered interventions to address multiple needs of patients. In addition, the data presented from this project also suggest that when misuse does occur among community pharmacy patients (regardless of subgroup), behaviors are primarily centered around seeking early refills (11.8%), shortening time between doses (23.6%), and taking higher dosages than prescribed (12.8%). Such behaviors for intervention reside strongly within the pharmacist’s skillset and expertise and could be addressed through targeted brief medication management interventions directed at improving opioid regimen adherence.83 Future research must seek to develop, test, and implement such opioid intervention strategies at the point of medication dispensing.

Approaches to establish evidence-based protocols include the example of naloxone distribution by pharmacists to individuals misusing opioid medications and bystanders who are at an increased probability to witness an overdose.84 The content of this approach has predominantly focused on how to respond to overdose including the emergency administration of naloxone.84 There have been strong trends for leveraging pharmacists to address opioid overdose through naloxone distribution and patient education. This is aptly demonstrated by the number of states that have adopted collaborative practice agreements enabling naloxone distribution.84 The capability of pharmacists to identify patients filling opioid medications who are at risk for misuse offers a more robust and concerted effort to explicitly target these populations. Future research should seek to incorporate overdose risk into patient subgroup identification in order to assist pharmacists to ensure that naloxone kits and training are delivered to those patients within the highest risk subgroups.

Limitations

This study possesses limitations that should be taken into account when considering its findings. While the geographic locations of the pharmacies sites where the screening took place represented both urban and rural settings, they were nonetheless located within southwestern Pennsylvania and thus may not represent other US states and regions. However, as noted in the discussion, the health characteristics of the patients in this sample closely align with previously published studies, thereby providing increased confidence in the external validity of the findings reported. In addition, it should be noted that the patients in the current project were not directly asked about treatment they were currently receiving for opioid misuse or misuse risk factors. Whether these conditions were being treated or not, it is crucial that the health status of patients be known at the point of opioid dispensing to allow for assessment of possible issues of patient safety—consequently providing an important justification for collecting these data at point-of-service. Lastly, the behavioral, mental, and physical health screening tools employed in this study were selected because of their brevity so as to reduce burden on the pharmacist and the patient. Future research should employ more comprehensive measures in order to identify greater detail in subgroup characterization.

Conclusion

Employing latent class analysis, 3 distinct subgroups were identified: mental health, poor health, and hazardous alcohol use. These data offer the field valuable information to better understand specific patient subgroups that constitute the bases of a patient-centered individualized approach to intervention. The observation that patients in the mental health subgroup have highest probability of reporting misuse of opioid medications underscores the need to assess psychiatric needs at the point of dispensing. Using the findings obtained herein as the platform, future research should enhance the characterization of each subgroup with more comprehensive measurement for development of an opioid misuse algorithm enabling rapid, accurate, and routine screening in the community pharmacy setting.

Acknowledgments

Funding: This project was supported by the University of Pittsburgh Central Development Fund.

References

  • 1.Cochran G, Field C, Lawson K. Pharmacists Who Screen and Discuss Opioid Misuse With Patients: Future Directions for Research and Practice. J Pharm Pract. 2015;28(4):404–412. doi: 10.1177/0897190014522064. [DOI] [PubMed] [Google Scholar]
  • 2.Cochran G, Field C, Lawson K, Erickson C. Pharmacists’ knowledge, attitudes and beliefs regarding screening and brief intervention for prescription opioid abuse: a survey of Utah and Texas pharmacists. J Pharm Health Serv Res. 2013;4(2):71–79. [Google Scholar]
  • 3.Cochran G, Gordon AJ, Field C, et al. Developing a framework of care for opioid medication misuse in community pharmacy. Res Social Adm Pharm. doi: 10.1016/j.sapharm.2015.05.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.American Pharmacists Association. Actions of the 2015 APhA House of Delegates. San Diego, CA: American Pharmacists Assoication; 2015. [Google Scholar]
  • 5.American Pharmacists Association. American Pharmacists Association Policy Manual. Washington, DC: American Pharmacists Association; 2015. [Google Scholar]
  • 6.American Society of Health-System Pharmacists. American Society of Health-System Pharmacists Statement on the Pharmacist’s Role in Substance Abuse Prevention, Education, and Assisstance. Bethesda, MD: American Society of Health-System Pharmacists; 2015. [Google Scholar]
  • 7.Robinson M. [Accessed Feburary, 2016];Combating opioid drug abuse with naloxone. 2015 https://www.pharmacist.com/combating-opioid-drug-abuse-naloxone.
  • 8.Cochran G, Rubinstein J, Bacci JL, Ylioja T, Tarter R. Screening community pharmacy patients for risk of prescription opioid misuse. J Addict Med. 2015;9(5):411–416. doi: 10.1097/ADM.0000000000000148. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Office of National Drug Congrol Policy. Epidemic: Responding to America’s Prescription Drug Abuse Crisis. Washington, DC: Office of National Drug Congrol Policy, Executive Office of the President of the United States; 2011. [Google Scholar]
  • 10.Substance Abuse and Mental Health Services Administration. Behavioral Health Trends in the United States: Results from the 2014 National Survey on Drug Use and Health. Rockville, MD: Substance Abuse and Mental Health Services Administration; 2015. [Google Scholar]
  • 11.Centers for Disease Control and Prevention; CDC, editor. WONDER. Altanta, GA: CDC; 2015. Underlying Cause of Death 1999–2013 on CDC WONDER Online Database, released 2015. Data are from the Multiple Cause of Death Files, 1999–2013, as compiled from data provided by the 57 vital statistics jurisdictions through the Vital Statistics Cooperative Program. [Google Scholar]
  • 12.Centers for Disease Control and Prevention. [Accessed September 7, 2016];Drug overdose deaths in the United States hit record numbers in 2014. 2016 http://www.cdc.gov/drugoverdose/epidemic/index.html.
  • 13.Cochran G, Gordon AJ, Lo-Ciganic W-H, et al. An Examination of Claims-based Predictors of Overdose from A Large Medicaid Program. Med Care. doi: 10.1097/MLR.0000000000000676. In press. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Rice JB, White AG, Birnbaum HG, Schiller M, Brown DA, Roland CL. A Model to Identify Patients at Risk for Prescription Opioid Abuse, Dependence, and Misuse. Pain Med. 2012;13(9):1162–1173. doi: 10.1111/j.1526-4637.2012.01450.x. [DOI] [PubMed] [Google Scholar]
  • 15.Unick GJ, Rosenblum D, Mars S, Ciccarone D. Intertwined epidemics: national demographic trends in hospitalizations for heroin- and opioid-related overdoses, 1993–2009. Plos One. 2013;8(2):e54496–e54496. doi: 10.1371/journal.pone.0054496. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Sullivan MD, Edlund MJ, Fan M-Y, Devries A, Brennan Braden J, Martin BC. Risks for possible and probable opioid misuse among recipients of chronic opioid therapy in commercial and medicaid insurance plans: The TROUP Study. Pain. 2010;150(2):332–339. doi: 10.1016/j.pain.2010.05.020. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Becker WC, Sullivan LE, Tetrault JM, Desai RA, Fiellin DA. Non-medical use, abuse and dependence on prescription opioids among U.S. adults: Psychiatric, medical and substance use correlates. Drug Alcohol Depend. 2008;94(1):38–47. doi: 10.1016/j.drugalcdep.2007.09.018. [DOI] [PubMed] [Google Scholar]
  • 18.White AG, Birnbaum HG, Schiller M, Tang J, Katz NP. Analytic models to identify patients at risk for prescription opioid abuse. Am J Manag Care. 2009;15(12):897–906. [PubMed] [Google Scholar]
  • 19.Amari E, Rehm J, Goldner E, Fischer B. Nonmedical prescription opioid use and mental health and pain comorbidities: a narrative review. Can J Psychiatry. 2011;56(8):495. doi: 10.1177/070674371105600808. [DOI] [PubMed] [Google Scholar]
  • 20.Huang B, Dawson DA, Stinson FS, et al. Prevalence, correlates, and comorbidity of nonmedical prescription drug use and drug use disorders in the United States: Results of the National Epidemiologic Survey on Alcohol and Related Conditions. J Clin Psychiatry. 2006;67(7):1062–1073. doi: 10.4088/jcp.v67n0708. [DOI] [PubMed] [Google Scholar]
  • 21.Martins SS, Keyes KM, Storr CL, Zhu H, Chilcoat HD. Pathways between nonmedical opioid use/dependence and psychiatric disorders: results from the National Epidemiologic Survey on Alcohol and Related Conditions. Drug Alcohol Depend. 2009;103(1–2):16–24. doi: 10.1016/j.drugalcdep.2009.01.019. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Novak SP, Herman-Stahl M, Flannery B, Zimmerman M. Physical pain, common psychiatric and substance use disorders, and the non-medical use of prescription analgesics in the United States. Drug Alcohol Depend. 2009;100(1–2):63–70. doi: 10.1016/j.drugalcdep.2008.09.013. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Braker LS, Reese AE, Card RO, Van Howe RS. Screening for potential prescription opioid misuse in a michigan medicaid population. Fam Med. 2009;41(10):729. [PubMed] [Google Scholar]
  • 24.Hudson TJ, Edlund MJ, Steffick DE, Tripathi SP, Sullivan MD. Epidemiology of regular prescribed opioid use: results from a national, population-based survey. J Pain Symptom Manage. 2008;36(3):280–288. doi: 10.1016/j.jpainsymman.2007.10.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Lee J. The Epistemology of Mathematical and Statistical Modeling: A Quiet Methodological Revolution. Am Psychol. 2010;65(1):1–12. doi: 10.1037/a0018326. [DOI] [PubMed] [Google Scholar]
  • 26.Muthen B, Asparouhov T. Item response mixture modeling: Application to tobacco dependence criteria. Addict Behav. 2006;31(6):1050–1066. doi: 10.1016/j.addbeh.2006.03.026. [DOI] [PubMed] [Google Scholar]
  • 27.Collins L, Lanza S. Latent Class and Latent Transition Analysis : With Applications in the Social, Behavioral, and Health Sciences. Hoboken: John Wiley & Sons, Inc; 2010. [Google Scholar]
  • 28.Kline RB. Principles and Practice of Structural Equation Modeling. 3. New York: Guilford Publications, Inc; 2010. [Google Scholar]
  • 29.McCutcheon AL. Latent class analysis. Newbury Park, Calif: Sage Publications; 1987. [Google Scholar]
  • 30.Muthén L, Muthén B. Mplus Users Guide. 6. Los Angeles, CA: Muthen and Muthen; 2010. [Google Scholar]
  • 31.Lanza ST, Collins LM, Lemmon DR, Schafer JL. PROC LCA: A SAS Procedure for Latent Class Analysis. Struct Equ Modeling. 2007;14(4):671–694. doi: 10.1080/10705510701575602. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Connell CM, Cook EC, Aklin WM, Vanderploeg JJ, Brex RA. Risk and protective factors associated with patterns of antisocial behavior among nonmetropolitan adolescents. Aggress Behav. 2011;37(1):98–106. doi: 10.1002/ab.20370. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.[Blinded for review].
  • 34.Bradley KA, DeBenedetti AF, Volk RJ, Williams EC, Frank D, Kivlahan DR. AUDIT-C as a brief screen for alcohol misuse in primary care. Alcohol Clin Exp Res. 2007;31(7):1208–1217. doi: 10.1111/j.1530-0277.2007.00403.x. [DOI] [PubMed] [Google Scholar]
  • 35.Williams EC, Lapham GT, Hawkins EJ, et al. Variation in documented care for unhealthy alcohol consumption across race/ethnicity in the Department of Veterans Affairs Healthcare System. Alcohol Clin Exp Res. 2012;36(9):1614–1622. doi: 10.1111/j.1530-0277.2012.01761.x. [DOI] [PubMed] [Google Scholar]
  • 36.Bush K, Kivlahan DR, McDonell MB, Fihn SD, Bradley KA. The AUDIT alcohol consumption questions (AUDIT-C): an effective brief screening test for problem drinking. Ambulatory Care Quality Improvement Project (ACQUIP). Alcohol Use Disorders Identification Test. Arch Intern Med. 1998;158(16):1789–1795. doi: 10.1001/archinte.158.16.1789. [DOI] [PubMed] [Google Scholar]
  • 37.Yudko E, Lozhkina O, Fouts A. A comprehensive review of the psychometric properties of the Drug Abuse Screening Test. J Subst Abuse Treat. 2007;32(2):189–198. doi: 10.1016/j.jsat.2006.08.002. [DOI] [PubMed] [Google Scholar]
  • 38.Kroenke K, Spitzer RL, Williams JBW. The Patient Health Questionnaire-2: Validity of a Two-Item Depression Screener. Med Care. 2003;41(11):1284–1292. doi: 10.1097/01.MLR.0000093487.78664.3C. [DOI] [PubMed] [Google Scholar]
  • 39.Corson K, Gerrity MS, Dobscha SK. Screening for depression and suicidality in a VA primary care setting: 2 items are better than 1 item. Am J Manag Care. 2004;10(11 Pt 2):839. [PubMed] [Google Scholar]
  • 40.van Dam D, Ehring T, Vedel E, Emmelkamp PMG. Validation of the Primary Care Posttraumatic Stress Disorder screening questionnaire (PC-PTSD) in civilian substance use disorder patients. J Subst Abuse Treat. 2010;39(2):105–113. doi: 10.1016/j.jsat.2010.05.005. [DOI] [PubMed] [Google Scholar]
  • 41.Ouimette P, Wade M, Prins A, Schohn M. Identifying PTSD in primary care: Comparison of the Primary Care-PTSD Screen (PC-PTSD) and the General Health Questionnaire-12 (GHQ) J Anxiety Disord. 2008;22(2):337–343. doi: 10.1016/j.janxdis.2007.02.010. [DOI] [PubMed] [Google Scholar]
  • 42.Prins A, Ouimette P, Kimerling R, et al. The primary care PTSD screen (PC-PTSD): Development and operating characteristics. Primary Care Psychiatry. 2003;9:9–14. [Google Scholar]
  • 43.Jakobsson U, Westergren A, Lindskov S, Hagell P. Construct validity of the SF-12 in three different samples. J Eval Clin Pract. 2012;18(3):560–566. doi: 10.1111/j.1365-2753.2010.01623.x. [DOI] [PubMed] [Google Scholar]
  • 44.Maruish M, DeRosa M. A Guide to the Integration of Certified Short Form Survey Scoring and Data Quality Evaluation Capabilities. Lincoln, RI: Quality Metric Inc; 2009. [Google Scholar]
  • 45.Knisely JS, Wunsch MJ, Cropsey KL, Campbell ED. Prescription Opioid Misuse Index: a brief questionnaire to assess misuse. J Subst Abuse Treat. 2008;35(4):380–386. doi: 10.1016/j.jsat.2008.02.001. [DOI] [PubMed] [Google Scholar]
  • 46.Sacco P, Bucholz KK, Spitznagel EL. Alcohol Use Among Older Adults in the National Epidemiologic Survey on Alcohol and Related Conditions: A Latent Class Analysis. J Stud Alcohol Drugs. 2009;70(6):829–838. doi: 10.15288/jsad.2009.70.829. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Perron BE, Ilgen MA, Hasche L, Howard MO. Service Needs of Clients in Outpatient Substance-Use Disorder Treatment: A Latent Class Analysis. J Stud Alcohol Drugs. 2008;69(3):449–453. doi: 10.15288/jsad.2008.69.449. [DOI] [PubMed] [Google Scholar]
  • 48.Morgenstern J, Hogue A, Dasaro C, Kuerbis A, Dauber S. Characteristics of Individuals Screening Positive for Substance Use in a Welfare Setting: Implications for Welfare and Substance-Use Disorders Treatment Systems. J Stud Alcohol Drugs. 2008;69(4):561–570. doi: 10.15288/jsad.2008.69.561. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Lanza ST, Collins LM. A Mixture Model of Discontinuous Development in Heavy Drinking From Ages 18 to 30: The Role of College Enrollment. J Stud Alcohol. 2006;67(4):552–561. doi: 10.15288/jsa.2006.67.552. [DOI] [PubMed] [Google Scholar]
  • 50.Connell CM, Gilreath TD, Hansen NB. A multiprocess latent class analysis of the co-occurrence of substance use and sexual risk behavior among adolescents. J Stud Alcohol Drugs. 2009;70(6):943–951. doi: 10.15288/jsad.2009.70.943. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Buckman JF, Bates ME, Morgenstern J. Social Support and Cognitive Impairment in Clients Receiving Treatment for Alcohol- and Drug-Use Disorders: A Replication Study. J Stud Alcohol Drugs. 2008;69(5):738–746. doi: 10.15288/jsad.2008.69.738. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Chung T, Martin CS, Clark DB. Concurrent Change in Alcohol and Drug Problems Among Treated Adolescents Over Three Years. J Stud Alcohol Drugs. 2008;69(3):420–429. doi: 10.15288/jsad.2008.69.420. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Ingledew DK, Hardy L, Cooper CL. Latent class analysis applied to health behaviours. Pers Individ Dif. 1995;19(1):13–20. [Google Scholar]
  • 54.Sacker A, Wiggins RD, Clarke P, Bartley M. Making sense of symptom checklists: a latent class approach to the first 9 years of the British Household Panel Survey. J Public Health Med. 2003;25(3):215–222. doi: 10.1093/pubmed/fdg056. [DOI] [PubMed] [Google Scholar]
  • 55.Skolasky RL, Green AF, Scharfstein D, Boult C, Reider L, Wegener ST. Psychometric Properties of the Patient Activation Measure among Multimorbid Older Adults. Health Serv Res. 2011;46(2):457–478. doi: 10.1111/j.1475-6773.2010.01210.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56.Stewart J, Sapey B, Humphreys L, Francis B, Donaldson G. Older People and Dissatisfaction with Wheelchair Services. Scandinavian Journal of Disability Research. 2008;10(1):17–28. [Google Scholar]
  • 57.Wainstein L, Victorri-Vigneau C, Sébille V, et al. Pharmacoepidemiological characterization of psychotropic drugs consumption using a latent class analysis. Int Clin Psychopharmacol. 2011;26(1):54–62. doi: 10.1097/YIC.1090b1013e3283400cb3283402. [DOI] [PubMed] [Google Scholar]
  • 58.Wang WC, Worsley A, Cunningham EG, Hunter W. Investigation of population heterogeneity of diet use among middle-aged Australians. Br J Nutr. 2011;105(7):1091–1099. doi: 10.1017/S0007114510004745. [DOI] [PubMed] [Google Scholar]
  • 59.Weden MM, Bird CE, Escarce JJ, Lurie N. Neighborhood archetypes for population health research: Is there no place like home? Health & Place. 2011;17(1):289–299. doi: 10.1016/j.healthplace.2010.11.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 60.Skinner ML, Hong S, Herrenkohl TI, Brown EC, Lee JO, Jung H. Longitudinal Effects of Early Childhood Maltreatment on Co-Occurring Substance Misuse and Mental Health Problems in Adulthood: The Role of Adolescent Alcohol Use and Depression. J Stud Alcohol Drugs. 2016;77(3):464–472. doi: 10.15288/jsad.2016.77.464. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61.Burns CR, Lagdon S, Boyda D, Armour C. Interpersonal polyvictimization and mental health in males. J Anxiety Disord. 2016;40:75–82. doi: 10.1016/j.janxdis.2016.04.002. [DOI] [PubMed] [Google Scholar]
  • 62.Grasso DJ, Dierkhising CB, Branson CE, Ford JD, Lee R. Developmental Patterns of Adverse Childhood Experiences and Current Symptoms and Impairment in Youth Referred For Trauma-Specific Services. J Abnorm Child Psychol. 2016;44(5):871–886. doi: 10.1007/s10802-015-0086-8. [DOI] [PubMed] [Google Scholar]
  • 63.Berle D, Starcevic V, Milicevic D, et al. The structure and intensity of self-reported autonomic arousal symptoms across anxiety disorders and obsessive-compulsive disorder. J Affect Disord. 2016;199:81–86. doi: 10.1016/j.jad.2016.04.010. [DOI] [PubMed] [Google Scholar]
  • 64.Nylund KL, Asparouhov T, Muthén BO. Deciding on the Number of Classes in Latent Class Analysis and Growth Mixture Modeling: A Monte Carlo Simulation Study. Struct Equ Modeling. 2007;14(4):535–569. [Google Scholar]
  • 65.Wells KJ, Battaglia TA, Dudley DJ, et al. Patient navigation: state of the art or is it science? Cancer. 2008;113(8):1999–2010. doi: 10.1002/cncr.23815. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 66.Muthen B, Curran P. General Longitudinal Modeling of Individual Differences in Experimental Designs: A Latent Variable Framework for Analysis and Power Estimation. Psychol Methods. 1997;2(4):371–402. [Google Scholar]
  • 67.Lanza ST, Rhoades BL. Latent class analysis: an alternative perspective on subgroup analysis in prevention and treatment. Prev Sci. 2013;14(2):157–168. doi: 10.1007/s11121-011-0201-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 68.Clark S, Muthen B. Relating Latent Class Analysis Results to Variables not Included in the Analysis. Los Angeles: UCLA; 2003. [Google Scholar]
  • 69.Asparouhov T, Muthen B. Auxiliary Variables in Mixture Modeling: 3-Step Approaches Using Mplus. Los Angeles, CA: Mplus; 2014. [Google Scholar]
  • 70.Mplus 7.11 [computer program]. Version 6. Los Angeles, CA: 2013. [Google Scholar]
  • 71.Baldwin JN, Alexander JW, Dole EJ, Ryan G, Hirning FC. ASHP statement on the pharmacist’s role in substance abuse prevention, education, and assistance. American Am J Health Syst Pharm. 1998;55(16):1721–1724. doi: 10.1093/ajhp/55.16.1721. [DOI] [PubMed] [Google Scholar]
  • 72.Association AP. Pharmacists’ role in addressing opioid abuse, addiction, and diversion. J Am Pharm Assoc. 2014;54(1):e5–e15. doi: 10.1331/JAPhA.2014.13101. [DOI] [PubMed] [Google Scholar]
  • 73.Butler M, Kane RL, McAlpine D, et al. Agency for Healthcare Research and Quality Evidence Reports. 2008. Integration of mental health/substance abuse and primary care. [Google Scholar]
  • 74.Webster LR, Webster RM. Predicting aberrant behaviors in opioid-treated patients: preliminary validation of the Opioid Risk Tool. Pain Med. 2005;6(6):432–42. doi: 10.1111/j.1526-4637.2005.00072.x. [DOI] [PubMed] [Google Scholar]
  • 75.Butler SF, Budman SH, Fernandez K, Jamison RN. Validation of a screener and opioid assessment measure for patients with chronic pain. Pain. 2004;112(1):65–75. doi: 10.1016/j.pain.2004.07.026. [DOI] [PubMed] [Google Scholar]
  • 76.Jones T, Lookatch S, Grant P, McIntyre J, Moore T. Further validation of an opioid risk assessment tool: the Brief Risk Interview. J Opioid Manag. 2014;10(5):353–364. doi: 10.5055/jom.2014.0226. [DOI] [PubMed] [Google Scholar]
  • 77.Dowell D, Haegerich TM, Chou R. CDC guideline for prescribing opioids for chronic pain—United States, 2016. JAMA. 2016;315(15):1624–1645. doi: 10.1001/jama.2016.1464. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 78.Cobaugh DJ, Gainor C, Gaston CL, et al. The opioid abuse and misuse epidemic: implications for pharmacists in hospitals and health systems. Am J Health Syst Pharm. 2014;71(18):1539–1554. doi: 10.2146/ajhp140157. [DOI] [PubMed] [Google Scholar]
  • 79.Tommasello AC. Substance abuse and pharmacy practice: what the community pharmacist needs to know about drug abuse and dependence. Harm Reduct J. 2004;1(1):1. doi: 10.1186/1477-7517-1-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 80.Egan JE, Casadonte P, Gartenmann T, et al. The Physician Clinical Support System-Buprenorphine (PCSS-B): a novel project to expand/improve buprenorphine treatment. J Gen Intern Med. 2010;25(9):936–941. doi: 10.1007/s11606-010-1377-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 81.Substance Abuse and Mental Health Services Administration. Buprenorphine Treatment Physician Locator. 2016 Aug 23; at http://www.samhsa.gov/medication-assisted-treatment/physician-program-data/treatment-physician-locator.
  • 82.American Pharmacists Association. Tools and Guidelines - Opioid Use. Abuse and Misuse Resource Center; 2016. [Accessed July 13, 2016]. http://www.pharmacist.com/tools-and-guidelines-opioid-use-abuse-and-misuse-resource-center. [Google Scholar]
  • 83.Bacci JL, McGrath SH, Pringle JL, Maguire MA, McGivney MS. Implementation of targeted medication adherence interventions within a community chain pharmacy practice: The Pennsylvania Project. J Am Pharm Assoc. 2014;54(6):584–593. doi: 10.1331/JAPhA.2014.14034. [DOI] [PubMed] [Google Scholar]
  • 84.Green TC, Dauria EF, Bratberg J, Davis CS, Walley AY. Orienting patients to greater opioid safety: models of community pharmacy-based naloxone. Harm Reduct J. 2015;12(1):1. doi: 10.1186/s12954-015-0058-x. [DOI] [PMC free article] [PubMed] [Google Scholar]

RESOURCES