Skip to main content
PLOS One logoLink to PLOS One
. 2020 Jul 15;15(7):e0236019. doi: 10.1371/journal.pone.0236019

Impact of health information technology optimization on clinical quality performance in health centers: A national cross-sectional study

Robert Baillieu 1,#, Hank Hoang 2,, Alek Sripipatana 2,, Suma Nair 2, Sue C Lin 2,*,#
Editor: Mustafa Ozkaynak3
PMCID: PMC7363086  PMID: 32667953

Abstract

Background

Delivery of preventive care and chronic disease management are key components of a high functioning primary care practice. Health Centers (HCs) funded by the Health Resources and Services Administration (HRSA) have been delivering affordable and accessible primary health care to patients in underserved communities for over fifty years. This study examines the association between health center organization’s health information technology (IT) optimization and clinical quality performance.

Methods and findings

Using 2016 Uniform Data System (UDS) data, we performed bivariate and multivariate analyses to study the association of Meaningful Use (MU) attestation as a proxy for health IT optimization, patient centered medical home (PCMH) recognition status, and practice size on performance of twelve electronically specified clinical quality measures (eCQMs). Bivariate analysis demonstrated performance of eleven out of the twelve preventive and chronic care eCQMs was higher among HCs attesting to MU Stage 2 or above. Multivariate analysis demonstrated that Stage 2 MU or above, PCMH status, and larger practice size were positively associated with performance on cancer screening, smoking cessation counseling and pediatric weight assessment and counseling eCQMs.

Conclusions

Organizational advancement in MU stages has led to improved quality of care that augments HCs patient care capacity for disease prevention, health promotion, and chronic care management. However, rapid technological advancement in health care acts as a potential source of disparity, as considerable resources needed to optimize the electronic health record (EHR) and to undertake PCMH transformation are found more commonly among larger HCs practices. Smaller practices may lack the financial, human and educational assets to implement and to maintain EHR technology. Accordingly, targeted approaches to support small HCs practices in leveraging economies of scale for health IT optimization, clinical decision support, and clinical workflow enhancements are critical for practices to thrive in the dynamic value-based payment environment.

Introduction

In 2011, the Centers for Medicare & Medicaid Services (CMS) implemented the Medicare and Medicaid Electronic Health Record (EHR) Incentive Programs to encourage clinicians and practices to adopt, implement, upgrade, and demonstrate meaningful use of certified electronic health record technology (CEHRT) [1, 2]. The CMS Meaningful Use (MU) program, which is now known as Promoting Interoperability, continued to compel all clinical practices to optimize EHR functionality in order to achieve integrated platforms for better patient care, lower healthcare costs, and to promote patient engagement. In particular, Stage 2 of MU sought to expand the adoption of advanced EHR functions that included: clinical decision support; electronic prescribing; health information exchange; patient-tailored health and disease management tools; secure electronic communication between patients and providers; health education materials; and monitoring of clinical quality metrics [3, 4]. Other EHR functions, such as the presence of clinical reminders and the production of clinic-level data, are common to all CEHRT [1].

The Institute for Healthcare Improvement (IHI) first promulgated the Triple Aim in 2008, as a means of improving the experience of care, the health of populations, and reducing per capita costs of health care. Since that time, value-based care delivery programs have been guided by national clinical quality metrics and the principles of continuous quality improvement [5, 6]. Underlying this is the EHR, as it provides systematic assistance to clinical activities, communication, clinical decision support and enhanced reporting and monitoring of quality metrics. In 2015, 86% of office-based physicians in the United States had adopted an EHR, but the sophistication of EHR technology and its capacity for quality reporting varied across practice settings [710]. Advancing the uptake of supports provided by EHR and health information technology (health IT) innovations has the potential to promote parity in health IT implementation across practice settings [11].

Studies have demonstrated a positive association between MU implementation and improved process quality metrics in preventive screening, diabetes control, maternal and child health measures in primary care clinics that leveraged health IT for patient engagement and care coordination [12, 13]. Embedded decision support tools such as electronic reminders have significant impact on the uptake of preventative care and performance of pertinent preventative risk assessments in the clinical setting [14, 15]. In many practices, health IT has been used to disseminate evidence-based care guidelines and to provide clinical alerts that enhance patient safety and decrease mortality [1619].

In 2016, the Health Resources and Services Administration’s (HRSA) Health Center Program (HCP) was comprised of over 1,300 health centers (HCs) operating more than 11,000 primary care service delivery sites [20]. These HCs provided comprehensive, affordable and quality primary health care to nearly 26 million individuals in every U.S. state, the District of Columbia, Puerto Rico, the U.S. Virgin Islands, and the Pacific Basin. From 2011 to 2016, EHR adoption rose from 65% to 95% among HCs. To standardize the monitoring of clinical quality performance, HRSA collects data on electronically specified clinical quality measures (eCQMs) annually; twelve eCQMs were collected in 2016. Additionally, 66% of HCs achieved primary care patient-centered medical home (PCMH) recognition by meeting national standards for primary care that emphasized care coordination, comprehensive care and on-going clinical quality improvement that included leveraging health IT [20]. The specific aim of this study is to examine the association of Stage 2 MU attainment on eCQM performance among HCs, and to explore surrogate levers of health IT implementation, specifically PCMH recognition and practice size, in clinical quality performance.

Methods

Data acquisition

Data came from HRSA’s 2016 Uniform Data System (UDS), which is an administrative data set containing information on patient sociodemographic characteristics, primary care services provision, healthcare workforce, clinical quality measures (CQMs), and Meaningful Use (MU) attestation that are reported and aggregated at the health center organizational level. MU attestation for Stage 2 or above was identified through HCs self-report to the following two questions: 1) Are your eligible providers participating in the CMS EHR Incentive Program commonly known as “Meaningful Use”?; and 2) If yes, at what stage of Meaningful Use are the majority of your participating providers who have most recently received incentive payments? In addition, PCMH recognition status was ascertained for HCs who received certification from national organizations and state-based initiatives. Finally, the study categorized practice size by number of physician full time equivalents (FTEs) in HCs as follows: 1) small practice was defined as HCs with 0–5 physician FTEs; 2) medium practice was defined as 6–20 physician FTEs; and 3) large practice was defined as 21 or more physician FTEs [21, 22].

Study design

A descriptive cross-sectional study of the association of health IT optimization, PCMH recognition status, and practice size on clinical quality measure performance was conducted. It was hypothesized that HCs that are larger and have achieved MU stage 2 or above, as well as PCMH recognition, would demonstrate better clinical quality performance. The dependent variables of interest were the twelve preventive and chronic care eCQMs reported in the 2016 UDS. The eight preventive measures consisted of the following: 1) cervical cancer screening; 2) colorectal cancer screening; 3) adult body mass index (BMI) screening and follow-up plan; 4) weight assessment and counseling for nutrition and physical activity for children and adolescents; 5) tobacco use screening and cessation intervention; 6) depression screening and follow-up plan; 7) childhood immunization; and 8) dental sealant for children between 6–9 years old. The four chronic care measures were as follows: 1) aspirin therapy for patients with ischemic vascular disease; 2) blood pressure control (as defined by hypertensive patients with a blood pressure less than 140/90mmHg); 3) uncontrolled diabetes (i.e. diabetic patients with an HbA1c > 9%); and 4) asthma pharmacologic therapy [20].

Data analysis

In Table 1, we conducted bivariate analysis to compare the mean percentages of patient sociodemographic attributes by practice size using an F test, as well as the HCs’ attainment of PCMH recognition and MU Stage 2 or above using chi-square analysis. In Table 2, we examined the unadjusted association of clinical quality measure performance with MU attestation at Stage 2 or above in order to compare the means of eCQM by MU attestation stage using an F test. In Table 3, we looked at the association of practice size with eCQM performance using an F test statistic. Mean percentages have been reported in Tables 13 as it is the most commonly utilized measure of central tendency [23]. Finally, we carried out multiple linear regression analyses to assess the association of MU stage, PCMH status, and practice size on clinical quality performance. PCMH status was included due to previous established associations with clinical quality improvement in health center research [2427]. After conducting the interaction testing, the interacting terms were found to be not statistically significant and thus were not retained in the regression model [28]. Clinical quality measures with statistically non-significant associations with MU stage and practice size from the bivariate analyses were not included in the multiple linear regression analyses. Control variables in the regression model included the following patient characteristics: percentage of racial/ethnic minority patients, percentage of patients at or below 100% of the federal poverty level (FPL), and percentage of uninsured patients. All statistical analyses were performed using SAS version 9.4.

Table 1. Characteristics of Health Centers (HC) and patients served by practice size.

Small Practice Medium Practice Large Practices
N = 685 N = 517 N = 143
Characteristics             p-value
Mean SD Mean SD Mean SD
Race/ethnicity
Hispanic 21.3% 0.24 30.1% 0.28 45.2% 0.28 <0.01
Non-Hispanic White 52.5% 0.52 42.6% 0.31 33.1% 0.27 <0.01
Non-Hispanic Black 20.5% 0.26 25.0% 0.27 18.7% 0.21 <0.01
Other 9.3% 0.19 7.0% 0.14 8.8% 0.17 0.06
Language Preferred
Patients Best Served in a language other than English 13.9% 0.20 21.8% 0.24 31.6% 0.24 <0.01
Age
0–17 Years 23.2% 0.13 29.7% 0.12 33.1% 0.10 <0.01
18–64 Years 67.0% 0.13 61.4% 0.11 58.9% 0.08 <0.01
65 Years and Older 10.0% 0.07 8.9% 0.05 7.9% 0.04 <0.01
Household poverty level
≤100% 46.5% 0.24 49.2% 0.23 52.2% 0.23 0.02
101–200% 16.6% 0.11 15.9% 0.11 14.6% 0.08 0.09
>200% 6.9% 0.09 5.9% 0.07 5.8% 0.07 0.06
Not reported 30.2% 0.27 29.3% 0.26 27.5% 0.26 0.50
Insurance status
Uninsured 28.9% 0.20 22.8% 0.16 19.8% 0.12 <0.01
Medicaid/CHIP 39.2% 0.20 47.9% 0.18 54.9% 0.15 <0.01
Medicare 11.0% 0.08 10.0% 0.06 8.4% 0.05 <0.01
Private Insurance 20.7% 0.14 18.9% 0.12 17.0% 0.11 <0.01
Chi-Square P-value
Patient-Centered Medical Home Recognition 52.6% 78.9% 93.7% <0.01
Meaningful Use Stage 2 or 3 Attestation 38.3% 54.9% 72.0% <0.01

Source: 2016 UDS Data

Bold numbers indicate p-value ≤ 0.05

Table 2. Electronic Clinical Quality Measure (e-CQMs) performance by Meaningful Use (MU) attestation.

e-CQMs MU Stage ≤ 1 MU Stage ≥ 2
(mean percentages)     p-value
1. Cervical Cancer Screening 46.4% 52.1% <0.01
2. Colorectal Cancer Screening 34.1% 40.0% <0.01
3. Adult Body Mass Index (BMI) Screening and Follow-Up Plan 57.7% 62.8% <0.01
4. Weight Assessment & Counseling for Nutrition & Physical Activity (PA) for Children & Adolescents 52.6% 60.6% <0.01
5. Diabetes A1C Poor Control 35.0% 31.6% <0.01
6. Ischemic Vascular Disease (IVD): Use of Aspirin or Another Antithrombotic 76.1% 78.2% 0.01
7. Controlling High Blood Pressure 60.8% 62.7% <0.01
8. Tobacco Use: Screening and Cessation Intervention 81.2% 84.6% <0.01
9. Asthma Pharmacologic Therapy 84.2% 86.5% <0.01
10. Childhood Immunizations 35.9% 39.3% 0.02
11. Depression Screening and Follow-Up Plan 58.0% 61.0% 0.03
12. Dental Sealant for Children between 6–9 years 48.4% 47.3% 0.49

Source: 2016 UDS Data

Bold numbers indicate p-value ≤ 0.05

Table 3. Electronic Clinical Quality Measure (e-CQMs) performance by health center practice size.

e-CQMs Small Practice Medium Practice Large Practice
(mean percentages)       p-value
1. Cervical Cancer Screening 44.5% 53.6% 57.7% <0.01
2. Colorectal Cancer Screening 33.2% 40.9% 42.2% <0.01
3. Adult Body Mass Index (BMI) Screening and Follow-Up Plan 58.9% 62.0% 62.4% 0.03
4. Weight Assessment & Counseling for Nutrition & Physical Activity (PA) for Children & Adolescents 52.0% 61.3% 63.9% <0.01
5. Diabetes A1C Poor Control 34.6% 32.4% 30.0% <0.01
6. Ischemic Vascular Disease (IVD): Use of Aspirin or Another Antithrombotic 75.6% 78.5% 80.0% <0.01
7. Controlling High Blood Pressure 60.6% 62.5% 64.3% <0.01
8. Tobacco Use: Screening and Cessation Intervention 80.4% 85.0% 86.6% <0.01
9. Asthma Pharmacologic Therapy 83.8% 86.3% 89.2% <0.01
10. Childhood Immunizations 33.2% 40.9% 45.8% <0.01
11. Depression Screening and Follow-Up Plan 60.0% 59.1% 58.7% 0.74
12. Dental Sealant for Children between 6–9 years 48.9% 46.7% 48.8% 0.41

Source: 2016 UDS Data

Bold numbers indicate p-value ≤ 0.05

Results

Table 1 describes demographic characteristics of HCs at the organizational level and by practice size. When compared to smaller practices, large practices cared for: a higher mean percentage of Hispanic patients (45.2% versus 21.3%, P<0.01); patients who are best served in a language other than English (31.6% versus 13.9%, P<0.01); patients with a household poverty level at or below 100% FPL (52.2% versus 46.5%, P<0.02); and patients with Medicaid or Children’s Health Insurance Program (CHIP) insurance (54.9% versus 39.2%, P<0.01). In contrast, small practices reported a higher mean percentage of Non-Hispanic White patients (52.5% versus 33.1%, P<0.01) and patients 65 years or older (10.0% versus 7.9%, P<0.01) in comparison to their larger counterparts. Moreover, small practices served higher percentages of uninsured (28.9% versus 19.8%, P<0.01), Medicare (11.0% versus 8.4%, P<0.01), and privately insured patients (20.7% versus 17.0%, P<0.01) than large practices. The percentage of practices with PCMH recognition were as follows: 52.6% of small practices; 78.9% of medium practices; and 93.7% of large practices, (P<0.01). 38.3% of small practices attested to MU Stage 2 or above as compared with 54.9% of medium sized practices and 72.0% of large practices (P<0.01).

Table 2 contains eCQM performance by MU attestation status. Performance on eleven out of twelve eCQMs were significantly higher among HCs attesting to MU Stage 2 or above. Although the dental sealants for children eCQM, which was introduced in the 2015 UDS, demonstrated an inverse pattern, this finding was not statistically significant. Notably, significant differences in performance of 5 percentage points or more were observed in: cancer prevention measures of cervical cancer screening (46.4% vs. 52.1%); colorectal cancer screening (34.1% vs 40.0%); and obesity prevention measures for adult (57.7% vs. 62.8%) and pediatric patients (52.6% vs. 60.6%).

Table 3 presents the bivariate analysis of eCQMs performance by small, medium, and large practice size. Ten out of twelve eCQMs had the highest mean percentage among large HCs. In particular, we observed significant differences in performance of 5 or more percentage points when comparing eCQMs of small to large practices with respect to cervical cancer screening (44.5% vs. 57.7%), colorectal cancer screening (33.2% vs. 42.2%), obesity prevention measure for pediatric patients (52.0% vs 63.9%), tobacco use screening and cessation intervention (80.4% vs 86.6%), asthma pharmacologic therapy (83.8% vs 89.2%), and childhood immunization (33.2% vs. 45.8%). Similar to the findings in Table 2, the dental sealants for children eCQM showed a reverse pattern that was not statistically significant. In addition, the depression screening and follow-up plan eCQM had no statistical significance findings.

Table 4 describes results from multiple linear regressions performed between eCQMs as the dependent variables and MU stage, PCMH status, and HC practice size as the independent variables. MU Stage 2 or above was a significant predictor of performance on cancer prevention, obesity prevention, tobacco screening and cessation counseling, childhood immunization, and diabetes control measures. PCMH recognition was a significant predictor for all eCQMs except childhood immunization. With respect to practice size, large practice size was a significant positive predictor for cancer prevention, hypertension control, diabetes control, tobacco screening and cessation counseling, depression screening and follow-up plan, and childhood immunization measures. For prevention care eCQMs, MU Stage 2 or above, PCMH and practices size were significant positive predictors for colorectal cancer screening, cervical cancer screening, smoking cessation counseling, and pediatric weight assessment and counseling.

Table 4. Multiple linear regression of Clinical Quality Measure (CQM) performance.

Elec-tronic CQM Meaningful Use Stage 2 or Above Patient Centered Medical Home Practice Size Large (Ref = Small) Practice Size Medium (Ref = Small)
Coefficient 95% CI SE t-value p-value Coefficient 95% CI SE t-value p-value Coefficient 95% CI SE t-value p-value Coefficient 95% CI SE t-value p-value
Chronic Care CQM
Ischemic Vascular Disease (IVD): Use of Aspirin or Another Antithrombotic 1.07 (-0.63, 2.77) 0.87 1.24 0.22 3.18 (1.28, 5.07) 0.97 3.29 <0.01 2.10 (-0.92, 5.12) 1.54 1.36 0.17 1.47 (-0.45, 3.38) 0.97 1.50 0.13
Controlling High Blood Pressure 1.11 (-0.03, 2.24) 0.58 1.91 0.06 1.81 (0.55, 3.07) 0.64 2.81 0.01 2.46 (0.44, 4.48) 1.03 2.39 0.02 0.75 (-0.5,3 2.02) 0.65 1.15 0.25
Diabetes A1C Poor Control -1.77 (-3.18, -0.37) 0.71 -2.48 0.01 -3.39 (-4.95, -1.83) 0.79 -4.27 <0.01 -3.13 (-5.62, -0.63) 1.27 -2.46 0.01 -1.06 (-2.64, 0.51) 0.80 -1.32 0.19
Asthma Pharmacologic Therapy 1.32 (-0.38, 3.03) 0.87 1.52 0.13 1.97 (0.07, 3.87) 0.97 2.03 0.04 2.78 (-0.24, 5.81) 1.54 1.81 0.07 1.06 (-0.86, 2.97) 0.97 1.08 0.28
Preventive Care
Cervical Cancer Screening 3.67 (1.83, 5.51) 0.94 3.92 <0.01 3.28 (1.23, 5.32) 1.04 3.15 <0.01 8.51 (5.25, 11.78) 1.66 5.12 <0.01 6.08 (4.02, 8.14) 1.05 5.78 <0.01
Colorectal Cancer Screening 3.40 (1.43, 5.38) 1.01 3.38 <0.01 5.17 (2.97, 7.37) 1.12 4.61 <0.01 4.62 (1.11, 8.14) 1.79 2.58 0.01 4.75 (2.53, 6.97) 1.13 4.20 <0.01
Adult BMI Screening & F/Up Plan 4.37 (1.92, 6.81) 1.25 3.50 <0.01 3.84 (1.12, 6.56) 1.39 2.77 0.01 -0.88 (-5.23, 3.46) 2.22 -0.40 0.69 0.46 (-2.28, 3.21) 1.40 0.33 0.74
Weight Assessment & Counseling for Nutrition & Physical Activity for Children & Adolescents 5.39 (2.55, 8.22) 1.45 3.73 <0.01 4.03 (0.87, 7.19) 1.61 2.50 0.01 5.56 (0.53, 10.60) 2.57 2.17 0.03 5.45 (2.27, 8.64) 1.62 3.36 <0.01
Tobacco Use: Screening & Cessation Intervention 1.87 (0.06, 3.68) 0.92 2.03 0.04 3.69 (1.68, 5.71) 1.03 3.60 <0.01 3.85 (0.64, 7.07) 1.64 2.35 0.02 3.11 (1.08, 5.14) 1.04 3.00 <0.01
Depression Screening and Follow-up Plan 2.73 (-0.05, 5.51) 1.42 1.93 0.05 4.65 (1.56, 7.74) 1.58 2.95 <0.01 -5.58 (-10.51, -0.64) 2.52 -2.22 0.03 -3.46 (-6.58, -0.34) 1.59 -2.18 0.03
Childhood Immunizations 3.04 (0.21, 5.87) 1.44 2.11 0.04 -1.07 (-4.24, 2.10) 1.62 -0.66 0.51 9.70 (4.71, 14.69) 2.54 3.81 <0.01 6.19 (3.02, 9.36) 1.62 3.83 <0.01

Source: 2016 UDS Data

Model control for % of Minority Patients, Patients of Poverty Level 100% and Below, and Uninsured Patients; CI = confidence interval; SE = standard error

Discussion

Our findings suggest that health IT optimization, PCMH transformation, and larger practice size correlate with better clinical quality performance in the majority of eCQMs reported by HRSA HCs. Health IT optimization by primary care practices facilitates quality improvement (QI) and enables effective implementation of PCMH to enhance care coordination, deliver high quality care, prevent unnecessary acute care visits and ultimately improve patient outcomes. It further holds the promise of better continuity of care, particularly for underserved populations that faces multiple competing priorities in accessing health care [29, 30]. Federal investments that accelerate health IT optimization in HCs through strengthening health IT infrastructure, as well as promoting targeted health IT training and technical assistance (T/TA) will continue to be critically important.

In demonstrating that successful health IT optimization can support improvement in clinical quality outcome measures, this study is aligned with previous analyses of these factors that impact HC performance [2427]. The associations of MU Stage 2 or above, PCMH, and large practice size with diabetes control are very positive news for chronic care management. Furthermore, the positive association of PCMH recognition with nine eCQMs demonstrates the importance of PCMH transformation in clinical quality performance among HCs. Finally, as health IT optimization reaches the stage where health, social, economic, behavioral, and environmental data can be fully integrated to customize care for the patient, primary care teams might be able to more comprehensively address social determinants of health within the PCMH [31, 32].

An emerging body of research suggests that advanced EHR technologies are potentially associated with improved information sharing, enhanced patient interaction with the EHR, and less burdensome quality reporting [17, 18, 33, 34]. This could be especially true when practices customize their EHRs to better reflect clinical workflows, patient desired as well as provider and care team preferences. The significant improvement in cancer screening rates and preventive care delivery in those HCs that attested to Stage 2 MU or higher, for example, suggests that health IT optimization may be of benefit in augmenting a clinical encounter through patient reminders and other readily available electronic educational resources that promote health equity. The literature also demonstrates cost and time savings after configuration of an EHR to facilitate data collection to automatically report quality metrics [34, 35].

Overall, HCs have made great strides in health IT implementation and optimization. With respect to practice size, 72% of large HCs and 55% of medium-sized HCs successfully attested to MU Stage 2 or above. This is compared to the 60% of all U.S. office-based physicians (MD/DO) who reported meaningful use of certified health IT to the CMS EHR Incentive Programs in 2016. The positive association between practice size and MU in adult and pediatric preventive care suggests that successful implementation of clinical care and workflow supported by health IT contributes to reducing the burden of preventable chronic disease [19, 3638]. Previous research suggests that the relationship between eCQM performance and practice size is in part attributable to available human and financial capital [39, 40]. In comparison to their larger counterparts, small and medium sized practices are more likely to experience lower physician to patient ratios and shorter consultation times [39]. Moreover, smaller practices are predominantly found in areas of higher economic need [21]. This has been determined to be an independent marker of lower health outcomes, possibly due to the higher morbidity associated with those underserved communities [41]. In this way, physicians in smaller practices face time constraints that potentially make adherence to quality guidelines difficult, while also treating a patient population that eschews preventative care in favor of acute management [4244]. In addition, our study showed that small HCs disproportionately serve uninsured patients, which may impact their ability to allocate significant resources towards health IT. This finding suggests strategically targeting small and medium sized practices for health IT T/TA support in attaining CMS Promoting Interoperability Program requirements.

Limitations

The UDS is an administrative dataset reported by HRSA-funded HCs and aggregated at the HC organizational level. Although HC may operate several health care clinical sites, data in the UDS cannot be filtered by delivery site. While certain elements of the UDS (e.g., eCQMs) are automatically extracted from the EHR, other elements of the UDS are self-reported including Health Information Technology Capabilities and Staffing data. In addition, staffing is captured as full-time equivalents, and not the actual number of physicians/providers.

Policy implications

Practices that report being at MU Stage 2 or above experience tangible benefits in coordination of communication, patient care and data management. Our findings suggest that optimization of health IT, PCMH transformation, and practice size are closely related to enhanced quality of care and health outcomes. Given this association, HRSA has strategically aligned CQM reporting with eCQMs, where possible. However, the potential benefits of health IT optimization are not being realized across all HCs, particularly among smaller practices. The underlying financial, training, staffing and opportunity costs associated with the implementation and maintenance of EHR technology may be potential sources of disparity for those small or medium practices without access to significant human or financial capital. It is critical that safety net providers remain current with advances in health IT adoption and utilization in order to maximize quality of care, ensure patient safety, reduce health disparities, improve care coordination and augment public health reporting. Better understanding of those EHR functions that are most relevant and useful to smaller HCs would help direct HRSA’s technical assistance assets and resource allocation efforts. Such assessments need to be ongoing and multidimensional since advancement in health IT and EHR technology is rapid and also uneven across practices of different sizes. Overcoming this disparity is an important way to support patient care in underserved communities and to promote access to all health centers.

Data Availability

The Health Resources and Services Administration/Bureau of Primary Health Care (HRSA/BPHC)'s Health Center Program makes the Uniform Data Systems (UDS) available, for free, to the public in an electronic format. This action is being taken pursuant to the Freedom of Information Act (5 U.S.C. 552(a)(2)(D)) (FOIA). URL: https://www.hrsa.gov/foia/UDS-public-use.html

Funding Statement

This paper was submitted as part of the Health Resources and Services Administration (HRSA) Collection, which is sponsored and funded by HRSA.

References

  • 1.Medicare and Medicaid programs; electronic health record incentive program. Final rule. Fed Regist. 2010;75(144):44313–588. [PubMed] [Google Scholar]
  • 2.Gold M, Hossain M, Charles DR, Furukawa MF. Evolving vendor market for HITECH-certified ambulatory EHR products. Am J Manag Care. 2013;19(10 Spec No):Sp353–61. [PubMed] [Google Scholar]
  • 3.Patel V, Reed ME, Grant RW. Electronic health records and the evolution of diabetes care: a narrative review. J Diabetes Sci Technol. 2015;9(3):676–80. 10.1177/1932296815572256 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Medicare and Medicaid programs; electronic health record incentive program—stage 2. Final rule. Fed Regist. 2012;77(171):53967–4162. [PubMed] [Google Scholar]
  • 5.Whittington JW, Nolan K, Lewis N, Torres T. Pursuing the Triple Aim: The First 7 Years. Milbank Q. 2015;93(2):263–300. 10.1111/1468-0009.12122 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Berwick DM, Nolan TW, Whittington J. The triple aim: care, health, and cost. Health Aff (Millwood). 2008;27(3):759–69. [DOI] [PubMed] [Google Scholar]
  • 7.Huang MZ, Gibson CJ, Terry AL. Measuring Electronic Health Record Use in Primary Care: A Scoping Review. Appl Clin Inform. 2018;9(1):15–33. 10.1055/s-0037-1615807 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Krousel-Wood M, McCoy AB, Ahia C, Holt EW, Trapani DN, Luo Q, et al. Implementing electronic health records (EHRs): health care provider perceptions before and after transition from a local basic EHR to a commercial comprehensive EHR. J Am Med Inform Assoc. 2017. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Cohen DJ, Dorr DA, Knierim K, DuBard CA, Hemler JR, Hall JD, et al. Primary Care Practices' Abilities And Challenges In Using Electronic Health Record Data For Quality Improvement. Health Aff (Millwood). 2018;37(4):635–43. 10.1377/hlthaff.2017.1254 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.QuickStats: Percentage* of Office-Based Primary Care Physicians Accepting New Patients, by Source of Payment Accepted—National Electronic Health Records Survey, 2015. MMWR Morb Mortal Wkly Rep. 2017;66(28):766 10.15585/mmwr.mm6628a9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Fleming NS, Culler SD, McCorkle R, Becker ER, Ballard DJ. The financial and nonfinancial costs of implementing electronic health records in primary care practices. Health Aff (Millwood). 2011;30(3):481–9. [DOI] [PubMed] [Google Scholar]
  • 12.Kruse CS, Beane A. Health Information Technology Continues to Show Positive Effect on Medical Outcomes: Systematic Review. J Med Internet Res. 2018;20(2):e41 10.2196/jmir.8793 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Kranz AM, Dalton S, Damberg C, Timbie JW. Using Health IT to Coordinate Care and Improve Quality in Safety-Net Clinics. Jt Comm J Qual Patient Saf. 2018;44(12):731–40. 10.1016/j.jcjq.2018.03.006 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Balas EA, Boren SA, Brown GD, Ewigman BG, Mitchell JA, Perkoff GT. Effect of physician profiling on utilization. Meta-analysis of randomized clinical trials. J Gen Intern Med. 1996;11(10):584–90. 10.1007/BF02599025 [DOI] [PubMed] [Google Scholar]
  • 15.Wells S, Furness S, Rafter N, Horn E, Whittaker R, Stewart A, et al. Integrated electronic decision support increases cardiovascular disease risk assessment four fold in routine primary care practice. Eur J Cardiovasc Prev Rehabil. 2008;15(2):173–8. 10.1097/HJR.0b013e3282f13af4 [DOI] [PubMed] [Google Scholar]
  • 16.Manaktala S, Claypool SR. Evaluating the impact of a computerized surveillance algorithm and decision support system on sepsis mortality. J Am Med Inform Assoc. 2017;24(1):88–95. 10.1093/jamia/ocw056 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Jones SS, Rudin RS, Perry T, Shekelle PG. Health information technology: an updated systematic review with a focus on meaningful use. Ann Intern Med. 2014;160(1):48–54. 10.7326/M13-1531 [DOI] [PubMed] [Google Scholar]
  • 18.Chaudhry B, Wang J, Wu S, Maglione M, Mojica W, Roth E, et al. Systematic review: impact of health information technology on quality, efficiency, and costs of medical care. Ann Intern Med. 2006;144(10):742–52. 10.7326/0003-4819-144-10-200605160-00125 [DOI] [PubMed] [Google Scholar]
  • 19.Campanella P, Lovato E, Marone C, Fallacara L, Mancuso A, Ricciardi W, et al. The impact of electronic health records on healthcare quality: a systematic review and meta-analysis. Eur J Public Health. 2016;26(1):60–4. 10.1093/eurpub/ckv122 [DOI] [PubMed] [Google Scholar]
  • 20.HRSA Uniform Data System Reporting Instructions for 2016 Health Center Data. [cited 2018 May 29]. Available from: https://bphc.hrsa.gov/datareporting/reporting/2016udsreportingmanual.pdf.
  • 21.Liaw WR, Jetty A, Petterson SM, Peterson LE, Bazemore AW. Solo and Small Practices: A Vital, Diverse Part of Primary Care. Ann Fam Med. 2016;14(1):8–15. 10.1370/afm.1839 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Phillips RL Jr., Klink K, Petterson SM, KoJima N, Bazemore AW. The continued importance of small practices in the primary care landscape. Am Fam Physician. 2014;90(4):Online. [PubMed] [Google Scholar]
  • 23.Manikandan S. Measures of central tendency: The mean. J Pharmacol Pharmacother. 2011;2(2):140–2. 10.4103/0976-500X.81920 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Hu R, Shi L, Sripipatana A, Liang H, Sharma R, Nair S, et al. The Association of Patient-centered Medical Home Designation With Quality of Care of HRSA-funded Health Centers: A Longitudinal Analysis of 2012–2015. Med Care. 2018;56(2):130–8. 10.1097/MLR.0000000000000862 [DOI] [PubMed] [Google Scholar]
  • 25.Lebrun-Harris LA, Shi L, Zhu J, Burke MT, Sripipatana A, Ngo-Metzger Q. Effects of patient-centered medical home attributes on patients' perceptions of quality in federally supported health centers. Ann Fam Med. 2013;11(6):508–16. 10.1370/afm.1544 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Shi L, Lee DC, Chung M, Liang H, Lock D, Sripipatana A. Patient-Centered Medical Home Recognition and Clinical Performance in U.S. Community Health Centers. Health Serv Res. 2017;52(3):984–1004. 10.1111/1475-6773.12523 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Shi L, Lock DC, Lee DC, Lebrun-Harris LA, Chin MH, Chidambaran P, et al. Patient-centered Medical Home capability and clinical performance in HRSA-supported health centers. Med Care. 2015;53(5):389–95. 10.1097/MLR.0000000000000331 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Pagano M GK. Principles of Biostatistics 2nd Edition Australia: Duxbury; 2000. [Google Scholar]
  • 29.Burton LC, Anderson GF, Kues IW. Using electronic health records to help coordinate care. Milbank Q. 2004;82(3):457–81, table of contents. 10.1111/j.0887-378X.2004.00318.x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Rao S, Brammer C, McKethan A, Buntin MB. Health information technology: transforming chronic disease management and care transitions. Prim Care. 2012;39(2):327–44. 10.1016/j.pop.2012.03.006 [DOI] [PubMed] [Google Scholar]
  • 31.Garg A, Jack B, Zuckerman B. Addressing the social determinants of health within the patient-centered medical home: lessons from pediatrics. Jama. 2013;309(19):2001–2. 10.1001/jama.2013.1471 [DOI] [PubMed] [Google Scholar]
  • 32.Evans RS. Electronic Health Records: Then, Now, and in the Future. Yearb Med Inform. 2016;Suppl 1:S48–61. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Adelman EE, Burke JF. Can Electronic Health Records Make Quality Measurement Fast and Easy? Circ Cardiovasc Qual Outcomes. 2017;10(9). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Atasoy H, Greenwood BN, McCullough JS. The Digitization of Patient Care: A Review of the Effects of Electronic Health Records on Health Care Quality and Utilization. Annu Rev Public Health. 2019;40:487–500. 10.1146/annurev-publhealth-040218-044206 [DOI] [PubMed] [Google Scholar]
  • 35.Birkhead GS, Klompas M, Shah NR. Uses of electronic health records for public health surveillance to advance public health. Annu Rev Public Health. 2015;36:345–59. 10.1146/annurev-publhealth-031914-122747 [DOI] [PubMed] [Google Scholar]
  • 36.Zhou L, Soran CS, Jenter CA, Volk LA, Orav EJ, Bates DW, et al. The relationship between electronic health record use and quality of care over time. J Am Med Inform Assoc. 2009;16(4):457–64. 10.1197/jamia.M3128 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Sebo P, Cerutti B, Fournier JP, Rat C, Rougerie F, Senn N, et al. How do general practitioners put preventive care recommendations into practice? A cross-sectional study in Switzerland and France. BMJ Open. 2017;7(10):e017958 10.1136/bmjopen-2017-017958 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Pandhi N, Yang WL, Karp Z, Young A, Beasley JW, Kraft S, et al. Approaches and challenges to optimising primary care teams' electronic health record usage. Inform Prim Care. 2014;21(3):142–51. 10.14236/jhi.v21i3.57 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Campbell JL, Ramsay J, Green J. Practice size: impact on consultation length, workload, and patient assessment of care. Br J Gen Pract. 2001;51(469):644–50. [PMC free article] [PubMed] [Google Scholar]
  • 40.Bitton A. Finding a Parsimonious Path for Primary Care Practice Transformation. Ann Fam Med. 2018;16(Suppl 1):S16–s9. 10.1370/afm.2234 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Ashworth M, Armstrong D. The relationship between general practice characteristics and quality of care: a national survey of quality indicators used in the UK Quality and Outcomes Framework, 2004–5. BMC Fam Pract. 2006;7:68 10.1186/1471-2296-7-68 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Yarnall KS, Pollak KI, Ostbye T, Krause KM, Michener JL. Primary care: is there enough time for prevention? Am J Public Health. 2003;93(4):635–41. 10.2105/ajph.93.4.635 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Bucher S, Maury A, Rosso J, de Chanaud N, Bloy G, Pendola-Luchel I, et al. Time and feasibility of prevention in primary care. Fam Pract. 2017;34(1):49–56. 10.1093/fampra/cmw108 [DOI] [PubMed] [Google Scholar]
  • 44.Bardach SH, Schoenberg NE. Primary care physicians' prevention counseling with patients with multiple morbidity. Qual Health Res. 2012;22(12):1599–611. 10.1177/1049732312458183 [DOI] [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

Mustafa Ozkaynak

Transfer Alert

This paper was transferred from another journal. As a result, its full editorial history (including decision letters, peer reviews and author responses) may not be present.

29 Nov 2019

PONE-D-19-29335

Impact of Health Information Technology Optimization on Clinical Quality Performance in Health Centers: A National Cross-Sectional Study

PLOS ONE

Dear Dr. Lin,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

We would appreciate receiving your revised manuscript by Jan 03 2020 11:59PM. When you are ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter.

To enhance the reproducibility of your results, we recommend that if applicable you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). This letter should be uploaded as separate file and labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. This file should be uploaded as separate file and labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. This file should be uploaded as separate file and labeled 'Manuscript'.

Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.

We look forward to receiving your revised manuscript.

Kind regards,

Mustafa Ozkaynak

Academic Editor

PLOS ONE

Journal Requirements:

1. When submitting your revision, we need you to address these additional requirements.

Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

http://www.journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and http://www.journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

Additional Editor Comments:

The manuscript reports on an important study but needs major revisions.

In summary,

- Statistical analysis has important concerns. Please rewrite this section using the feedback from reviewers.

- Introduction section can be enriched adding some relevant literature.

- Discussion section should be reorganized and enriched using the findings in the results section.

Please see reviewer comments for further details.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #2: Yes

Reviewer #3: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: No

Reviewer #2: Yes

Reviewer #3: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: For the statistical analysis seems incomplete. I am assuming you are aggregating the data at the clinic level, which means you are going to have for any outcome a range from 0-100% for a clinic meeting that quality measure, correct? if this is true then you are not doing bivariate (logistic) regression - you are doing linear regression (or you can do a probit model taking into account the N for each clinic).

or if you are modeling at the patient level then you should be doing a mixed model with a random effect at the clinic level.

Concerns regarding model selection - removing variables that do not meet significance (which I am assuming you are using cutoff of 0.05) is not an approach that is recommended for model selection. For your sample size you are not hurting on power so why not adjust by all factors of interest if you do not want to do true model selection?

Also, on any regression model you are making assumptions and you do not state you verify them in the statistical section.

For table 2, Only MU is addressed but you are interested in association across 3 key variables of which PCMH is not addresses in terms of describing outcomes (practice size in table 1).

Test statistics in table 1 and 2 were not mentioned and should be described in statistical section (what is p-value testing??).

The term Multivariate is not used appropriately, you are actually doing Multivariable linear regression.

For presenting modeling results you show coefficient and p-value, the results should show how much variation there is about the estimate.

Reviewer #2: This is an important topic given that IT optimization ( via meaningful use stage 2) is critical or meant to be critical to improve quality of care. This paper explores association of these measures using public data called UDS. Please see my detailed comments section by section below

Introduction

1. The paper needs to add findings form studies which reported on HIT implementation ( EHR adoption) and their impact of clinical quality outcomes. There is big literature on that which is missing in the introduction

2. There are other studies used the same data set published results for similar or different measures. Some of these studies should be reported

Methods

1. The method section should be formatted well with sub headings such as study design, data Acquisition, data analysis, validity etc.

2. They need to add hypothesis and state if hypothesis are supported or not.

Results

It is straightforward and well written

1. Tables need to highlight or starred the p values which are significant for a better visualization.

2. Discussion

Discussion needs to reflect all of the results reported in Table 1-3 and studies form the literature should be discussed supporting or not supporting these findings. The discussion should be expanded considering the suggestion above. Currently, it is confusing that if they are discussing their own results or findings from the literature. There area also several statements in which citations are missing.

Some detail points:

1. Second paragraph line 201, that sentence needs to have more than 1 citation. The authors should show more studies which is indication of their expertise in that domain.

2. Second paragraph line 205, the literature demonstrates.... There is no citations added to this sentences. There should be citations supporting this statement.

3. The first sentence of third paragraph. I am confused because of citations, I am assuming they report the finding of this study, then the citations should be explained how those studies support findings of this current study.

4. Same comment ( llike number 3) for this sentence " Furthermore, the positive association of PCMH recognition with nine out of the ten eCQMs, demonstrate the importance of PCMH transformation in high clinical quality performance among HCs. [15-17]" Authors need to clarify this point.

5. line 231..previous should start with capital letter.

6. Line 231..Previous research..... needs citations at the end of the statement

Reviewer #3: Dear authors,

While the topic is relevant and important, you need to do some revisions.

Thank you

Abstract

The aim of the study should be similar with the aim in the main text.

Please privde the references fort he alst paragrapg of the introduction.

Page 7 line 131 add mmHg after blood pressure value

Methods

Page 7- the last paragraph- The number of variables should continue with the number of 9 until 12 since you specified twelve variables.

Discussion section

The section should be supported with more up-to-date references. – especially 1st and 2nd paragraph needs more references

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Megan E. Branda

Reviewer #2: No

Reviewer #3: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files to be viewed.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org. Please note that Supporting Information files do not need this step.

Attachment

Submitted filename: Reveiwer comment.doc

PLoS One. 2020 Jul 15;15(7):e0236019. doi: 10.1371/journal.pone.0236019.r002

Author response to Decision Letter 0


3 Jan 2020

Response to Reviewers

Editor Comments:

Editor Comment #1: Statistical analysis has important concerns. Please rewrite this section using the feedback from reviewers.

Response: The Methods section has been revised based upon reviewer’s comments.

Editor Comment #2: Introduction section can be enriched adding some relevant literature.

Response: Additional relevant literature has been added to enrich the Introduction section.

Editor Comment #3: Discussion section should be reorganized and enriched using the findings in the results section.

Response: The Discussion section has been reorganized to further highlight relevant study findings.

Reviewer#1:

Reviewer #1-1: For the statistical analysis seems incomplete. I am assuming you are aggregating the data at the clinic level, which means you are going to have for any outcome a range from 0-100% for a clinic meeting that quality measure, correct? if this is true then you are not doing bivariate (logistic) regression - you are doing linear regression (or you can do a probit model taking into account the N for each clinic).

or if you are modeling at the patient level then you should be doing a mixed model with a random effect at the clinic level.

Response: We have revised the Methods section and Data Acquisition sub-section to clarify that the Uniform Data System (UDS) collect aggregated data at the health center organizational level (i.e. parent organization or network level). In addition, we have revised the Methods section and Data Analysis sub-section to clarify the bivariate analyses and the multiple linear regression analyses conducted.

Reviewer #1-2: Concerns regarding model selection - removing variables that do not meet significance (which I am assuming you are using cutoff of 0.05) is not an approach that is recommended for model selection. For your sample size you are not hurting on power so why not adjust by all factors of interest if you do not want to do true model selection?

Also, on any regression model you are making assumptions and you do not state you verify them in the statistical section.

Response: We revised the statement in the Methods section and Data Analysis sub-section to clarify clinical quality measures with statistically non-significant associations with MU stage and practice size were not included in the multiple linear regression analyses.

Reviewer #1-3: For table 2, Only MU is addressed but you are interested in association across 3 key variables of which PCMH is not addresses in terms of describing outcomes (practice size in table 1).

Response: We have added a table (i.e. new Table 3: Electronic Clinical Quality Measure (e-CQMs) Performance by Health Center Practice Size) on the bivariate analyses conducted for practice size and clinical quality performance, and updated the methods and result sections accordingly. As stated originally in the Method section, PCMH status was included in our study to build upon previous research that established associations with clinical quality improvement in health centers. The literature cited were studies that Drs. Suma Nair and Alek Sripipatana had previously conducted.

Reviewer #1-4: Test statistics in table 1 and 2 were not mentioned and should be described in statistical section (what is p-value testing??).

Response: We have revised the Methods section and Data Analysis sub-section to clarify the bivariate analyses conducted and test statistics used in Tables 1 and 2.

Reviewer #1-5: The term Multivariate is not used appropriately, you are actually doing Multivariable linear regression.

Response: We have revised the Methods section and Data Analysis sub-section to clarify the multiple linear regression analyses conducted.

Reviewer #1-6: For presenting modeling results you show coefficient and p-value, the results should show how much variation there is about the estimate.

Response: Regression coefficients inform the mean change in the dependent variable of eCQM mean percentage for one unit of change in the independent variable in MU stage, PCMH recognition, and practice size. Thus, the authors have chosen to highlight and report the coefficients and p-value.

Reviewer #2:

Reviewer #2-1: This is an important topic given that IT optimization (via meaningful use stage 2) is critical or meant to be critical to improve quality of care. This paper explores association of these measures using public data called UDS. Please see my detailed comments section by section below

Response: We sincerely appreciate the reviewer’s perspective on the significance of our study topic.

Reviewer #2-2: Introduction -The paper needs to add findings form studies which reported on HIT implementation (EHR adoption) and their impact of clinical quality outcomes. There is big literature on that which is missing in the introduction

Response: Thank you for this correction. A paragraph detailing the salient aspects of this evidence has been added to the Introduction.

Reviewer #2-3: Introduction -There are other studies used the same data set published results for similar or different measures. Some of these studies should be reported

Response: We have added the 2018 study by Kranz AM, Dalton S, Damberg C, Timbie JW). In addition, the authors had included the following references in the initial submission that detailed use of the same data set and examined the association of patient centered medical home transformation and clinical quality measures

• Hu R, Shi L, Sripipatana A, Liang H, Sharma R, Nair S, et al. The Association of Patient-centered Medical Home Designation With Quality of Care of HRSA-funded Health Centers: A Longitudinal Analysis of 2012-2015. Medical care. 2018;56(2):130-8.

• Shi L, Lee DC, Chung M, Liang H, Lock D, Sripipatana A. Patient-Centered Medical Home Recognition and Clinical Performance in U.S. Community Health Centers. Health services research. 2017;52(3):984-1004.

• Shi L, Lock DC, Lee DC, Lebrun-Harris LA, Chin MH, Chidambaran P, et al. Patient-centered Medical Home capability and clinical performance in HRSA-supported health centers. Medical care. 2015;53(5):389-95.

Reviewer #2-4: Methods - The method section should be formatted well with sub headings such as study design, data Acquisition, data analysis, validity etc.

Response: We have revised to add subheadings of data acquisition, study design, and data analysis to the Results section.

Reviewer #2-5: Methods - They need to add hypothesis and state if hypothesis are supported or not.

Response: We have revised the Methods section and Study Design sub-section with the hypothesis. In addition, we have revised the specific aim statement in the Introduction section to add further clarity on the objective of the study.

Reviewer #2-5: Results - It is straightforward and well written

Response: We sincerely appreciate the reviewer’s comment.

Reviewer #2-6: Results -Tables need to highlight or starred the p values which are significant for a better visualization.

Response: We have revised the tables by bolding the p-values to highlight the statistically significant findings.

Reviewer #2-7: Discussion - Discussion needs to reflect all of the results reported in Table 1-3 and studies form the literature should be discussed supporting or not supporting these findings. The discussion should be expanded considering the suggestion above. Currently, it is confusing that if they are discussing their own results or findings from the literature. There area also several statements in which citations are missing.

Response: We have revised the language used in this section to simplify and to clarify the focus of Discussion.

Reviewer #2-8: Second paragraph line 201, that sentence needs to have more than 1 citation. The authors should show more studies which is indication of their expertise in that domain.

Response: Citations have been added to strengthen this statement.

Reviewer #2-9: Second paragraph line 205, the literature demonstrates.... There is no citations added to this sentences. There should be citations supporting this statement.

Response: Citations have been added.

Reviewer #2-10: The first sentence of third paragraph. I am confused because of citations, I am assuming they report the finding of this study, then the citations should be explained how those studies support findings of this current study.

Response: This has been clarified to reflect where this study stands in comparison to other studies.

Reviewer #2-11: Same comment ( like number 3) for this sentence " Furthermore, the positive association of PCMH recognition with nine out of the ten eCQMs, demonstrate the importance of PCMH transformation in high clinical quality performance among HCs. [15-17]" Authors need to clarify this point.

Response: We have removed the citations in order to clarify that this statement refers to results from the study.

Reviewer #2-12: line 231..previous should start with capital letter.

Response: This change has been made.

Reviewer #2-12: Line 231..Previous research..... needs citations at the end of the statement

Response: Citations have been added.

Reviewer #3:

Reviewer #3-1: Abstract - The aim of the study should be similar with the aim in the main text.

Response: Text has been revised on the aims of the study.

Reviewer #3-2: Please provide the references for the last paragraph of the introduction.

Response: A reference has been added.

Reviewer #3-3: Page 7 line 131 add mmHg after blood pressure value

Response: This has been added to the text.

Reviewer #3-4: Methods - Page 7- the last paragraph- The number of variables should continue with the number of 9 until 12 since you specified twelve variables.

Response: We have revised the text in the paragraph to indicate the 8 preventive care eCQMs and 4 chronic care eCQMs collected.

Reviewer #3-4: Discussion section -The section should be supported with more up-to-date references. – especially 1st and 2nd paragraph needs more references

Response: Additional references have been incorporated to the Discussion section.

Decision Letter 1

Mustafa Ozkaynak

6 Feb 2020

PONE-D-19-29335R1

Impact of Health Information Technology Optimization on Clinical Quality Performance in Health Centers: A National Cross-Sectional Study

PLOS ONE

Dear Dr. Lin,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

==============================

I can not recommend acceptance until the statistics part is free from major flaws as highlighted by one of the reviewers. Please consider getting statistics consultancy.

==============================

We would appreciate receiving your revised manuscript by Mar 22 2020 11:59PM. When you are ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter.

To enhance the reproducibility of your results, we recommend that if applicable you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). This letter should be uploaded as separate file and labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. This file should be uploaded as separate file and labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. This file should be uploaded as separate file and labeled 'Manuscript'.

Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.

We look forward to receiving your revised manuscript.

Kind regards,

Mustafa Ozkaynak

Academic Editor

PLOS ONE

Additional Editor Comments (if provided):

Although revisions have significantly improved the manuscript, statistical part is still concerning. Authors are encouraged to pay attention to reviewers' comment and address the issues they (particularly one of them) raised. I highlight recommend getting consultancy from a statistician since the manuscript includes major statical flaws that decrease the credibility of the study and could be caught by a statistician.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: (No Response)

Reviewer #3: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #3: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: No

Reviewer #3: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: No

Reviewer #3: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #3: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: First I want to thank the authors for being responsive to my previous review.

I still have some minor critiques to the statistical analysis that need to be addressed:

* on line 132 and in several other places you call the analysis bivariate. This is incorrect. Bivariate is a two level analysis, when you reference it is in terms of either the HC size (small, medium, large) or just being added without actual context. This should be removed from all text.

* within the results you list Statistical Significance, There has been a big shift in the literature to avoid this term and the ASA recommends to not use this term. Instead we should be thinking of clinical relevance. When reading your results I am not sure how much of the p-value is driven by sample size. Which a lot of that comes from presenting the information to allow the reader to interpret the findings accurately beyond your text.

When reporting the model results you should be showing the Coefficient, the SE (Standard Error), 95% CI, Test statistic and p-value. Each of your models should report the overall model effect as well the R^2 associated with each. Also, it is typical to see all coefficients including intercept. You are trying to show a lot of information in the table so I can see the justification in only concentrating on the three variables of interest. In your response to showing SE, this is not acceptable. The reader needs to understand the variation about that change.

Also, you do not mention model assumptions, an appropriate model selection was not done and you do not mention interaction testing.

Reviewer #3: All revision request are appropriate within the manuscript regarding my concerns. Thank you for your effort!

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Megan E. Branda

Reviewer #3: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files to be viewed.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2020 Jul 15;15(7):e0236019. doi: 10.1371/journal.pone.0236019.r004

Author response to Decision Letter 1


22 Mar 2020

Response to Reviewer #1:

Reviewer #1-1 had stated a “No” response to Q4: Have the authors made all data underlying findings in their manuscript fully available?

Response: The authors had previously provided information in the manuscript submission questionnaire on how to request access to the Uniform Data System as follows: The Health Resources and Services Administration/Bureau of Primary Health Care (HRSA/BPHC)'s Health Center Program makes the Uniform Data Systems (UDS) available, for free, to the public in an electronic format. This action is being taken pursuant to the Freedom of Information Act (5 U.S.C. 552(a)(2)(D)) (FOIA). URL: https://www.hrsa.gov/foia/UDS-public-use.html)

Reviewer #1-2: On line 132 and in several other places you call the analysis bivariate. This is incorrect. Bivariate is a two level analysis, when you reference it is in terms of either the HC size (small, medium, large) or just being added without actual context. This should be removed from all text.

Response: Bivariate analysis is the analysis of two variables to study the empirical relationship between the variables.[1] Examples of the types of variable of interest could be binary, categorical, ordinal, nominal, and continuous. In Table 1, we analyzed practice size and each of the characteristics in the bivariate analysis. Practice size is a categorical variable with three categories of small, medium, and large.

Reviewer #1-3: within the results you list Statistical Significance, There has been a big shift in the literature to avoid this term and the ASA recommends to not use this term. Instead we should be thinking of clinical relevance. When reading your results I am not sure how much of the p-value is driven by sample size. Which a lot of that comes from presenting the information to allow the reader to interpret the findings accurately beyond your text.

Response: P-value is one of the tools in statistical hypothesis testing. Thus, we have chosen to report it in our manuscript. In response the Reviewer #1 comment 1-4, we have revised Table 4 to report the 95% confidence interval along with p-values to provide the reader with additional statistics in interpreting the findings.

With respect to the comment on clinical relevance, the study conducted a data analysis of the Uniform Data System (UDS), which is an administrative data set containing information on patient sociodemographic characteristics, primary care services provision, healthcare workforce, clinical quality measures (CQMs), and Meaningful Use (MU) attestation that are reported and aggregated at the health center organizational level as described in the Methods section. This study aims to examine the association between MU attainment supported by federal initiative and clinical quality performance at the health center organization level as stated in the Introduction section. This was not a clinical treatment study. No individual patient records are contained in UDS dataset. Thus, clinical relevance does not pertain to our study.

Reviewer #1-4: When reporting the model results you should be showing the Coefficient, the SE (Standard Error), 95% CI, Test statistic and p-value. Each of your models should report the overall model effect as well the R^2 associated with each. Also, it is typical to see all coefficients including intercept. You are trying to show a lot of information in the table so I can see the justification in only concentrating on the three variables of interest. In your response to showing SE, this is not acceptable. The reader needs to understand the variation about that change.

Response: Table 4 has been updated with coefficient, standard error, 95 CI, test statistic and p-value.

Reviewer #1-5: Also, you do not mention model assumptions, an appropriate model selection was not done and you do not mention interaction testing.

Response: We had conducted interaction testing, which demonstrated that interacting terms were not statistically significant. Thus, interaction terms were not retained in the regression model. [2] We have added a statement in the Methods section and reference in the revised manuscript.

References

1. Tabachnick BG, Fidell LS. Using multivariate statistics (5th ed). Boston, MA: Allyn & Bacon/Pearson Education; 2007.

2. Pagano M, Gauvreau K. Principles of Biostatistics 2nd Edition. Australia: Duxbury; 2000.

Attachment

Submitted filename: Response to Reviewer.docx

Decision Letter 2

Mustafa Ozkaynak

20 May 2020

PONE-D-19-29335R2

Impact of health information technology optimization on clinical quality performance in health centers: A national cross-sectional study

PLOS ONE

Dear Dr. Lin,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

We would appreciate receiving your revised manuscript by Jul 04 2020 11:59PM. When you are ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter.

To enhance the reproducibility of your results, we recommend that if applicable you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). This letter should be uploaded as separate file and labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. This file should be uploaded as separate file and labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. This file should be uploaded as separate file and labeled 'Manuscript'.

Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.

We look forward to receiving your revised manuscript.

Kind regards,

Mustafa Ozkaynak

Academic Editor

PLOS ONE

Additional Editor Comments (if provided):

Please address the issue highlighted by one of the reviewers about percentages.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #4: (No Response)

Reviewer #5: (No Response)

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #4: Yes

Reviewer #5: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #4: Yes

Reviewer #5: No

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #4: Yes

Reviewer #5: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #4: Yes

Reviewer #5: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #4: The authors should provide a more detailed explanation of the following

The point should be placed at the end of the reference.

Reviewer #5: I think more clarification is required as to why mean percentages is used in the analysis. By using the mean percentages, some of the categories, for example, small practice size may have varying responses for cervical cancer screening. Any outliers, or differing ranges will not be reflected if the mean percentages are used, and it may affect the analysis that should be undertaken. If the authors can provide more justification around the use of mean percentages it will help determine whether the analysis is appropriate and provides more context to the data.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #4: No

Reviewer #5: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files to be viewed.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2020 Jul 15;15(7):e0236019. doi: 10.1371/journal.pone.0236019.r006

Author response to Decision Letter 2


22 Jun 2020

Response to Reviewers

Reviewer #4: The authors should provide a more detailed explanation of the following

The point should be placed at the end of the reference.

Response: Authors have reviewed all reference citations and revised the manuscript to place the period to the end of citation. The authors found a paper published in PLOS ONE in June of 2020 entitled “Echocardiographic screening to determine progression of latent rheumatic heart disease in endemic areas: A systematic review and meta-analysis” that followed the citation format of our manuscript (https://doi.org/10.1371/journal.pone.0234196); on the hand, there was another paper entitled “’It's disappointing and it's pretty frustrating, because it feels like it's something that will never go away.’ A qualitative study exploring individuals’ beliefs and experiences of Achilles tendinopathy” published in Mary of 2020 with the period placed at the end of reference (https://doi.org/10.1371/journal.pone.0233459). Thus, we have included our suggestion in the editor’s letter to update the online submission guidelines with citation format examples that may address potential confusion in the future.

Reviewer #5: I think more clarification is required as to why mean percentages is used in the analysis. By using the mean percentages, some of the categories, for example, small practice size may have varying responses for cervical cancer screening. Any outliers, or differing ranges will not be reflected if the mean percentages are used, and it may affect the analysis that should be undertaken. If the authors can provide more justification around the use of mean percentages it will help determine whether the analysis is appropriate and provides more context to the data.

Response: We have added a statement in the Methods section on the use of mean percentages as the most commonly used measure of central tendency and citation in the revised manuscript. With regards to the outlier concerns, the justification is due to the nature of the dataset. Our study conducted data analysis on the Uniform Data System (UDS), which is an administrative data set that is reported and aggregated at the health center organizational level for all patients served as described in the Methods section. Health centers must report UDS annually as a requirement of receiving federal grant funding. Thus, all clinical quality measurements reported, including outliers, are legitimate observations that are part of the health center organization reporting. Hence, we have included data from all health center organizations in the analysis.

Decision Letter 3

Mustafa Ozkaynak

29 Jun 2020

Impact of health information technology optimization on clinical quality performance in health centers: A national cross-sectional study

PONE-D-19-29335R3

Dear Dr. Lin,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Mustafa Ozkaynak

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Acceptance letter

Mustafa Ozkaynak

6 Jul 2020

PONE-D-19-29335R3

Impact of health information technology optimization on clinical quality performance in health centers: A national cross-sectional study

Dear Dr. Lin:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Mustafa Ozkaynak

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    Attachment

    Submitted filename: Reveiwer comment.doc

    Attachment

    Submitted filename: Response to Reviewer.docx

    Data Availability Statement

    The Health Resources and Services Administration/Bureau of Primary Health Care (HRSA/BPHC)'s Health Center Program makes the Uniform Data Systems (UDS) available, for free, to the public in an electronic format. This action is being taken pursuant to the Freedom of Information Act (5 U.S.C. 552(a)(2)(D)) (FOIA). URL: https://www.hrsa.gov/foia/UDS-public-use.html


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES