Table 1. Distribution of independent survey items by levels of success in CALNOC system usage.
Survey item scores range from 0 (strongly disagree) to 9 (strongly agree) and are expressed as mean ± standard deviation. High Success is defined as a score of 7–9, Medium Success as 4–6, and Low Success as 1–3. The number of hospitals answering each set of questions varied slightly because of one or more missing responses in the items making up the predictor or response variables.
| Survey Item | High Success N = 48 |
Medium Success N = 7 |
Low Success N = 6 |
P value |
|---|---|---|---|---|
| Leadership | ||||
| Your participation included a senior champion (executive level) who both supports your participation in the collaborative and is influential within your hospital organization |
8.6 ± 0.8 | 6.1 ± 2.9 | 6.7 ± 3.4 | 0.0030 |
| Your senior champion has had prior experience in guiding your hospital in similar strategic data sharing and/or benchmarking projects |
8.6 ± 0.9 | 7.0 ± 1.4 | 7.0 ± 2.8 | 0.0050 |
| Your hospital highly values the availability of electronic data, e.g. using dashboarding, routine electronic reports, quality assessments, etc. |
8.7 ± 0.7 | 7.3 ± 2.1 | 7.3 ± 2.3 | 0.0049 |
| Your hospital’s leaders have a well-defined vision of how participating in the collaborative will advance the strategic goals of the organization |
7.7 ± 1.6 | 5.1 ± 2.3 | 4.0 ± 3.4 | 0.0023 |
| Your hospital’s senior leadership uses collaborative data to track quality outcomes |
8.2 ± 1.3 | 6.6 ± 1.0 | 3.3 ± 3.3 | <0.0001 |
| Your hospital’s senior administrative-level personnel view themselves as personally accountable for you’re your hospital’s participation |
7.5 ± 1.9 | 6.6 ± 1.1 | 3.3 ± 1.9 | 0.0017 |
| The hospital staff recognizes that there is a strong mandate to participate in the collaborative |
7.0 ± 1.9 | 5.4 ± 0.8 | 3.2 ± 2.2 | 0.0016 |
| Personnel working with the collaborative data view this work as important in helping the hospital achieve its strategic objectives |
8.2 ± 1.1 | 8.1 ± 1.1 | 6.5 ± 1.2 | 0.0085 |
| The hospital holds you accountable for your own activities related to the collaborative (e.g., activities such as project leadership, data collection, submission, report generation, or using data for quality improvement) |
8.8 ± 0.4 | 8.0 ± 1.4 | 8.7 ± 0.5 | 0.0628 |
| The senior champion (executive level) and primary site coordinator communicate effectively with each other |
8.2 ± 1.3 | 6.2 ± 3.3 | 5.4 ± 2.9 | 0.0134 |
| Hospital Policies | ||||
| The collaborative data submission specifications are compatible with standing hospital policies, e.g. policies regarding privacy, sharing data with other organizations, HIPAA, and data security processes |
8.8 ± 0.5 | 8.1 ± 0.4 | 8.7 ± 0.5 | 0.0006 |
| At the time you joined the collaborative, your hospital had prior experience with projects involving data-sharing across organizations, e.g. Joint Commission Core Measures |
8.4 ± 1.31 | 8.1 ± 0.9 | 7.7 ± 2.8 | 0.3045 |
| Your hospital has confidence in the collaborative’s systems to ensure data security and confidentiality |
8.8 ± 0.5 | 8.4 ± 0.8 | 8.0 ± 1.7 | 0.2675 |
| Approval from the Institutional Review Board for Human | 4.1 ± 3.8 | 4.0 ± 4.1 | 6.0 ± 3.6 | 0.5445 |
| Subjects (IRB) was required by your hospital to join the collaborative |
||||
| Your hospital had prior experience in approving legal agreements for data-sharing projects with other hospitals or organizations |
8.6 ± 0.7 | 8.2 ± 0.8 | 8.8 ± 0.5 | 0.3537 |
| Your hospital’s legal counsel was needed to assist during the contracting process with the collaborative |
4.7 ± 3.7 | 1.0 ± 0.0 | 6.0 ± 4.2 | 0.1979 |
| If needed, your hospital’s legal counsel was available to assist during the contracting process |
7.6 ± 2.7 | 7.3 ± 2.1 | 8.5 ± 0.7 | 0.7079 |
| Hospital Operations | ||||
| The activities required for participation in the collaborative are compatible with standing hospital work procedures, e.g. availability of procedures and personnel for data collection, data entry, and data reporting |
7.6 ± 2.13 | 6.6 ± 1.7 | 6.3 ± 2.9 | 0.0940 |
| Your hospital was already collecting patient data electronically prior to joining the collaborative |
6.6 ± 3.2 | 6.7 ± 2.6 | 7.5 ± 3.2 | 0.6363 |
| Your hospital uses operational data from electronic clinical information systems to plan its services and staffing |
7.6 ± 2.2 | 6.9 ± 1.7 | 6.2 ± 3.4 | 0.3123 |
| Your hospital’s personnel resources are adequate to ensure the accuracy of your data collection, submission, and report generation |
7.6 ± 1.9 | 6.5 ± 2.1 | 7.5 ± 2.3 | 0.3948 |
| Your hospital provides adequate physical and technical resources to assist with data collection, submission, and data use, e.g. hardware, software, and physical location |
7.9 ± 1.5 | 7.2 ± 1.9 | 6.8 ± 2.3 | 0.3630 |
| Your hospital provides support, e.g. finances and protected time, to integrate collaborative activities related to data collection, submission, sand reporting into routine work procedures |
7.9 ± 1.6 | 7.3 ± 1.8 | 5.7 ± 3.3 | 0.2348 |
| Your hospital personnel working with the collaborative data generally have had prior experience in working with similar data |
7.3 ± 2.1 | 7.3 ± 1.1 | 7.5 ± 1.8 | 0.7120 |
| Your hospital’s work practices allow regular communication among your hospital’s team members if needed |
8.0 ± 1.5 | 7.6 ± 1.9 | 6.8 ± 2.3 | 0.4129 |
| Incentives | ||||
| External pressures demanding data encouraged your hospital to join the collaborative |
5.9 ± 2.3 | 6.9 ± 1.4 | 7.6 ± 1.5 | 0.2376 |
| The encouragement of nearby peer hospitals and/or the opportunity to benchmark among marketplace peers encouraged your hospital to join the collaborative |
6.8 ± 2.3 | 7.0 ± 1.3 | 6.4 ± 1.8 | 0.6944 |
| Before joining the collaborative, your hospital had well- established collaborative relationships with other member hospitals |
4.5 ± 2.7 | 5.6 ± 2.2 | 4.8 ± 1.8 | 0.5312 |
| Your hospital is part of a network or system that includes other hospitals participating in the collaborative |
6.7 ± 3.4 | 6.3 ± 3.7 | 7.0 ± 3.1 | 0.8432 |
| Your hospital system encouraged or required your hospital to join the collaborative |
5.4 ± 3.7 | 7.9 ± 1.7 | 5.5 ± 4.1 | 0.3974 |
| Your participation in the state benchmarking project required your hospital to submit data |
5.2 ± 3.8 | 6.3 ± 3.1 | 4.8 ± 4.4 | 0.8241 |
| The usefulness of the collaborative’s benchmarks to your hospital’s quality improvement program encouraged your hospital to join |
7.7 ± 2.2 | 7.3 ± 1.5 | 7.2 ± 1.9 | 0.2785 |