Abstract
We report on the development of an instrument to measure clinicians’ perceptions of their personal power in the workplace in relation to resistance to computerized physician order entry (CPOE). The instrument is based on French and Raven’s six bases of social power and uses a semantic differential methodology. A measurement study was conducted to determine the reliability and validity of the survey. The survey was administered online and distributed via a URL by email to 19 physicians, nurses, and health unit coordinators from a university hospital. Acceptable reliability was achieved by removing or moving some semantic differential word pairs used to represent the six power bases (alpha range from 0.76–0.89). The Semantic Differential Power Perception (SDPP) survey validity was tested against an already validated instrument and found to be acceptable (correlation range from 0.51–0.81). The SDPP survey instrument was determined to be both reliable and valid.
Keywords: power, resistance, measurement, questionnaire, electronic health records, clinical informatics, socio-technical, human factors, hospital information systems, computerized provider order entry
I. INTRODUCTION
Electronic health record implementations have approximately a 30% failure rate1 and the introduction of computerized physician order entry (CPOE) is often the process that precipitates the system failure 2–8. One consequence of CPOE that contributes to this failure is a perception by clinicians that CPOE alters their power status9. Because resistance is a factor in the failure of CPOE deployment, and changes in power have been identified as an unintended consequence of CPOE, we are investigating how changes in perceptions of power relate to resistance to CPOE10.
Personal power is a reflection of a person’s sense of dignity and work satisfaction which are an ongoing result of what occurs in his/her workplace11. Previous work with management information systems has indicated that there is a relationship between resistance to information technology and power changes in the workplace12. In healthcare, Ash identified three patterns of power shifts resulting from CPOE that can result in resistance. They are: 1) forced work redistribution and mandated clinical practice guidelines, 2) shifts in control away from clinicians, and 3) loss of autonomy and formation of colalitions13. By determining after implementation of CPOE what types of power change and to what degree power perceptions change, system developers and administrators may be able to accommodate these differences before encountering organized resistance resulting in CPOE system failure.
A significant barrier to researchers in this field is the absence of an appropriate measurement instrument for power perception in healthcare. Previous instruments used to measure perceptions of power have been structured to analyze superior/subordinate relationships, not an individual’s perceptions of his/her own power14–23. There are strong theoretical and practical arguments against the use of superior/subordinate instruments in healthcare environments. Therefore, we developed the Semantic Differential Power Perception (SDPP) survey instrument to measure an individual’s perception of his/her own power in the healthcare workplace. The semantic differential methodology24 measures people’s reactions to stimulus words presented in pairs that are on opposite ends of a spectrum (e.g. good/bad, happy/sad). These “word pairs” are separated by a series of dots that represent a numeric scale between the two words.
In this manuscript, we describe the SDPP survey instrument and its theoretical foundations. We report on a measurement study conducted to determine if the survey is reliable and valid for measuring power perceptions. The SDPP survey is available to researchers who wish to study aspects of or changes to personal power on a large scale within healthcare organizations.
II. BACKGROUND
The implementation of computerized provider order entry (CPOE) across the health care system has been slow and fraught with significant difficulty. Less than 20% of hospitals across the United States have implemented CPOE, and only slightly more than that have implemented an electronic health record (EHR)25. One cause of this delay is clinicians’ resistance26–30. An important factor related to this resistance is the clinician’s perception of the power that they have within their work domain and the belief that their power situation changes when CPOE is implemented10, 31, 32.
This power/resistance relationship has been studied in psychology, sociology, and business organizations for more than 50 years14, 33–36. The effects of power on social relationships and organizational change were the motivators for these studies, primarily as they relate to leadership and hierarchical relationships within an organization. More than 20 years ago, businesses were able to identify that information technology had the capacity to change an organization’s power structure and that resistance to such power changes was actually sufficient to cause the failure of that information technology6, 12, 15, 30, 37. This work has important implications for the implementation of technologies such as CPOE.
More recently, studies on power/resistance in healthcare have been conducted10, 38–42. The motivation for these studies is to encourage the acceptance of clinical information systems, or to determine perceptions of empowerment. These power studies use either (1) healthcare specific questionnaires using qualitative measures38, 40, 41 or (2) quantitative questionnaires designed for business practices39, 42.
Although qualitative studies provide important insights and richness of understanding, there are also some significant limitations43. Because power is such a sensitive topic and can have negative associations, beliefs and attitudes expressed may be slanted to appear more positive than they really are44. People may self-censor their responses for fear that answers indicating any negative perceptions relating to power may get back to co-workers or superiors. Also, a qualitative study does not provide a measurable means of comparison across individuals or over time. A tool to obtain less biased, measurable data about clinicians’ power was needed.
We determined that existing measurement instruments developed for business organizations would not be adequate for research in healthcare organizations because they are based on superior/subordinate relationships. Power measurement instruments for use in business organizations measure leadership, job satisfaction, and management abilities as well as how managers are perceived by their subordinates14, 16–23. Although, there are some similarities between business and healthcare organizations, the social and working relationships are typically very different. In healthcare, clinician work relationships are often more complex with both peer-to-peer and hierarchical structures. For example, a physician may be an independent practitioner at a hospital, which means he/she has no employment status in that hospital. However, the same physician has the authority to direct the work activity of employees of the hospital, to influence decisions made by that hospital, and to directly impact the financial well being of that hospital. In healthcare, power relationships are not always based on a person’s formal position as a “boss” or supervisor, but on responsibilities, knowledge, and respect. Therefore, perceptions of power within a healthcare organization cannot be adequately measured using the established superior/subordinate based instruments developed for standard business practices.
Perceptions of one’s own power in the workplace can be affected by many factors, such as autonomy, control of resources, authority to make decisions, and respect of co-workers13, 19, 45. For example, a resident physician under the watchful eye of an attending physician may feel powerless, while an experienced health unit coordinator who effectively manages the information flow on a patient unit may feel quite powerful. In order to measure self-perception of power, an instrument was needed to measure a person’s perceptions of their own power in an indirect and non-threatening manner. A requirement for the instrument was that it must translate perceptions into measurable values and encompass as well as differentiate factors that affect power. Since there were no instruments of this type, we developed the SDPP survey instrument (see Figure 1).
Figure 1.
Semantic Differential Power Perception Survey (SDPP) power questions.
III. INSTRUMENT DEVELOPMENT
The SDPP survey is based on the French and Raven theory of social power that states that individuals have different types of power or influence36. The measurement aspect of the survey uses the concept of semantic differential to identify attitudes and perceptions in a non-threatening manner24. These two aspects of the SDPP survey are described below.
A. Bases of Power
French and Raven identified six bases of social power 36, 46. The six bases of power are legitimate, expert, referent, informational, reward and coercive and are described in detail in Table 1. A review of other theories of power37, 47 relating to healthcare organizations shows that they can map back to these same six power bases, but they do not specifically identify the unique power relationships between various members of the healthcare team.
Table 1.
Definitions of French and Raven’s Six Bases of Social Power46 and their relationship in healthcare.
| Definitions of French and Raven’s Six Bases of Social Power | ||
|---|---|---|
| Six Power Bases | Definition of the Power Bases | Power Relationship in Healthcare |
| Informational | Power based on the ability to persuade or provide information to allow someone to make a decision | Clinicians as the source of information for patient care and patient-made decisions |
| Expert | Power based on one’s knowledge and/or experience | Clinicians as holders of specialized knowledge and experience regardless of position |
| Referent | Power based on people’s sense of identification or desire for identification with the influencing person | Clinicians as mentors, exemplars and confidants |
| Legitimate | Power based on one’s formal position within an organization, reciprocity for favors performed, equity for suffering incurred, or dependence on someone else for help | Clinicians with legal authority to order and plan care, but not with organizational authority over other healthcare providers |
| Reward/Coercive | Power based on the ability to provide acceptance, approval or tangible rewards
Power based on the ability to provide rejection, disapproval or threats |
Clinicians as benefactors of respect and positive recognition
Clinicians as detractors to co-workers, or impediments to ideas or practice |
In healthcare, the power bases can be interpreted in a slightly different manner than in a business environment. French and Raven identify legitimate power predominately as one’s formal position in an organization. Legitimate power is often perceived as power granted to the person hired to be “the boss”, but in healthcare legitimate power structures are typically more complex and multifaceted. Legitimate power can be derived from formal credentialing as well as organizational structure. For example, the physician’s legitimate power arises from being the person who is legally authorized to coordinate and prescribe care based on her/his licensure rather than being hired into the role of manager.
French and Raven define expert power as knowledge or expertise, which in most situations is based on experience, education or credentials. Expert power crosses all positions in healthcare. Knowledge and experience are particularly highly regarded in healthcare.
According to French and Raven, referent power is a function of charisma and identification with some aspect of a person. However, referent power in healthcare has multiple aspects and associations. It is an important power base in health care because of the clinician’s role as a mentor to more junior clinicians. Referent power is also critical for instilling trust and confidence in patients.
Informational power is the ability to persuade or to provide information (good or bad) to enable decision-making. In healthcare, informational power comes from gathering and providing the information on which life-altering decisions are made. Communicating information for these decisions is a critical and powerful role for a clinician. From the patient’s perspective, the expert and referent power of the clinician providing the information can impact how trustworthy they believe the information to be, and how persuasive the information is determined to be.
French and Raven identify reward and coercive power as separate and individual power bases, but we consider them to be related elements of social power and combined them into one concept. In business, good behavior usually entitles one to a monetary reward while poor behavior can result in punishment or withdrawal of some benefit. In healthcare, reward and coercion can be expressed by pay raises/cuts, better/poorer work schedules, access to/denial of resources or positive/negative recognition from co-workers as in any hierarchical organization. However, altruistic reward may also be found in appreciation from patients and their families and coercion may be demonstrated by criticism and mistrust, resistance to ideas, or even threats of legal retribution.
As is evident from the preceding discussion, in healthcare organizations, the formal administrative authority structure is not the sole, or even necessarily the primary basis for power. Power is intertwined between the various power bases, and certain types of power may be higher or lower for any specific individual. Taking these differences into consideration, it was necessary to develop a different method for determining the clinician’s perception of their own power that 1) is less prone to biases and 2) separates “power” into the different types, which each person holds in varying degrees. We identified semantic differential questions as the methodology best suited to this task.
B. Semantic Differential Questions
The SDPP survey uses a semantic differential methodology developed by Osgood in 195716. This method uses bipolar, paired adjectives (i.e. word pairs) to map identification and localization of attitudes in a subject’s thought processes16, 24, 48. The survey measures each subject’s perception of their power based on the connotative meaning of pairs of words related to the six bases of social power. The stimulus word pairs are representative of extremes (positive and negative). The subject identifies where on the continuum between those extremes their perceptions lie (see Figure 1). It provides the opportunity for a subject to express a degree of attitude toward separate aspects of a concept rather than a single belief or judgment about it. Because the issue of power can be sensitive, the semantic differential methodology was used because it is non-reactive in nature48 and does not promote responses that may be biased to be socially acceptable. Also, because the semantic differential questions look at individual aspects of a concept, they can isolate and measure the degree of different types of power instead of overall power.
A major issue in developing the word pairs is to ensure that the selected words have the same meaning for the subject as they do for the researcher. Establishing that the stimuli are interpreted consistently was an important consideration for performing a measurement study of the instrument.
C. The SDPP Survey
On the SDPP Survey, two questions regarding perceptions of power were presented. They are:
“At my work, I have....”
“At my work, I feel....”
Word pairs representing each power base were randomly intermixed under each question and varied according to whether the positive or negative word was presented first in order to manage central tendency bias. The scores obtained from the SDPP instrument were evaluated relative to a midpoint of zero (0), with five points on one side indicating incremental positive values and five points on the other side indicating incremental negative values. No values were presented on the survey itself to reduce bias toward positive or negative responses (see Figure 1).
The word pairs used in the survey were based on concepts identified in writings about French and Raven’s power bases36, 49–52, and the opposites of the words were identified as antonyms from Roget’s Thesaurus 53. The readability of the words used in the survey score were set at approximately a 10th grade level using the Dale-Chall Word List for readability of words 54. For example, the French and Raven concept for informational power means the power agent shares information or reasoning for a change so that the receiving agent can then make a decision55. “The imparting or interchange of thoughts, opinions, or information by speech, writing, or signs” is the definition of “communication”. So one aspect of informational power is communication. Using a thesaurus, the antonym or opposite of communication is “secret”. This leads to the word pair of “Secrets (−) and Communication (+)” representing Informational power.
In addition to questions related to power, the SDPP instrument asked for individual characteristic information, such as gender, age, position, education, employment status, patient unit specialty, previous experience with CPOE, and patient unit structure. Semantic differential questions related to attitudes toward CPOE were also included.
IV. METHODS
Because the SDPP survey was developed as a tool to be used in a much larger study evaluating perceptions of power, it was necessary to pilot the instrument and its administration. The results of the pilot study are the basis for this measurement study. The SDPP survey instrument and the research study in which it will be used were approved by the University of Pittsburgh’s Institutional Review Board (IRB protocol #0610080).
A. Setting and Sample
The measurement study was conducted in a large, tertiary care medical center on four patient units. The units were selected based on the principle investigator’s previous association with the Unit Directors and the diversity of the medical environments (Rehabilitation Medicine, Orthopedics, and Cardiology). The Unit Directors gave permission for us to approach their staff for the study, but did not encourage or discourage participation. All resident physicians, nurses, and health unit coordinators (total of 96 possible subjects) on those units were recruited to participate in the pilot study by asking them to provide their email address on a sign-up sheet.
B. Measurement Study Process
We sent each subject an email containing a URL link to two web-based surveys. The surveys were the SDPP survey and the validated Sources of Power (SOP) Audit developed by Slevin and Velthouse15. The SOP Audit was used to establish criterion-validity for the SDPP even though it focuses on perceptions of why subjects think others comply with an individual’s influence, not what the individual perceives their own power to be. Because the SOP Audit is not strictly superior/subordinate based and deals with the same six power bases, we believed that it would be an acceptable instrument to use to measure criterion-validity for the SDPP survey. The total time to take both surveys online was approximately 10–15 minutes and could be done from any computer from which the subject could access the World Wide Web. All subjects received a $5 gift card for agreeing to participate.
C. Statistical Analysis
As indicated in the Instrument Development section, the responses were scored on a scale of 5, 4, 3, 2, 1 (positive values), 0 (neutral value), −1, −2, −3, −4, −5 (negative values) based on which radio button along the continuum the subject selected. Statistical analyses were performed using SPSS©.
1) Reliability Measures
Reliability is the degree to which a measurement is consistent or reproducible 56. For the SDPP instrument, we wished to determine that the word pairs used to represent each power base did indeed measure the same power base. For example, if a subject scored very positively for one word pair representing expert power, they should also score very positively for the other word pairs representing expert power. Reliability for each group of word pairs was computed using Cronbach’s Alpha (using SPSS 14.057), and based on commonly accepted practice, 0.70 was used as the threshold for an acceptable value for evaluation of these reliability scores56.
2) Validity Measures
Validity is the degree to which the factor that the researcher wants to study is actually what is being measured56. For the intended study, it was necessary to know that each group of word pairs was measuring the appropriate power base. This could be determined by correlating the score for each power base from the SDPP with the score for each power base from the SOP Audit. For example, if a person had an overall high score for expert power in the SDPP survey, one would expect that they would have a high score for expert power in the SOP Audit. Pearson correlations between the scores of the two instruments were calculated using SPSS 14.057. A value greater than 0.40 was determined to be an acceptable, but low correlation strength56, while a strength between 0.50 and 0.69 was considered moderate, between 0.70 and 0.89 was considered strong, and between 0.90 and 1.00 was considered very strong58.
Content or “face” validity of the instrument was provided with examination by faculty and clinicians prior to administration in the pilot study. Feedback on the word pairs from the pilot subjects was also requested. Faculty indicated that the words should be chosen to be at the level of understanding of the HUC. Clinicians provided input as to what their perceptions of the word pairs represented and adjustments were made to the word pairs until a mutual understanding of what the word pairs represented was achieved. Feedback was received from only one subject, who stated that the instrument was easy to follow.
V. RESULTS
Of the 96 possible subjects, 19 completed the SDPP survey, and 13 completed both the SDPP and SOP Audit (response rate = 20%). Six subjects closed their web browser after completing the SDPP survey and before they completed the SOP Audit and could only be included in the reliability study. Reliability was calculated on all 19 of the respondents, and validity was calculated on the 13 that completed both the SDPP and SOP Audit.
Because it is necessary to have reliability before one can have validity56, calculations of reliability for the 19 subjects were performed on all of the original word pairs used in the SDPP survey. Then, in order to achieve optimum reliability, word pairs that did not contribute positively to the reliability of the power base to which they were assigned were removed from the survey, or in one case, a word pair’s assignment was changed from one power base to another. The original word pairs used to represent each power base and those that were removed are shown in Table 2. We did not change any of the individual words used in the word pairs as this would require re-piloting the instrument. Once the inadequate word pairs were removed, all the power bases achieved an acceptable reliability value with a range of 0.76–0.89.
Table 2.
Word pairs that reliably identify each power base and word pairs (italicized) that were removed to improve reliability. The word representing the negative extreme is on the left and the word representing the positive extreme is on the right
| Word Pairs Used for Each Power Base | |||||
|---|---|---|---|---|---|
| Word Pairs | Informational | Expert | Referent | Legitimate | Reward/Coercive |
| Reliable | Secrets/Communication
Arguments/Discussions Ignored/Asked |
Inexperience/Experience
No Education/Education Ignorance/Knowledge A student/A teacher |
Dishonesty/Honesty
No say/Influence Resistance/Cooperation Looked down on/Respected Criticized/Complimented |
No authority/Authority
Disorder/Goals Supervised/In control Restricted/Permitted* |
Nowhere to go/Opportunities
Uncertainty/Security Punished/Rewarded Discouraged/Encouraged |
| Removed | Rules/Ideas | Self doubt/Confidence |
Conflict/Agreement
A follower/A leader |
Dependent/Independent
Obedient/In charge |
Restricted/Permitted* |
Moved this word pair from the Reward/Coercive Power Base to the Legitimate Power Base to improve the reliability of the Legitimate Power Base.
A. Reliability results
We first calculated reliability for all of the original word pairs for each power base. The reliability for three of the power bases (Informational, Referent, and Legitimate) was not greater than 0.70 and therefore unacceptable (range of 0.50–0.89). Removing one word pair at a time from the group of word pairs used for a particular power base, Cronbach’s Alpha was calculated for all combinations of the word pairs to determine which subset of word pairs provided the highest reliability.
In this process, it was discovered that a word pair used to represent Reward/Coercive (i.e. “Restricted/Permitted”) actually represented the Legitimate power base better. Moving the word pair from Reward/Coercive did not cause that power base’s reliability to drop below the acceptable level and greatly improved the reliability of the Legitimate power base. Cronbach’s alpha using the original word pairs and then after removing the unreliable word pairs is shown in Table 3. Once the “reliable” word pairs were determined, all the power bases achieved an acceptable reliability value (range of 0.76–0.89).
Table 3.
Cronbach’s alpha calculations for reliability of the Semantic Differential Power Perception (SDPP) Survey.
| Reliability of the SDPP Survey (n = 19) | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Informational | Expert | Referent | Legitimate | Reward/Coercive | ||||||
| Number of Word Pairs | Original | Reliable | Original | Reliable | Original | Reliable | Original | Reliable | Original | Reliable |
| 4 | 3 | 5 | 4 | 7 | 5 | 5 | 4 | 5 | 4 | |
| Cronbach’s Alpha | 0.62 | 0.78 | 0.89 | 0.89* | 0.68 | 0.89 | 0.50 | 0.76 | 0.85 | 0.77** |
Even though reliability remained the same for the Expert Power Base, one word pair was dropped to improve the validity.
Moved a word pair from the Reward/Coercive Power Base to the Legitimate Power Base to improve the reliability of the Legitimate Power Base even though it decreased the reliability and validity of Reward/Coercive. However, Reward/Coercive remained above the acceptable threshold for both reliability and validity.
B. Validity results
For criterion validity, all power base scores from the SDPP were correlated with the power base scores from the Sources of Power Audit using SPSS 14.057. Validity was acceptable (correlation threshold greater than 0.40) for all the power bases using the original word pairs (range of 0.63–0.81, moderate to strong correlation). Correlations were then calculated using only the word pairs that represented an acceptable reliability. Validity for all power bases was still acceptable (range of 0.51–0.81, moderate to strong correlation). The correlation value for each power base and the strength of those correlations between the SDPP survey and the SOP Audit are shown in Table 4.
Table 4.
Pearson correlation for validity between the Semantic Differential Power Perception (SDPP) Survey and the Sources of Power (SOP) Audit.
| Validity of the SDPP Survey (n = 13) | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Informational | Expert | Referent | Legitimate | Reward/Coercive | ||||||
| Number of Word Pairs | Original | Reliable | Original | Reliable | Original | Reliable | Original | Reliable | Original | Reliable |
| 4 | 3 | 5 | 4 | 7 | 5 | 5 | 4 | 5 | 4 | |
| Pearson Correlation | 0.79 | 0.57 | 0.66 | 0.68 | 0.72 | 0.74 | 0.63 | 0.81 | 0.81 | 0.51* |
| Correlation Strength | Strong | Moderate | Moderate | Moderate | Strong | Strong | Moderate | Strong | Strong | Moderate |
Moved a word pair from the Reward/Coercive Power Base to the Legitimate Power Base to improve the reliability of the Legitimate Power Base even though it decreased the reliability and validity of Reward/Coercive. However, Reward/Coercive remained above the acceptable threshold for both reliability and validity.
VI. DISCUSSION
CPOE success is critical to minimizing medical errors and improving the quality of patient care59, 60. Understanding the implications of changes in power relationships in healthcare can greatly assist in successful CPOE implementations. For this reason, we created the Semantic Differential Power Perception (SDPP) survey instrument. In this measurement study, we determined that the instrument is both reliable and valid for quantitatively reporting power levels based on French and Raven’s six bases of power. This instrument will be used in a study of CPOE resistance and can also be used by other researchers to study power perceptions in the healthcare workplace.
The quantitative survey instrument that we have developed may capture information about power relationships in healthcare that qualitative studies alone cannot capture. Qualitative studies of power in a healthcare environment provide interpretations of perceptions across a limited number of subjects. The degree of change in those perceptions over time or circumstance cannot be determined. A reliable and valid quantitative instrument, such as the SDPP, can be administered to a much larger population and can reveal measurable changes in the different bases of power over time. With further studies of power and resistance in CPOE implementation, researchers may one day be able to predict organizational power changes and take appropriate steps to manage resistance. A variety of interventions could be tested for bolstering waning power bases and supporting already positive power bases by adjusting workflows, improving reporting structures, and providing individual recognition. In this way, CPOE resultant power changes could be an “intended intervention” rather than an “unintended consequence.”
As is typical of a measurement study, this study was performed with a relatively small number of subjects. However, the finding of acceptable reliability makes it unnecessary to add additional subjects, because reliability will typically increase with additional observations56, 61.
VII. LIMITATIONS
We have identified two limitations to the study. First, Fixed sets of word pairs used in the study was a limitation. Because of time constraints related to implementation schedules, the only changes made were removing word pairs or changing the power bases they measured. The individual words were not changed. Adding and testing different words and word pairs for the Legitimate and Reward/Coercive power bases might improve both their reliability and criterion-validity. Also, an exploratory factor analysis prior to the development of the SDPP survey may have been beneficial to assist in determining word pairs to be used for each power base. However, since the resulting correlations from the pilot were strong, a confirmatory factor analysis will be performed from the research study data for which this survey was designed 58. Second, the survey has not yet been shown to be generalizable across a wide range of environments. It would be beneficial to study this instrument across several different variables such as a community hospital vs. an academic medical center, or institutions with and without electronic clinical systems. This study attempted to provide some diversity by piloting across different types of patient units even though they were within the same healthcare organization. Consistency across multiple variables when measuring clinicians’ power perceptions would also indicate generalizability of the SDPP instrument. Despite these limitations, the SDPP survey may provide important benefits to researchers who wish to study and eventually minimize the impact of changes in power structure.
VIII. CONCLUSIONS
The SDPP instrument provides a quantitative, rather than qualitative, evaluation of the various types of power an individual perceives about themselves in their work place, thereby allowing comparisons over time, across individuals and across institutions. With the ability to quantify these perceptions, system implementers can determine changes in particular types of power and attempt to compensate for them.
Acknowledgments
The authors acknowledge the expert programming assistance of Girish Chavan, Systems Programmer IV, in creating the Semantic Differential Power Perception Survey in its electronic form. This study was supported by fellowship grant #5 T15 LM007059-20 from the National Library of Medicine. The preliminary results of this measurement study were also presented in poster form at the NLM Trainee Conference in Palo Alto, CA at Stanford University in June, 2007.
Footnotes
Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final citable form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.
References
- 1.Connolly C. Doctors cling to pen and paper. The Washington Post. 2005 March 21 [Google Scholar]
- 2.Morrissey J. Harmonic divergence. Mod Healthc. 2004 February 23;34(8):16. [PubMed] [Google Scholar]
- 3.Stavri PZ, Ash JS. Does failure breed success: narrative analysis of stories about computerized provider order entry. Int J of Med Inform. 2003 Dec;72(1–3):9–15. doi: 10.1016/j.ijmedinf.2003.08.001. [DOI] [PubMed] [Google Scholar]
- 4.Dambro MR, Weiss BD, McClure CL, Vuturo AF. An unsuccessful experience with computerized medical records in an academic medical center. J Med Educ. 1988 August;63;:617–23. doi: 10.1097/00001888-198808000-00005. [DOI] [PubMed] [Google Scholar]
- 5.Massaro TA. Introducing physician order entry at a major academic medical center: i. impact on organizational culture and behavior. Acad Med. 1993 January;68(1):20–5. doi: 10.1097/00001888-199301000-00003. [DOI] [PubMed] [Google Scholar]
- 6.Lapointe L, Rivard S. A multilevel model of resistance to information technology implementation. MIS Quart. 2005 September;29(3):461–91. [Google Scholar]
- 7.Aarts J, Doorewaard H, Berg M. Understanding implementation: the case of a computerized physician order entry system in a large Dutch university medical center. J Am Med Inform Assoc. 2004 May/June;11(3):207–16. doi: 10.1197/jamia.M1372. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Jones MR. Computers can land people on Mars, why can’t they get them to work in a hospital? Methods Inf Med. 2003;4:410–5. [PubMed] [Google Scholar]
- 9.Campbell EM, Sittig DF, Ash JS, Guappone KP, Dykstra RH. Types of unintended consequences related to computerized provider order entry. J Am Med Inform Assoc. 2006;13(5):547–56. doi: 10.1197/jamia.M2042. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Ash JS, Sittig DF, Poon EG, Guappone KP, Campbell EM, Dykstra R. The extent and importance of unintended consequences related to computerized provider order entry. J Am Med Inform Assoc. 2007;14(4):415–23. doi: 10.1197/jamia.M2373. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Roscigno VJ, Hodson R. The organizational and social foundations of worker resistance. American Sociological Review. 2004;69(1):14–39. [Google Scholar]
- 12.Markus ML. Power, politics, and MIS implementation. Commun ACM. 1983;26(6):430–44. [Google Scholar]
- 13.Ash JS, Sittig DF, Campbell E, Guappone K, Dykstra R, editors. An unintended consequence of CPOE implementation: shifts in power, control and autonomy. Proceedings of the Annual Symposium of the American Medical Informatics Association; 2006 Nov 11–15; Washington DC. Amsterdam. Elsevier. [PMC free article] [PubMed] [Google Scholar]
- 14.Garrison JP, Pate LE. Toward development and measurement of the interpersonal power construct. J Psychol. 1977;97(1):95. [Google Scholar]
- 15.Slevin DP. The whole manager. Pittsburgh (PA): Innodyne, Inc; 1989. [Google Scholar]
- 16.Osgood CE. The measurement of meaning. Chicago (IL): University of Illinois Press; 1971. [Google Scholar]
- 17.Siegel SM, Kaemmerer WF. Measuring the perceived support for innovation in organizations. J Appl Psychol. 1978;63(5):553–62. [Google Scholar]
- 18.Hawker J, Hall J. The power management inventory, the power management profile. The Woodlands (TX): Teleometrics International; 1981. [Google Scholar]
- 19.Deutchman IE. Internal-external locus of control, power and political participation. Psychol Rep. 1985;57:835–43. [Google Scholar]
- 20.Rahim MA. Some psychometric properties of two measures of French and Raven bases of power. J Psychol. 1986;120(5):465. [Google Scholar]
- 21.Henderson MC. Measuring managerial motivation: the power management inventory. J Nurs Meas. 1993;1(1):67–80. [PubMed] [Google Scholar]
- 22.Leslie DR, Holzhalb CM, Holland TP. Measuring staff empowerment: development of a worker empowerment scale. Res Social Work Prac. 1998;8(2):212–22. [Google Scholar]
- 23.Raven BH, Schwarzwald J, Koslowsky M. Conceptualizing and measuring a power/interaction model of interpersonal influence. J Appl Soc Psychol. 1998;28(4):307–32. [Google Scholar]
- 24.Heise DR. The semantic differential and attitude research. In: Summers GF, editor. Attitude Measurement. Chicago (IL): Rand McNally; 1970. pp. 235–53. [Google Scholar]
- 25.Ash JS, Gorman PN, Seshadri V, Hersh WR. Computerized physician order entry in U.S. hospitals: results of a 2002 survey. J Am Med Inform Assoc. 2004 Mar–Apr;11(2):95–9. doi: 10.1197/jamia.M1427. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Kirkley D, Stein M. Nurses and clinical technology: sources of resistance and strategies for acceptance. Nurs Econ. 2004 Jul–Aug;22(4):216–22. [PubMed] [Google Scholar]
- 27.Pare G, Sicotte C, Jacques H. The effects of creating psychological ownership on physicians’ acceptance of clinical information systems. J Am Med Inform Assoc. 2006 Mar–Apr;13(2):197–205. doi: 10.1197/jamia.M1930. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Tang PC, Ash JS, Bates DW, Overhage JM, Sands DZ. Personal health records: definitions, benefits, and strategies for overcoming barriers to adoption. J Am Med Inform Assoc. 2006 Mar–Apr;13(2):121–6. doi: 10.1197/jamia.M2025. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Timmons S. Nurses resisting information technology. Nurs Inq. 2003 Dec;10(4):257–69. doi: 10.1046/j.1440-1800.2003.00177.x. [DOI] [PubMed] [Google Scholar]
- 30.Trader-Leigh KE. Case study: identifying resistance in managing change. J Organ Change Manag. 2002;15(2):138–55. [Google Scholar]
- 31.Lapointe L, Rivard S. Getting physicians to accept new information technology: insights from case studies. CMAJ. 2006;174(11):1572–78. doi: 10.1503/cmaj.050281. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Ash JS, Gorman PN, Lavelle M, Payne TH, Massaro TA, Frantz GL, et al. A cross-site qualitative study of physician order entry. J Am Med Inform Assoc. 2003;10(2):188–200. doi: 10.1197/jamia.M770. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Winter DG. The power motive. NewYork (NY): The Free Press; 1973. [Google Scholar]
- 34.Cartwright D. Power: a neglected variable in social psychology. In: Cartwright D, editor. Studies in social power. Ann Arbor (MI): Institute for Social Research; 1959. pp. 1–14. [Google Scholar]
- 35.Coch L, French JR. Overcoming resistance to change. Hum Relat. 1948;1:512–32. [Google Scholar]
- 36.French JR, Raven BH. The bases of social power. In: Cartwright D, editor. Studies in Social Power. Ann Arbor (MI): Univ. Michigan; 1959. pp. 150–67. [Google Scholar]
- 37.Jasperson J, Carte TA, Saunders CS, Butler BS, Croes HJP, Zheng W. Review: power and information technology research: a metatriangulation review. MIS Quart. 2002;26(4):397–459. [Google Scholar]
- 38.Faulkner M. A measure of patient empowerment in hospital environments catering for older people. J Adv Nurs. 2001;34(5):676–86. doi: 10.1046/j.1365-2648.2001.01797.x. [DOI] [PubMed] [Google Scholar]
- 39.Forsberg E, Axelsson R, Arnetz B. Effects of performance-based reimbursement on the professional autonomy and power of physicians and the quality of care. Int J Health Plann Manage. 2001 Oct–Dec;16(4):297–310. doi: 10.1002/hpm.640. [DOI] [PubMed] [Google Scholar]
- 40.Lindholm M. Management from four different perspectives. J Nurs Manag. 1999;7:101–11. doi: 10.1046/j.1365-2834.1999.00035.x. [DOI] [PubMed] [Google Scholar]
- 41.Russell S. An exploratory study of patients’ perceptions, memories and experiences of an intensive care unit. J Adv Nurs. 1999 Apr;29(4):783–91. doi: 10.1046/j.1365-2648.1999.00953.x. [DOI] [PubMed] [Google Scholar]
- 42.Sieloff CL. Measuring nursing power within organizations. J Nurs Scholarsh. 2003;35(2):183–7. doi: 10.1111/j.1547-5069.2003.00183.x. [DOI] [PubMed] [Google Scholar]
- 43.Murphy E, Dingwall R, Greatbatch D, Parker S, Watson P. Qualitative research methods in health technology assessment: a review of the literature. Health Technology Assessment. 1998;2(16) [PubMed] [Google Scholar]
- 44.Thorndike RM. Measurement and evaluation in psychology and education. Upper Saddle River, NJ: Prentice Hall; 2005. [Google Scholar]
- 45.Kuokkanen L, Leino-Kilpi H. Power and empowerment in nursing: three theoretical approaches. J Adv Nurs. 2000 Jan;31(1):235–41. doi: 10.1046/j.1365-2648.2000.01241.x. [DOI] [PubMed] [Google Scholar]
- 46.Raven BH. A power/interaction model of interpersonal influence: French and Raven thirty years later. J Soc Behav Pers. 1992;7(2):217–44. [Google Scholar]
- 47.Lorenzi NM, Riley RT. In: Managing technological change. 2. Hannah KJ, Ball MJ, editors. New York (NY): Springer; 2003. [Google Scholar]
- 48.Snider JG, Osgood CE. Semantic differential technique: a sourcebook. Chicago (IL): Aldine; 1969. [Google Scholar]
- 49.Bruins J. Social power and influence tactics: a theoretical introduction. J Soc Issues. 1999;55(1):7–14. [Google Scholar]
- 50.Butler BS, Gibbons DE. Power distribution as a catalyst and consequence of decentralized technology diffusion. In: McGuire E, Larsen TJ, editors. Information systems and technology innovation and diffusion: issues and directions. Hershey (PA): Idea Group Publishing; 1997. [Google Scholar]
- 51.Carli LL. Gender, interpersonal power, and social influence. J Soc Issues. 1999;55(1):81–99. [Google Scholar]
- 52.Hinkin TR, Schriesheim CA. Development and application of new scales to measure the French and Raven (1959) bases of social power. J Appl Psychol. 1989;74(4):561–67. [Google Scholar]
- 53.Kippfer BA, editor. Roget’s 21st century thesaurus in dictionary form. 2. New York: Dell; 1999. [Google Scholar]
- 54.Dale E, Chall JS. The Dale-Chall list of 3,000 simple words. RFP Evaluation Centers; 1948. [updated 1948 October, 2006 cited 2006 October 10]; Available from: http://www.rfp-templates.com/Dale-Chall-List-of-3000-Simple-Words.html.
- 55.Raven BH. Kurt Lewin address: influence, power, religion, and the mechanisms of social control. Journal of Social Issues. 1999;55(1):161–86. [Google Scholar]
- 56.Friedman CP, Wyatt JC. Evaluations methods in biomedical informatics. New York (NY): Springer-Verlag; 1997. [Google Scholar]
- 57.SPSS 14.0. Version 14.0.1. Windows ed. Chicago, (IL): SPSS, Inc; 2005. [Google Scholar]
- 58.Pett MA, Lackey NR, Sullivan JJ. Making sense of factor analysis: the use of factor analysis for instrument development in health care research. Thousand Oaks, London, New Dehli: Sage Publications, Inc; 2003. [Google Scholar]
- 59.Bates DW, Leape LL, Cullen DJ, Laird N, Peterson LA, Teich JM, et al. Effect of computerized physician order entry and a team intervention on prevention of serious medication errors. JAMA. 1998;280(15):1311–16. doi: 10.1001/jama.280.15.1311. [DOI] [PubMed] [Google Scholar]
- 60.Thompson W, Dodek PM, Norena M, Dodek J. Computerized physician order entry of diagnostic tests in an intensive care unit is associated with improved timeliness of service. Crit Care Med. 2004;32(6):1306–9. doi: 10.1097/01.ccm.0000127783.47103.8d. [DOI] [PubMed] [Google Scholar]
- 61.Kerlinger FN, Lee HB. Foundations of behavioral research. 4. Fort Worth, Philadelphia, San Diego, New York, Orlando, Austin, San Antonio, Toronot, Montreal, London, Sydney, Tokyo: Harcourt College Publishing; 2000. [Google Scholar]

