Skip to main content
Health Services Research logoLink to Health Services Research
. 2009 Oct;44(5 Pt 2):1818–1841. doi: 10.1111/j.1475-6773.2009.01015.x

Toward Standardized, Comparable Public Health Systems Data: A Taxonomic Description of Essential Public Health Work

Jacqueline Merrill 1, Jonathan Keeling 2, Kristine Gebbie 3
PMCID: PMC2758408  PMID: 19686248

Abstract

Objective

To identify taxonomy of task, knowledge, and resources for documenting the work performed in local health departments (LHDs).

Data Sources

Secondary data were collected from documents describing public health (PH) practice produced by organizations representing the PH community.

Study Design

A multistep consensus-based method was used that included literature review, data extraction, expert opinion, focus group review, and pilot testing.

Data Extraction Methods

Terms and concepts were manually extracted from documents, consolidated, and evaluated for scope and sufficiency by researchers. An expert panel determined suitability of terms and a hierarchy for classifying them. This work was validated by practitioners and results pilot tested in two LHDs.

Principal Findings

The finalized taxonomy was applied to compare a national sample of 11 LHDs. Data were obtained from 1,064 of 1,267 (84 percent) of employees. Frequencies of tasks, knowledge, and resources constitute a profile of PH work. About 70 percent of the correlations between LHD pairs on tasks and knowledge were high (>0.7), suggesting between-department commonalities. On resources only 16 percent of correlations between LHD pairs were high, suggesting a source of performance variability.

Conclusions

A taxonomy of PH work serves as a tool for comparative research and a framework for further development.

Keywords: Taxonomy, public health, work measurement, work characteristics, knowledge management


Over 2,500 local health departments (LHDs) in the United States share an overarching mission to ensure the conditions in which people can be healthy (Institute of Medicine 2002; National Association of County and City Health Officials 2006;). There is a nationally acknowledged need for managing the performance of these organizations to provide consistent service to all constituents and to be adaptable in an increasingly complex environment (Exploring Accreditation Planning Committee 2006; Salinsky and Gursky 2006;). Yet there is little uniformity in how LHDs are organized and little understanding of how work within LHDs is accomplished (Mays 2007). Despite local differences between LHDs, mission-driven commonalities are likely to exist and LHDs are likely to share common features with other organizational forms in the public and private sector (Rainey 2000; Beitsch et al. 2007; Mays 2007;).

To accurately specify how common organizational features may influence performance, it is necessary to understand the elements of work (Pulakos, Arad, and Donovan 2000). Systems theory is a familiar framework used for understanding organizational performance (Bertalanffy 1968; Donabedian 1980; Nadler and Tushman 1988; Lichiello 1999; Handler, Issel, and Turnock 2001; Public Health Foundation 2004a,b;). An instance of systems theory applied to organizations is presented in the congruence model displayed in Figure 1 (Nadler and Tushman 1988). The model depicts an organization as a system of interrelationships and feedback loops. Inputs received from the external environment are transformed by work processes into outputs. Outputs influence outcomes (long-term results) related to the organization's mission and also produce feedback, which in turn influences the environment in which the organization operates. When management strategies optimize congruence or “fit” between the environment and the work, better performance in achieving outcomes is more likely (Woodward 1965; Nadler and Tushman 1988; Burton and Opel 1998;). Researchers have operationalized the work processes represented in the congruence model as a set of connected networks representing the employees, the tasks to which they are assigned, the knowledge they possess, and the resources to which they have access (Thompson 1967; Krackhardt and Carley 1996; Carley 2007;). Interactions between these elements can be studied with network analysis, a computational technique for understanding complex systems (Carley and Wallace 2001; Scott et al. 2005;). The goal is to reveal common patterns and insights that support management decisions to improve organizational performance. Herein this general theoretical approach is applied to public health (PH) organizations.

Figure 1.

Figure 1

A Congruence Model of an Organizational System Adapted from Nadler and Tushman (1988)

RESEARCH OBJECTIVE

The objective of the study presented here is to identify a taxonomy of tasks, knowledge, and resources that can serve as a standard for documenting the essentials of PH work. This was a foundational step in a larger research project that applied network analysis to study organizational performance in LHDs. Taxonomy is a classification framework that systematically arranges ideas, objects, or terms into categories according to specific criteria. Formulation of a well-defined theoretical or empirical classification is basic to conducting any form of scientific or systematic inquiry (McCarthy 1995; Bazzoli, Shortell, and Dubbs 2006;). Taxonomies are among the models and tools needed by researchers and analysts in all fields to bridge language, integrate concepts, and enable complex analysis (Colwell 1999; Pulakos, Arad, and Donovan 2000; National Cancer Institute 2004; National Institutes of Health 2008;). The Standard Occupational Classification system used by federal agencies to classify workers into occupational categories is an example of taxonomy with a broad scope (Bureau of Labor Statistics 2000). Many taxonomies of smaller scope exist to capture work processes, for example, taxonomy of cognitive work (Rasmussen, Pejtersen, and Schmidt 1990; Sanderson 2003;) or how work is organized in relation to safety and health (Sauter et al. 2003).

METHODS

To build taxonomy of essential PH work a multistep rational methodology was applied: (1) identification of documents describing PH practice; (2) extraction of terms; (3) solicitation of expert opinion; (4) validation with practitioners; and (5) pilot testing of the taxonomy as part of an organizational network survey (Whittaker and Breininger 2008). This is a consensus-based, iterative method that relies on the opinions of experts and practitioners who are knowledgeable about a field that is appropriate to use in the absence of taxonomy development in this domain. The taxonomy is intended to represent a minimum set of tasks, knowledge, and resources. Minimum is defined as the least number of essential items required to document the components of work done in any LHD, not in a particular health department (Trevino 1988).

Identification of Established Practice Documentation

Database and World Wide Web searches were conducted to identify established documents describing PH practice using terms such as “practice,”“process,” and “work.” Such documentation is not well represented in indexed sources (Turner et al. 2009); therefore, the document search relied on the research team's familiarity with the domain (Gebbie and Hwang 1998; Gebbie and Rice 1998; Gebbie 1999a, b; Gebbie and Garfield 2001; Gebbie and Merrill 2001, 2002; Gebbie et al. 2002a, 2003, 2007; Gebbie, Merrill, and Tilson 2002b; Merrill et al. 2003; Merrill 2004; J. Merrill and K. M. Gebbie, unpublished data) and previous taxonomy work (Gebbie and Merrill 2001). Most documents were retrieved from websites of professional associations and other organizations representing the practice community. Documents, sources, and the number of unique terms and concepts extracted from each document are listed in Table 1.

Table 1.

Sources of Terms and Concepts Extracted from Documents Describing Public Health Practice

Unique Terms/Concepts
Title Source Task Resource Knowledge
Laboratory Information Management Systems Requirements Document Association of Public Health Laboratories, 2003 25 14 4
2005 National Profile of Local Health Departments National Association of County and City Health Officials, 2006 15 0 0
Taking Care of Business: A Collaboration to Define Local Health Department Business Processes Public Health Informatics Institute & National Association of County and City Health Officials, 2006 28 16 18
Operational Definition of a Functioning Local Health Department National Association of County and City Health Officials, 2006 21 15 7
Local Health Department Accreditation Self-Assessment Instrument North Carolina Local Health Department Accreditation Board, 2006 11 114 5
Local Public Health System Assessment Instrument, Version 1 National Public Health Performance Standards Program, Centers for Disease Control & Prevention, 2002 6 37 16
Master's Degree in Public Health Core Competency Development Project, Version 2.3 Association of Schools of Public Health Education Committee, 2006 0 4 36
Core Competencies for Public Health Professionals Council on Linkages Between Academia and Public Health Practice, 2001 0 4 36
Health People 2010, Chapter 23, Public Health Infrastructure U.S. Department of Health and Human Services, 2000 14 57 11
Total of 544 Unique Terms and Concepts Extracted from Sources 120 267 157

Extraction of Terms

The researchers manually extracted terms or concepts representing tasks, knowledge, and resources from the practice documents. Two researchers used manual color coding to extract 544 unique terms or phrases each representing a task, an item of knowledge, or a resource used in PH practice. Similar terms and phrases were grouped or consolidated. No terms were discarded. Criteria for this process were based on common understanding of a term and whether it could be considered a synonym or part of a larger category, bearing in mind the overall goal to identify a minimum set of terms. For example, a site visit and a facility survey were considered subordinate to a more inclusive and common task: perform inspections. When there was disagreement the researchers engaged in discussion until they reached consensus on designation of the term. To ensure that terms and concepts adequately represented the range of essential PH work, they were evaluated for scope and sufficiency by mapping into a matrix of 10 essential services (Public Health Functions Steering Committee 1994) and 10 common activities performed in LHDs (National Association of County and City Health Officials 2006). The team iteratively reviewed this matrix to ensure there was adequate coverage in every cross-category. Consensus was reached on a draft list consisting of 77 tasks, 89 resource items, and 77 knowledge items.

Solicitation of Expert Opinion and Identification of a Schema

Expert panel meetings are frequently used to validate a method following the completion of initial development (Hora and Jensen 2002; Sherman et al. 2006;). This technique employs a structured meeting to gather information from relevant experts about an issue. An expert panel was convened to determine the suitability of the draft list of tasks, knowledge, and resources. Eight PH practice experts were identified through literature review and the knowledge of the research team. They were recruited by e-mail, all of those selected agreed to participate, and no substitutions were made. A meeting of the panel was conducted via a web conference facilitated by the researchers. Detailed instructions and a worksheet containing the draft set of terms were distributed in advance. The twofold objective was to reach a consensus on the inclusion or exclusion of each term in the set compiled by the research team and to confirm a classification hierarchy, or schema.

The experts were instructed to apply professional and personal judgment to consider the relevance of each item in relation to the essential work done in any PH department. The experts eliminated or consolidated terms and separated others into more basic elements. For example, a string of terms “cost–benefit analysis; cost–utility analysis; cost-effectiveness analysis” was eliminated from the list of knowledge items because the experts agreed that these terms represented more specialized, nonessential, knowledge. Two resource concepts “current data files on health threats (screening, reportable conditions, environmental)” and “current data files on health status (vital records, mortality, and morbidity data for all population groups)” were reduced to a single concept “local surveillance data.” The expert panel review resulted in a set of 44 tasks, 54 resource items, and 57 knowledge items.

An objective of taxonomies is to define overarching domains within which large numbers of specific instances can be understood in a simplified way (John and Srivastava 1968). An important goal for the expert panel was to determine a hierarchical schema for classifying tasks, knowledge, and resource items. Together with the research team, the experts considered how to categorize terms as each one was discussed. When the discussion reached a decision point on a hierarchical component of the schema, all members of the expert panel were queried. If there was lack of agreement, the discussion continued until consensus was reached. The experts determined that PH tasks, knowledge, and resources share a common dimension that is administrative in nature. From that starting point the experts categorized tasks into two subgroups: administrative or service. Knowledge items were categorized into four subgroups: administrative; analytic; policy and program; and PH science. Resources were also categorized into four subgroups: administrative; data and information; general; and outside partners. The schema is displayed in Figure 2.

Figure 2.

Figure 2

Hierarchical Schema for Taxonomy of Public Health Work

Validation by Practitioners

A focus group was convened to assess whether the expert's results captured essential elements of work from the point of view of practitioners. Focus group research involves discussion with a group of individuals selected for their understanding of a topic (Krueger and Casey 2000). The hierarchy produced by the expert panel was reviewed by a group of 12 local practitioners recruited with the assistance of a county health director. These practitioners represented four levels of the workforce: three administrators, four professionals, two technicians, and three clerical support staff (U.S. Office of Personnel Management 2000). Participants were instructed to consider whether the lists reflected an essential set of tasks, knowledge, and resources items for any LHD. They were asked probing questions: Are there any items that you feel need to be expanded? Are there any items that you feel are too broad and need to be separated? Are the lists getting at the essence of what working in a local health department is like? Are any of the items worded in such a way that the meaning is ambiguous and could possibly be misinterpreted by local health department workers? Each item was discussed. Participants were instructed to comment if they were either unsure of the meaning or felt the term was unsuitable. They were encouraged to suggest items or to comment on wording, including labels used for the hierarchical schema. For example, the group suggested the hierarchical category “Material Resources” as a replacement for “General Resources.” The proceedings were tape recorded and notes were taken by a researcher. Based on the focus group findings a draft was produced containing 43 tasks, 56 resource items, and 55 knowledge items.

Pilot Testing

The draft was used as the basis for a pilot organizational network survey. The survey was administered to a total of about 300 PH employees in a convenience sample of two LHDs that were recruited with the assistance of a state health department. Response rates of 90 and 77 percent were achieved from the two LHDs, respectively. An open text question requested feedback that resulted in changes to the survey format and content, such as more precise wording, consolidation of terms, and additions related to administrative support work. For example, two additional tasks were included: “phone communication with the public” and “use e-mail.” Three tasks—“evaluate staff performance,”“schedule staff,” and “recruit staff”—were merged into a single item “manage staff.” The finalized taxonomy of 44 tasks, 53 knowledge items, and 54 resources is displayed in Table 2.

Table 2.

Taxonomy for Documenting the Essential Elements of Public Health Work Done in Any Local Health Department

Tasks Knowledge Resources
1.1 Administrative Tasks Manage files, prepare reports and/or correspondence Phone communication with the public Use the Internet to get information Use e-mail Manage inventory Manage personnel (e.g., recruit, schedule, train, and/or evaluate staff) Supervise, plan, or distribute work to others Postinformation for staff use Process requests from the public (for services, information, or appointments) Schedule services and inspections Process billing, fees, and payments Financial management (including manage budgets) Prepare applications for external funding Manage contracts or service agreements Establish fees for public health services Develop public policy and/or regulations Enforce regulations Develop community partnerships Plan public health programs Manage public health programs Evaluate program performance 1.2 Service Tasks Serve on committees, boards, or task forces Register and enroll clients Deliver direct health services to clients Meet with clients Review medical records Conduct site visits, home visits, or inspections Perform health or environmental screenings Review facility operational plans Develop information and training materials Provide education to the public Conduct community assessments Represent the department at community meetings Interact with local or regional media Develop surveillance procedures Investigate health problems, including environmental health Obtain information, specimens, or samples Report data to the county or state Vector control Issue permits Plan for emergencies Respond to emergencies Take part in public health research 2.1 Administrative Knowledge Workplace safety General office skills (filing, record keeping, writing reports, correspondence) Job descriptions (yours, those who work with you) Chain of command in the health department General operating policy and procedures Mission of the health department The health department's plan for emergency response Human relations/managing people Principles of team learning EEO guidelines Accounting and budget management Contract requirements for the health department Federal or state grant requirements Quality improvement and performance measurement Strategic planning 2.2 Analytic Knowledge Problem solving Assessment (community or individual) Data collection Data analysis Case investigation Program evaluation 2.3 Policy and Program Knowledge Assets and resources in the community HIPPA regulations on confidentiality Multicultural diversity and tolerance Ethics, social justice, human rights principles Authority to operate (laws, regulations, and ordinances related to your work) Health education and training methods Social marketing Health needs and health risks of the community Distribution and determinants of disease in the population Community health improvement methods Community channels for communicating information Ecological model of population health Emerging public health issues (e.g., chronic diseases, bioterrorism) Local policy makers and leaders Utilization of health department services by the public Evidence-based health promotion and disease prevention strategies Strategies for partnership and policy development Benefits and costs of public health programs Risk communication principles Principles of public health screening Participatory decision making Steps of program planning Definition of public health Core functions and essential services of public health Healthy People 2010 goals, objectives, indicators 2.4 Public Health Science Knowledge Biostatistics Epidemiology Basic human biology Environmental health science Social or behavioral science Routine lab tests and diagnostic procedures Genetics and genomics issues in public health 3.1 Administrative Resources E-mail access Internet access Personal computer workstation Desk space Mobile phone Mobile data collection device (PDA, laptop, tablet) Reliable communication with management team The health department group e-mail (list serve) Trained coworkers Epidemiology staff expert(s) Information technology support (IT staff) Presentation software (e.g., PowerPoint) Geographic information software (GIS) Transportation Distance learning or other continuing education Safe, secure working conditions 3.2 Data and Information Resources Library of resources and scientific evidence (journals or publications) Population health registries (e.g., immunization, lead, cancer, toxicology) Referrals from community providers State health alert network (HAN) State health information network (HIN) Local surveillance data National and state surveillance data Data sharing agreements Public health websites (e.g., CDC, HRSA, EPA) 3.3 Material Resources The health code or local public health laws, regulations and ordinances Health department's media communication plan Healthy People 2010 Community health assessment or improvement plan Up-to-date directory of community groups and organizations Up-to-date directory of laboratories Up-to-date staff directory Time and activity schedules for staff Consumer satisfaction assessment Consumer complaint log Staff development plan and training log Staff performance evaluations Lab kits for collection and testing Health information that is translated and/or culturally appropriate for your clients Surveys, questionnaires, forms for data collection Health department emergency response plan County emergency plan 3.4 Outside Partner Resources State health department consultant Translator Community health advocate State epidemiologist Public health veterinarian State laboratory Other city, county, or state government agencies (private or public agencies) Area health education Center (AHEC) Medicaid and/or Medicare program staff Local emergency planning committee Researchers Legal counsel

RESULTS

Taxonomy Applied in a Study of LHD Networks

The taxonomy of PH work was used to study organizational networks in a national sample of LHDs. The study had two goals: the first goal, part of which is reported here, consisted of developing and administering a survey to compare LHD networks; the second goal, which will be reported elsewhere, was to examine how LHD networks correlate with system performance. Accordingly, the primary criterion for selecting study sites was recent completion of the National Public Health Performance Standards Assessment, Version 1 (National Public Health Performance Standards Program 2002). Another criterion was size of between 25 and 200 employees, which encompasses roughly 32 percent of LHDs nationally (National Association of County and City Health Officials 2006). This size was targeted for two reasons: to minimize response burden and to optimize the visualizations produced in network analysis by keeping the number of nodes representing employees in the network below 200. Sites were selected to represent a range of jurisdictional characteristics such as populations served (urban, rural, tribal) and type of governance (centralized, independent, home rule, and hybrid; Beitsch et al. 2006). A list of 17 eligible sites was identified by reviewing data from a national survey of LHDs (National Association of County and City Health Officials 2006) and the NPHPS V.1 assessment dataset. Eleven LHDs within six states (Arkansas, Arizona, Florida, Illinois, Montana, New Jersey, and New York) agreed to participate. Reasons LHDs gave for not participating included lack of either interest or capacity to participate in research. A total of 1,064 employees out of 1,267 possible completed the network survey, a mean response rate of 84 percent.

Profile of Essential Work

The organizational network survey asked employees to indicate (1) tasks (a) to which they were assigned as part of normal work, and (b) not assigned but they could back up if needed; (2) items for which they possessed better than average knowledge; and (3) resources (a) readily available when needed for daily work, and (b) either completely unavailable or getting the resource delayed work. The ranking of task, knowledge, and resources documented by these 1,064 PH workers constitutes a profile of essential work performed in 11 LHDs. These results are displayed in Table 3.

Table 3.

Top and Bottom Ranked Tasks, Knowledge, and Resources as Reported by 1,074 Public Health Employees Who Completed a Survey Based on a Taxonomy of Essential Elements of Work Performed in Any Local Health Department

Tasks % Backup Tasks % Knowledge % Adequate Resources % Inadequate Resources %
Top 10 ranked tasks, knowledge, and resources
Use e-mail 90 Research 44 Office skills 83 E-mail access 92 Translator 27
Use Internet 85 Supervision 40 Job descriptions 83 Internet access 90 PDA 25
Phone communication 84 Respond to emergencies 39 Problem solving 77 Computer 89 Directory of community groups 23
Manage files 79 Manage personnel 38 Chain of command 77 Desk space 89 Consumer complaints 23
Meet w/clients 65 Postinformation 37 Mission 76 Department list serve 87 County emergency plan 23
Process requests 62 Manage inventory 37 Workplace safety 75 Trained coworkers 86 Library of resources 22
Educate public 59 Plan for emergencies 35 Policy and procedures 72 Safe work conditions 86 Health info translated 22
Postinformation for staff 48 Represent department 33 HIPAA regs 67 Management team 79 Staff development plan 21
Report data 43 Serve on committees 33 Data collection 65 Staff directory 78 Continuing education 21
Serve on committees 43 Register and enroll clients 31 Diversity 64 IT staff 76 Medicare program staff 20
Bottom 10 ranked tasks, knowledge, and resources
Vector control 6 Use e-mail 5 Genetics 15 Veterinarian 17 E-mail access 3
Establish fees 8 Use Internet 10 Biostatistics 15 Researchers 18 List serve 6
Issue permits 10 Issue permits 13 Ecological model 16 GIS 25 Internet access 6
Develop surveillance 12 Manage files 13 Screening 23 AHEC 25 State laboratory 6
Prepare applications for funding 13 Phone communication 13 Contract requirements 25 Data-sharing agreements 27 Public health websites 7
Review plans 15 Vector control 14 Strategies for partnership 26 Mobile data collection device 29 Computer 7
Develop policy 16 Meet w/clients 17 Grant requirements 27 Directory labs 30 Lab kits 7
Interact w/media 16 Deliver health services 17 Risk communication 27 Community health advocate 30 Desk space 9
Research 17 Review records 19 Environmental health 27 Local surveillance 33 Other government agencies 9
Manage contracts 18 Conduct site visits 19 Epidemiology 28 State epidemiologist 33 Trained coworkers 10

Tasks

The tasks assigned to the greatest proportion of employees involve technology and communication: “use e-mail” (assigned to 90 percent of respondents) and “use Internet” (85 percent). Contact with the public, both administrative and service related, is well represented among top tasks: “phone communication with the public” (84 percent), “meet with clients” (65 percent), “process requests from the public” (62 percent), and “educate the public” (59 percent) all rank high among tasks assigned to the greatest proportion of employees. Tasks assigned to the lowest proportion of employees are specialized in nature, such as “develop public policy or regulations” (assigned to 16 percent of respondents), “develop surveillance procedures” (12 percent), and “prepare applications for funding” (13 percent). Task backup capability notably includes “respond to emergencies” (39 percent). Although not ranked in the top 10, another 35 percent of employees indicated that response is part of their assignment.

Knowledge

Top items for which employees possessed better than average knowledge fell into the administrative category. The greatest proportion of employees indicated above average knowledge of “general office skills, such as filing and record keeping, writing reports, and correspondence” (83 percent of respondents). About three quarters of employees indicated better than average knowledge of the health department's mission (76 percent). Knowledge of “HIPAA confidentiality regulations” was indicated by 67 percent of employees. Items for which the smallest proportion of employees indicated above average knowledge included “genetics and genomic issues in relation to practice” (15 percent) and “the ecological model of public health” (16 percent).

Resources

The top adequate resources (available when needed to do work) are also mostly administrative. “E-mail access” and “Internet access” were available to 92 and 90 percent of the respondents, respectively. “Computer workstation” and “desk space” were available when needed by 89 percent of respondents. “Safe working conditions” and “well-trained coworkers” are available to 86 percent of respondents and “IT support” available to 76 percent. About a quarter of employees indicated inadequate resources (i.e., unavailable or getting access created delays) for “translators” (27 percent) and “health information that is translated and/or culturally appropriate for clients” (22 percent).

Correlation of Tasks, Knowledge, and Resources

To confirm the utility of the taxonomy, we performed correlations across 11 sample sites using Kendall's τ, a nonparametric test of correspondence between two rankings (Kendall 1948). We correlated ranked lists of (a) tasks to which employees were assigned to as part of normal work; (b) items for which they possessed better than average knowledge; and (c) resources readily available when needed for daily work. Results demonstrated high correlation regarding tasks and knowledge, but limited correlation regarding resources. Correlation of tasks, ranked by the proportions of employees indicating assignment, yielded coefficients ranging between 0.59 and 0.85 with 69 percent of pairs highly correlated (at >0.70). Correlation of knowledge items, ranked by the proportions of employees indicating better than average knowledge, yielded coefficients ranging between 0.61 and 0.84, with 73 percent of pairs highly correlated (at >0.70). However, correlation coefficients for resources ranked by the proportions of employees indicating access was available when needed, ranged between 0.40 and 0.84, with only 16 percent of health department pairs highly correlated (at >0.70). These results are displayed in Table 4.

Table 4.

Kendall's τ Correlation Coefficients* for Ranked Lists of Tasks Assigned (T), Knowledge Possessed (K), and Resources Available (R) in 11 Local Health Departments (LHDs) of Different Size and with Different Governance

Governance Size LHD 1 LHD 2 LHD 3 LHD 4 LHD 5 LHD 6 LHD 7 LHD 8 LHD 9 LHD 10
Centralized 35 LHD 1
43 LHD 2 T 0.75
K 0.76
R 0.69
Centralized hybrid 121 LHD 3 T 0.73 0.74
K 0.69 0.74
R 0.53 0.64
115 LHD 4 T 0.72 0.75 0.81
K 0.72 0.74 0.83
R 0.52 0.67 0.72
187 LHD 5 T 0.76 0.85 0.8 0.81
K 0.72 0.74 0.81 0.83
R 0.59 0.73 0.71 0.74
Home rule§ 139 LHD 6 T 0.68 0.64 0.7 0.73 0.69
K 0.64 0.7 0.74 0.74 0.76
R 0.57 0.69 0.65 0.59 0.61
Independent 115 LHD 7 T 0.77 0.72 0.74 0.74 0.75 0.64
K 0.69 0.72 0.76 0.8 0.82 0.75
R 0.6 0.71 0.65 0.59 0.66 0.68
144 LHD 8 T 0.64 0.72 0.72 0.74 0.76 0.7 0.75
K 0.69 0.68 0.68 0.68 0.72 0.72 0.69
R 0.6 0.73 0.7 0.66 0.75 0.7 0.67
107 LHD 9 T 0.59 0.64 0.65 0.67 0.65 0.67 0.65 0.73
K 0.61 0.69 0.7 0.72 0.76 0.82 0.77 0.68
R 0.54 0.68 0.7 0.62 0.64 0.73 0.68 0.73
118 LHD 10 T 0.72 0.68 0.69 0.75 0.75 0.73 0.79 0.78 0.7
K 0.68 0.75 0.76 0.81 0.81 0.78 0.84 0.69 0.82
R 0.52 0.63 0.54 0.58 0.61 0.62 0.61 0.6 0.64
122 LHD 11 T 0.72 0.72 0.75 0.75 0.77 0.77 0.77 0.81 0.73 0.84
K 0.71 0.79 0.72 0.76 0.77 0.79 0.77 0.74 0.81 0.82
R 0.4 0.58 0.65 0.65 0.63 0.66 0.59 0.63 0.69 0.66
*

All correlations are significant at p≤.05.

LHDs are units of the state health agency.

LHDs are units of the state health agency with a degree of local autonomy.

§

LHD that has jurisdiction over many local townships and municipalities.

LHDs are units of local government.

DISCUSSION

The taxonomy developed and tested here is a workable way of describing and comparing the essential work that goes on in health departments of different size and with different governance, information that is essential to conduct research about LHD performance. With a functional taxonomy we can raise a series of important questions about PH practice, as the profile in Table 3 and correlations in Table 4 begin to suggest. For example:

  • PH work has a significant administrative component. Is this dominance related to the core communication aspect (written, oral, and electronic) of all PH activities? Can this profile be viewed in relation to other organizations with a significant administrative service component? Could such comparisons inform system-wide management strategies for LHDs?

  • Is the low ranking of more technical tasks related to the limited number of specialists available in a typical LHD, or is specialization less important in PH work than assumed?

  • What does the low ranking of knowledge about the ecological model of population health (a prominent framework for education, training, and research; Institute of Medicine 2003) tell us about the model, or about the workforce?

  • Do the nearly universal e-mail and Internet access, as well as highly ranked access to computers and IT support, reflect a decade of emergency preparedness funds, or something else?

  • About 75 percent of employees indicate they either are assigned or have backup capability to respond in emergencies. Who are the 25 percent of employees that do not indicate capability for response? Are there implications for preparedness?

  • Is inadequate access to translators and translated health materials a reflection of the nation's changing demographics, a different scope of PH services being provided, or something else?

  • Limited correlations between LHDs on resources may not be surprising, given the range of funding for LHDs. Is lack of correlation related primarily to funding variance or to something else?

IMPLICATIONS

Beyond the exploratory questions suggested above, data collected using the taxonomy will enable exploratory analyses to examine the distribution of tasks and their association with resources and knowledge. This can contribute to a more precise picture of how work is accomplished in local PH, allow exploration of appropriate redundancies in PH work, and potentially suggest systemic strategies for management. In theory, with an expanded dataset such research might be extended to produce falsifiable predictions of performance in LHDs.

Taxonomy is the organization of a particular set of information for a particular purpose (Rappaport 2008). A classification of PH work can serve two main purposes: as a tool for research it provides a practical resource for documenting PH work; and it establishes a framework for further development. Taxonomy is always a contentious issue because the world does not come to us arranged in tidy packages (Gould 1981), and the value of taxonomy at any stage of development is in its application. The survey developed with this taxonomy produced standardized comparable data that supported local management decisions and that potentially can inform system-wide infrastructure development (Merrill and Carley 2008). It is an expectation that this taxonomy will be revised and expanded by researchers and practitioners who use it (Bazzoli et al. 1999; Bazzoli, Shortell, and Dubbs 2006; Luke 2006;). This taxonomy does have the advantage of being readily adapted to circumstances within real PH organizations because it is based on practice documentation and expert consensus.

The taxonomy is a first step toward developing a shared understanding of the work done in local PH. It lays a foundation for a controlled set of terms for representing information electronically in computer systems similar to the terminologies available in nursing and medicine (Werley et al. 1991; Kleinbeck 1996; McCloskey and Bulechek 2000; Pulakos, Arad, and Donovan 2000; Yeung, Chan, and Lee 2003; Chang et al. 2005; Cimino 2006; American Medical Association 2008; Lee et al. 2008;). Future steps include establishing common definitions for all terms and evaluating these for consistency, completeness, and conciseness (Gomez-Perez 1995). Formal representation with Unified Modeling Language would allow visualization and further understanding of the concepts involved, which is a prerequisite for computational interoperability among heterogeneous systems such as those designed for finance, education, quality assurance, and research purposes (Object Management Group 2008).

The current state of knowledge about exactly how PH work is accomplished is insufficient to support modern analytic approaches in systems and policy research (Lenaway et al. 2006). Studies to inform both organizational management and policy development at all levels of government require data beyond what is currently available about PH organizations (Gebbie et al. 2007). Until common data elements and vocabulary are more widely available, this work will proceed slowly. As the discipline of Public Health Services and Systems Research emerges, it is incumbent upon members of this community to lay foundations for a sound and comparable body of knowledge with an array of data tools and resources.

Acknowledgments

Joint Acknowledgment/Disclosure Statement: The research described here was supported by a 2006 Pfizer Public Health Scholar Award, a research grant from the Robert Wood Johnson Foundation, and a subaward from the National Institute of Nursing Research through the Center for Evidence-Based Practice in the Underserved, Columbia University School of Nursing, P20-NR07799. Jonathan Keeling is a predoctoral trainee in the Department of Biomedical Informatics at Columbia University, funded by the National Library of Medicine, T15-LM007079. The authors thank Angela Wantroba, who at the time of the study was a doctoral student at the Columbia University School of Nursing, for assistance in the early phase of this research.

Disclosures: None.

Disclaimers: None.

Supporting Information

Additional supporting information may be found in the online version of this article:

Appendix SA1: Author Matrix.

hesr0044-1818-SD1.doc (87KB, doc)

Please note: Wiley-Blackwell is not responsible for the content or functionality of any supporting materials supplied by the authors. Any queries (other than missing material) should be directed to the corresponding author for the article.

REFERENCES

  1. American Medical Association. Current Procedural Terminology. Chicago: American Medical Association; 2008. [Google Scholar]
  2. Association of Public Health Laboratories and Public Health Informatics Institute. Requirements Document for Public Health Laboratory Information Management Systems. Washington, DC: Association of Public Health Laboratories; 2003. [Google Scholar]
  3. Association of Schools of Public Health. “Master's Degree in Public Health Core Competency Development Project, Version 2.3” [accessed on September 2006]. Available at http://www.asph.org/userfiles/version2.3.pdf.
  4. Bazzoli G, Shortell S, Dubbs N, Chan C, Kralovec P. An Organizational Taxonomy of Health Networks and Systems: Bringing Order out of Chaos. Health Services Research. 1999;33(6):1683–717. [PMC free article] [PubMed] [Google Scholar]
  5. Bazzoli GJ, Shortell SM, Dubbs NL. Rejoinder to Taxonomy of Health Networks and Systems: A Reassessment. Health Services Research. 2006;41(3, part 1):629–39. doi: 10.1111/j.1475-6773.2006.00525.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Beitsch LM, Grigg M, Menachemi N, Brooks RG. Roles of Local Public Health Agencies within the State Public Health System. Journal of Public Health Management and Practice. 2006;12(3):232–41. doi: 10.1097/00124784-200605000-00003. [DOI] [PubMed] [Google Scholar]
  7. Beitsch LM, Mays G, Corso L, Chang C, Brewer R. States Gathering Momentum: Promising Strategies for Accreditation and Assessment Activities in Multistate Learning Collaborative Applicant States. Journal of Public Health Management and Practice. 2007;13(4):364–73. doi: 10.1097/01.PHH.0000278029.33949.21. [DOI] [PubMed] [Google Scholar]
  8. Bertalanffy LV. General System Theory. New York: George Braziller; 1968. [Google Scholar]
  9. Bureau of Labor Statistics. “Standard Occupational Classification (SOC)” [accessed on August 17, 2008]. Available at http://www.bls.gov/SOC/
  10. Burton RM, Opel B. Strategic Organizational Design: Developing Theory from Application. Boston: Kluwer; 1998. [Google Scholar]
  11. Carley KM. ORA: Organizational Risk Analyzer (Release Software) Pittsburgh, PA: Center for Analysis of Social and Organizational Systems; 2007. [Google Scholar]
  12. Carley KM, Wallace WA. Computational Organization Theory: A New Perspective. In: Gass S, Harris CM, editors. Encyclopedia of Operations Research and Management Science. Norwich, MA: Kluwer Academic Publishers; 2001. pp. 126–131. [Google Scholar]
  13. Centers for Disease Control and Prevention. National Public Health Performance Standards Program” [accessed on July 5, 2008]. Available at http://www.cdc.gov/od/ocphp/nphpsp/
  14. Centers for Disease Control and Prevention and National Public Health Performance Standards Program. “Local Public Health Performance Assessment Instrument, Version 1.0” [accessed on September 2006]. Available at http://www.cdc.gov/od/ocphp/nphpsp/Documents/Local_v_1_0MB_0920-0555.pdf.
  15. Chang A, Schyve PM, Croteau RJ, O'Leary DS, Loeb JM. The JCAHO Patient Safety Event Taxonomy: A Standardized Terminology and Classification Schema for Near Misses and Adverse Events. International Journal of Quality Health Care. 2005;17(2):95–105. doi: 10.1093/intqhc/mzi021. [DOI] [PubMed] [Google Scholar]
  16. Cimino JJ. In Defense of the Desiderata. Journal of Biomedical Informatics. 2006;39(3):299–306. doi: 10.1016/j.jbi.2005.11.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
  17. Colwell RR. “Investing in Federal Science and Technology: Integrating Our Research Portfolio, Testimony of the Director of the National Science Foundation before the Senate Science and Technology Caucus” [accessed on August 1, 2009]. Available at http://www.nsf.gov/news/speeches/colwell/rc90303stcaucus.htm.
  18. Council on Linkages between Academia and Public Health Practice. “Core Competencies for Public Health Professionals” [accessed on September 2006]. Available at http://www.phf.org/link/corecompetencies.htm.
  19. Donabedian A. Explorations in Quality Assessment and Monitoring. Ann Arbor, MI: Health Administration Press; 1980. [Google Scholar]
  20. Exploring Accreditation Planning Committee. Exploring Accreditation: Final Recommendations for a Voluntary National Accreditation Program for State & Local Public Health Departments. Princeton, NJ: Robert Wood Johnson Foundation and Centers for Disease Control and Prevention; 2006. [Google Scholar]
  21. Gebbie K. The Public Health Workforce: Key to Public Health Infrastructure [Editorial] American Journal of Public Health. 1999a;89(5):660–1. doi: 10.2105/ajph.89.5.660. [DOI] [PMC free article] [PubMed] [Google Scholar]
  22. Gebbie K. Who's Minding the Public Health Store? [Editorial] Journal of Public Health Management Practice. 1999b;5(3):vii–viii. doi: 10.1097/00124784-199905000-00002. [DOI] [PubMed] [Google Scholar]
  23. Gebbie K, Garfield R. Public Health Nursing and Essential Public Health Functions: A Basis for Practice in the Twenty-First Century. New York: Columbia University School of Nursing, Center for Health Policy; 2001. [Google Scholar]
  24. Gebbie K, Hwang I. Preparing Currently Employed Public Health Professionals for Changes in the Health System. New York: Columbia University School of Nursing, Center for Health Policy; 1998. [Google Scholar]
  25. Gebbie K, Merrill J, Sanders L, Gebbie E, Chen DW. Public Health Workforce Enumeration: Beware the ‘Quick Fix’. Journal of Public Health Management and Practice. 2007;13(1):72–9. doi: 10.1097/00124784-200701000-00012. [DOI] [PubMed] [Google Scholar]
  26. Gebbie K, Rice R. Toward a Practical Curriculum for Currently Employed Public Health Nurses: Summary of Public Health Nursing Planning Retreat. New York: Columbia University School of Nursing, Center for Health Policy; 1998. [Google Scholar]
  27. Gebbie KM, Merrill J. Enumeration of the Public Health Workforce: Developing a System. Journal of Public Health Management Practice. 2001;7(4):8–16. doi: 10.1097/00124784-200107040-00003. [DOI] [PubMed] [Google Scholar]
  28. Gebbie KM, Merrill J. Public Health Worker Competencies for Emergency Response. Journal of Public Health Management and Practice. 2002;8(3):73–81. doi: 10.1097/00124784-200205000-00011. [DOI] [PubMed] [Google Scholar]
  29. Gebbie KM, Merrill J, Hwang I, Gebbie E, Gupta M. The Public Health Workforce in the Year 2000. Journal of Public Health Management and Practice. 2003;9(1):79–86. doi: 10.1097/00124784-200301000-00011. [DOI] [PubMed] [Google Scholar]
  30. Gebbie KM, Merrill J, Hwang I, Gupta M, Btoush R, Wagner M. Identifying Individual Competency in Emerging Areas of Practice: An Applied Approach. Qualitative Health Research. 2002a;12(7):990–9. doi: 10.1177/104973202129120403. [DOI] [PubMed] [Google Scholar]
  31. Gebbie KM, Merrill J, Tilson H. The Public Health Workforce. Health Affairs. 2002b;21(6):57–67. doi: 10.1377/hlthaff.21.6.57. [DOI] [PubMed] [Google Scholar]
  32. Gomez-Perez A. Some Ideas and Examples to Evaluate Ontologies. Proceedings of the 11th Conference on Artificial Intelligence for Applications, IEEE Computer Society.
  33. Gould SJ. The Mismeasure of Man. New York: Norton; 1981. [Google Scholar]
  34. Handler A, Issel M, Turnock B. A Conceptual Framework to Measure Performance of the Public Health System. American Journal of Public Health. 2001;91(8):1235–9. doi: 10.2105/ajph.91.8.1235. [DOI] [PMC free article] [PubMed] [Google Scholar]
  35. Hora S, Jensen M. Expert Judgment Elicitation. Oslo: Swedish Radiation Authority; 2002. [Google Scholar]
  36. Institute of Medicine. The Future of the Public's Health in the 21st Century. Washington, DC: National Academy Press; 2002. [Google Scholar]
  37. Institute of Medicine. Who Will Keep the Public Healthy? Educating Public Health Professionals for the 21st Century. Washington, DC: National Academy of Medicine; 2003. [PubMed] [Google Scholar]
  38. John OP, Srivastava S. The Big-Five Trait Taxonomy: History, Measurement, and Theoretical Perspectives. In: Pervin L, John OP, editors. Handbook of Personality: Theory and research. New York: Guilford; 1968. pp. 102–138. [Google Scholar]
  39. Kendall M. Rank Correlation Methods. London: Charles Griffin & Company Limited; 1948. [Google Scholar]
  40. Kleinbeck SVM. In Search of Perioperative Nursing Data Elements. AORN Journal. 1996;63(5):926–31. doi: 10.1016/s0001-2092(06)63104-9. [DOI] [PubMed] [Google Scholar]
  41. Krackhardt D, Carley KM. A PCANS Model of Structure in Organizations. Paper presented at the International Symposium on Command and Control Research and Technology, Monterey, CA.
  42. Krueger R, Casey MA. Focus Groups: A Practical Guide for Applied Research. Thousand Oaks, CA: Sage Publications; 2000. [Google Scholar]
  43. Lee S, Alexander J, Wang V, Margolin F, Combes J. An Empirical Taxonomy of Hospital Governing Board Roles. Health Services Research. 2008;43(4):1223–43. doi: 10.1111/j.1475-6773.2008.00835.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  44. Lenaway D, Halverson P, Sotnikov S, Tilson H, Corso L, Millington W. Public Health Systems Research: Setting a National Agenda. American Journal of Public Health. 2006;96(3):410–3. doi: 10.2105/AJPH.2004.046037. [DOI] [PMC free article] [PubMed] [Google Scholar]
  45. Lichiello P. Guidebook for Performance Measurement. Seattle, WA: Turning Point National Program Office, University of Washington; 1999. [Google Scholar]
  46. Luke RD. Taxonomy of Health Networks and Systems: A Reassessment. Health Services Research. 2006;41(3, part 1):618–28. doi: 10.1111/j.1475-6773.2006.00524.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  47. Mays GP. Understanding the Dimensions of Public Health Delivery Systems: Theory, Evidence, and Unanswered Questions. White Paper presented at the AcademyHealth Public Health Systems Research Stakeholder Meeting, Washington, DC.
  48. McCarthy I. Manufacturing Classification: Lessons from Organizational Systematics and Biological Taxonomy. Integrated Manufacturing Systems. 1995;6(6):37–48. [Google Scholar]
  49. McCloskey JC, Bulechek GM. Nursing Interventions Classification (NIC) St. Louis: Mosby-Year Book; 2000. [PubMed] [Google Scholar]
  50. Merrill J. Reasoning for Emergency Public Health Risk Communication. In: Fieschi M, Coiera E, Li J, editors. Proceedings of the 11th World Congress on Medical Informatics (MedInfo) San Francisco: International Medical Informatics Association; 2004. p. 1757. [Google Scholar]
  51. Merrill J, Carley KM. Early Findings from a Comparative Network Analysis of Local Public Health Organizations. AcademyHealth, Public Health Systems Research Interest Group Meeting. Washington, DC: AcademyHealth.
  52. Merrill J, Btoush R, Gupta M, Gebbie K. A History of Public Health Workforce Enumeration. Journal of Public Health Management and Practice. 2003;9(6):459–70. doi: 10.1097/00124784-200311000-00005. [DOI] [PubMed] [Google Scholar]
  53. Nadler DA, Tushman ML. Strategic Organization Design: Concepts, Tools, and Processes. Glenview: Scott Foresman; 1988. [Google Scholar]
  54. National Association of County and City Health Officials. “Operational Definition of a Functional Local Public Health Agency” [accessed on September 2006]. Available at http://www.naccho.org.
  55. National Association of County and City Health Officials. Survey Instrument, 2005 National Profile of Local Health Departments. Washington, DC: National Association of County and City Health Officials; 2005. [Google Scholar]
  56. National Association of County and City Health Officials. The 2005 National Profile of Local Health Departments. Washington, DC: National Association of County and City Health Officials; 2006. [Google Scholar]
  57. National Cancer Institute. “Building the Nation's Cancer Research Capacity: Developing Bioinformatics for Cancer Research” [accessed on July 5, 2008]. Available at http://plan2004.cancer.gov/capacity/informatics.htm.
  58. National Institutes of Health. “NIH Roadmap for Medical Research” [accessed on July 5, 2008]. Available at http://nihroadmap.nih.gov/
  59. North Carolina Association of Local Health Directors Accreditation Committee. “Health Department Self-Assessment Instrument” [accessed on July 5, 2007]. Available at http://nciph.sph.unc.edu/accred/health_depts/materials/index.htm.
  60. Object Management Group. Unified Modeling Language (Release 20) Software. Needham, MA: Object Management Group; 2008. [Google Scholar]
  61. Public Health Foundation. From Silos to Systems: Using Performance Management to Improve the Public's Health. Seattle, WA: Turning Point Performance Management National Excellence Collaborative; 2004a. [Google Scholar]
  62. Public Health Foundation. Performance Measurement in Public Health: A Literature Review. Seattle, WA: Turning Point Performance Management National Excellence Collaborative; 2004b. [Google Scholar]
  63. Public Health Functions Steering Committee. Public Health in America: Vision, Mission, and Essential Services. Washington, DC: U.S. Public Health Service; 1994. [Google Scholar]
  64. Public Health Informatics Institute. “Taking Care of Business: A Collaboration to Define Local Health Department Business Processes” [accessed on September 2006]. Available at http://www.phii.org/resources/doc_details.asp?id=104.
  65. Pulakos ED, Arad S, Donovan MA. Adaptability in the Workplace: Development of a Taxonomy of Adaptive Performance. Journal of Applied Psychology. 2000;85(4):612–24. doi: 10.1037/0021-9010.85.4.612. [DOI] [PubMed] [Google Scholar]
  66. Rainey HG. Comparing Public and Private Organizations: Empirical Research and the Power of the a Priori. Journal of Public Administration Research and Theory. 2000;10:447–69. [Google Scholar]
  67. Rappaport A. “Search Tools for Web Sites and Intranets” [accessed on October 2008]. Available at http://www.searchtools.com/info/classifiers.html.
  68. Rasmussen J, Pejtersen AM, Schmidt K. “Taxonomy for Cognitive Work Analysis” [accessed on November 2008]. Available at http://infoscience.epfl.ch/record/51879.
  69. Salinsky E, Gursky S. The Case for Transforming Governmental Public Health. Health Affairs. 2006;25(4):1017–28. doi: 10.1377/hlthaff.25.4.1017. [DOI] [PubMed] [Google Scholar]
  70. Sanderson PM. Cognitive Work Analysis. In: Carroll J, editor. HCI Models, Theories, and Frameworks: Toward an Interdisciplinary Science. New York: Morgan-Kaufmann; 2003. pp. 225–64. [Google Scholar]
  71. Sauter S, Brightwell W, Colligan M, Hurrell JJ, Jr, Katz TM, LeGrande DE, Lessin N, Lippin RA, Lipscomb JA, Murphy LR, Peters RH, Keita GP, Robertson SR, Stellman JM, Swanson NG, Tetrick LE. DHHS (NIOSH) Publication No. 2002-116. Atlanta: DHHS (NIOSH); 2003. The Changing Organization of Work and the Safety and Health of Working People: Knowledge Gaps and Research Directions. [Google Scholar]
  72. Scott JG, Tallia A, Crosson J, Orzano AJ, Stroebel C, DiCicco-Bloom B, O'Malley D, Shaw E, Crabtree B. Social Network Analysis as an Analytic Tool for Interaction Patterns in Primary Care Practices. Annals of Family Medicine. 2005;3(5):443–8. doi: 10.1370/afm.344. [DOI] [PMC free article] [PubMed] [Google Scholar]
  73. Sherman KJ, Dixon MW, Thompson D, Cherkin DC. Development of a Taxonomy to Describe Massage Treatments for Musculoskeletal Pain. BMC Complementary and Alternative Medicine. 2006;6(1):24. doi: 10.1186/1472-6882-6-24. [accessed on August 1, 2009]Available at http://www.biomedcentral.com/1472-6882/6/24. [DOI] [PMC free article] [PubMed] [Google Scholar]
  74. Thompson JD. Organizations in Action Social Science Bases of Administrative Theory. New York: McGraw Hill; 1967. [Google Scholar]
  75. Trevino FM. Uniform Minimum Data Sets: In Search of Demographic Comparability. American Journal of Public Health. 1988;78(2):126–7. doi: 10.2105/ajph.78.2.126. [DOI] [PMC free article] [PubMed] [Google Scholar]
  76. Turner AM, Petrochilos D, Nelson DE, Allen E, Liddy ED. Access and Use of the Internet for Health Information Seeking: A Survey of Local Public Health Professionals in the Northwest. Journal of Public Health Management and Practice. 2009;15(1):67–9. doi: 10.1097/01.PHH.0000342946.33456.d9. [DOI] [PubMed] [Google Scholar]
  77. U.S. Department of Health and Human Services, Office of Disease Prevention and Health Promotion. Healthy People 2010: Understanding and Improving Health. 2d Edition. Washington, DC: U.S. Government Printing Office; 2000. [PubMed] [Google Scholar]
  78. U.S. Office of Personnel Management. Federal Civilian Workforce Statistics: Occupations of Federal White-Collar and Blue-Collar Workers (September 1999) Washington, DC: U.S. Government Printing Office; 2000. [Google Scholar]
  79. Werley H, Devine EC, Zorn CR, Ryan P, Westra BL. The Nursing Minimum Data Set: Abstraction Tool for Standardized, Comparable, Essential Data. American Journal of Public Health. 1991;81(4):421–6. doi: 10.2105/ajph.81.4.421. [DOI] [PMC free article] [PubMed] [Google Scholar]
  80. Whittaker M, Breininger K. Taxonomy Development for Knowledge Management. Paper presented at the 74th General Conference and Council of the World Library and Information, Quebec, Canada.
  81. Woodward J. Industrial Organization: Theory and Practice. London: Oxford University Press; 1965. [Google Scholar]
  82. Yeung A, Chan L, Lee TS. An Empirical Taxonomy for Quality Management Systems: A Study of the Hong Kong Electronics Industry. Journal of Operations Management. 2003;21(1):45–62. [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

hesr0044-1818-SD1.doc (87KB, doc)

Articles from Health Services Research are provided here courtesy of Health Research & Educational Trust

RESOURCES