Abstract
Objective
To identify taxonomy of task, knowledge, and resources for documenting the work performed in local health departments (LHDs).
Data Sources
Secondary data were collected from documents describing public health (PH) practice produced by organizations representing the PH community.
Study Design
A multistep consensus-based method was used that included literature review, data extraction, expert opinion, focus group review, and pilot testing.
Data Extraction Methods
Terms and concepts were manually extracted from documents, consolidated, and evaluated for scope and sufficiency by researchers. An expert panel determined suitability of terms and a hierarchy for classifying them. This work was validated by practitioners and results pilot tested in two LHDs.
Principal Findings
The finalized taxonomy was applied to compare a national sample of 11 LHDs. Data were obtained from 1,064 of 1,267 (84 percent) of employees. Frequencies of tasks, knowledge, and resources constitute a profile of PH work. About 70 percent of the correlations between LHD pairs on tasks and knowledge were high (>0.7), suggesting between-department commonalities. On resources only 16 percent of correlations between LHD pairs were high, suggesting a source of performance variability.
Conclusions
A taxonomy of PH work serves as a tool for comparative research and a framework for further development.
Keywords: Taxonomy, public health, work measurement, work characteristics, knowledge management
Over 2,500 local health departments (LHDs) in the United States share an overarching mission to ensure the conditions in which people can be healthy (Institute of Medicine 2002; National Association of County and City Health Officials 2006;). There is a nationally acknowledged need for managing the performance of these organizations to provide consistent service to all constituents and to be adaptable in an increasingly complex environment (Exploring Accreditation Planning Committee 2006; Salinsky and Gursky 2006;). Yet there is little uniformity in how LHDs are organized and little understanding of how work within LHDs is accomplished (Mays 2007). Despite local differences between LHDs, mission-driven commonalities are likely to exist and LHDs are likely to share common features with other organizational forms in the public and private sector (Rainey 2000; Beitsch et al. 2007; Mays 2007;).
To accurately specify how common organizational features may influence performance, it is necessary to understand the elements of work (Pulakos, Arad, and Donovan 2000). Systems theory is a familiar framework used for understanding organizational performance (Bertalanffy 1968; Donabedian 1980; Nadler and Tushman 1988; Lichiello 1999; Handler, Issel, and Turnock 2001; Public Health Foundation 2004a,b;). An instance of systems theory applied to organizations is presented in the congruence model displayed in Figure 1 (Nadler and Tushman 1988). The model depicts an organization as a system of interrelationships and feedback loops. Inputs received from the external environment are transformed by work processes into outputs. Outputs influence outcomes (long-term results) related to the organization's mission and also produce feedback, which in turn influences the environment in which the organization operates. When management strategies optimize congruence or “fit” between the environment and the work, better performance in achieving outcomes is more likely (Woodward 1965; Nadler and Tushman 1988; Burton and Opel 1998;). Researchers have operationalized the work processes represented in the congruence model as a set of connected networks representing the employees, the tasks to which they are assigned, the knowledge they possess, and the resources to which they have access (Thompson 1967; Krackhardt and Carley 1996; Carley 2007;). Interactions between these elements can be studied with network analysis, a computational technique for understanding complex systems (Carley and Wallace 2001; Scott et al. 2005;). The goal is to reveal common patterns and insights that support management decisions to improve organizational performance. Herein this general theoretical approach is applied to public health (PH) organizations.
Figure 1.
A Congruence Model of an Organizational System Adapted from Nadler and Tushman (1988)
RESEARCH OBJECTIVE
The objective of the study presented here is to identify a taxonomy of tasks, knowledge, and resources that can serve as a standard for documenting the essentials of PH work. This was a foundational step in a larger research project that applied network analysis to study organizational performance in LHDs. Taxonomy is a classification framework that systematically arranges ideas, objects, or terms into categories according to specific criteria. Formulation of a well-defined theoretical or empirical classification is basic to conducting any form of scientific or systematic inquiry (McCarthy 1995; Bazzoli, Shortell, and Dubbs 2006;). Taxonomies are among the models and tools needed by researchers and analysts in all fields to bridge language, integrate concepts, and enable complex analysis (Colwell 1999; Pulakos, Arad, and Donovan 2000; National Cancer Institute 2004; National Institutes of Health 2008;). The Standard Occupational Classification system used by federal agencies to classify workers into occupational categories is an example of taxonomy with a broad scope (Bureau of Labor Statistics 2000). Many taxonomies of smaller scope exist to capture work processes, for example, taxonomy of cognitive work (Rasmussen, Pejtersen, and Schmidt 1990; Sanderson 2003;) or how work is organized in relation to safety and health (Sauter et al. 2003).
METHODS
To build taxonomy of essential PH work a multistep rational methodology was applied: (1) identification of documents describing PH practice; (2) extraction of terms; (3) solicitation of expert opinion; (4) validation with practitioners; and (5) pilot testing of the taxonomy as part of an organizational network survey (Whittaker and Breininger 2008). This is a consensus-based, iterative method that relies on the opinions of experts and practitioners who are knowledgeable about a field that is appropriate to use in the absence of taxonomy development in this domain. The taxonomy is intended to represent a minimum set of tasks, knowledge, and resources. Minimum is defined as the least number of essential items required to document the components of work done in any LHD, not in a particular health department (Trevino 1988).
Identification of Established Practice Documentation
Database and World Wide Web searches were conducted to identify established documents describing PH practice using terms such as “practice,”“process,” and “work.” Such documentation is not well represented in indexed sources (Turner et al. 2009); therefore, the document search relied on the research team's familiarity with the domain (Gebbie and Hwang 1998; Gebbie and Rice 1998; Gebbie 1999a, b; Gebbie and Garfield 2001; Gebbie and Merrill 2001, 2002; Gebbie et al. 2002a, 2003, 2007; Gebbie, Merrill, and Tilson 2002b; Merrill et al. 2003; Merrill 2004; J. Merrill and K. M. Gebbie, unpublished data) and previous taxonomy work (Gebbie and Merrill 2001). Most documents were retrieved from websites of professional associations and other organizations representing the practice community. Documents, sources, and the number of unique terms and concepts extracted from each document are listed in Table 1.
Table 1.
Sources of Terms and Concepts Extracted from Documents Describing Public Health Practice
Unique Terms/Concepts |
||||
---|---|---|---|---|
Title | Source | Task | Resource | Knowledge |
Laboratory Information Management Systems Requirements Document | Association of Public Health Laboratories, 2003 | 25 | 14 | 4 |
2005 National Profile of Local Health Departments | National Association of County and City Health Officials, 2006 | 15 | 0 | 0 |
Taking Care of Business: A Collaboration to Define Local Health Department Business Processes | Public Health Informatics Institute & National Association of County and City Health Officials, 2006 | 28 | 16 | 18 |
Operational Definition of a Functioning Local Health Department | National Association of County and City Health Officials, 2006 | 21 | 15 | 7 |
Local Health Department Accreditation Self-Assessment Instrument | North Carolina Local Health Department Accreditation Board, 2006 | 11 | 114 | 5 |
Local Public Health System Assessment Instrument, Version 1 | National Public Health Performance Standards Program, Centers for Disease Control & Prevention, 2002 | 6 | 37 | 16 |
Master's Degree in Public Health Core Competency Development Project, Version 2.3 | Association of Schools of Public Health Education Committee, 2006 | 0 | 4 | 36 |
Core Competencies for Public Health Professionals | Council on Linkages Between Academia and Public Health Practice, 2001 | 0 | 4 | 36 |
Health People 2010, Chapter 23, Public Health Infrastructure | U.S. Department of Health and Human Services, 2000 | 14 | 57 | 11 |
Total of 544 Unique Terms and Concepts Extracted from Sources | 120 | 267 | 157 |
Extraction of Terms
The researchers manually extracted terms or concepts representing tasks, knowledge, and resources from the practice documents. Two researchers used manual color coding to extract 544 unique terms or phrases each representing a task, an item of knowledge, or a resource used in PH practice. Similar terms and phrases were grouped or consolidated. No terms were discarded. Criteria for this process were based on common understanding of a term and whether it could be considered a synonym or part of a larger category, bearing in mind the overall goal to identify a minimum set of terms. For example, a site visit and a facility survey were considered subordinate to a more inclusive and common task: perform inspections. When there was disagreement the researchers engaged in discussion until they reached consensus on designation of the term. To ensure that terms and concepts adequately represented the range of essential PH work, they were evaluated for scope and sufficiency by mapping into a matrix of 10 essential services (Public Health Functions Steering Committee 1994) and 10 common activities performed in LHDs (National Association of County and City Health Officials 2006). The team iteratively reviewed this matrix to ensure there was adequate coverage in every cross-category. Consensus was reached on a draft list consisting of 77 tasks, 89 resource items, and 77 knowledge items.
Solicitation of Expert Opinion and Identification of a Schema
Expert panel meetings are frequently used to validate a method following the completion of initial development (Hora and Jensen 2002; Sherman et al. 2006;). This technique employs a structured meeting to gather information from relevant experts about an issue. An expert panel was convened to determine the suitability of the draft list of tasks, knowledge, and resources. Eight PH practice experts were identified through literature review and the knowledge of the research team. They were recruited by e-mail, all of those selected agreed to participate, and no substitutions were made. A meeting of the panel was conducted via a web conference facilitated by the researchers. Detailed instructions and a worksheet containing the draft set of terms were distributed in advance. The twofold objective was to reach a consensus on the inclusion or exclusion of each term in the set compiled by the research team and to confirm a classification hierarchy, or schema.
The experts were instructed to apply professional and personal judgment to consider the relevance of each item in relation to the essential work done in any PH department. The experts eliminated or consolidated terms and separated others into more basic elements. For example, a string of terms “cost–benefit analysis; cost–utility analysis; cost-effectiveness analysis” was eliminated from the list of knowledge items because the experts agreed that these terms represented more specialized, nonessential, knowledge. Two resource concepts “current data files on health threats (screening, reportable conditions, environmental)” and “current data files on health status (vital records, mortality, and morbidity data for all population groups)” were reduced to a single concept “local surveillance data.” The expert panel review resulted in a set of 44 tasks, 54 resource items, and 57 knowledge items.
An objective of taxonomies is to define overarching domains within which large numbers of specific instances can be understood in a simplified way (John and Srivastava 1968). An important goal for the expert panel was to determine a hierarchical schema for classifying tasks, knowledge, and resource items. Together with the research team, the experts considered how to categorize terms as each one was discussed. When the discussion reached a decision point on a hierarchical component of the schema, all members of the expert panel were queried. If there was lack of agreement, the discussion continued until consensus was reached. The experts determined that PH tasks, knowledge, and resources share a common dimension that is administrative in nature. From that starting point the experts categorized tasks into two subgroups: administrative or service. Knowledge items were categorized into four subgroups: administrative; analytic; policy and program; and PH science. Resources were also categorized into four subgroups: administrative; data and information; general; and outside partners. The schema is displayed in Figure 2.
Figure 2.
Hierarchical Schema for Taxonomy of Public Health Work
Validation by Practitioners
A focus group was convened to assess whether the expert's results captured essential elements of work from the point of view of practitioners. Focus group research involves discussion with a group of individuals selected for their understanding of a topic (Krueger and Casey 2000). The hierarchy produced by the expert panel was reviewed by a group of 12 local practitioners recruited with the assistance of a county health director. These practitioners represented four levels of the workforce: three administrators, four professionals, two technicians, and three clerical support staff (U.S. Office of Personnel Management 2000). Participants were instructed to consider whether the lists reflected an essential set of tasks, knowledge, and resources items for any LHD. They were asked probing questions: Are there any items that you feel need to be expanded? Are there any items that you feel are too broad and need to be separated? Are the lists getting at the essence of what working in a local health department is like? Are any of the items worded in such a way that the meaning is ambiguous and could possibly be misinterpreted by local health department workers? Each item was discussed. Participants were instructed to comment if they were either unsure of the meaning or felt the term was unsuitable. They were encouraged to suggest items or to comment on wording, including labels used for the hierarchical schema. For example, the group suggested the hierarchical category “Material Resources” as a replacement for “General Resources.” The proceedings were tape recorded and notes were taken by a researcher. Based on the focus group findings a draft was produced containing 43 tasks, 56 resource items, and 55 knowledge items.
Pilot Testing
The draft was used as the basis for a pilot organizational network survey. The survey was administered to a total of about 300 PH employees in a convenience sample of two LHDs that were recruited with the assistance of a state health department. Response rates of 90 and 77 percent were achieved from the two LHDs, respectively. An open text question requested feedback that resulted in changes to the survey format and content, such as more precise wording, consolidation of terms, and additions related to administrative support work. For example, two additional tasks were included: “phone communication with the public” and “use e-mail.” Three tasks—“evaluate staff performance,”“schedule staff,” and “recruit staff”—were merged into a single item “manage staff.” The finalized taxonomy of 44 tasks, 53 knowledge items, and 54 resources is displayed in Table 2.
Table 2.
Taxonomy for Documenting the Essential Elements of Public Health Work Done in Any Local Health Department
Tasks | Knowledge | Resources |
---|---|---|
1.1 Administrative Tasks Manage files, prepare reports and/or correspondence Phone communication with the public Use the Internet to get information Use e-mail Manage inventory Manage personnel (e.g., recruit, schedule, train, and/or evaluate staff) Supervise, plan, or distribute work to others Postinformation for staff use Process requests from the public (for services, information, or appointments) Schedule services and inspections Process billing, fees, and payments Financial management (including manage budgets) Prepare applications for external funding Manage contracts or service agreements Establish fees for public health services Develop public policy and/or regulations Enforce regulations Develop community partnerships Plan public health programs Manage public health programs Evaluate program performance 1.2 Service Tasks Serve on committees, boards, or task forces Register and enroll clients Deliver direct health services to clients Meet with clients Review medical records Conduct site visits, home visits, or inspections Perform health or environmental screenings Review facility operational plans Develop information and training materials Provide education to the public Conduct community assessments Represent the department at community meetings Interact with local or regional media Develop surveillance procedures Investigate health problems, including environmental health Obtain information, specimens, or samples Report data to the county or state Vector control Issue permits Plan for emergencies Respond to emergencies Take part in public health research | 2.1 Administrative Knowledge Workplace safety General office skills (filing, record keeping, writing reports, correspondence) Job descriptions (yours, those who work with you) Chain of command in the health department General operating policy and procedures Mission of the health department The health department's plan for emergency response Human relations/managing people Principles of team learning EEO guidelines Accounting and budget management Contract requirements for the health department Federal or state grant requirements Quality improvement and performance measurement Strategic planning 2.2 Analytic Knowledge Problem solving Assessment (community or individual) Data collection Data analysis Case investigation Program evaluation 2.3 Policy and Program Knowledge Assets and resources in the community HIPPA regulations on confidentiality Multicultural diversity and tolerance Ethics, social justice, human rights principles Authority to operate (laws, regulations, and ordinances related to your work) Health education and training methods Social marketing Health needs and health risks of the community Distribution and determinants of disease in the population Community health improvement methods Community channels for communicating information Ecological model of population health Emerging public health issues (e.g., chronic diseases, bioterrorism) Local policy makers and leaders Utilization of health department services by the public Evidence-based health promotion and disease prevention strategies Strategies for partnership and policy development Benefits and costs of public health programs Risk communication principles Principles of public health screening Participatory decision making Steps of program planning Definition of public health Core functions and essential services of public health Healthy People 2010 goals, objectives, indicators 2.4 Public Health Science Knowledge Biostatistics Epidemiology Basic human biology Environmental health science Social or behavioral science Routine lab tests and diagnostic procedures Genetics and genomics issues in public health | 3.1 Administrative Resources E-mail access Internet access Personal computer workstation Desk space Mobile phone Mobile data collection device (PDA, laptop, tablet) Reliable communication with management team The health department group e-mail (list serve) Trained coworkers Epidemiology staff expert(s) Information technology support (IT staff) Presentation software (e.g., PowerPoint) Geographic information software (GIS) Transportation Distance learning or other continuing education Safe, secure working conditions 3.2 Data and Information Resources Library of resources and scientific evidence (journals or publications) Population health registries (e.g., immunization, lead, cancer, toxicology) Referrals from community providers State health alert network (HAN) State health information network (HIN) Local surveillance data National and state surveillance data Data sharing agreements Public health websites (e.g., CDC, HRSA, EPA) 3.3 Material Resources The health code or local public health laws, regulations and ordinances Health department's media communication plan Healthy People 2010 Community health assessment or improvement plan Up-to-date directory of community groups and organizations Up-to-date directory of laboratories Up-to-date staff directory Time and activity schedules for staff Consumer satisfaction assessment Consumer complaint log Staff development plan and training log Staff performance evaluations Lab kits for collection and testing Health information that is translated and/or culturally appropriate for your clients Surveys, questionnaires, forms for data collection Health department emergency response plan County emergency plan 3.4 Outside Partner Resources State health department consultant Translator Community health advocate State epidemiologist Public health veterinarian State laboratory Other city, county, or state government agencies (private or public agencies) Area health education Center (AHEC) Medicaid and/or Medicare program staff Local emergency planning committee Researchers Legal counsel |
RESULTS
Taxonomy Applied in a Study of LHD Networks
The taxonomy of PH work was used to study organizational networks in a national sample of LHDs. The study had two goals: the first goal, part of which is reported here, consisted of developing and administering a survey to compare LHD networks; the second goal, which will be reported elsewhere, was to examine how LHD networks correlate with system performance. Accordingly, the primary criterion for selecting study sites was recent completion of the National Public Health Performance Standards Assessment, Version 1 (National Public Health Performance Standards Program 2002). Another criterion was size of between 25 and 200 employees, which encompasses roughly 32 percent of LHDs nationally (National Association of County and City Health Officials 2006). This size was targeted for two reasons: to minimize response burden and to optimize the visualizations produced in network analysis by keeping the number of nodes representing employees in the network below 200. Sites were selected to represent a range of jurisdictional characteristics such as populations served (urban, rural, tribal) and type of governance (centralized, independent, home rule, and hybrid; Beitsch et al. 2006). A list of 17 eligible sites was identified by reviewing data from a national survey of LHDs (National Association of County and City Health Officials 2006) and the NPHPS V.1 assessment dataset. Eleven LHDs within six states (Arkansas, Arizona, Florida, Illinois, Montana, New Jersey, and New York) agreed to participate. Reasons LHDs gave for not participating included lack of either interest or capacity to participate in research. A total of 1,064 employees out of 1,267 possible completed the network survey, a mean response rate of 84 percent.
Profile of Essential Work
The organizational network survey asked employees to indicate (1) tasks (a) to which they were assigned as part of normal work, and (b) not assigned but they could back up if needed; (2) items for which they possessed better than average knowledge; and (3) resources (a) readily available when needed for daily work, and (b) either completely unavailable or getting the resource delayed work. The ranking of task, knowledge, and resources documented by these 1,064 PH workers constitutes a profile of essential work performed in 11 LHDs. These results are displayed in Table 3.
Table 3.
Top and Bottom Ranked Tasks, Knowledge, and Resources as Reported by 1,074 Public Health Employees Who Completed a Survey Based on a Taxonomy of Essential Elements of Work Performed in Any Local Health Department
Tasks | % | Backup Tasks | % | Knowledge | % | Adequate Resources | % | Inadequate Resources | % |
---|---|---|---|---|---|---|---|---|---|
Top 10 ranked tasks, knowledge, and resources | |||||||||
Use e-mail | 90 | Research | 44 | Office skills | 83 | E-mail access | 92 | Translator | 27 |
Use Internet | 85 | Supervision | 40 | Job descriptions | 83 | Internet access | 90 | PDA | 25 |
Phone communication | 84 | Respond to emergencies | 39 | Problem solving | 77 | Computer | 89 | Directory of community groups | 23 |
Manage files | 79 | Manage personnel | 38 | Chain of command | 77 | Desk space | 89 | Consumer complaints | 23 |
Meet w/clients | 65 | Postinformation | 37 | Mission | 76 | Department list serve | 87 | County emergency plan | 23 |
Process requests | 62 | Manage inventory | 37 | Workplace safety | 75 | Trained coworkers | 86 | Library of resources | 22 |
Educate public | 59 | Plan for emergencies | 35 | Policy and procedures | 72 | Safe work conditions | 86 | Health info translated | 22 |
Postinformation for staff | 48 | Represent department | 33 | HIPAA regs | 67 | Management team | 79 | Staff development plan | 21 |
Report data | 43 | Serve on committees | 33 | Data collection | 65 | Staff directory | 78 | Continuing education | 21 |
Serve on committees | 43 | Register and enroll clients | 31 | Diversity | 64 | IT staff | 76 | Medicare program staff | 20 |
Bottom 10 ranked tasks, knowledge, and resources | |||||||||
Vector control | 6 | Use e-mail | 5 | Genetics | 15 | Veterinarian | 17 | E-mail access | 3 |
Establish fees | 8 | Use Internet | 10 | Biostatistics | 15 | Researchers | 18 | List serve | 6 |
Issue permits | 10 | Issue permits | 13 | Ecological model | 16 | GIS | 25 | Internet access | 6 |
Develop surveillance | 12 | Manage files | 13 | Screening | 23 | AHEC | 25 | State laboratory | 6 |
Prepare applications for funding | 13 | Phone communication | 13 | Contract requirements | 25 | Data-sharing agreements | 27 | Public health websites | 7 |
Review plans | 15 | Vector control | 14 | Strategies for partnership | 26 | Mobile data collection device | 29 | Computer | 7 |
Develop policy | 16 | Meet w/clients | 17 | Grant requirements | 27 | Directory labs | 30 | Lab kits | 7 |
Interact w/media | 16 | Deliver health services | 17 | Risk communication | 27 | Community health advocate | 30 | Desk space | 9 |
Research | 17 | Review records | 19 | Environmental health | 27 | Local surveillance | 33 | Other government agencies | 9 |
Manage contracts | 18 | Conduct site visits | 19 | Epidemiology | 28 | State epidemiologist | 33 | Trained coworkers | 10 |
Tasks
The tasks assigned to the greatest proportion of employees involve technology and communication: “use e-mail” (assigned to 90 percent of respondents) and “use Internet” (85 percent). Contact with the public, both administrative and service related, is well represented among top tasks: “phone communication with the public” (84 percent), “meet with clients” (65 percent), “process requests from the public” (62 percent), and “educate the public” (59 percent) all rank high among tasks assigned to the greatest proportion of employees. Tasks assigned to the lowest proportion of employees are specialized in nature, such as “develop public policy or regulations” (assigned to 16 percent of respondents), “develop surveillance procedures” (12 percent), and “prepare applications for funding” (13 percent). Task backup capability notably includes “respond to emergencies” (39 percent). Although not ranked in the top 10, another 35 percent of employees indicated that response is part of their assignment.
Knowledge
Top items for which employees possessed better than average knowledge fell into the administrative category. The greatest proportion of employees indicated above average knowledge of “general office skills, such as filing and record keeping, writing reports, and correspondence” (83 percent of respondents). About three quarters of employees indicated better than average knowledge of the health department's mission (76 percent). Knowledge of “HIPAA confidentiality regulations” was indicated by 67 percent of employees. Items for which the smallest proportion of employees indicated above average knowledge included “genetics and genomic issues in relation to practice” (15 percent) and “the ecological model of public health” (16 percent).
Resources
The top adequate resources (available when needed to do work) are also mostly administrative. “E-mail access” and “Internet access” were available to 92 and 90 percent of the respondents, respectively. “Computer workstation” and “desk space” were available when needed by 89 percent of respondents. “Safe working conditions” and “well-trained coworkers” are available to 86 percent of respondents and “IT support” available to 76 percent. About a quarter of employees indicated inadequate resources (i.e., unavailable or getting access created delays) for “translators” (27 percent) and “health information that is translated and/or culturally appropriate for clients” (22 percent).
Correlation of Tasks, Knowledge, and Resources
To confirm the utility of the taxonomy, we performed correlations across 11 sample sites using Kendall's τ, a nonparametric test of correspondence between two rankings (Kendall 1948). We correlated ranked lists of (a) tasks to which employees were assigned to as part of normal work; (b) items for which they possessed better than average knowledge; and (c) resources readily available when needed for daily work. Results demonstrated high correlation regarding tasks and knowledge, but limited correlation regarding resources. Correlation of tasks, ranked by the proportions of employees indicating assignment, yielded coefficients ranging between 0.59 and 0.85 with 69 percent of pairs highly correlated (at >0.70). Correlation of knowledge items, ranked by the proportions of employees indicating better than average knowledge, yielded coefficients ranging between 0.61 and 0.84, with 73 percent of pairs highly correlated (at >0.70). However, correlation coefficients for resources ranked by the proportions of employees indicating access was available when needed, ranged between 0.40 and 0.84, with only 16 percent of health department pairs highly correlated (at >0.70). These results are displayed in Table 4.
Table 4.
Kendall's τ Correlation Coefficients* for Ranked Lists of Tasks Assigned (T), Knowledge Possessed (K), and Resources Available (R) in 11 Local Health Departments (LHDs) of Different Size and with Different Governance
Governance | Size | LHD 1 | LHD 2 | LHD 3 | LHD 4 | LHD 5 | LHD 6 | LHD 7 | LHD 8 | LHD 9 | LHD 10 | ||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Centralized† | 35 | LHD 1 | — | — | — | — | — | — | — | — | — | — | |
43 | LHD 2 | T | 0.75 | — | — | — | — | — | — | — | — | — | |
K | 0.76 | — | — | — | — | — | — | — | — | — | |||
R | 0.69 | — | — | — | — | — | — | — | — | — | |||
Centralized hybrid‡ | 121 | LHD 3 | T | 0.73 | 0.74 | — | — | — | — | — | — | — | — |
K | 0.69 | 0.74 | — | — | — | — | — | — | — | — | |||
R | 0.53 | 0.64 | — | — | — | — | — | — | — | — | |||
115 | LHD 4 | T | 0.72 | 0.75 | 0.81 | — | — | — | — | — | — | — | |
K | 0.72 | 0.74 | 0.83 | — | — | — | — | — | — | — | |||
R | 0.52 | 0.67 | 0.72 | — | — | — | — | — | — | — | |||
187 | LHD 5 | T | 0.76 | 0.85 | 0.8 | 0.81 | — | — | — | — | — | — | |
K | 0.72 | 0.74 | 0.81 | 0.83 | — | — | — | — | — | — | |||
R | 0.59 | 0.73 | 0.71 | 0.74 | — | — | — | — | — | — | |||
Home rule§ | 139 | LHD 6 | T | 0.68 | 0.64 | 0.7 | 0.73 | 0.69 | — | — | — | — | — |
K | 0.64 | 0.7 | 0.74 | 0.74 | 0.76 | — | — | — | — | — | |||
R | 0.57 | 0.69 | 0.65 | 0.59 | 0.61 | — | — | — | — | — | |||
Independent¶ | 115 | LHD 7 | T | 0.77 | 0.72 | 0.74 | 0.74 | 0.75 | 0.64 | — | — | — | — |
K | 0.69 | 0.72 | 0.76 | 0.8 | 0.82 | 0.75 | — | — | — | — | |||
R | 0.6 | 0.71 | 0.65 | 0.59 | 0.66 | 0.68 | — | — | — | — | |||
144 | LHD 8 | T | 0.64 | 0.72 | 0.72 | 0.74 | 0.76 | 0.7 | 0.75 | — | — | — | |
K | 0.69 | 0.68 | 0.68 | 0.68 | 0.72 | 0.72 | 0.69 | — | — | — | |||
R | 0.6 | 0.73 | 0.7 | 0.66 | 0.75 | 0.7 | 0.67 | — | — | — | |||
107 | LHD 9 | T | 0.59 | 0.64 | 0.65 | 0.67 | 0.65 | 0.67 | 0.65 | 0.73 | — | — | |
K | 0.61 | 0.69 | 0.7 | 0.72 | 0.76 | 0.82 | 0.77 | 0.68 | — | — | |||
R | 0.54 | 0.68 | 0.7 | 0.62 | 0.64 | 0.73 | 0.68 | 0.73 | — | — | |||
118 | LHD 10 | T | 0.72 | 0.68 | 0.69 | 0.75 | 0.75 | 0.73 | 0.79 | 0.78 | 0.7 | — | |
K | 0.68 | 0.75 | 0.76 | 0.81 | 0.81 | 0.78 | 0.84 | 0.69 | 0.82 | — | |||
R | 0.52 | 0.63 | 0.54 | 0.58 | 0.61 | 0.62 | 0.61 | 0.6 | 0.64 | — | |||
122 | LHD 11 | T | 0.72 | 0.72 | 0.75 | 0.75 | 0.77 | 0.77 | 0.77 | 0.81 | 0.73 | 0.84 | |
K | 0.71 | 0.79 | 0.72 | 0.76 | 0.77 | 0.79 | 0.77 | 0.74 | 0.81 | 0.82 | |||
R | 0.4 | 0.58 | 0.65 | 0.65 | 0.63 | 0.66 | 0.59 | 0.63 | 0.69 | 0.66 |
All correlations are significant at p≤.05.
LHDs are units of the state health agency.
LHDs are units of the state health agency with a degree of local autonomy.
LHD that has jurisdiction over many local townships and municipalities.
LHDs are units of local government.
DISCUSSION
The taxonomy developed and tested here is a workable way of describing and comparing the essential work that goes on in health departments of different size and with different governance, information that is essential to conduct research about LHD performance. With a functional taxonomy we can raise a series of important questions about PH practice, as the profile in Table 3 and correlations in Table 4 begin to suggest. For example:
PH work has a significant administrative component. Is this dominance related to the core communication aspect (written, oral, and electronic) of all PH activities? Can this profile be viewed in relation to other organizations with a significant administrative service component? Could such comparisons inform system-wide management strategies for LHDs?
Is the low ranking of more technical tasks related to the limited number of specialists available in a typical LHD, or is specialization less important in PH work than assumed?
What does the low ranking of knowledge about the ecological model of population health (a prominent framework for education, training, and research; Institute of Medicine 2003) tell us about the model, or about the workforce?
Do the nearly universal e-mail and Internet access, as well as highly ranked access to computers and IT support, reflect a decade of emergency preparedness funds, or something else?
About 75 percent of employees indicate they either are assigned or have backup capability to respond in emergencies. Who are the 25 percent of employees that do not indicate capability for response? Are there implications for preparedness?
Is inadequate access to translators and translated health materials a reflection of the nation's changing demographics, a different scope of PH services being provided, or something else?
Limited correlations between LHDs on resources may not be surprising, given the range of funding for LHDs. Is lack of correlation related primarily to funding variance or to something else?
IMPLICATIONS
Beyond the exploratory questions suggested above, data collected using the taxonomy will enable exploratory analyses to examine the distribution of tasks and their association with resources and knowledge. This can contribute to a more precise picture of how work is accomplished in local PH, allow exploration of appropriate redundancies in PH work, and potentially suggest systemic strategies for management. In theory, with an expanded dataset such research might be extended to produce falsifiable predictions of performance in LHDs.
Taxonomy is the organization of a particular set of information for a particular purpose (Rappaport 2008). A classification of PH work can serve two main purposes: as a tool for research it provides a practical resource for documenting PH work; and it establishes a framework for further development. Taxonomy is always a contentious issue because the world does not come to us arranged in tidy packages (Gould 1981), and the value of taxonomy at any stage of development is in its application. The survey developed with this taxonomy produced standardized comparable data that supported local management decisions and that potentially can inform system-wide infrastructure development (Merrill and Carley 2008). It is an expectation that this taxonomy will be revised and expanded by researchers and practitioners who use it (Bazzoli et al. 1999; Bazzoli, Shortell, and Dubbs 2006; Luke 2006;). This taxonomy does have the advantage of being readily adapted to circumstances within real PH organizations because it is based on practice documentation and expert consensus.
The taxonomy is a first step toward developing a shared understanding of the work done in local PH. It lays a foundation for a controlled set of terms for representing information electronically in computer systems similar to the terminologies available in nursing and medicine (Werley et al. 1991; Kleinbeck 1996; McCloskey and Bulechek 2000; Pulakos, Arad, and Donovan 2000; Yeung, Chan, and Lee 2003; Chang et al. 2005; Cimino 2006; American Medical Association 2008; Lee et al. 2008;). Future steps include establishing common definitions for all terms and evaluating these for consistency, completeness, and conciseness (Gomez-Perez 1995). Formal representation with Unified Modeling Language would allow visualization and further understanding of the concepts involved, which is a prerequisite for computational interoperability among heterogeneous systems such as those designed for finance, education, quality assurance, and research purposes (Object Management Group 2008).
The current state of knowledge about exactly how PH work is accomplished is insufficient to support modern analytic approaches in systems and policy research (Lenaway et al. 2006). Studies to inform both organizational management and policy development at all levels of government require data beyond what is currently available about PH organizations (Gebbie et al. 2007). Until common data elements and vocabulary are more widely available, this work will proceed slowly. As the discipline of Public Health Services and Systems Research emerges, it is incumbent upon members of this community to lay foundations for a sound and comparable body of knowledge with an array of data tools and resources.
Acknowledgments
Joint Acknowledgment/Disclosure Statement: The research described here was supported by a 2006 Pfizer Public Health Scholar Award, a research grant from the Robert Wood Johnson Foundation, and a subaward from the National Institute of Nursing Research through the Center for Evidence-Based Practice in the Underserved, Columbia University School of Nursing, P20-NR07799. Jonathan Keeling is a predoctoral trainee in the Department of Biomedical Informatics at Columbia University, funded by the National Library of Medicine, T15-LM007079. The authors thank Angela Wantroba, who at the time of the study was a doctoral student at the Columbia University School of Nursing, for assistance in the early phase of this research.
Disclosures: None.
Disclaimers: None.
Supporting Information
Additional supporting information may be found in the online version of this article:
Appendix SA1: Author Matrix.
Please note: Wiley-Blackwell is not responsible for the content or functionality of any supporting materials supplied by the authors. Any queries (other than missing material) should be directed to the corresponding author for the article.
REFERENCES
- American Medical Association. Current Procedural Terminology. Chicago: American Medical Association; 2008. [Google Scholar]
- Association of Public Health Laboratories and Public Health Informatics Institute. Requirements Document for Public Health Laboratory Information Management Systems. Washington, DC: Association of Public Health Laboratories; 2003. [Google Scholar]
- Association of Schools of Public Health. “Master's Degree in Public Health Core Competency Development Project, Version 2.3” [accessed on September 2006]. Available at http://www.asph.org/userfiles/version2.3.pdf.
- Bazzoli G, Shortell S, Dubbs N, Chan C, Kralovec P. An Organizational Taxonomy of Health Networks and Systems: Bringing Order out of Chaos. Health Services Research. 1999;33(6):1683–717. [PMC free article] [PubMed] [Google Scholar]
- Bazzoli GJ, Shortell SM, Dubbs NL. Rejoinder to Taxonomy of Health Networks and Systems: A Reassessment. Health Services Research. 2006;41(3, part 1):629–39. doi: 10.1111/j.1475-6773.2006.00525.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Beitsch LM, Grigg M, Menachemi N, Brooks RG. Roles of Local Public Health Agencies within the State Public Health System. Journal of Public Health Management and Practice. 2006;12(3):232–41. doi: 10.1097/00124784-200605000-00003. [DOI] [PubMed] [Google Scholar]
- Beitsch LM, Mays G, Corso L, Chang C, Brewer R. States Gathering Momentum: Promising Strategies for Accreditation and Assessment Activities in Multistate Learning Collaborative Applicant States. Journal of Public Health Management and Practice. 2007;13(4):364–73. doi: 10.1097/01.PHH.0000278029.33949.21. [DOI] [PubMed] [Google Scholar]
- Bertalanffy LV. General System Theory. New York: George Braziller; 1968. [Google Scholar]
- Bureau of Labor Statistics. “Standard Occupational Classification (SOC)” [accessed on August 17, 2008]. Available at http://www.bls.gov/SOC/
- Burton RM, Opel B. Strategic Organizational Design: Developing Theory from Application. Boston: Kluwer; 1998. [Google Scholar]
- Carley KM. ORA: Organizational Risk Analyzer (Release Software) Pittsburgh, PA: Center for Analysis of Social and Organizational Systems; 2007. [Google Scholar]
- Carley KM, Wallace WA. Computational Organization Theory: A New Perspective. In: Gass S, Harris CM, editors. Encyclopedia of Operations Research and Management Science. Norwich, MA: Kluwer Academic Publishers; 2001. pp. 126–131. [Google Scholar]
- Centers for Disease Control and Prevention. National Public Health Performance Standards Program” [accessed on July 5, 2008]. Available at http://www.cdc.gov/od/ocphp/nphpsp/
- Centers for Disease Control and Prevention and National Public Health Performance Standards Program. “Local Public Health Performance Assessment Instrument, Version 1.0” [accessed on September 2006]. Available at http://www.cdc.gov/od/ocphp/nphpsp/Documents/Local_v_1_0MB_0920-0555.pdf.
- Chang A, Schyve PM, Croteau RJ, O'Leary DS, Loeb JM. The JCAHO Patient Safety Event Taxonomy: A Standardized Terminology and Classification Schema for Near Misses and Adverse Events. International Journal of Quality Health Care. 2005;17(2):95–105. doi: 10.1093/intqhc/mzi021. [DOI] [PubMed] [Google Scholar]
- Cimino JJ. In Defense of the Desiderata. Journal of Biomedical Informatics. 2006;39(3):299–306. doi: 10.1016/j.jbi.2005.11.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Colwell RR. “Investing in Federal Science and Technology: Integrating Our Research Portfolio, Testimony of the Director of the National Science Foundation before the Senate Science and Technology Caucus” [accessed on August 1, 2009]. Available at http://www.nsf.gov/news/speeches/colwell/rc90303stcaucus.htm.
- Council on Linkages between Academia and Public Health Practice. “Core Competencies for Public Health Professionals” [accessed on September 2006]. Available at http://www.phf.org/link/corecompetencies.htm.
- Donabedian A. Explorations in Quality Assessment and Monitoring. Ann Arbor, MI: Health Administration Press; 1980. [Google Scholar]
- Exploring Accreditation Planning Committee. Exploring Accreditation: Final Recommendations for a Voluntary National Accreditation Program for State & Local Public Health Departments. Princeton, NJ: Robert Wood Johnson Foundation and Centers for Disease Control and Prevention; 2006. [Google Scholar]
- Gebbie K. The Public Health Workforce: Key to Public Health Infrastructure [Editorial] American Journal of Public Health. 1999a;89(5):660–1. doi: 10.2105/ajph.89.5.660. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gebbie K. Who's Minding the Public Health Store? [Editorial] Journal of Public Health Management Practice. 1999b;5(3):vii–viii. doi: 10.1097/00124784-199905000-00002. [DOI] [PubMed] [Google Scholar]
- Gebbie K, Garfield R. Public Health Nursing and Essential Public Health Functions: A Basis for Practice in the Twenty-First Century. New York: Columbia University School of Nursing, Center for Health Policy; 2001. [Google Scholar]
- Gebbie K, Hwang I. Preparing Currently Employed Public Health Professionals for Changes in the Health System. New York: Columbia University School of Nursing, Center for Health Policy; 1998. [Google Scholar]
- Gebbie K, Merrill J, Sanders L, Gebbie E, Chen DW. Public Health Workforce Enumeration: Beware the ‘Quick Fix’. Journal of Public Health Management and Practice. 2007;13(1):72–9. doi: 10.1097/00124784-200701000-00012. [DOI] [PubMed] [Google Scholar]
- Gebbie K, Rice R. Toward a Practical Curriculum for Currently Employed Public Health Nurses: Summary of Public Health Nursing Planning Retreat. New York: Columbia University School of Nursing, Center for Health Policy; 1998. [Google Scholar]
- Gebbie KM, Merrill J. Enumeration of the Public Health Workforce: Developing a System. Journal of Public Health Management Practice. 2001;7(4):8–16. doi: 10.1097/00124784-200107040-00003. [DOI] [PubMed] [Google Scholar]
- Gebbie KM, Merrill J. Public Health Worker Competencies for Emergency Response. Journal of Public Health Management and Practice. 2002;8(3):73–81. doi: 10.1097/00124784-200205000-00011. [DOI] [PubMed] [Google Scholar]
- Gebbie KM, Merrill J, Hwang I, Gebbie E, Gupta M. The Public Health Workforce in the Year 2000. Journal of Public Health Management and Practice. 2003;9(1):79–86. doi: 10.1097/00124784-200301000-00011. [DOI] [PubMed] [Google Scholar]
- Gebbie KM, Merrill J, Hwang I, Gupta M, Btoush R, Wagner M. Identifying Individual Competency in Emerging Areas of Practice: An Applied Approach. Qualitative Health Research. 2002a;12(7):990–9. doi: 10.1177/104973202129120403. [DOI] [PubMed] [Google Scholar]
- Gebbie KM, Merrill J, Tilson H. The Public Health Workforce. Health Affairs. 2002b;21(6):57–67. doi: 10.1377/hlthaff.21.6.57. [DOI] [PubMed] [Google Scholar]
- Gomez-Perez A. Some Ideas and Examples to Evaluate Ontologies. Proceedings of the 11th Conference on Artificial Intelligence for Applications, IEEE Computer Society.
- Gould SJ. The Mismeasure of Man. New York: Norton; 1981. [Google Scholar]
- Handler A, Issel M, Turnock B. A Conceptual Framework to Measure Performance of the Public Health System. American Journal of Public Health. 2001;91(8):1235–9. doi: 10.2105/ajph.91.8.1235. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hora S, Jensen M. Expert Judgment Elicitation. Oslo: Swedish Radiation Authority; 2002. [Google Scholar]
- Institute of Medicine. The Future of the Public's Health in the 21st Century. Washington, DC: National Academy Press; 2002. [Google Scholar]
- Institute of Medicine. Who Will Keep the Public Healthy? Educating Public Health Professionals for the 21st Century. Washington, DC: National Academy of Medicine; 2003. [PubMed] [Google Scholar]
- John OP, Srivastava S. The Big-Five Trait Taxonomy: History, Measurement, and Theoretical Perspectives. In: Pervin L, John OP, editors. Handbook of Personality: Theory and research. New York: Guilford; 1968. pp. 102–138. [Google Scholar]
- Kendall M. Rank Correlation Methods. London: Charles Griffin & Company Limited; 1948. [Google Scholar]
- Kleinbeck SVM. In Search of Perioperative Nursing Data Elements. AORN Journal. 1996;63(5):926–31. doi: 10.1016/s0001-2092(06)63104-9. [DOI] [PubMed] [Google Scholar]
- Krackhardt D, Carley KM. A PCANS Model of Structure in Organizations. Paper presented at the International Symposium on Command and Control Research and Technology, Monterey, CA.
- Krueger R, Casey MA. Focus Groups: A Practical Guide for Applied Research. Thousand Oaks, CA: Sage Publications; 2000. [Google Scholar]
- Lee S, Alexander J, Wang V, Margolin F, Combes J. An Empirical Taxonomy of Hospital Governing Board Roles. Health Services Research. 2008;43(4):1223–43. doi: 10.1111/j.1475-6773.2008.00835.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lenaway D, Halverson P, Sotnikov S, Tilson H, Corso L, Millington W. Public Health Systems Research: Setting a National Agenda. American Journal of Public Health. 2006;96(3):410–3. doi: 10.2105/AJPH.2004.046037. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lichiello P. Guidebook for Performance Measurement. Seattle, WA: Turning Point National Program Office, University of Washington; 1999. [Google Scholar]
- Luke RD. Taxonomy of Health Networks and Systems: A Reassessment. Health Services Research. 2006;41(3, part 1):618–28. doi: 10.1111/j.1475-6773.2006.00524.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mays GP. Understanding the Dimensions of Public Health Delivery Systems: Theory, Evidence, and Unanswered Questions. White Paper presented at the AcademyHealth Public Health Systems Research Stakeholder Meeting, Washington, DC.
- McCarthy I. Manufacturing Classification: Lessons from Organizational Systematics and Biological Taxonomy. Integrated Manufacturing Systems. 1995;6(6):37–48. [Google Scholar]
- McCloskey JC, Bulechek GM. Nursing Interventions Classification (NIC) St. Louis: Mosby-Year Book; 2000. [PubMed] [Google Scholar]
- Merrill J. Reasoning for Emergency Public Health Risk Communication. In: Fieschi M, Coiera E, Li J, editors. Proceedings of the 11th World Congress on Medical Informatics (MedInfo) San Francisco: International Medical Informatics Association; 2004. p. 1757. [Google Scholar]
- Merrill J, Carley KM. Early Findings from a Comparative Network Analysis of Local Public Health Organizations. AcademyHealth, Public Health Systems Research Interest Group Meeting. Washington, DC: AcademyHealth.
- Merrill J, Btoush R, Gupta M, Gebbie K. A History of Public Health Workforce Enumeration. Journal of Public Health Management and Practice. 2003;9(6):459–70. doi: 10.1097/00124784-200311000-00005. [DOI] [PubMed] [Google Scholar]
- Nadler DA, Tushman ML. Strategic Organization Design: Concepts, Tools, and Processes. Glenview: Scott Foresman; 1988. [Google Scholar]
- National Association of County and City Health Officials. “Operational Definition of a Functional Local Public Health Agency” [accessed on September 2006]. Available at http://www.naccho.org.
- National Association of County and City Health Officials. Survey Instrument, 2005 National Profile of Local Health Departments. Washington, DC: National Association of County and City Health Officials; 2005. [Google Scholar]
- National Association of County and City Health Officials. The 2005 National Profile of Local Health Departments. Washington, DC: National Association of County and City Health Officials; 2006. [Google Scholar]
- National Cancer Institute. “Building the Nation's Cancer Research Capacity: Developing Bioinformatics for Cancer Research” [accessed on July 5, 2008]. Available at http://plan2004.cancer.gov/capacity/informatics.htm.
- National Institutes of Health. “NIH Roadmap for Medical Research” [accessed on July 5, 2008]. Available at http://nihroadmap.nih.gov/
- North Carolina Association of Local Health Directors Accreditation Committee. “Health Department Self-Assessment Instrument” [accessed on July 5, 2007]. Available at http://nciph.sph.unc.edu/accred/health_depts/materials/index.htm.
- Object Management Group. Unified Modeling Language (Release 20) Software. Needham, MA: Object Management Group; 2008. [Google Scholar]
- Public Health Foundation. From Silos to Systems: Using Performance Management to Improve the Public's Health. Seattle, WA: Turning Point Performance Management National Excellence Collaborative; 2004a. [Google Scholar]
- Public Health Foundation. Performance Measurement in Public Health: A Literature Review. Seattle, WA: Turning Point Performance Management National Excellence Collaborative; 2004b. [Google Scholar]
- Public Health Functions Steering Committee. Public Health in America: Vision, Mission, and Essential Services. Washington, DC: U.S. Public Health Service; 1994. [Google Scholar]
- Public Health Informatics Institute. “Taking Care of Business: A Collaboration to Define Local Health Department Business Processes” [accessed on September 2006]. Available at http://www.phii.org/resources/doc_details.asp?id=104.
- Pulakos ED, Arad S, Donovan MA. Adaptability in the Workplace: Development of a Taxonomy of Adaptive Performance. Journal of Applied Psychology. 2000;85(4):612–24. doi: 10.1037/0021-9010.85.4.612. [DOI] [PubMed] [Google Scholar]
- Rainey HG. Comparing Public and Private Organizations: Empirical Research and the Power of the a Priori. Journal of Public Administration Research and Theory. 2000;10:447–69. [Google Scholar]
- Rappaport A. “Search Tools for Web Sites and Intranets” [accessed on October 2008]. Available at http://www.searchtools.com/info/classifiers.html.
- Rasmussen J, Pejtersen AM, Schmidt K. “Taxonomy for Cognitive Work Analysis” [accessed on November 2008]. Available at http://infoscience.epfl.ch/record/51879.
- Salinsky E, Gursky S. The Case for Transforming Governmental Public Health. Health Affairs. 2006;25(4):1017–28. doi: 10.1377/hlthaff.25.4.1017. [DOI] [PubMed] [Google Scholar]
- Sanderson PM. Cognitive Work Analysis. In: Carroll J, editor. HCI Models, Theories, and Frameworks: Toward an Interdisciplinary Science. New York: Morgan-Kaufmann; 2003. pp. 225–64. [Google Scholar]
- Sauter S, Brightwell W, Colligan M, Hurrell JJ, Jr, Katz TM, LeGrande DE, Lessin N, Lippin RA, Lipscomb JA, Murphy LR, Peters RH, Keita GP, Robertson SR, Stellman JM, Swanson NG, Tetrick LE. DHHS (NIOSH) Publication No. 2002-116. Atlanta: DHHS (NIOSH); 2003. The Changing Organization of Work and the Safety and Health of Working People: Knowledge Gaps and Research Directions. [Google Scholar]
- Scott JG, Tallia A, Crosson J, Orzano AJ, Stroebel C, DiCicco-Bloom B, O'Malley D, Shaw E, Crabtree B. Social Network Analysis as an Analytic Tool for Interaction Patterns in Primary Care Practices. Annals of Family Medicine. 2005;3(5):443–8. doi: 10.1370/afm.344. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sherman KJ, Dixon MW, Thompson D, Cherkin DC. Development of a Taxonomy to Describe Massage Treatments for Musculoskeletal Pain. BMC Complementary and Alternative Medicine. 2006;6(1):24. doi: 10.1186/1472-6882-6-24. [accessed on August 1, 2009]Available at http://www.biomedcentral.com/1472-6882/6/24. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Thompson JD. Organizations in Action Social Science Bases of Administrative Theory. New York: McGraw Hill; 1967. [Google Scholar]
- Trevino FM. Uniform Minimum Data Sets: In Search of Demographic Comparability. American Journal of Public Health. 1988;78(2):126–7. doi: 10.2105/ajph.78.2.126. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Turner AM, Petrochilos D, Nelson DE, Allen E, Liddy ED. Access and Use of the Internet for Health Information Seeking: A Survey of Local Public Health Professionals in the Northwest. Journal of Public Health Management and Practice. 2009;15(1):67–9. doi: 10.1097/01.PHH.0000342946.33456.d9. [DOI] [PubMed] [Google Scholar]
- U.S. Department of Health and Human Services, Office of Disease Prevention and Health Promotion. Healthy People 2010: Understanding and Improving Health. 2d Edition. Washington, DC: U.S. Government Printing Office; 2000. [PubMed] [Google Scholar]
- U.S. Office of Personnel Management. Federal Civilian Workforce Statistics: Occupations of Federal White-Collar and Blue-Collar Workers (September 1999) Washington, DC: U.S. Government Printing Office; 2000. [Google Scholar]
- Werley H, Devine EC, Zorn CR, Ryan P, Westra BL. The Nursing Minimum Data Set: Abstraction Tool for Standardized, Comparable, Essential Data. American Journal of Public Health. 1991;81(4):421–6. doi: 10.2105/ajph.81.4.421. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Whittaker M, Breininger K. Taxonomy Development for Knowledge Management. Paper presented at the 74th General Conference and Council of the World Library and Information, Quebec, Canada.
- Woodward J. Industrial Organization: Theory and Practice. London: Oxford University Press; 1965. [Google Scholar]
- Yeung A, Chan L, Lee TS. An Empirical Taxonomy for Quality Management Systems: A Study of the Hong Kong Electronics Industry. Journal of Operations Management. 2003;21(1):45–62. [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.