Development of Detailed Clinical Models for Nursing Assessments and Nursing Interventions

Abstract

Objectives

The aim of this study was to develop and validate Detailed Clinical Models (DCMs) for nursing assessments and interventions.

Methods

First, we identified the nursing assessment and nursing intervention entities. Second, we identified the attributes and the attribute values in order to describe the entities in more detail. The data type and optionality of the attributes were then defined. Third, the entities, attributes and value sets in the DCMs were mapped to the International Classification for Nursing Practice Version 2 concepts. Finally, the DCMs were validated by domain experts and applied to case reports.

Results

In total 481 DCMs, 429 DCMs for nursing assessments and 52 DCMs for nursing interventions, were developed and validated. The DCMs developed in this study were found to be sufficiently comprehensive in representing the clinical concepts of nursing assessments and interventions.

Conclusions

The DCMs developed in this study can be used in electronic nursing records. These DCMs can be used to ensure the semantic interoperability of the nursing information documented in electronic nursing records.

I. Introduction

As health care grows more complex and the boundaries among health professionals become increasingly blurred, the ability to communicate effectively about patient care is more important than ever [1]. In addition, as health care organizations transition from paper to electronic documentation systems, data collected from an electronic documentation system should be able to be reused for a purpose other than the original; such as the continuity of care and decision support on the individual level, quality measurement, and management of healthcare institutions [2,3].

One of the main challenges of sharing and reusing healthcare data is the semantic interoperability of data collected. Semantic interoperability is defined as the ability for data shared by systems to be understood at the level of fully defined domain concepts [3,4]. Semantic interoperability ensures that exchanged information be understood by any other systems or applications not initially developed for [3,5].

To achieve semantic interoperability it is necessary to have standards, not just for terminology to represent data but also structure of data to be transferred [5]. One way to ensure semantic interoperability would be to represent data with standardized terminology, in which each clinical concept is unique and clearly defined. However, there is no terminology covering all domains of health care currently available. Besides a terminology to represent all concepts of health care is not realistic and thus not desirable [5-7]. In addition to standardized terminology to represent data collected, it is necessary to have data model to capture context where and how data were collected [7]. Data model expresses clinical concepts in a standardized and reusable manner [8]. One of data model called Detailed Clinical Models (DCMs) consists of entity-attribute-value triplets. An entity is a core or focus concept of a data element. An attribute is a qualifier that represents a data entity in more detail, and is associated with possible values. A value set, in turn, represents a uniquely identifiable set of valid concept representations of an attribute. These models represent the information a clinician may want or need to report about patients, which are highly related and clinically meaningful for clinicians. In addition, these models enable to create and systematically organize clinical information or knowledge in specific contexts to conform to requirements of data capture [7-11].

There have been several different researches to develop data models in health care. Examples are Intermountain Healthcare Clinical Element Models (CEMs), 13606/openEHR archetype, HL7 templates, Dutch Detailed Clinical Model, and Clinical Contents Model [12-15]. However, these efforts are limited to the domain of medical knowledge. Though the importance of developing data models in nursing has been addressed by many nurse informaticists [8], there is only one report on this topic in nursing literature by Goossen [16], except research results published by the authors of this paper [17-20]. Goossen [16] developed data specifications for stroke patients that have been developed in the Netherlands and the authors of this paper developed DCMs of nursing problems for breast cancer patients, nursing problems for maternal care, nursing assessment for cancer survivors, and nursing information for initial assessment in Korea. These researches were only pilot studies which showed the possibility of model development in nursing domain.

Therefore, it is necessary to develop data models to represent comprehensive nursing concepts covering patient health status and nursing activity. The purpose of the present study was to develop and validate DCMs to represent clinical contents of nursing assessments and interventions to be implemented in electronic nursing records.

II. Methods

This study was carried out in two steps: first, DCMs were developed by identifying entities, attributes, and values and linking them; second, DCMs were validated by the domain experts.

1. Development of DCMs

1) Identifying entities, attributes, and values

The entities, key concepts of data elements were extracted from various sources. First, we extracted entities by analyzing narrative nursing statements used to document nursing care in electronic nursing records system in a tertiary teaching hospital in Korea. For example, 'pain' entity was extracted from narrative nursing statements such as 'complain of pain', 'severe pain persist', 'acute pain in abdomen', 'RUQ pain present', and 'no pain in IV site'. Second, we extracted entities by reviewing concepts of International Classification for Nursing Practice (ICNP) version 2. Concepts such as 'hopelessness', 'colic pain', and 'drinking pattern' were extracted from ICNP version 2. Third, we extracted entities by reviewing nursing literatures and clinical practice guidelines. Concepts such as 'skin condition', 'back pain', and 'chemotherapy induced vomiting' were extracted from the nursing literatures and clinical practice guidelines.

The attributes of entities, which are qualifier or modifier to represent the entities in more detail, were also identified by analyzing narrative nursing statements; reviewing ICNP concepts, nursing literature, and clinical practice guidelines; and interviewing the domain experts. For example, we identified 'anatomical site' attribute from the following statements: 'pain in abdomen', 'pain in back', and 'RUQ pain'.

Then, we categorized attributes by referring to characterizing categories of the ISO/DTS 22789, a conceptual framework for patient findings and problems in terminologies [21], semantic domains of the ISO 18104, a reference terminology model for nursing [22], and qualifier values of the Systematized Nomenclature of Medicine Clinical Terms.

Possible values of attributes were identified again by analyzing narrative nursing statements; reviewing ICNP concepts, nursing literature, and clinical practice guidelines; and interviewing the domain experts.

2) Linking entities, attributes, and values

We modeled DCMs by linking an entity and its corresponding attributes with values, and specifying data types and optionality of the attributes. Data type of attributes was selected from the ISO/DIS 20190 Health Data Type Standard [23]. Examples are 'BL: boolean', 'SC: character string with coded', 'INT: integer number', 'TS: point in time', 'CO: coded ordinal', 'REAL: real number', and 'ST: character string'. Optionality of attributes was specified by interviewing domain experts. Optionality of attributes can be either mandatory (attribute must be used) or optional (attribute may be used).

Then, we conducted an internal validation. During internal validation, each model was refined through reviewing the similar entities, related entities, and opposite entities and through repeated consultation with domain experts. The concepts in entity-attribute-value triplets of DCMs were mapped to ICNP version 2, which is a reference terminology in nursing.

2. Validation of DCMs

The adequacy of DCMs was validated by eight domain experts who were nurses with graduate level informatics training and clinical nursing experience more than five years. To ensure reliability of validation among eight experts, the experts were taught validation process with 10 DCMs. The experts then validated additional 40 DCMs randomly assigned to them using questionnaire for inter-rater reliability. In the questionnaire, experts were asked whether the entities were clearly represented and reusable in nursing practice; attributes and value sets were mutually exclusive, inclusive, consistent, and relevant to represent entities; and data type and optionality of each attribute were relevant to represent entities. The items of the questionnaire were scored on 4-point rating scale (from 1 = strongly disagreed to 4 = strongly agreed). We asked the experts to provide comments when they rated DCMs with score 1 or 2. Inter-rater reliability was 0.782 (p = 0.016).

For actual validation, four groups of two experts validated 481 DCMs. We calculated a content validity index (CVI) for the validation of the DCMs. A CVI of 0.80 or higher is generally acceptable [24,25].

After validation, we invited all of the eight domain experts and convened a meeting to further discuss DCMs with score 1 or 2. In the meeting, each expert explained why they rated specific DCMs with score 1 or 2. These DCMs were refined by the consensus building process among eight experts.

III. Results

1. Development of DCMs

In total, 429 entities of nursing assessments and 52 entities of nursing interventions were extracted. Three hundred seventy five entities (77.9%) were extracted from narrative nursing statements, 61 entities (12.7%) from ICNP version 2, and 45 entities (9.4%) from nursing literatures and clinical practice guidelines.

Entities of nursing assessments were classified into 22 categories such as demographics, administration process, and intentional process (Table 1). Entities of nursing interventions were classified into five categories such as performing, managing, attending, determining, and informing (Table 2). Attributes concepts of nursing assessments were classified into 11 categories such as timing, anatomical site, target, and degree (Table 3). Attributes concepts of nursing interventions were classified into 11 categories such as target, means, and recipient (Table 3).

Table 1.

Categories of nursing assessment entities

Table 2.

Categories of nursing interventions entities

Table 3.

Categories of attributes for nursing assessments and interventions

Table 4 depicts 'pain' DCM as an example DCM of nursing assessments. 'Pain' DCM has 12 attributes, including severity, severity_VisualAnalogueScale, anatomical site, onset, progression, occurrence, duration, character_pain, frequency, regularity, time sequence, and radiation. Four concepts were identified as values to express severity of pain and were mapped to ICNP concepts. Data type of severity attribute was expressed in a coded value. To describe pain, severity attribute was necessary, and other attributes were desirable. Entities, attributes, and values concepts were mapped to ICNP version 2 concepts. For example, 'pain' was mapped to '10013950 Pain' of ICNP.

Table 4.

Detailed clinical model of pain

ICNP: International Classification for Nursing Practice, VAS: Visual Analogue Scale.

'Teaching' DCM as example DCM of nursing interventions was presented in Table 5. 'Teaching' entity has seven attributes: target, material, device, method, recipient, duration, and place. Concepts such as exercise, diet, wound care, and ambulation were identified as values of target attribute of teaching DCM. Data type of target attribute was a coded value. To describe teaching, target attribute is required and material, device, method, recipient, duration, and place attributes are recommended. Entities, attributes, and values concepts were mapped to ICNP version 2 concepts. For example, 'teaching' was mapped to '10019502 Teaching' of ICNP.

Table 5.

Detailed Clinical Model of teaching

ICNP: International Classification for Nursing Practice.

2. Validation of DCMs

CVI between the two experts ranged from 0.87 to 0.96 (Table 6). A CVI score of 0.80 or better is generally considered to have a good content validity. DCMs rated as either 1 or 2, in total 115 DCMs, were modified and refined. The domain experts rated 4 DCMs as either 1 or 2 for irrelevant naming of entities. They suggested changing names of the entities to clearly reflect nursing practice. 'Vascular pain' was renamed to 'phlebitis' based on the suggestion of nurse experts.

Table 6.

Content validity index for 481 DCMs between two experts

Content validity index (CVI) is the percentage of Detailed Clinical Models (DCMs) rated by the experts as either 3 or 4 on a 4-point scale (from 1 = strongly disagreed to 4 = strongly agreed).

They rated 12 DCMs as either 1 or 2 for incompleteness of attributes and values. They suggested adding additional attributes and values. For example, 'alcohol' DCM originally has four attributes, including previous alcohol consumption, current alcohol consumption, amount, and duration of alcohol consumption. Frequency of alcohol consumption attribute was added to the 'alcohol' model. They rated 54 DCMs as either 1 or 2 for inconsistency of attributes and values. They suggested adding attributes and values to describe the presence or absence of each entity in DCMs. If it is important to document absence of a problem, such as pain and discomfort, we added presence/absence attribute with absent as one of value set. On the other hand, if it is not important to document absence of a problem, such as macular, we did not add presence/absence attribute.

They rated 45 DCMs as either 1 or 2 for irrelevant optionality of attributes. For example, optionality of severity attribute of 'depression' DCM was changed from optional to mandatory based on the recommendation of the experts.

IV. Discussion

The purpose of this study was to develop DCMs for nursing assessments and interventions. We developed 481 DCMs in this study, which is about 1.5 times more than the number of archetypes developed in the openEHR for the entire domain of medicine [26]. The DCMs we developed had covered content of patient problems and nursing activity.

When we identified attributes of the entities, we found small number of attributes from narrative nursing statement such as severity, presence or absence, and increase or decrease of signs and symptoms. This implies that nurses do not document nursing assessment as precisely as described in the literature or as recommended by the domain experts [18].

We also encountered a few challenges during the development of DCMs. The first challenge was how to select nursing sensitive entities for DCMs in nursing. Entities we identified could be classified as entities for nursing only problems such as self esteem and disturbed body image; entities for shared problems between nursing and medicine such as unconsciousness, pain, and malnutrition; and entities for medicine only problems such as spider hemangiomas. We decided not to develop DCMs for entities for medical problems in this study. The DCMs we developed for shared problems between nursing and medicine could have different attributes from DCMs developed in medicine, because nurses view and document the same entity differently from other health care professionals. For example, blood pressure can be represented with various attributes such as anatomical site, position, cuff size, and device. However, 'blood pressure' DCM we developed does not have attributes such as confounding factor found in the 'blood pressure' model developed in medicine because it is not easy for nurses to make judgment on contributing factors to the blood pressure [26]. Data can be shared between nursing and medicine domains as long as the structure and meaning of data are the same. However, if structure and meaning of data are not the same, complex interfaces are required to share data between nursing and medicine domains.

The second challenge we faced was that entities have different abstract levels. For example, musculoskeletal pain is a super concept of arthritis pain, bone pain, and muscle pain. Another example is the relationship between pain and labor pain which is a type of pain. One way to reflect different abstract level in DCMs would be to introduce the hierarchies of DCMs.

The third challenge we faced was that entities can be nested. To avoid nesting problem in nursing assessment DCMs, we did not include related or contributing factors to patient problems in DCMs. For example, 'coughing' DCM could have 'allergy' as one of related factors, which can be modeled separately. We removed nesting problem in nursing intervention DCMs by excluding qualifying or modifying factors. For example, 'assessing' DCM could have 'discharge' as one of assessment target with its own attributes and value sets, which can be modeled as a separate patient problem.

We found that value set of attributes developed for a DCM can be reused in the other DCM. For example, value set of severity attribute describing degree of pain in 'pain' DCM can be reused in describing degree of febrile sense. We also found that two different DCMs can have exactly the same attributes and value sets. For example, 'grief' and 'guilt' DCMs have the same attributes such as severity, progression, duration, frequency, onset, and occurrence with the same value sets. These findings imply reusability of the attributes and value sets in DCM development.

The DCMs developed in this study were validated by the domain experts. The domain experts rated reusability, clarity, mutual exclusiveness, inclusiveness, consistency, and relevancy of the DCMs on a 4-point scale (from 1 = strongly disagreed to 4 = strongly agreed). This validation method was used because there are no tools and gold standards available to evaluate the quality of the data models such as DCMs. Quality and usability of the DCMs developed in this study can be further evaluated when these models are implemented in the electronic nursing records system.

DCMs of nursing assessments and interventions were developed to represent comprehensive contextual data and information in a more consistent manner. The DCMs developed in this study can be used in the electronic nursing record system to ensure semantic interoperability of nursing data. DCMs can be used for both structured and unstructured data entry in the electronic nursing records system. For structured data entry, DCMs can be used for designing sections and templates of nursing forms. For unstructured data entry, DCMs can be used to generate narrative statements. Once the DCM-based electronic nursing record system is developed, it is expected to see the improvement in the quality of data collected in terms of reusability, portability, granularity, flexibility, and redundancy, and quality of nursing care in terms of patient outcomes.