Confirmatory factor analysis model of factors affecting the implementation of clinical guidelines in Iran

Abstract

Background: Clinical guidelines refer to a developed scientific statement to help physicians and patients for decision-making about the best care for special clinical conditions, which can be an important document to shape evidence-based medicine. This study aimed to identify factors affecting the implementation of clinical guidelines in Iran to enhance the quality of services.

Methods: This descriptive analytical study was performed with combined quantitative-qualitative method in the first half of 2019. The statistical population consisted of 400 health managers and experts who were selected through multistage sampling method in 5 regions of Iran (north, south, center, east, and west). Overall, 20 academic experts were selected from each university. For data collection, a researcher-made questionnaire (n = 400) was used. To measure face and content validity, content validity ratio (CVR) and content validity index (CVI) were used. Also, to determine reliability, test-retest method, with Cronbach’s alpha coefficient of 0.934 was used. For data analysis, Lisrel 8.8 and SPSS 24 were used. Finally, fitness indices were used to determine the fitness of the model.

Results: Six factors, including organizational (9 components), organizational culture (8 components), the clinical guidelines feature (8 components), insurance (7 components), and trusteeship of the health care system (8 components) were identified as the main dimensions. The economic dimension had the maximum effect on implementing clinical guidelines (0.90), while the clinical guidelines feature (0.63) and organizational culture (0.63) showed the minimum extent of effect on implementing clinical guidelines.

Conclusion: Evidently, imposing the mentioned interventions with the ultimate goal of sustainable behavior change in providing health care services requires contribution of all practitioners, presentation of suitable facilities for implementing clinical guidelines based on evidence, time and personnel management, training methodology and planning, developing the necessary infrastructure, supervision, and developing professional and legal motivation.

↑ What is “already known” in this topic:

In previous studies, there is no general model for implementing clinical guidelines in Iran. Also, the factors affecting the implementation of clinical guidelines in Iran have not been identified.

→ What this article adds:

This study is the first study for identifying the managerial factors influencing the implementation of clinical guidelines.

In the clinical guideline model, factors affecting the implementation of the guidelines have been identified.

This model helps policymakers and managers in implementing clinical guidelines.

This model provides the context for improving the quality of services provided by health care providers.

Introduction

The main reason for the different practices in similar health care is the gap between knowledge production and its consequences. Measuring the “gap” between evidence and actual practice or policy-making is one of the first steps in knowledge translation (1). By evidence, we mean the best available research-based evidence (2). Ideally, this evidence should come from high-quality practice guidelines or systematic reviews (3). To fill this gap, in recent years, the evidence-based method has attracted a great deal of attention (4, 5). This method is an international priority in an attempt to improve the quality of health care and has been defined as integrating clinical experience with high quality evidence and patient priority (6, 7). Clinical guidelines refer to a developed scientific statement to help the patient and physician for decision-making about the best care for special clinical conditions, which can be an important document to shape evidence-based medicine (8, 9). Development and implementation of instructions aim to organize and present the best available evidence to support clinical decision-making to improve health care quality, outcome of patients, effectiveness, and cost reduction (10-14). Clinical guidelines are categorized and provide information to help the decision-making of medical teams, with the aim of improving patients care. Therefore, this study aimed to identify the factors influencing the implementation of clinical guidelines in Iran (15). Accordingly, clinical instructions can help the executors to improve professional performance in hospitals and also enhance the performance level of different groups of health care providers, quality of care, and patients’ outcome (16).

In countries, such as USA and the Netherlands, around 30%-40% of patients do not receive evidence that the patients receive the treatments that are not required or are even sometimes harmful. Indeed, there is a gap between what is currently available and the best evidence-based medical treatment (17). Not following instructions may result in inessential diagnosis and inadequate or unfocused treatment (18). The investigation by Wolpert et al in London revealed many obstacles against the use of evidence and its implementation. The major obstacles include lack of time, lack of knowledge, lack of medical resources, negative attitude to evidence, and financial constraints (19). In the investigation by Kabana et al, lack of awareness, limited familiarity, and disagreeing with clinical guidelines were found to be the main obstacles in approving clinical guidelines. Furthermore, this investigation concluded that the main obstacle can be attributed to the simple fact that sometimes physicians are not aware of the existence of special clinical guidelines (16). In addition, the findings of a qualitative study in Iran indicated the obstacles for creating, developing, and implementing clinical guidelines include the context of practice, evidence-based health care systems, professionality of individuals, supportive policymakers and political context, innovation, and patients (20).

A study in Tehran indicated only 31.8% of physicians were aware of clinical instructions for presenting health care services. The obstacles against implementation, according to these people, included lack of awareness of development of clinical instructions and evidence-based performance (37%), being time-consuming and tedious (70%), unavailability (60%), lack of skill of physicians in using clinical guidelines (31%), and absence of the necessary conditions and facilities (65%) (21). Furthermore, the authors developed a framework in which these obstacles were categorized into 3 main groups: the obstacles related to physician’s knowledge (eg, lack of awareness and unfamiliarity), obstacles affecting the attitude of physicians (eg, absence of agreement and lack of motivation), and external factors (patient-associated factors, the feature of guidelines, and environmental factors) (9, 22, 23). Furthermore, the results obtained from a study in Iran showed 39% of the participants had very little familiarity with EBM databases and only 12.7% of these databases were very familiar (24).

The implementation strategies should be based on the current knowledge about effective interventions and evaluating the potential obstacles to approve guidelines (25, 26). Evaluating the obstacles and facilitators to implement clinical instructions is the first step to adapt and approve localized evidence (27). Clinical instructions can improve the quality of health care services, but there are a number of challenges in adopting and implementing the instructions (11). Therefore, given the investigations performed in Iran, there are problems in implementation of the guidelines, including absence of adequate studies about the obstacles of implementation and unavailability of a suitable executive model. Therefore, to motivate the authorities to select development policies and use clinical guidelines, this study aimed to identify factors affecting the implementation of clinical guidelines in Iran.

Methods

This descriptive analytical study was performed using Mix method that combined quantitative-qualitative method in 2019. The study population was selected from the managers, directors, deputies, and heads of medical universities in Iran, the experts, and middle managers and heads of the medical departments in medical sciences universities. The sample size was 400 and participants were selected by multistage sampling at 5 regions in the country (north, south, east, west and center); in each region with 4 universities and 5 quotas, they were assigned into the clusters. A total of 20 experts were selected from each university.

In this study, information form and questionnaire were used to collect data. In the initial stage, all relevant studies were conducted on the barriers and facilitators, knowledge and attitude, and the impact of factors on the implementation of clinical guidelines in Iran and worldwide by referring to libraries and searching the internet in Persian and non-Persian databases. In the internet search Persian and English keywords were deliberately studied and all relevant factors were extracted by taking notes. An interview was conducted with experts and in the field of formulating clinical guidelines to extract additional information. Then, the initial questionnaire was designed. The first section included gender, age, education level, management history, work place, and field of study. The second section included 47 questions about the factors influencing the implementation of clinical guidelines in dimensions and related factors. To ensure the reliability of the questionnaire, the initial sample was selected using the test-retest method by selecting 50 people. Based on the number of evaluators (n = 20), the minimum acceptable value of CVR and CVI was 0.42 and 0.79, respectively. Also, in the CVR survey, 47 items scored above 0.42, and the CVI results showed all items received a score above 0.8. Finally, out of 62 variables of the initial questionnaire, according to the CVR and CVI, 47 variables were finalized. The content validity rate and content validity index for the whole questionnaire were calculated 0.9 and 0.9. To investigate the validity of the questionnaire, formal validity and content validity were used in 2 quantitative and qualitative methods, including content validity ratio (CVR) and content validity index (CVI) using a 20-person panel. Based on the number of evaluators, the minimum acceptable values of CVR and CVI were 0.42 and more than 0.79, respectively. The confirmatory factor analysis (CFA) with covariance-based approach was used to verify the fitness of the measuring tool (questionnaire) and Lisrel 8.8 and SPSS 24.0 software. Also, goodness-of -fit indices )c²/df, RMSEA, NFI, NNFI, CFI, IFI, GFI ) were used to determine pattern fitness. In the present study the following fundamental principles were taken into consideration as the ethical considerations: coordination with the Ministry of Health and Medical Education through an introduction letter, provision of the required explanations of the projects and their objectives to the experts, voluntary participation in the study, so that the participations could withdraw from the study in each stage, anonymous responses to the questionnaire items, and confidential data analysis.

Results

The results indicated the mean ± SD of age in the participants was 40.53±6.86 years, with a standard deviation of 6.86.

The maximum frequency in the variable of gender was related to men with 230 (57.5%) participants, while the maximum frequency regarding the level of education was associated with medical subspecialty with 118 individuals (29.5%). Considering working experience, the greatest frequency was related to the group with 15-20 years of experience, with a frequency of 105(26.3%). Also, regarding management background, the maximum frequency was related to the group with 5-10 years of experience, with the frequency of 128 (32%). Regarding the field of study, the highest frequency was in the field of health care services management, with a frequency of 86 people (21.5%) (Table 1).

Table 1. Demographics of the participants .

Sex	Age	Education Level	Job Experience	Management Experience	Field of Study	N (%)
Male						230 (42.5)
Female						170 (57.5)
	<30					46 (11.5)
	30-35					43 (10.8)
	35-40					77 (19.3)
	40-45					90 (22.5)
	>45					144 (36)
		Master's degree				69 (17.3)
		PHD				76 (19)
		Public doctorate				56 (14)
		Medical expertise				64 (16)
		Super specialist doctor				118 (29.9)
		Fellowship				17 (4.3)
			<5			38 (9.5)
			5-10			65 (16.3)
			10-15			94 (23.5)
			15-20			105 (26.3)
			20>			98 (24.5)
				<5		76 (19)
				5-10		128 (32)
				11-20		121 (30.3)
				>20		75 (18.8)
					Health care service management	86 (21.5)
					Medical	76 (19)
					Nursing	40 (10)
					Urologist	20 (5)
					Internist	42 (10.5)
					Specialist of infectious diseases	2 (0/5)
					Pediatrician	24 (6)
					Medical files	1 (0/3)
					Cardiologist	14 (3.5)
					Traditional medicine	1 (0/3)
					Policymaking	2 (0/5)
					Emergency specialist	13 (3.3)
					Neurologist	7 (1.8)
					General surgeon	5 (1.3)
					Health economics	8 (2)
					Midwifery	9 (2.3)
					Medical nutrition	3 (0/8)
					Gynecologist	8 (2)
					ENT specialist	5 (1.3)
					Orthopedist	4 (1)
					Endocrinologist	19 (4.8)
					ocular surgeon	7 (1.8)
					Medical education	4 (1)

In the qualitative phase of studying the results of reviewing resources, a 6-dimensional model suggests the following dimensions: organizational (9 components), organizational culture (8 components), the clinical guidelines feature (8 components), insurance (7 components), and trusteeship of the health care system (8 components) (Table 2).

Table 2. Extracted factors affecting the implementation of clinical guidelines .

Factors	Components
Insurance: B1- B7	Correcting the payment system	Aggregating the resources of insurer organizations	Optimal and strategic purchase of services	Insurance tariffs	Supplying financial resources	Preparing, designing and developing incentive packages by insurers	Integrated function of insurer organizations
Healthcare system trusteeship: T1-T8	The necessity of integrated healthcare system	Improving the structure and resolving the methodologic problems of guidelines	Developing regulations and bylaws and supervising the implementation	Existence of a practical evidence-based system	Paying attention to professional features and the strategy of implementing instructions	Support of managers and decision-makers institutions	Time and personnel management	Resolving simulation in clinical setting
Economic factor: E1-E7	The necessary investments for realizing implementation of guidelines	Financial profit in the using clinical guidelines	Developing the necessary infrastructures for implementing guidelines	Caring for the cost of access to evidence	Caring for clinical uncertainty	Availability of budget and resolving budget constraints	Multidimensionality of health phenomenon
Organizational factors: S1-S	Proper structure of the organization and development of the organization	Interaction and cooperation in development sectors to implement the clinical guidelines	Holding training courses in the academic education and constant training	Caring for clinical guidelines in policymaking under macro conditions	Developing behavior adaptation and approving guidelines in case of availability of evidence and the alternative to the best method	Ability, skill, and experience employing the research findings in the healthcare	Familiarity, developing motivation, and attempts for teamwork	Changing the attitude of employees to reliability, importance, and usefulness of instructions	Attracting the cooperation and contribution of beneficiaries
The features of clinical guidelines: L1-L8	The potential of localizing the guidelines in the country	Implementability of guidelines across all patients	Practicalizing guidelines	Convenience in implementing clinical guidelines	Access to higher-quality evidence	Sufficient production and publication in the number and distribution of clinical guidelines	Availability of a clear protocol for production and adaptation	Resolving the ambiguity of clinical guidelines
Organizational culture: F1-F8	Corresponding to patient needs	Interaction between physician and patient	Adequate notification to the patient	Developing collaboration and commitment for following up the course of treatment by the patient	Taking the patient preferences into account	Correspondence with previous experiences of using guidelines	Understanding the patient need to guidelines and patient adaptation	Physician understanding, generalizing the research findings to the patient population

Results

The results indicated the mean ± SD of age in the participants was 40.53±6.86 years, with a standard deviation of 6.86.

To analyze the confirmed factor, the data and the studied responses were used according to the proposed structure. The results of goodness-of-fit indices for the model are presented in Figure 1, suggesting approval of the studied index. Also, the value of the approximate error of the approximation variance (RMSEA) was equal to 0.61. Also, the adaptive fitness index (CFI), the fitness index (GFI), the incremental fitness index (IFI), and the normal fitness index (NFI) were all good, so the fit model was good and confirmed (Table 3).

Fig. 1.

General structure of the confirmatory factor analysis in standardized coefficient state

Table 3. Indicators of confirmatory factor analysis model .

IFI>0.9	CFI>0.9	GFI<0.8	NFI>0.9	RMSEA<0.08	x2/ df<3
0.95	0.95	0.79	0.92	0.061	2.50

In general, and considering the calculated indices, goodness-of-fit of the model can be concluded. With loading factors, the economic dimension had the maximum effect on implementing clinical guidelines (0.90), while the clinical guidelines feature (0.63) and organizational culture (0.63) showed the minimum extent of effect on implementing clinical guidelines.

Discussion

The present study aimed to identify the most important effective factors on creating a system for developing and implementing clinical guidelines and the loading value of each factor on the principal components in the context of Iran. Clinical performance guidelines (CPGs) are considered as one of the knowledge products that aim to improve clinical services, help in decision-making for physicians and patients, function as a means for insurance with the aim of controlling the costs, and help governments in policymaking or prioritizing health care (28, 29).

Six groups of the influential factors were identified after analysis, some of which have also been mentioned in other frameworks and models. For example, in coordinated implementation model , the most important factors were organizational setting, education, economic factors, social, and administrative factors and eventually the personal environment of individuals, and the role of information, motivation, existence of regulations, and patient conditions (30). Furthermore, Thorsen mentioned some factors, such as knowledge, attitude, and skills of the patient and physician and organizational and economic factors, as the obstacles against implementing guidelines. In this study the effect of support of managers, thought of leaders, professionality of individuals, organizational efficiency, the characteristic of colleague groups, and other service providers have been mentioned (31). In another model which also propounds the clinical performance setting, a combination of economic, organizational, cultural, and policymaking effects has been mentioned as influential factors. In addition, this model emphasizes the effect of the ability of implementation, awareness, and attitude of physicians (20). Financial interventions in the present study referred to disciplinary and motivational interventions. Generally, financial interventions focus on service providers or patients (32). As long as financial incentives and the payment system are not corrected, adhering to clinical guidelines cannot be expected (14).

Other studies have included the following barriers to the implementation of clinical guidelines:

1. Knowledge, attitude, and behavior change of patients and physicians (20);

2. Characteristics of clinical guidance, including ambiguity and simplicity (32);

3. Environmental factors, such as lack of time, lack of sufficient resources, and payment system problems.

Furthermore, in other relevant studies, the most common obstacles against implementation of guidelines in the health care system have been mentioned as research obstacles, limited support of colleagues, and obstacles of change (33, 34). Poor communication, deficiency of technical abilities of policymakers, limited capacity for conducting clinical research, constraint of resources, legal processes, infrastructures, equipment, and the recognized market, and resolving the budget constraints, lack of valid support for altering the leadership, and diminished leadership power were also mentioned as the main obstacles against implementing guidelines (8, 16, 35-38). In addition, such factors as presence of contradictory instructions and environmental factors, including lack of time, refund system (8), organizational constraints, and the increased understanding of the need to implement clinical guidelines, have been mentioned as obstacles against implementing clinical guidelines (39).

Absence of an evidence-based health care system has been one of the main reasons behind the attempts of economic development of evidence-based practice (EBP) over the past decade in Iran (40). Indeed, absence of an evidence-based health care system and improper political support on macro scale in Iran as a developing country have challenged the creation of a system for developing and implementing clinical performance guidelines (CPG) (41). Studies conducted in Iran on the awareness and attitude of physicians about CPG have suggested inadequate familiarity of physicians as the most important factor in failure to implement clinical guidelines (24, 42, 43).

Inadequate production and publication of CPGs might be one of the reasons of the unfamiliarity with CPG by physicians. In a study, most physicians stated they had access to a limited number of CPGs and used them in their clinical practice. The findings of a study in the US indicated over half of physicians have changed their clinical methods based on CPG, while 3% did not use it in their practice (44). Successful implementation of the guidelines involves development, publication, and implementation (9). The organizations involved in production of guidelines should develop the strategies for publicizing guidelines for timely delivery of information, reducing the complexity of clinical guidelines for physicians, and producing simple and understandable clinical guidelines (45). In qualitative studies conducted on the influential factors on implementing clinical guidelines, the factors were found to be approving the subject and content, approving the references, organizational factors, patient characteristics, and the strategies of publication of journals (33). A supportive organizational culture can act as a catalyst for EBP implementation with respective factors, including available information, abundant sources for developing change, and skillful personnel to change the practice, having prerequisite skills, and powerful leadership (46).

Therefore, the results of the present study and those of similar studies suggest that along with the trend of corresponding and developing CPG, planning should also be done for their implementation. The mentioned interventions have been implemented with the following final goals:

• Make sustainable behavior change in health care providers;

• Involve all service providers;

• Provide appropriate facilities for the implementation of evidence-based clinical guidelines in health care centers;

• Time management;

• Human resources management;

• Provide training to properly search for clinical guides;

• Create the necessary infrastructure;

• Have adequate planning, supervision, and guidance;

• Create professional and legal motivation.

Conclusion

Evidently, promoting the mentioned interventions with the ultimate goal of sustainable behavior change in providing health care services requires the following steps: contribution of all practitioners and health service providers, presentation of suitable facilities for implementing clinical guidelines based on evidence, time and personnel management, training methodology and planning, development of the necessary infrastructure, supervision, and development of professional and legal motivation.

Acknowledgement

This work was extracted from a PhD thesis. The authors would like to thank all who cooperated in this study, including the heads and employees of Ministry of Health and Medical Education.

Conflict of Interests

The authors declare that they have no competing interests.

Cite this article as: Kimiaeimehr F, Hosseini SM, Alimohammadzadeh Kh, Bahadori M, Maher A. Confirmatory factor analysis model of factors affecting the implementation of clinical guidelines in Iran. Med J Islam Repub Iran. 2020 (16 Sep);34:122. https://doi.org/10.34171/mjiri.34.122