Feedback Survey of the Effect, Burden, and Cost of the National Endoscopic Quality Assessment Program during the Past 5 Years in Korea

Abstract

Background/Aims

In Korea, the nationwide gastric cancer screening program recommends biennial screening for individuals aged 40 years or older by way of either an upper gastrointestinal series or endoscopy. The national endoscopic quality assessment (QA) program began recommending endoscopy in medical institutions in 2009. We aimed to assess the effect, burden, and cost of the QA program from the viewpoint of medical institutions.

Methods

We surveyed the staff of institutional endoscopic units via e-mail.

Results

Staff members from 67 institutions replied. Most doctors were endoscopic specialists. They responded as to whether the QA program raised awareness for endoscopic quality (93%) or improved endoscopic practice (40%). The percentages of responders who reported improvements in the diagnosis of gastric cancer, the qualifications of endoscopists, the quality of facilities and equipment, endoscopic procedure, and endoscopic reprocessing were 69%, 60%, 66%, 82%, and 75%, respectively. Regarding reprocessing, many staff members reported that they had bought new automated endoscopic preprocessors (3%), used more disinfectants (34%), washed endoscopes longer (28%), reduced the number of endoscopies performed to adhere to reprocessing guidelines (9%), and created their own quality education programs (59%). Many responders said they felt that QA was associated with some degree of burden (48%), especially financial burden caused by purchasing new equipment. Reasonable quality standards (45%) and incentives (38%) were considered important to the success of the QA program.

Conclusions

Endoscopic quality has improved after 5 years of the mandatory endoscopic QA program.

INTRODUCTION

In Korea, a nationwide gastric cancer screening program was started in 1999 as part of the National Cancer Screening Program (NCSP) [1]. The NCSP recommends biennial gastric cancer screening for men and women aged 40 years or older by way of either an upper gastrointestinal series or endoscopy [2]. The gastric cancer screening program has reduced the incidence and mortality of gastric cancer, but the degree of success is highly variable [3].

The National Endoscopy Quality Assessment program was initiated in 2009 for quality control of endoscopic screening protocols. The National Cancer Center and the National Health Insurance Service (NHIS) organized the program in cooperation with the Korean Society of Gastrointestinal Endoscopy (KSGE) [4,5]. For medical institutions that perform screening endoscopies, five domains of endoscopic quality are assessed annually: qualifications of endoscopists, endoscopic unit facility and equipment, endoscopic procedure, outcome of endoscopy, and endoscopic reprocessing.

To achieve successful implementation of the quality assessment (QA) program, good communication between the testing institution and the tested medical institution is essential. We surveyed medical institutions nationwide on their perceptions of the endoscopic QA program. We aimed to identify the influences on real practice, key components for success of the QA program, and level of difficulty of implementation from the viewpoint of each institution.

MATERIALS AND METHODS

This survey was conducted from November 2014 to January 2015 by the KSGE ethics and quality control committee. An e-mail-based or post-based survey was utilized. The KSGE ethics and quality control committee approved the questionnaire. More than a hundred doctors or head nurses working in medical institutions or health-screening centers that perform screening endoscopy were invited to participate. The anonymous responses were collected after 1 week either by post or in person by committee members.

Survey development and structure

A comprehensive questionnaire was developed through review of the current endoscopic QA protocol and literature. The questionnaire dealt with self-assessment of endoscopic quality in all measurable domains, the costs associated with the program, and the administrative burden felt during preparation of the QA audit. All responses were anonymous, and the questionnaire was designed to take 15 to 20 minutes to complete. It consisted of several sections: (1) responder demographics; (2) questions regarding current status of the national endoscopic QA program; (3) questions regarding the proper management of institutions that did not pass the audit; (4) questions regarding how much the quality has improved (self-assessment); (5) questions regarding burden and cost; and (6) quality improvement (QI) of endoscopic reprocessing.

RESULTS

General characteristics of the endoscopic units

Doctors and nurses in the endoscopic units of 67 medical institutions responded to the survey. Among them, 79% were nurses, and the remainder were doctors. The median numbers of doctors and nurses from each institution were 14 (interquartile range [IQR], 5 to 15) and 14 (IQR, 8 to 16). More than one endoscopic specialist worked at 54 institutions, all doctors were endoscopic specialists at 39 institutions, and doctors worked as endoscopists at 13 institutions. The average numbers of endoscopies and colonoscopies performed per year were more than 3,000 at 50 institutions and more than 100 at 42 institutions. Thirty-three institutions had large endoscopic units performing more than 10,000 endoscopic screenings per year (Table 1).

Table 1.

General Subject Characteristics

Characteristic	Value
No. of medical institutions involved in this survey	67
No. of doctors, median (IQR)	14 (5–15)
No. of nurses, median (IQR)	14 (8–16)
No. of nursing assistants, median (IQR)	3 (1–3)
No. of other members, median (IQR)	1 (1–2)
Specialties of the doctors
Physician+Endoscopic specialist±Family doctor	14
Physicians	13
General surgeon+Endoscopic specialist	1
Endoscopic specialist	39
Mean no. of endoscopies performed/year
10,000 or more	33
5,000–9,999	12
3,000–4,999	5
1,000–2,999	13
500–999	2
<500	2

IQR, interquartile range.

Questions regarding the current status of the national endoscopic QA audit

Regarding the question, “How do you perceive the effect of the QA program?” 93% of responders said that the national QA program raised awareness of endoscopic quality and improved their practices (n=27, 40%), whereas others answered that their practices had not changed much (n=40, 53%). The remainder answered that their perceptions of endoscopic quality had not changed despite the QA program (n=3, 6%)(Table 2).

Table 2.

Questions Regarding the Current Status of the Endoscopic Quality Assessment Program

	No. (%)
How much did you feel the endoscopic quality assessment (QA) program influenced endoscopic practices in the institution?
Successful (It improved endoscopic practices)	27 (40)
Somewhat successful (It raised awareness of endoscopic quality, but practice has not changed much)	36 (54)
The perception of endoscopic quality has not changed.	4 (6)
If you feel that the endoscopic quality improvement (QI) program has not been successful, what do you think the causes are? (Double choices permitted)
The standards ignore the realities of medical institutions	29
Too much administrative burden to prepare it	28
Cost to prepare it	15
Indifference to it	14
Psychological aversion to it	6
Inability to comprehend the standards	2
What do you think is the most important factor needed to make the endoscopic QI program successful? (Double choices permitted)
The standard considering the reality of the practices	45
Incentives (all types) for institutions that achieve QA in practice	38
The change in perception of the quality of medical institutions	25
Effective promotions for the QA program	9
Cooperation from medical institutions	6

Regarding the question, “What do you think is the most important factor for the success of the endoscopic QA program?” most responders chose acceptable quality standards for the medical institution (n=45). Other answers included incentives (all types) for institutions that achieved high-quality practice (n=28) and changes in institutions’ perceptions. Regarding the question, “If you feel that the QA program has not been successful, what do you think the causes are?” most responders said that standards that ignore the needs of real practice (n=29) or too much of an administrative (n=28) or financial (n=25) burden.

Regarding the question “what is the proper management strategy for institutions that did not pass the audit?”

Regarding the question, “If you have to be reeducated, why do you think this is the case?” more than 50% of responders said they were chosen because their units are high-volume endoscopic centers rather than because of a low quality score. Others said it was because they had not prepared the audit well, or they had a poor unit facility, or they had low diagnostic accuracy for gastric cancer. There was no answer regarding poor endoscopic processing. Regarding the proper management strategy for institutions that did not pass the audit, 50% of participants identified reeducation as the proper protocol (Table 3).

Table 3.

Questions Given to Those Who Did Not Pass the Endoscopic Quality Improvement Program

	Number
If you were chosen for reeducation, what do you think the reason was?
Our unit has a high endoscopic volume.	30
We did not prepare the quality improvement (QI) audit properly.	11
Our endoscopic unit facility is poor.	2
The diagnostic sensitivity for cancer is low.	1
We have poor endoscopic reprocessing.	0
We would not be chosen to be reeducated (or question not answered).	25
What do you think would be the proper management strategy for institutions that did not pass the audit?
Reeducation	50
Repeat of audit until they pass	9
Warning or penalty	8
Do you disagree with warnings or penalties? If so, why?
Disagree	34
Penalties are not good methods for achieving quality assessment (QA).	16
Accurate audits are difficult under the current criteria.	11
The penalties imposed on medical institutions are too harsh.	7

Questions regarding how much the quality has improved

When asked to self-assess their degree of improvement, 60%, 66%, 80%, and 82% of participants reported improvements in diagnostic accuracy for detecting gastric cancer, improvements in qualifications of endoscopists (which involves more continuing medical education [CME] courses on gastrointestinal endoscopy), improvements in management of endoscopic unit facilities, and improvements in endoscopic procedure, respectively. Regarding endoscopic reprocessing, 75% responded that it had improved, and 21% responded that it had greatly improved (Fig. 1).

Fig. 1.

Improvements in endoscopic quality after 5 years of the endoscopic quality improvement program. The data are shown as percentages.

Questions regarding burden and cost

Of the responders, 52% were conscious of considerable burden and/or high costs while they prepared the endoscopic QA audit (Table 4). Regarding the question, “What were the difficulties encountered while preparing the QA audit?” most responders answered that they could not be sure whether they had prepared well (n=29), or that facility standards were not clearly defined (n=21), or that they had had difficulty in meeting the criteria (n=21). Proving total endoscopic volume (n=6) or obtaining CME (n=3) in regard to endoscopists’ qualifications was difficult. The other answers regarded how they check frequently asked questions, how they downloaded documents or forms, how they were notified of audit results, and how they perceived the results.

Table 4.

What Were the Costs and Administrative Burdens of Preparing the Endoscopic Quality Assessment Audit?

	No. (%)
Negligible, but the practice got somewhat disrupted	8 (12)
Not too much	24 (36)
Considerable burden or cost	35 (52)

Regarding costs spent in preparing the QA audit, 54% of participants answered that they had attended CME courses more than twice to meet the criteria for qualification; 7% and 3% had bought new endoscopes or colonoscopes, respectively, to meet facility criteria; and 3% had purchased endoscopic hemostatic devices (e.g., hemoclips), emergency supplies (emergency drugs such as epinephrine, Ambu bags, laryngoscopes), emergency carts, or pulse oximeters. Some staff members said they had bought new containers for endoscopic storage (18%), new automated endoscopic preprocessors (3%), and supplies for endoscopic reprocessing (4%). Regarding administrative costs, some responders referenced new documents for endoscopic procedures, new endoscopic reports (23%), new informed consent protocols for sedated endoscopy (24%), new discharge criteria (16%), drug treatment guidelines (19%), and pre-endoscopy checklists (24%).

Quality improvement of endoscopic reprocessing

Regarding endoscopic reprocessing, 21% of staff members answered that it had been improved significantly. Some responders said they had bought a new automated endoscopic preprocessor (3%), and some reported greater consumption of disinfectants (34%), longer washing times (28%), or reduced numbers of endoscopies per day to adhere strictly to reprocessing guidelines (9%). Others reported they had bought new washing or reprocessing equipment (10%). In addition, 60% of institutions had designed their own education programs to control endoscopic quality; 41% of participants said they already had their own autoclave or ethylene oxide gas sterilizer; 85% of staff said they had undergone education for endoscopic reprocessing; and 31% said they had designed their own reprocessing education protocols.

DISCUSSION

Although the incidence and mortality rates of gastric cancer are decreasing, it remains one of the major cancers in Korea. The NCSP, launched in 1999, provides free cancer screening for common cancers, including gastric cancer. The gastric cancer screening program recommends biennial gastric cancer screening for those aged 40 years or older by way of either an upper gastrointestinal series or endoscopy. Korea is the only country that uses endoscopy for gastric cancer screening [3].

In Korea, increasing the quality of endoscopy has become an important priority in recent years. That agenda became organized into a more coordinated effort led by the National Cancer Center, the NHIS, and the KSGE. A national endoscopy QA program, initiated in 2009, aimed to enhance the quality of medical institutions and improve the effectiveness of the NCSP. Korean endoscopic quality standards were initially designed by a broad systemic review of other endoscopic quality guidelines and discussions with experts [6-8]. The standards comprise five domains: qualifications of endoscopists, endoscopic unit facilities and equipment, endoscopic procedure, outcomes of endoscopy, and endoscopic reprocessing. Quality standards have improved in the past 5 years, supported by the KSGE and the NHIS. All institutions at which endoscopic screening is performed should undergo an annual QA audit implemented by the NHIS. We aimed to investigate the effects of the national endoscopic QA program on endoscopic practice and perceptions, burden, and costs of QA activity—especially from the viewpoints of medical institutions that conduct endoscopic screening.

The most-promising results of this survey are the perception that QI has enhanced significantly at 93% of the medical institutions since the national endoscopic QA program was initiated. QI even improved endoscopic practice in 40% of practices but had not yet influenced practice in 53%. Those results show that the QA program is somewhat successful.

Approximately 80% of responders answered that all aspects of endoscopic quality had improved: qualifications of endoscopists, the endoscopic unit facility and equipment, endoscopic procedure and outcomes, and reprocessing. The rate of detection of gastric cancer had also increased, according to 80% of responders. CME in endoscopy for nonendoscopic specialists is mandatory to meet the criteria for endoscopists’ qualifications, and 60% of participants answered that they had taken additional CME courses to prepare for the QA audit despite that the majority were already endoscopic specialists. Such education explains indirectly why detection of gastric cancer has increased since implementation of the QA program [9,10].

QIs in the endoscopic unit facility and reprocessing were prominent. Quality indicators of endoscopic reprocessing include endoscope washing time, amounts of disinfectant used, and strict adherence to reprocessing guidelines, all of which were improved. Education and importance perception regarding reprocessing have been widespread. Some institutions said they had bought new automated preprocessors at high cost. Endoscopic reprocessing is an important issue associated with patient safety. The national QA program emphasizes strict adherence to endoscopic reprocessing guidelines. A qualitative evaluation by the KSGE in 2014 revealed several problems, such as reuse of disposable accessories, transport of contaminated endoscopes in a sealed container, and lack of eyewear, all of which require improvement [11]. Most responders selected (1) financial problems such as medical insurance fees for endoscopic procedures and (2) large quantities of endoscopic examinations as the two most common causes of difficulty in complying with guidelines. However, the KSGE survey showed that the quality of endoscopic reprocessing has improved compared with results from the survey conducted 5 years previous. Periodic surveillance and practitioners’ education in reprocessing should be continued.

Many participants indicated that adherence to quality standards should be rigorous, considering the current realities of medical institutions. Because screening endoscopy can be performed in small Korean clinics by nonendoscopic specialists to meet nationwide demand, the target level of the facility or equipment is likely to meet only minimum quality requirements. In particular, endoscopic facilities’ quality standards were set based on small clinic size. Despite that, most responders complained that their facilities’ ability to meet the quality criteria was one of the most difficult aspects of the program. In reality, anyone interested in the national QA program can easily access the protocols online and download the documents. Effective and intense promotions to the public represent an important strategy for overcoming indifference and psychological aversion.

Finding small defects early would reduce errors, lower overall costs, and improve patient satisfaction [12]. But despite the advantages of the program, the preparation of a QA audit represents a financial and administrative burden from the viewpoint of medical institutions. In this survey, medical institutions said they had taken on the cost of endoscopists’ CME and bought new equipment such as endoscopes or colonoscopes and even new automatic reprocessors. Creating new documents, implementing new systems, and designing education protocols for quality or reprocessing would be costly and time-consuming. The heavy workload and cost may justify criticisms that say the current standard does not consider the reality of clinics or institutions despite the fact that most of the institutions surveyed had large endoscopic units.

There are a few limitations to this study. The results of the survey depend largely on responders’ characteristics. First, we did not select responders randomly, even though we had intended to choose responder candidates from high-volume endoscopy centers—ones performing more than 500 endoscopies per year. Practically, the majority of screening endoscopy is concentrated at the large medical institutions, and the national QA program prioritizes improvements to quality at those institutions. Second, responses that claimed QI may be overestimated because responders were biased in favor of large medical institutions or large health-screening centers.

This study is a subjective survey, with no objective QI data. It may not have measured endoscopic quality accurately. The ideal, objective parameter of QI in screening endoscopy would be the diagnostic accuracy of gastric cancer, but it is impossible to so measure that at one medical institution annually, considering the volume of endoscopy performed. In addition, there is no validated endoscopic quality indicator such as adenoma detection rate or cecal intubation rate in colonoscopy. Perceptional change is the important first step in taking action to improve quality. Therefore, the survey can be considered an indirect parameter measuring endoscopic quality from the point of view of participants in QI practice.

In conclusion, the quality of endoscopy has improved after 5 years of implementation of the mandatory endoscopic QA program. A continuous and well-organized national endoscopic QI program is required for enhancing the effectiveness of national gastric cancer screening. The results of this survey provide a road map for developing a better quality assurance program for endoscopic practices.