Skip to main content
Journal of Peking University (Health Sciences) logoLink to Journal of Peking University (Health Sciences)
. 2021 Dec 22;54(1):100–104. [Article in Chinese] doi: 10.19723/j.issn.1671-167X.2022.01.016

应用Delphi法构建下颌阻生第三磨牙拔除难度评分量表

Constructions of the scale of difficulty in the extraction of impacted mandibular third molars by using Delphi method

Zhen CHEN 1, Bao-xin GU 1, Yu-fang TANG 1, Zi-yu YAN 1, Fang-duan NI 1, Nian-hui CUI 1,*
PMCID: PMC8860643  PMID: 35165475

Abstract

Objective

To evaluate the relevant indicators affecting difficulty in the extraction of impacted mandibular third molars and score difficulty of different operation and risk indicators, so as to build an intuitive and accurate scale to help operators make more accurate analysis and prediction of difficulty before the operation.

Methods

Based on literature and the clinical review, the difficulty indicators of tooth extraction were summarized. Firstly, 10 doctors from Peking University School and Hospital of Stomatology who had been engaged in alveolar surgery for a long time established an expert nominal group, and then rated whether the summarized indicators needed to be retained in the form of face-to-face questionnaires. A level 1 and 2 item frame for evaluating difficulty in the tooth extraction was formed after discussion; Then Delphi method was used to send a questionnaire to 30 experts by e-mail. After two rounds of scoring and modification, the scale of difficulty in the extraction of impacted mandibular third molars was formed.

Results

The recycling rate of two rounds of questionnaires was 100.0%, which showed that the experts were very enthusiastic about the study; The authority coefficients (Cr) of the two rounds of Delphi expert consultation were both 0.92, which showed that the results were representative and authoritative. After two rounds of grading and revision, the variable coefficient (CV) decreased and the Kendall's concordance coefficient (W) increased, which were statistically significant: In the first round, the CV was 0.24 and W was 0.56 (P < 0.001), and in the second, the CV was 0.19 and W was 0.72 (P < 0.001), which indicated that there was a good convergence among the expert opinions. Finally, a scale of difficulty in the tooth extraction containing 12 items at level A and 37 items at level B was formed, including operation difficulty indicators, risk difficulty indicators and common difficulty indicators.

Conclusion

Based on comprehensive literature retrieval, the study has put forward the concept that difficulty in the extraction of impacted mandibular third molars is composed of operation difficulty and risk difficulty. Using Delphi method, the long-term clinical experience and professional knowledge of experts are transformed into quantitative indicators as a scoring scale. The scale has certain representativeness and authority.

Keywords: Impacted mandibular third molars, Tooth extraction, The scale of difficulty, Delphi method


下颌第三磨牙阻生(impacted mandibular third molar,IMTM)是一种常见的牙科疾病,由于解剖变异较多且手术视野暴露困难,故拔除具有一定的复杂性[1]。在进行操作前,充分的术前分析、拔牙难度评估可以最大限度地减少局部和全身损伤以及术后并发症[2-4]。此前虽有关于下颌阻生第三磨牙拔除难度指标评估的文献报道[5-7],但更多关注的是操作本身的复杂性,对于拔牙手术所带来的创伤和风险,也就是为规避术中、术后并发症发生所提高的手术难度尚未见报道,而后者正是目前临床风险和医疗纠纷的重要组成部分,针对这一复杂问题,建立一份有代表性的牙槽外科专家共识是必要的[8]。本研究提出下颌阻生第三磨牙拔除难度由操作难度和风险难度共同构成的理念,运用Delphi专家咨询法界定难度指标体系,并最终构建评分量表,利用专家们的经验将难度指标进行量化,针对临床和教学的需求,帮助医生在术前对手术难度进行更加准确的分析与预测, 制定更具针对性的手术方案。

1. 资料与方法

1.1. 汇总评分量表的条目池

根据研究需要,拟定6名成员组成研究小组, 其中1名为具有20年以上的牙槽外科临床经验及教学经验的主任医师, 1名为从事牙槽外科工作并具有良好的临床操作能力的主治医师, 博士研究生和硕士研究生各两名。

研究小组通过文献检索,汇总拔牙难度评估指标,系统检索纳入有效文献18篇。经商议后最终筛选出20个一级指标,54个二级指标。操作难度指标是指单纯增加操作困难程度的项目,如智齿牙冠龋坏程度、牙根数目、患者开口度等;风险难度指标是指虽然不直接增加操作困难程度,但在治疗过程中必须关注并且是并发症的主要原因的项目,如牙根与下牙槽神经管位置关系、第二磨牙远中充填体/修复体等;共同难度指标是与前两者都有一定联系,如阻生深度、阻生角度等。

1.2. 确定评分量表的二级条目框架

本研究共有10位北京大学口腔医院牙槽外科专家组成专家名义小组,专家纳入标准为:(1)具有高级以上职称;(2)从事牙槽外科工作10年以上;(3)在相关专业领域发表过著作;(4)具备丰富的临床经验及实践技能(表 1)。

表 1.

专家名义小组基本情况

Basic information about the nominal group

Basic information Items Number
Gender Male 6
Female 4
Age/years 31-40 1
41-49 3
≥50 6
Years of clinical work 10-15 1
15-20 3
≥20 6
Final degree Bachelor 1
Master 0
Doctor 9
Professional title Attending physician 1
Associate chief physician 4
Chief physician 5

通过成立专家名义小组[9],以面对面发放自填问卷的形式,请专家对文献检索汇总的拔牙难度指标是否需要保留进行打分。问卷分为“非常值得保留”“值得保留”“一般”“不太值得保留”“非常不值得保留”,分别赋予权重5、4、3、2、1分。汇总第一轮打分情况反馈给这10名专家,然后10位专家对指标删减情况进行讨论并进行第二轮打分。对10名专家第二轮的打分结果进行统计,均值≥4分或内容效度指数(content validity index,CVI)高于0.8的条目予以保留,即10名专家中超过8名打满分的指标才可保留[10];对评分较低且有争议的指标进行反复讨论,最终决定是否纳入该指标,确定拔牙难度评分量表的二级条目框架。

1.3. Delphi专家咨询

1.3.1. 专家遴选

(1) 专家纳入标准为就职于三级口腔专科医院或三级综合医院口腔科;(2)具有高级职称;(3)在牙槽外科专业领域发表过著作;(4)从事相关领域工作时间5年及以上;(5)自愿参与研究并保证至少能完成两轮的专家咨询。本研究共纳入30人作为函询专家(表 2)。

表 2.

Delphi专家咨询组基本情况

Basic information about the Delphi experts

Basic information Items Number
Age/years 31-40 9
41-50 11
>50 10
Years of clinical work 5-10 5
11-15 5
16-20 6
>20 14
Final degree Bachelor 4
Master 5
Doctor 21
Professional title Attending physician 8
Associate chief physician 13
Chief physician 9
Research direction Alveolar surgery 22
Oral and maxillofacial surgery 5
Others 3

1.3.2. 设计咨询表

将专家名义小组决议产生的拔牙难度评分量表的二级条目框架设计成咨询表,表中依次介绍本项目的研究背景、目的、意义及评分标准。请函询专家根据重要程度,分别对二级指标框架中的每个指标在该级中所占的权重进行打分,同时,专家需对指标打分的判断依据和熟悉程度进行自评,此外,咨询表中设置开放性问题,便于专家对备选指标提出自己的修改或另增指标的建议[11]

1.3.3. 第一轮专家咨询

通过电子邮件的方式向专家发放咨询表,收集专家的反馈结果后,对评分量表进行统计分析,计算各级指标得分的均数及标准差,拟定第二轮Delphi专家咨询表。

1.3.4. 第二轮专家咨询

将咨询表及第一轮的分析结果发给30位专家,请其再次对一、二级指标及条目评分。收集专家反馈结果,再次进行统计分析,最终使变异系数(coefficient of variation, CV)变小,意见协调系数(Kendall’s concordance coefficient, W)上升,协调性较好,形成下颌阻生第三磨牙拔除难度评分量表。

1.4. 统计学分析

(1) 专家积极性:专家积极系数(coefficient of junction, Cj)用咨询问卷的回收率表示,即(回收的问卷数/发放的问卷数)×100%,回收率>70%,即表明专家积极性高[12]。(2)专家权威程度:权威系数(coefficient of reliability, Cr)主要包括两个因素,即专家对方案做出判断的依据(coefficient of adjudication, Ca)和专家对方案的熟悉程度(coefficient of sense, Cs),Cr为两者的算术均数,一般Cr≥0.7视为可接受程度[13]。(3)专家意见集中程度:用重要性赋值均数表示。依据Likerts分度量法将指标重要性程度分为很重要、重要、一般重要、不太重要、不重要5个等级[14],并分别赋值5、4、3、2、1。(4)专家意见协调程度:用变异系数(CV)和Kendall协调系数(W)表示[15]。CV越小,说明专家对某一项的意见越趋于一致,CV < 0.25为可接受范围;W反映专家彼此之间对每项指标给出的评价意见是否存在较大分歧,W越大, 意味着专家协调程度越高,W值范围为0~1, 当W波动在0.4~0.5时, 协调性较好, 即可停止咨询。

2. 结果

2.1. Delphi专家咨询结果

两轮Delphi咨询问卷回收率均为100%,即专家的积极系数(Cj)均为100%;两轮Delphi专家咨询的Cs为0.97,Ca为0.87,Cr为0.92,权威系数非常高,说明结果具有代表性和权威性。第一轮CV为0.24,W为0.56(P<0.001);第二轮CV为0.19,W为0.72(P<0.001)。两轮的变异系数减少,协调系数升高,均有统计学意义,说明专家意见有较好的趋同性。汇总第二轮专家意见,二级指标最终分值=一级指标附分均值×二级指标附分均值,据此形成下颌阻生第三磨牙拔除难度评分量表。

2.2. 量表二级条目框架的构成情况

最终完成的量表由12项一级指标和37项二级指标构成,其中风险难度指标一级共3项(第二磨牙牙冠情况、第二磨牙邻牙稳定程度和智齿与下颌神经管关系),细分为二级指标共7项;操作难度指标一级共7项(智齿的牙冠情况、牙根数目、牙根形态、智齿牙根的宽度、牙冠阻力、患者的年龄和开口度),细分为二级指标共19项;共同难度指标一级包括智齿的阻生角度(Winter分类)和深度(Pell-Gregory牙合平面分类)两项,细分为二级指标共7项。

3. 讨论

对于下颌阻生第三磨牙拔除难度进行直观而准确的预测评估,不仅可以为口腔医生选择合理有效的手术方式提供参考,从而控制手术时间,降低风险,减少并发症;同时也利于与患者进行充分的术前沟通,增加患者的信任度和满意度。自经典的Pell-Gregory分类法、Winter分类以及Pederson指数后,关于下颌阻生第三磨牙拔除难度预测的研究一直在进行,但截至到现在仍未见形成既有深度又有广度的专家共识[1]。而本研究在全面进行文献检索的基础上,采用Delphi专家咨询法,听取专家意见,多轮次地征询、归纳、修改, 最后汇总成专家们基本一致的看法, 作为拔牙难度预测的评分量表,更具代表性和权威性。

Delphi法是一个可控制的集体思想交流的过程,适用于处理以往没有充足经验和论证的复杂问题,通过专家们的集思广益给出相对准确且权威的结论意见[16-17],起初用于空间技术、国防备战、人口控制等领域,近年来在医学领域中应用逐渐广泛、成熟[18]。Delphi法具有权威性、独立性和趋同性。

专家选择是Delphi法的关键,本研究纳入的函询专家均为从事牙槽外科领域工作的资深医师,且两轮Delphi专家咨询的权威系数Cs为0.92,进一步印证了函询结果的代表性和权威性。此外,两轮咨询积极系数均为100%,表明专家对本研究配合程度很好。通过两轮函询后,专家的意见也已趋于一致,变异系数由0.24降低到0.19,协调系数由0.56提高到0.72, 显著性检验结果表明专家意见协调性好, 第二轮结果可取, 据此确定了下颌阻生第三磨牙拔除难度评分量表。

本研究确定的量表提出下颌阻生第三磨牙拔除难度由操作难度和风险难度共同构成。既往的难度评分量表更多关注的是智齿拔除这一手术操作本身的复杂性,即操作难度,而在临床工作中,为减少拔牙手术造成的创伤,规避术中、术后并发症,与神经管位置接近、邻牙不健康等类型的智齿拔除会对术者操作的规范化、微创化等提出更高的要求,本研究将其归为风险难度。量表中位列难度分值前三位的二级指标分别为“低位”“倒置位”“紧邻或进入神经管”,说明含有风险难度因素的指标在专家打分中更受关注,也提示在临床操作中,应当对含有这些风险难度指标的下颌阻生智齿提高警惕,减少临床风险和医疗纠纷的产生。

此外,在既往下颌阻生智齿拔除难度评测的相关研究中,评分量表中同一级指标的赋值分数常为1、2、3、4这样的自然数数列[7, 19]。而临床中拔牙难度的变化并不仅仅是简单的自然数递增关系,如年龄是影响下颌阻生第三磨牙拔除难度的因素之一[20],年轻的恒牙牙体及牙周状况都处于较好的状态,其牙根所受到的软组织、骨组织阻力也会相对较小,但随年龄增长,阻生的下颌第三磨牙与其周围的软组织、骨组织都会发生不同程度粘连,拔除时阻力增大,这就会增加手术难度,将不同年龄组之间的拔牙难度进行比较,一定不会是简单的自然数递增关系。同理,智齿的牙根数目和阻生深度等指标难度递增的关系也不会是简单的等差数列。为使难度评估指标的递增关系更加精确、具体,本研究将30位专家的意见进行集中,取重要性评分的均值,精确至百分位数,并用权威系数(对指标的判断依据和熟悉程度)进行了验证,从而消除专家个人因素的偏差,增加了预测精度。

综上所述,Delphi法作为一种主观、定性的方法,将专家长期的临床经验、专业知识转化成量化指标,在评分量表的框架确立、指标赋值阶段发挥了重要作用。本研究以文献回顾为基础,汇总拔牙难度指标,组建专家名义小组,商议形成一、二级条目框架;通过Delphi专家咨询法两轮函询修订, 最终形成由操作难度和风险难度共同构成的下颌阻生第三磨牙拔除难度评分量表,具有一定代表性和权威性。本课题组目前已将本评分量表应用于牙槽外科,用以临床验证。

志谢

白忠诚、陈慧敏、翟新利、段登辉、葛娜、郭睿、何伟、焦岩涛、李聪、李志刚、刘宝钟、刘桂红、刘林、刘宇、孟娟红、齐伟、王恩博、王浩、王晶、王瑞永、王艳荣、吴斌、吴煜、徐训敏、许向亮、殷卫红、张智勇、周治波、邹立东在Delphi法研究中参与两轮打分,特此致谢!

Funding Statement

北京大学口腔医院新技术新疗法项目(PKUSSNCT-20B09)

Supported by the Program for New Clinical Techniques and Therapies of Peking University School and Hospital of Stomatology (PKUSSNCT-20B09)

References

  • 1.Sanchez-Torres A, Soler-Capdevila J, Ustrell-Barral M, et al. Patient, radiological, and operative factors associated with surgical difficulty in the extraction of third molars: A systematic review. Int J Oral Maxillofac Surg. 2020;49(5):655–665. doi: 10.1016/j.ijom.2019.10.009. [DOI] [PubMed] [Google Scholar]
  • 2.Montserrat-Bosch M, Figueiredo R, Nogueira-Magalhaes P, et al. Efficacy and complications associated with a modified inferior alveolar nerve block technique. A randomized, triple-blind clinical tria. Med Oral Patol Oral Cir Bucal. 2014;19(4):E391–E397. doi: 10.4317/medoral.19554. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Sigron G, Pourmand P, Mache B, et al. The most common complications after wisdom-tooth removal: Part 1: A retrospective study of 1 199 cases in the mandible. Swiss Dent J. 2014;124(10):1042–1046, 1052. doi: 10.61872/sdj-2014-10-01. [DOI] [PubMed] [Google Scholar]
  • 4.赵 珺如, 刘 乙澍, 崔 念晖. 下颌第三磨牙拔除术后并发双侧广泛性皮下气肿及纵隔气肿1例报告. 中国实用口腔科杂志. 2021;14(2):253–256. [Google Scholar]
  • 5.Diniz-Freitas M, Lago-Mendez L, Gude-Sampedro F, et al. Pederson scale fails to predict how difficult it will be to extract lower third molars. Br J Oral Maxillofac Surg. 2007;45(1):23–26. doi: 10.1016/j.bjoms.2005.12.004. [DOI] [PubMed] [Google Scholar]
  • 6.Al-Samman AA. Evaluation of Kharma scale as a predictor of lower third molar extraction difficulty. Med Oral Patol Oral Cir Bucal. 2017;22(6):e796–e799. doi: 10.4317/medoral.22082. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Zhang X, Wang L, Gao Z, et al. Development of a new index to assess the difficulty level of surgical removal of impacted mandibular third molars in an Asian population[J/OL]. J Oral Maxillofac Surg, 2019, 77(7): 1358. e1-1351. e8[2021-10-01]. https://pubmed.ncbi.nlm.nih.gov/30959010/.
  • 8.王芷乔. 应用德尔菲法确立甲状腺癌中医证候及分型指标的调查研究[D]. 北京中医药大学, 2016.
  • 9.Humphrey-Murto S, Varpio L, Gonsalves C, et al. Using consensus group methods such as Delphi and Nominal Group in medical education research. Med Teach. 2017;39(1):14–19. doi: 10.1080/0142159X.2017.1245856. [DOI] [PubMed] [Google Scholar]
  • 10.史 静琤, 莫 显昆, 孙 振球. 量表编制中内容效度指数的应用. 中南大学学报(医学版) 2012;37(2):49–52. [Google Scholar]
  • 11.Lakhani A, Watling DP, Zeeman H, et al. Nominal group technique for individuals with cognitive disability: A systematic review. Disabil Rehabil. 2018;40(18):2105–2115. doi: 10.1080/09638288.2017.1325946. [DOI] [PubMed] [Google Scholar]
  • 12.王 青, 朱 晓丹, 常 茹, et al. 基于德尔菲专家咨询法构建稳定期精神分裂症康复方案的研究. 现代医药卫生. 2021;37(14):2357–2361. doi: 10.3969/j.issn.1009-5519.2021.14.006. [DOI] [Google Scholar]
  • 13.Sutherland K, Yeung W, Mak Y, et al. Envisioning the future of clinical analytics: A modified Delphi process in New South Wales, Australia. BMC Med Inform Decis Mak. 2020;20(1):210. doi: 10.1186/s12911-020-01226-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Langmack KA, Newton LA, Jordan S, et al. Cone beam CT dose reduction in prostate radiotherapy using Likert scale methods[J/OL]. Br J Radiol, 2016, 89: 20150460[2021-10-01]. https://pubmed.ncbi.nlm.nih.gov/26689092/.
  • 15.Wu C, Wu P, Li P, et al. Construction of an index system of core competence assessment for infectious disease specialist nurse in China: A Delphi study. BMC Infect Dis. 2021;21(1):791. doi: 10.1186/s12879-021-06402-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Niederberger M, Spranger J. Delphi technique in health sciences: A map. Front Public Health. 2020;8:457. doi: 10.3389/fpubh.2020.00457. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Nasa P, Jain R, Juneja D. Delphi methodology in healthcare research: How to decide its appropriateness. World J Methodol. 2021;11(4):116–129. doi: 10.5662/wjm.v11.i4.116. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Jiang F, Liu T, Zhou H, et al. Developing medical record-based, healthcare quality indicators for psychiatric hospitals in China: A modified Delphi-analytic hierarchy process study. Int J Qual Health Care. 2019;31(10):733–740. doi: 10.1093/intqhc/mzz005. [DOI] [PubMed] [Google Scholar]
  • 19.Carvalho RF, Vasconcelos BC. Pernambuco index: Predictability of the complexity of surgery for impacted lower third molars. Int J Oral Maxillofac Surg. 2018;47(2):234. doi: 10.1016/j.ijom.2017.07.013. [DOI] [PubMed] [Google Scholar]
  • 20.史嘉昕. 下颌第三磨牙拔除时间的多因素相关分析及预测模型建立[D]. 天津医科大学, 2020.

Articles from Journal of Peking University (Health Sciences) are provided here courtesy of Editorial Office of Beijing Da Xue Xue Bao Yi Xue Ban, Peking University Health Science Center

RESOURCES