Skip to main content
Journal of Primary Care & Community Health logoLink to Journal of Primary Care & Community Health
. 2023 Jul 27;14:21501319231189060. doi: 10.1177/21501319231189060

Development and Validation of the Sinonasal Outcome Test-12

Salma S Al Sharhan 1,, Mohammed H Al Bar 1, Abdulmalik S Al Saied 1, Maha I Al Somali 1, Moataza M Abdel Wahab 2
PMCID: PMC10388610  PMID: 37501403

Abstract

Objectives:

Quality of life (QoL) questionnaires are widely used in clinical interviews to assess the impact of medical interventions or measure the outcomes of healthcare services. The main aim of such questionnaires is the subjective assessment of health status and its impact on QoL. This study aimed to develop an efficient, short sinonasal disease assessment instrument, the sinonasal outcomes test-12 (SNOT-12), and to compare it with the preexisting SNOT-22.

Methods:

This was a two-phase cross-sectional study. The study was performed between June 2019 and February 2020 using the electronic files of the ORL department outpatient clinics at King Fahd University Hospital, affiliated with Imam Abdulrahman Bin Faisal University. The study was performed in 2 phases: an item reduction phase, which resulted in an initial SNOT-12 scale, and a validation phase, using a comparative analysis of the initial SNOT-12 and the SNOT-22.

Results:

The developed short-form SNOT-12 maintained the 4 latent factors extracted in EFA (nasal, Sleep/extra nasal, psychological, ear/facial). It strongly correlated with SNOT-22 (r = 0.973). It had good construct reliability (0.705-0.901) and validity and a higher discrimination power than the SNOT-22.

Conclusions:

The SNOT-12 is a short, valid, and reliable instrument that may prove useful for the initial screening and monitoring of patients with chronic rhinosinusitis.

Keywords: sinonasal outcome test, chronic rhinosinusitis, rhinosinusitis, sinusitis, rhinitis, quality of life, self-administered questionnaires, rhinology, allergy

Introduction

Chronic rhinosinusitis (CRS) is an inflammation of the nose and the paranasal sinuses. It is a common clinical condition that significantly impacts the quality of life (QoL) and individual morbidity. CRS cases represent 10.8% of all outpatient clinic visits. Therefore, patient-reported outcome measures (PROMs) are widely used in clinical interviews to assess patients’ perspectives regarding their systemic health status and its impact on QoL. 1

Morley and Sharp 2 compared 15 sinonasal disease-specific questionnaires; they considered the sinonasal outcomes test-22 (SNOT-22) the most adequate self-assessment tool for CRS with or without nasal polyps. The SNOT-22 comprises 22 items reflecting the health burden of CRS symptoms and health-related QoL measures centered on 5 distinct symptom domains: rhinological, extra-nasal, ear, facial, sleep dysfunction, and psychological disease. 3 The SNOT-22 has been translated into different languages and applied to various adult patient groups. Alanazy et al. adopted and validated a literary Arabic version of the SNOT-22. It exhibited excellent internal consistency with excellent test to re-test reliability, similar to the English version. 4

For optimum quality of care for patients with CRS, it is essential to improve PROMs through validation, making them more efficient and convenient for both patients and physicians. The SNOT-22 questionnaire has the advantage of combining items specific to sinonasal disease with general health items, which may be assessed alone or together. However, it is considered lengthy, and it includes redundant items. 5 This imposes a significant respondent burden, making it time-consuming for patients to complete and clinicians to score. Also, they do not specifically relate to the typical CRS symptomatology seen by otolaryngologists. 6

In this study, we developed and validated a short version of the preexisting SNOT-22 questionnaire by removing redundant questions and those with the least contribution to the scale validity and reliability items without reducing the overall information provided. Also, for the newly developed short version, all questions associated with higher content validity were included (ie, the instrument’s capacity to properly measure all important aspects associated with the disease at hand for patients with self-perceived symptoms of CRS to enable tracing improvements in the targeted symptoms and, hence, optimizing patient-centered care and facilitating treatment outcomes. 5

Methods

A license agreement for the use of the questionnaires was obtained from Washington University. Written consents were obtained from the participants and from parents of participants younger than 18 years.

The study was conducted between June 2019 and February 2020 using the electronic files of the ORL department outpatient clinics at King Fahd University Hospital, affiliated with IAU. In the clinics, all patients were routinely asked to complete the validated Arabic-translated SNOT-22 7 before their initial evaluation. Their demographic data, personal habits, and medical histories were also obtained. This study was conducted in 2 phases.

Phase 1: Item Reduction

The original SNOT-22 is a self-administered questionnaire designed to investigate rhinosinusitis. “All rights reserved. Copyright 2006. Washington University in St. Louis, Missouri.” It uses a six-point Likert-type response format to obtain data regarding a list of symptoms and social/emotional consequences of rhinosinusitis. Scoring ranges from 0 (No Problem) to 5 (Problem as bad as it can be); the total score ranges from 0 to 110, with higher scores indicating worse conditions.

In Phase 1, item analysis was performed on the Arabic-translated SNOT-22, 4 filled out by 75 patients with rhinosinusitis and 150 controls, that is, patients visiting the clinic for other ENT reasons. All were evaluated using history and examination, including nasal endoscopy. Student’s t-test was performed to obtain items with statistically significant different scores between the case and the control groups. Moreover, 4 rhinologists prioritized the 10 most “clinically relevant” SNOT-22 items during their initial assessment for rhinosinusitis. They had a clinical consensus conference, where options with less than 2 votes were eliminated. This resulted in 10 SNOT items considered by the group to be the most clinically robust based on their clinical experience in evaluating CRS (Table 3).

Table 3.

Exploratory Factor Analysis, Clinical Consensus and Confirmatory Factor Analysis Items, Loading, Reliability, and Convergent Validity Latent Factors.

Results of clinical consensus Exploratory factor analysis Confirmatory factor analysis
SNOT-22 items Loading Item-total correlation CA, and if item deleted Item Estimate CA/ CR AVE
Factor 1: Nasal (45.73%) 0.887 0.828/0.836 0.51
s4 Runny nose s4 0.930 0.762 0.861 s4 0.739
s3 Sneezing s3 0.851 0.693 0.869
s1 Need to blow nose s1 0.806 0.753 0.861 s1 0.785
s2 Nasal blockage s2 0.782 0.753 0.860 s2 0.747
s7 Thick nasal discharge s7 0.716 0.708 0.866 s7 0.705
s12 Decreased sense of smell or taste s12 0.585 0.567 0.885 s12 0.564
s6 Post-nasal discharge s4 0.466 0.546 0.887
Factor 2: Sleep/extra nasal (9.39%) 0.910 0.901/0.901 0.82
s14 Wake up at night 0.983 0.813 0.885 s14 0.888
s15 Lack of a good night’s sleep s15 0.901 0.836 0.882 s15 0.922
s13 Difficulty falling asleep 0.870 0.809 0.886
s16 Wake up tired 0.830 0.827 0.883
s17 Fatigue 0.739 0.766 0.892
s5 Cough 0.405 0.463 0.932
Factor 3: Psychological (5.99%) 0.859 0.702/0.706 0.55
s21 Sad s21 0.890 0.681 0.829 s21 0.686
s22 Embarrassed 0.867 0.654 0.835
s20 Frustrated/restless/irritable 0.682 0.725 0.817
s18 Reduced productivity 0.550 0.658 0.834 s18 0.790
s19 Reduced concentration 0.499 0.664 0.833
Factor 4: Ear/facial (5.03%) 0.762 0.702/0.705 0.44
s10 Ear pain 0.818 0.608 0.682
s9 Dizziness 0.803 0.602 0.685 s9 0.681
s8 Ear fullness 0.691 0.591 0.690 s8 0.685
s11 Facial pain/pressure s11 0.298 0.454 0.764 s11 0.631

% of variance explained after rotation. AVE, average variance extracted; CA, Cronbach’s alpha; CR, composite reliability.

Exploratory factor analysis (EFA) was performed. The 22 questions of the SNOT-22 were factor analyzed using principal components analysis with promax rotation. This yielded 4 latent factors; we kept the item loadings at more than 0.3 7 (facial pain/pressure loading was 0.298, but it was kept because it is a cardinal item of SNOT-22). Confirmatory factor analysis (CFA) was computed using AMOS 22 to test the measurement models. The model was run many times on a trial to obtain a shorter version of SNOT-22 while keeping the 4 latent constructs obtained in the EFA.

Reasons to consider the deletion of an item were: a factor loading below 0.5 or a standardized residual covariance above 2. When high modification indices (MI) showed redundancy between similar indicators within each construct, the indicator showing smaller factor loadings was considered for deletion.8 -11 Based on the clinical experts’ consensus on the 10 most important items and the patients’ choices of the most irritating SNOT-22 symptoms, we re-ran and re-assessed the model until a 4-factor model with 12 items was obtained (SNOT-12). This SNOT-12 gave the best model fit and good validity and reliability. The model fit measurements were used to assess the model’s overall goodness-of-fit with the following acceptance levels: CMIN/DF <3, GFI, AGFI, CFI, NFI, RFI, IFI, TLI >0.9, PNFI >0.5, and SRMR, RSMEA <0.08.8 -11

Construct reliability was assessed using Cronbach’s alpha and composite reliability and established for constructs of values above .7. 12 The convergent validity scale of items was estimated using average variance extracted (AVE), with a threshold value above 0.5.12,13 Discriminant validity was assessed using the Fornell and Larcker criterion: discriminant validity was established when the square root of AVE for a construct was greater than its correlation with the other constructs. We also used the heterotrait monotrait (HTMT) ratio, where discriminant validity was established for ratios less than the required limit of 0.85. 13

Phase 2: Comparative Analysis of the Initial SNOT-12 and SNOT-22

We validated the SNOT-12 through a register-based cross-sectional survey of 613 patients who visited the ORL department. After completing the SNOT-22 questionnaire, the patients underwent a comprehensive evaluation by an ENT specialist to confirm the coded diagnosis based on EPOS 2020 defining criteria for CRS (symptoms, compatible endoscopic findings and/or computed tomography abnormalities when imaging was available). 14

We excluded the following patients from the study: those younger than 10 years, those with a systemic granulomatous disease, recurrent acute rhinosinusitis, ciliary dyskinesia, cystic fibrosis, or malignant tumors, and/or those who underwent surgery for CRS within 6 months, and patients with a psychiatric disorder.

Statistical Analyses

The SNOT-12 score was calculated by adding the scores of the 12 selected items of the initial SNOT-12 from Phase 1, and the SNOT-22 was calculated by adding the scores of the 22 items in the SNOT-22. Statistical analyses were performed using IBM SPSS Statistics for Windows, Version 26, with the significance level set at 0.05 (2-tailed).

The content validity of SNOT-12 was evaluated by correlation with SNOT-22. Construct validity was evaluated using EFA, and the reliability of the SNOT-12 was evaluated using Cronbach’s alpha. Moreover, areas under the receiver operating characteristic (ROC) curve were compared for the SNOT-12 and SNOT-22, stratified by a SNOT-22 mild/moderate/severe (MMS) classification15 -17: mild, SNOT-22 score of 8 to 20; moderate, >20 to 50; severe, >50; normal, <8. The overall model quality after ROC was indicated by the correct prediction rate for positive responses. A good model has a value >0.5; <0.5 indicates that the model is no better than random prediction. 18

Results

Phase 1

There were 75 CRS cases and 150 comparable controls (age: 10-69 years, median: 33 years). Also, 53% were males, 14.7% were smokers, and 1.8% consumed alcohol. Other medical conditions were asthma (13.8%; more in the CRS group), DM (8.4%), hypertension (8%), laryngopharyngeal reflux (8.4%), nasal trauma (21.3%; more in the control group), and other allergies (54.2%) (Table 1). The most irritating symptoms are displayed in Table 2.

Table 1.

Basic Characteristics of the Patients by Grouping According to Chronic Rhinosinusitis.

Phase I Phase 2
Chronic rhinosinusitis (CRS)
No (n = 150) Yes (n = 75) Total (n = 225) No (n = 505) Yes (n = 108) Total (n = 613)
No. % No. % No. % No. % No. % No. %
Sex
 Male 80 53.3 39 52.0 119 52.9 266 53.0 61 56.5 327 53.6
 Female 70 46.7 36 48.0 106 47.1 236 47.0 47 43.5 283 46.4
Habits
 Smoking 23 15.3 10 13.3 33 14.7 78 15.4 15 13.9 93 15.2
 Alcohol 3 2.0 1 1.3 4 1.8 11 2.2 1 0.9 12 2.0
Medical history
 Asthma 15 10.0a 16 21.3b 31 13.8 47 9.3a 23 21.3b 70 11.4
 Diabetes mellitus 16 10.7 3 4.0 19 8.4 58 11.5a 5 4.6b 63 10.3
 Hypertension 14 9.3 4 5.3 18 8.0 51 10.1 5 4.6 56 9.1
 Laryngopharyngeal reflux 15 10.0 4 5.3 19 8.4 50 9.9 6 5.6 56 9.1
 Nose trauma 39 26.0a 9 12.0b 48 21.3 130 25.7a 14 13.0b 144 23.5
 Teeth surgery 47 31.3 16 21.3 63 28.0 158 31.3a 23 21.3b 181 29.5
 Allergies 75 50.0 47 62.7 122 54.2 243 48.1a 65 60.2b 308 50.2
Medication
 Corticosteroids 75 50.0a 57 76.0b 132 58.7 255 50.5a 82 75.9b 337 55.0
 Anti-histamine 77 51.3a 52 69.3b 129 57.3 254 50.3a 76 70.4b 330 53.8
 Nasal decongestant 81 54.0a 53 70.7b 134 59.6 266 52.7a 78 72.2b 344 56.1

For the same row, a and b are significantly different at P < .05 in the 2-sided z-test of proportion adjusted for all pairwise comparisons using the Bonferroni correction.

Table 2.

Distribution of Patients According to the Most Irritating SNOT-22 Symptom Grouped by Chronic Rhinosinusitis Status.

Phase 1 Phase 2
Chronic rhinosinusitis (CRS)
No
(n = 150)
Yes
(n = 75)
Total
(n = 225)
No
(n = 505)
Yes
(n = 108)
Total
(n = 613)
No. % No. % No. % No. % No. % No. %
Need to blow nose 14 21.2 7 36.8 21 24.7 42 19.4a 11 39.3b 53 21.7
Nasal blockage 26 39.4 6 31.6 32 37.6 76 35.0 11 39.3 87 35.5
Post-nasal discharge 17 25.8 4 21.1 21 24.7 41 19.0 6 22.2 47 19.3
Difficulty falling asleep 17 25.8 2 10.5 19 22.4 48 22.2 5 17.9 53 21.7
Lack of a good night’s sleep 15 22.7 4 21.1 19 22.4 36 16.7 6 21.4 42 17.2
Ear fullness 13 19.7 4 21.1 17 20.0 36 16.7 6 21.4 42 17.2
Cough 13 19.7 3 15.8 16 18.8 33 15.2 3 10.7 36 14.7
Dizziness 15 22.7 0 0.0 15 17.6 40 18.4a 1 3.6b 41 16.7
Waking up tired 8 12.1a 7 36.8b 15 17.6 29 13.4a 8 28.6b 37 15.2
Thick nasal discharge 11 16.7 3 15.8 14 16.5 29 13.4 5 17.9 34 13.9
Decreased sense of smell or taste 6 9.1a 8 40.0b 14 16.3 35 16.2a 10 34.5b 45 18.4
Nighttime awakening 8 12.1 5 27.8 13 15.5 30 13.9 6 22.2 36 14.8
Facial pain/pressure 8 12.1 5 26.3 13 15.3 28 13.0 6 21.4 34 13.9
Fatigue 10 15.2 3 15.8 13 15.3 31 14.4 4 14.3 35 14.3
Sneezing 9 13.6 3 15.8 12 14.1 30 13.9 3 10.7 33 13.5
Reduced concentration 8 12.1 2 10.5 10 11.8 24 11.1 2 7.1 26 10.7
Ear pain 8 12.1 1 5.3 9 10.6 25 11.6 2 7.1 27 11.1
Reduced productivity 5 7.6 4 21.1 9 10.6 19 8.8 4 14.3 23 9.4
Runny nose 3 4.5 3 15.8 6 7.1 24 11.1 3 10.7 27 11.0
Feeling embarrassed 4 6.2 1 5.3 5 6.0 6 2.8 1 3.6 7 2.9
Sad 4 6.1 1 5.3 5 5.9 8 3.7 1 3.6 9 3.7
Frustrated/restless/irritable 4 6.1 0 0.0 4 4.7 15 6.9 0 0.0 15 6.1

For the same row, a and b are significantly different at P < .05 in the 2-sided z-test of proportion adjusted for all pairwise comparisons using the Bonferroni correction.

For EFA, the SNOT-22 questions were factor analyzed. The Kaiser–Meyer–Olkin measure was 0.915, indicating an adequate sample, and Bartlett’s test of sphericity was significant (χ2 = 2867.657, P < .0001). We used both the scree plot and eigenvalues >1 to determine the underlying components. The analysis yielded 4 latent factors explaining 66.14% of the variance: nasal, sleep issues, psychological (emotional + functional), and ear/facial. Table 3 shows the factors, the percentage of the variance explained by each factor after rotation, and the item loadings to each latent factor.

CFA was computed using AMOS 22 to test the measurement models. We re-ran and re-assessed the model until a 4-factor model with 12 items was obtained (SNOT-12). The model yielded good fit: CMIN/DF = 2.281, GFI = 0.970, AGFI = 0.952, CFI = 0.979, NFI = 0.963, RFI = 0.949, IFI = 0.979, TLI = 0.971, PNFI = 0.7, and SRMR = 0.035, RMSEA = 0.047. The model and factor loadings are shown in Table 3 and Figure 1.

Figure 1.

Figure 1.

Confirmatory factor analysis model for SNOT-12, with standardized estimates.

Construct reliability: Cronbach’s alpha for each construct exceeded the required limit of .7. Composite reliabilities ranged from 0.705 to 0.901, above the 0.7 benchmark. Hence, construct reliability was established for each construct (Table 3).

Convergent validity: The AVE values were above the threshold value of 0.5, except for the “ear/facial” factor, where AVE = 0.44. However, since the construct reliability was over the required value and AVE is above 0.4, we could conclude that the “ear/facial” construct was valid. Therefore, the scales used have the required convergent validity (Table 3).

Discriminant validity: The square root of the AVE for each construct is greater than its correlation with the other constructs. Moreover, all HTMT ratios were less than the required limit of 0.85; hence, discriminant validity was established (Table 4).

Table 4.

Discriminant Validity using Fornell and Larcker Criterion and Heterotrait Monotrait (HTMT) Ratio.

Fornell and larcker criterion Heterotrait monotrait ratio
Nasal Sleep Psychological Ear/facial Nasal Sleep Psychological
Nasal 0.712 Nasal
Sleep 0.513 0.906 Sleep 0.591
Psychological 0.445 0.540 0.739 Psychological 0.592 0.694
Ear/facial 0.562 0.527 0.488 0.666 Ear/Facial 0.770 0.660 0.703

The 12 symptoms (initial SNOT-12) resulting were: runny nose, need to blow nose, nasal blockage, thick nasal discharge, decreased sense of smell or taste, waking up at night, lack of a good night’s sleep, sadness, reduced productivity, dizziness, ear fullness, and facial pain/pressure.

Phase 2

This phase comprised 613 patients visiting ENT clinics (age: 10-70 years, median: 33 years). Patients with CRS formed 17.6% of the sample, while the rest (82.4%) complained of 1 of the following: vocal cord problems and hoarseness of voice, ear infection and problems concerning hearing, tinnitus, and imbalance, seasonal allergies, headache, CSF rhinorrhea, nasal trauma and epistaxis, septal deviation, reflux, insomnia, apnea attacks and SOB, cough, excessive tears, facial pain, sore throat, and URTI.

Both groups were comparable regarding age, sex, smoking status, alcohol consumption, and medical history. The CRS group had higher percentages of allergies and asthma (Table 1). Their most irritating symptoms, according to the SNOT-22, are presented in Table 2.

The SNOT-12 scores ranged from 0 to 60, with a median of 19, and the SNOT-22 scores ranged from 0 to 108, with a median of 32. Both were higher in the CRS group (SNOT-12 = 25 and SNOT-22 = 42) than the non-CRS group (SNOT-12 = 17 and SNOT-22 = 26).

Validation of SNOT-12

SNOT-12 and SNOT-22 had a strong significant direct correlation (r = 0.973, P = .0001). SNOT-12 had good reliability using the internal consistency (Cronbach’s alpha (CA) = .895), compared to CA = .943 for the SNOT-22 (not shown in the tables). Based on the SNOT-22 MMS classification, 8.19% of the sample was normal, 13.1% was mild, 37.9% was moderate, and 30% was severe.

The AUC for SNOT-12 and SNOT-22 were 0.625 and 0.593, respectively. Furthermore, SNOT-12 had a higher overall model quality. Stratified by a SNOT-22 MMS classification, SNOT 12 discrimination for CRS cases was comparable to the SNOT-22 in normal levels but higher in the other severity levels. SNOT-12 also gave higher accuracy for mild CRS followed by normal, moderate, and severe levels (Figure 2).

Figure 2.

Figure 2.

ROC curves for SNOT-22 and SNOT-12 as discrimination for chronic rhino sinusitis by mild/moderate/severe (MMS) classification.

Discussion and Conclusions

Health status, as described by the World Health Organization, is a multidimensional concept encompassing physical, mental, and social states of well-being. 17 Improvement in any of these states due to management is considered an achievable outcome. Thus, disease-specific, health-related QoL measuring tools have been developed, such as the SNOT-22, which is an indicative measure of a patient’s perspective regarding the disease. It includes different elements, such as physical limitations and functional and emotional impacts due to CSR. This instrument primarily evaluates the effectiveness and efficiency of treatment. 19

As per clinical practices and research purposes, many measures of patient-based rhinosinusitis outcomes have recently been developed.20,21 Juniper and Guyatt 22 developed a self-regulated rhinosinusitis QoL questionnaire to assess the following components: slumber, problems of practicality, nasal relations, symptoms of non-hay fever, issues of the eye, emotions, and functional activities. Moreover, this instrument requires only 5 to 10 min to determine the effects and can be used repeatedly for longitudinal assessments. In addition, the Chronic Sinusitis Survey 23 is a duration-based 6-item sinusitis-specific monitor that gives results in 2 sections: medication-based and symptom-based. Lund et al. 24 developed a symptom score instrument involving 5 symptoms: pressure or pain in the face, headaches, nasal congestion, discharge, or blocking, and an olfactory disturbance analog scale. This is considered a brief, reliable, and sensitive tool; however, the patient has to determine his priorities by ranking the 3 most disturbing symptoms. The patient lists nasal- and sinus-related symptoms and specifies their functioning limitations to generate a rhinosinusitis disability index. 25 Conversely, the SNOT-22 is a high-quality questionnaire, but it is considered lengthy and can be replaced by a shortened version, as we developed in our study. SNOT-12 has been proven valid, reliable, and sensitive for many nose and sinus diseases.

SNOT-12 is a concise tool for the initial and follow-up assessments of all patients with rhinosinusitis disease. SNOT-12 was shown in this study to be more accurate, with a higher discrimination power, than SNOT-22. Nevertheless, SNOT-12 symptom items were classified in a prior manner through factor analysis of the original SNOT-22, which describes 4 latent factors of patient-perceived CRS. Also, SNOT-12 has a strong, direct, significant correlation with SNOT-22. Previous studies by Orlandi and Terrell and Bhattacharyya et al. have addressed the CRS diagnostic criteria and the American Rhinosinusitis Task Force. They found that nasal congestion and obstruction are the most frequently reported symptom (81%-95%), followed by facial pressure and fullness (70%-85%), discolored nasal leakage (51%-83%), and hyposmia (61%-69%).26,27 Nevertheless, SNOT-22 and SNOT-12 focus on and quantify a patient’s “overall” state and the reliability of the patient’s perspective to measure the trait of interest instead of considering the performance of each item of rhino-sinuses disease. SNOT-22 focuses on broadband and general aspects of CRS, while SNOT-12 is more accurate with higher discrimination power and increased strength of direct significant correlation.

This review of the SNOT-22 and SNOT-12 scores of many patients represents an exceptional comprehensive description of the mean scores and ranges across wide variations of CRS. The clinical consensus conference and the item analysis initially selected 10 SNOT items. However, we proceeded with a 12-item questionnaire based on clinical and statistical analyses that patients can fill up in a shorter time. This saves almost half of the time (48%).

The diagnostic ability of SNOT-12 to differentiate various disease states was mainly evaluated using ROC curves. Moreover, the study revealed a highly significant correlation between SNOT-12 and SNOT-22 (P = .0001). The measure of accuracy provided by the AUC, by displaying the capacity of this diagnostic test to determine differences between the presence and absence of any disease and its sensitivity and specificity values corresponded. 27 The AUC for the total SNOT-12 score was 0.625, while it was 0.593 for the SNOT-22. This indicates that SNOT-12 can differentiate CRS cases with high accuracy. When testing the correlations with the severity factors for the different CRS symptoms, the SNOT-12 had a direct, significant correlation with a higher strength than the SNOT-22.

This work had several limitations, including the difficulty of answering the SNOT-12 questionnaire in children younger than 10 years. The control group was recruited from the ENT clinics. These patients potentially had several medical problems with overlapping symptoms with CRS, including allergy, headache, imbalance, reflux, sleep problems, and facial pain. Thus, this was not a true “normal” cohort. However, they reflected the actual population in the ENT outpatient clinics who will utilize the SNOT-12 as a screening and evaluating tool for CRS.

This study developed and validated a shortened version of the SNOT-22, a disease-specific CRS questionnaire. It also integrated the most important complaints of this group of patients. Questions related to the frequency of reported symptoms and other clinically relevant questions were added to the patient population. Quantifiable outcomes could be provided by successful validation to strengthen the clinician’s evaluation of CRS symptoms concurrently with an assessment of QoL improvement. Moreover, more studies are needed to evaluate CRS management outcomes and follow-up scores to trace the disease progression over time, before and after treatment.

In conclusion, the SNOT-12 is a short, valid, and reliable instrument that may be useful for evaluating initial screenings and monitoring patients with rhinosinusitis.

Acknowledgments

Thanks to our colleagues at the Otolaryngology, Head, and Neck Surgery Department and Epidemiology Division of the Family Medicine Department at King Fahad University Hospital for their constructive contributions. We are grateful to our patients for their understanding and agreement to participate in the study.

Footnotes

List of Abbreviations: CMIN/DF (minimum discrepancy per degree of freedom), GFI (goodness of fit index), AGFI (adjusted goodness of fit index), CFI (comparative fit index), NFI (normed fit index), RFI (relative fit index), IFI (incremental fit index), TLI (Tucker Lewis index), PNFI (parsimony-adjusted measures index), SRMR (standardized root mean square residual), RSMEA (root mean square error of approximation), AUC (area under the curve), ROC (receiver operating characteristic curve), EFA (exploratory factor analysis)

Author Contributions: Salma Saud Al Sharhan: designed the study and wrote and revised the manuscript. Maha Ismail AlSomali: participated in data collection and writing and reviewing the manuscript. Mohammad Hussain Al-Bar and Abdulmalik Saad Alsaied: reviewed the literature and participated in writing the manuscript. Moataza Abdelwahab: participated in the study design, compiled, and analyzed the data, and participated in writing the manuscript. All authors read and approved the final manuscript.

The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Funding: The author(s) received no financial support for the research, authorship, and/or publication of this article.

Ethical Approval: Ethical approval was obtained from the institutional review board (IRB) of Imam Abdulrahamn bin FaisaL University, and informed consent was obtained from all patients prior to their enrollment (IRB-2020-01-047). This study was approved by the institutional review board of Imam Abdulrahman Bin Faisal University (IAU) (IRB No. 2019-01-362).

ORCID iDs: Salma S. Al Sharhan Inline graphic https://orcid.org/0000-0002-7708-8368

Maha I. Al Somali Inline graphic https://orcid.org/0000-0001-8767-921X

Availability of Data and Material: The data supporting this study’s findings are available from the corresponding author upon reasonable request.

References

  • 1. Guillemin F, Bombardier C, Beaton D. Cross-cultural adaptation of health-related quality of life measures: literature review and proposed guidelines. J Clin Epidemiol. 1993;46:1417-1432. doi: 10.1016/0895-4356(93)90142-n. [DOI] [PubMed] [Google Scholar]
  • 2. Morley AD, Sharp HR. A review of sinonasal outcome scoring systems - which is best? Clin Otolaryngol. 2006;31: 103-109. doi: 10.1111/j.1749-4486.2006.01155.x. [DOI] [PubMed] [Google Scholar]
  • 3. DeConde AS, Mace JC, Bodner T, et al. SNOT-22 quality of life domains differentially predict treatment modality selection in chronic rhinosinusitis. Int Forum Allergy Rhinol. 2014;4:972-979. doi: 10.1002/alr.21408. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4. Alanazy F, Dousary SA, Albosaily A, Aldriweesh T, Alsaleh S, Aldrees T. Psychometric Arabic Sino-Nasal outcome test-22: validation and translation in chronic rhinosinusitis patients. Ann Saudi Med. 2018;38:22-27. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5. Hopkins C, Gillett S, Slack R, Lund VJ, Browne JP. Psychometric validity of the 22-item sinonasal outcome test. Clin Otolaryngol. 2009;34:447-454. doi: 10.1111/j.1749-4486.2009.01995.x. [DOI] [PubMed] [Google Scholar]
  • 6. Phillips KM, Hoehle LP, Caradonna DS, Gray ST, Sedaghat AR. Determinants of noticeable symptom improvement despite sub-MCID change in SNOT-22 score after treatment for chronic rhinosinusitis. Int Forum Allergy Rhinol. 2019;9: 508-513. doi: 10.1002/alr.22269. [DOI] [PubMed] [Google Scholar]
  • 7. Costello AB, Osborne JW. Best practices in exploratory factor analysis: four recommendations for getting the most from your analysis. PARE. 2005;10:1-9. [Google Scholar]
  • 8. Byrne BM. Structural Equation Modelling with AMOS: Basic Concepts, Applications, and Programming. 3rd ed. Routledge; 2016. [Google Scholar]
  • 9. Hair JF, Jr, Gabriel M, Patel VK. Amos covariance-based structural equation modeling (Cb-Sem): guidelines on its application as a marketing research tool. Rev Bras Mark. 2014;13:44-55. doi: 10.5585/remark.v13i2.2718. [DOI] [Google Scholar]
  • 10. Bentler PM. Comparative fit indexes in structural models. Psychol Bull. 1990;107:238-246. doi: 10.1037/0033-2909.107.2.238. [DOI] [PubMed] [Google Scholar]
  • 11. Hu LT, Bentler PM. Fit indices in covariance structure modeling: sensitivity to underparameterized model misspecification. Psychol Methods. 1998;3:424-453. [Google Scholar]
  • 12. Nunnally JC, Bernstein IH. The assessment of reliability. Psychometric Theory. 1994;3:248-292. [Google Scholar]
  • 13. Fornell C, Larcker DF. Structural equation models with unobservable variables and measurement error: algebra and statistics. J Mark Res. 1981;18:382-388. doi: 10.2307/3150980 [DOI] [Google Scholar]
  • 14. Henseler J, Ringle CM, Sarstedt M. A new criterion for assessing discriminant validity in variance-based structural equation modeling. J Acad Mark Sci. 2015;43:115-135. doi: 10.1007/s11747-014-0403-8. [DOI] [Google Scholar]
  • 15. Fokkens WJ, Lund VJ, Hopkins C, et al. European position paper on rhinosinusitis and nasal polyps 2020. Rhinology. 2020;58:1-464. doi: 10.4193/Rhin20.600. [DOI] [PubMed] [Google Scholar]
  • 16. Toma S, Hopkins C. Stratification of SNOT-22 scores into mild, moderate or severe and relationship with other subjective instruments. Rhinology. 2016;54:129-133. [DOI] [PubMed] [Google Scholar]
  • 17. World Health Organization. The economics of health and disease. WHO Chron. 1971;25:20-24. [PubMed] [Google Scholar]
  • 18. Nahm FS. Receiver operating characteristic curve: overview and practical use for clinicians. Korean J Anesthesiol. 2022;75:25-36. doi: 10.4097/kja.21209. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19. Huang CC, Wang CH, Fu CH, et al. The link between chronic rhinosinusitis and asthma: a questionnaire-based study. Medicine (Baltimore). 2016;95:e4294. doi: 10.1097/MD.0000000000004294. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20. Bhattacharyya N. The economic burden and symptom manifestations of chronic rhinosinusitis. Am J Rhinol. 2003; 17:27-32. [PubMed] [Google Scholar]
  • 21. Zou KH, O’Malley AJ, Mauri L. Receiver-operating characteristic analysis for evaluating diagnostic tests and predictive models. Circulation. 2007;115:654-657. doi: 10.1161/CIRCULATIONAHA.105.594929. [DOI] [PubMed] [Google Scholar]
  • 22. Juniper EF, Guyatt GH. Development and testing of a new measure of health status for clinical trials in rhinoconjunctivitis. Clin Exp Allergy. 1991;21(1):77-83. doi: 10.1111/j.1365-2222.1991.tb00807.x. [DOI] [PubMed] [Google Scholar]
  • 23. Piccirillo JF, Edwards D, Haiduk A, et al. Psychometric and clinimetric validity of the 31-item rhinosinusitis outcome measure (RSOM-31). Am J Rhinol Allergy. 1995;9(6):297-308. doi: 10.2500/105065895781808711. [DOI] [Google Scholar]
  • 24. Lund VJ, Holmstrom M, Scadding GK. Functional endoscopic sinus surgery in the management of chronic rhinosinusitis. An objective assessment. J Laryngol Otol. 1991;105(10): 832-835. doi: 10.1017/s0022215100117463. [DOI] [PubMed] [Google Scholar]
  • 25. Leopold D, Ferguson BJ, Piccirillo JF. Outcomes assessment. Otolaryngol Head Neck Surg. 1997;117(3 Pt 2):S58-S68. doi: 10.1016/s0194-5998(97)70009-3. [DOI] [PubMed] [Google Scholar]
  • 26. Gliklich RE, Hilinski JM. Longitudinal sensitivity of generic and specific health measures in chronic sinusitis. Qual Life Res. 1995;4(1):27-32. doi: 10.1007/BF00434380. [DOI] [PubMed] [Google Scholar]
  • 27. Liu DT, Phillips KM, Speth MM, et al. Exploring possibilities for shortening the 22-item Sino–Nasal Outcome Test (SNOT-22) using item response theory. Int Forum Allergy Rhinol. 2022;12:191-199. [DOI] [PubMed] [Google Scholar]

Articles from Journal of Primary Care & Community Health are provided here courtesy of SAGE Publications

RESOURCES