Skip to main content
Wiley Open Access Collection logoLink to Wiley Open Access Collection
. 2013 Jan;7(1):53–63. doi: 10.1111/j.1752-699X.2012.00281.x

Questionnaire layout and wording influence prevalence and risk estimates of respiratory symptoms in a population cohort

Linda Ekerljung 1, Eva Rönmark 1,2,3, Jan Lötvall 1, Göran Wennergren 4, Kjell Torén 5, Bo Lundbäck 1,2
PMCID: PMC3654566  PMID: 22243692

Abstract

Objective

Results of epidemiological studies are greatly influenced by the chosen methodology. The study aims to investigate how two frequently used questionnaires (Qs), with partly different layout, influence the prevalence of respiratory symptoms.

Study Design and Setting

A booklet containing two Qs, the Global Allergy and Asthma European Network Q and the Obstructive Lung Disease in Northern Sweden Q, was mailed to 30 000 subjects aged 16–75 years in West Sweden; 62% responded. Sixteen questions were included in the analysis: seven identical between the Qs, four different in set-up and five with the same layout but different wording. Comparisons were made using differences in proportions, observed agreement and Kappa statistics.

Results

Identical questions yielded similar prevalences with high observed agreement and kappa values. Questions with different set-up or differences in wording resulted in significantly different prevalences with lower observed agreement and kappa values. In general, the use of follow-up questions, excluding subjects answering no to the initial question, resulted in 2.9–6.7% units lower prevalence.

Conclusion

The question set-up has great influences on epidemiological results, and specifically questions that are set up to be excluded based on a previous no answer leads to lower prevalence compared with detached questions. Therefore, Q layout and exact wording of questions has to be carefully considered when comparing studies.

Please cite this paper as: Ekerljung L, Rönmark E, Lötvall J, Wennergren G, Torén K and Lundbäck B. Questionnaire layout and wording influence prevalence and risk estimates of respiratory symptoms in a population cohort. Clin Respir J 2013; 7: 53–63.

Keywords: epidemiology, GA2LEN, kappa, OLIN, questionnaire, respiratory symptoms

Introduction

Postal enquiries are among the most efficient tools when assessing prevalence and risk factors of asthma and respiratory symptoms (1, 2). The prevalence of asthma has increased over the last 50–60 years and is estimated to be 7%–10% in different parts of the Western world (36). Data on incidence vary partly depending on different definitions of asthma and population at risk. Using similar methods, the incidence is approximately 2/1000/year in Northern Europe (710). When self-reported asthma by questionnaires (Qs) is validated against clinically relevant asthma, it has a high specificity and a fair, or good, sensitivity in countries with developed health-care systems (1, 2). When comparing results from epidemiological studies, it is important to take the methods and definitions used into consideration, as results are influenced by the methodology. Two main models have been used in the validation of epidemiological diagnosis of asthma: a provocation test or a clinical interview (1, 2, 11), or a combination of both methods (12).

Today, there are few Qs that are widely used. Among adults, the European Community Respiratory Health Survey Q (ECRHS-Q) (13) and the subsequent Global Allergy and Asthma European Network Q (GA2LEN-Q) are commonly used. Both fail to cover bronchitis or chronic obstructive pulmonary disease (COPD) in a satisfactory way. However, the Obstructive Lung Disease in Northern Sweden Q (OLIN-Q) (14) cover these aspects and has frequently been used in Sweden and northern European countries.

In 2008, a study focusing mainly on asthma was initiated in West Sweden. The initial step was a postal survey using two respiratory Qs, the GA2LEN-Q and the OLIN-Q, with the primary aim of updating the prevalence of asthma, respiratory symptoms and allergy (15). The aim of the present study was to investigate how these two frequently used Qs, with partly different question structure and wording, influence the prevalence of respiratory symptoms and other outcomes.

Materials and methods

Study area and population

The study was initiated in 2008 when 30 000 randomly selected subjects aged 16–75 years of age received a postal Q. The study was performed in the region of West Gothia in Western Sweden, including the city of Gothenburg. The study population was selected using the Swedish Population Register and was stratified by age and sex to mirror the population in West Gothia. Study design, results of prevalence and effects of late response and nonresponse have previously been published (15, 16).

Qs

The study consisted of a booklet containing the OLIN-Q followed by the GA2LEN-Q. The OLIN-Q has been used in many studies in the Nordic and the Baltic countries, prominently the FinEsS (Finland, Estonia, Sweden) studies, comparative studies of airway diseases 6, 17, 18). It was developed from the British Medical Research Council Q (BMRC-Q). The OLIN-Q contains questions on asthma, rhinitis, chronic bronchitis/COPD/emphysema, respiratory symptoms, use of asthma medication and possible determinants of disease, such as smoking habit, occupation and family history of disease. The OLIN-Q and variants of it (19) have been validated against physiological variables including bronchial hyperresponsiveness (12, 20). To this Q, detailed questions about occupation, occupational exposure, socio-economic conditions and health status were added. The Swedish version of the GA2LEN-Q is a variant of the ECRHS-Q (13, 21) with additional questions concerning mainly rhinitis, chronic sinusitis and eczema. Questions on rhinitis and sinusitis in the GA2LEN-Q originate from the Allergic Rhinitis and its Impact on Asthma initiative (21).

Definitions

In this comparative study, 16 questions from the two Qs were analyzed. The questions were categorized into three groups based on similarity between the Qs: Group I – identical between the Qs; Group II – same question layout but not identical symptom or condition asked for; and Group III – similar wording but different layout. The questions and differences between the Qs have been summarized in Table 1. The questions belonging to group III were follow-up questions in one of the Qs, excluding subjects who did not respond to a qualifying question, but single questions in the other. Use of asthma medication and attacks of shortness of breath were follow-up questions in the GA2LEN-Q, while productive cough was a follow-up question in the OLIN-Q. The qualifying question for use of asthma medication and attacks of shortness of breath was ‘Have you ever had asthma’. For productive cough the qualifying question was ‘Do you usually have phlegm when coughing, or do you have phlegm in your chest, which is difficult to bring up’. Smoking was a combination of two questions in the OLIN-Q but consisted of only one question in the GA2LEN-Q.

Table 1.

Questions used in the Obstructive Lung Disease in Northern Sweden questionnaire (OLIN-Q) and the Global Allergy and Asthma European Network questionnaire (GA2LEN-Q)

OLIN-Q GA2LEN-Q
Group I – identical between the questionnaires
 Ever asthma Have you ever had asthma? [Identical to OLIN-Q]
 Any wheeze Have you had wheezing or whistling in your chest at any time in the last 12 months? [Identical to OLIN-Q]
 Wheeze with breathlessness Have you been at all breathless when the wheezing noise was present? [Identical to OLIN-Q]
 Wheeze apart from cold Have you had this wheezing or whistling when you did not have a cold? [Identical to OLIN-Q]
 Wheeze with breathlessness apart from cold Yes to all three out of: any wheeze, wheezing with breathlessness and wheezing apart from cold. [Identical to OLIN-Q]
 Waking with tight chest Have you woken up with a feeling of tightness in your chest at any time in the last 12 months? [Identical to OLIN-Q]
 Respiratory reaction to ASA Have you ever had any difficulty with your breathing within 3 hours after taking a pain killer? [Identical to OLIN-Q]
Group II – same question set-up but not identical symptom or condition asked for
 Rhinitis Have you now or have you ever had allergic rhinitis (hay fever) or allergic eye catarrh. Do you have any nasal allergies including hay fever?
 Physician-diagnosed COPD Have you been diagnosed as having chronic bronchitis, COPD or emphysema by a doctor? Have you been diagnosed as having chronic obstructive pulmonary disease (COPD) by a doctor?
 Nasal blockage Do you have blocking of your nose more or less permanently? Has your nose been blocked for more than 12 weeks during the last 12 months?
 Rhinorrea Do you have a runny nose more or less permanently? Have you had discoloured nasal discharge (snot) or discoloured mucus in the throat for more than 12 weeks during the last 12 months?
 Exposed at work Have you been heavily exposed to dust, gases or fumes at your work? Have you ever held a job where you were exposed to gases, fumes or dust?
Group III – similar wording but different set-up
 Productive cough Follow-up question: Do you bring up phlegm on most days during periods of at least three months? Do you bring up phlegm from your chest on most days for as much as three months each year?
 Ever smoker Do you smoke? or Have you previously smoked? Have you ever smoked for as long as a year?
 Asthma medication Do you currently use asthma medication (permanently or as needed)? Follow-up question: Are you currently taking any asthma medication (including inhalers, aerosols or tablets) for asthma?
 Attacks of shortness of breath Have you now or have you had asthma symptoms during the last 12 months (intermittent breathlessness or attacks of shortness of breath, the symptoms may exist simultaneously with or without cough or wheezing)? Follow-up question: Have you had an attack of asthma in the last 12 months?

Differences have been highlighted using bold text.

ASA, Aspirin Sensitive Asthma.

Statistical analyses

Statistical analyses were performed using the Statistical Package for the Social Sciences 16.0 (SPSS, Inc., Chicago, IL, USA). Comparisons were made using differences in proportions, observed agreement (OA) and the kappa coefficient. The kappa coefficient compares the level of agreement between different groups of data (22) and was interpreted using the following definitions: below 0.2, slight or poor agreement; 0.21–0.4, fair agreement; 0.41–0.6, moderate agreement; 0.61–0.8, substantial agreement; and 0.81–1, almost-perfect agreement (23). OA measures the proportion of identical answers from the two Qs. The significance of the kappa coefficient and differences in proportions were determined by the 95% confidence interval (95% CI). Exposed to gas, dust or fumes at work, and smoking from each of the Qs were used as an independent variable in logistic regression analyses of questions from their respective Q to obtain relative risk estimates.

Results

The participation in the study has previously been described in detail (15, 16). The response rate was 62% higher among women compared with men [67.4% (95% CI 66.6–68.2) vs 56.4% (95% CI 55.5–57.2)] (Table 1). Of the identical questions (group I), five yielded close to identical results, while ‘any wheeze’ 17.7% (95% CI 17.2–18.3) vs 15.5% (95% CI 15.0-16-0) and ‘wheezing with breathlessness’ 10.6% (95% CI 10.2–11.1) vs 8.9% (95% CI 8.5–9.3) were significantly different (Fig. 1A).

Figure 1.

Figure 1

Prevalence [% with 95% confidence interval (CI)] of symptoms, disease and environmental factors by questionnaire and group. (A) Group I – identical between the questionnaires, (B) Group II – same question layout but not identical symptom or condition asked for, (C) Group III – similar wording but different layout. Bars indicate 95% CIs; significant differences between the groups are indicated as follows: *P value <0.05, **P value <0.01 and ***P value <0.001. GA2LEN-Q, Global Allergy and Asthma European Network Questionnaire; OLIN-Q, Obstructive Lung Disease in Northern Sweden Questionnaire. ASA, Aspirin Sensitive Asthma.

All five questions with similar wording but somewhat different definition (group II) had significantly different prevalences in the two Qs (Fig. 1B). Prevalence of reported ‘physician-diagnosed COPD’ was 3.2% (95% CI 2.9–3.4) using the OLIN-Q vs 1.4% (95% CI 1.2–1.6) using GA2LEN-Q and ‘rhinorrhea’ was 14.9% (95% CI 14.4–15.5) vs 6.1% (95% CI 5.8–6.5).

With the exception of ‘ever smoking’, all questions with a different layout between the Qs (group III) yielded significantly different results (Fig. 1C). A layout where the question was a resulting question of a previous answer (excluding subjects who had answered no to a qualifying question) yielded lower prevalence compared with a single question. Prevalent ‘use of asthma medication’ was 8.7% (95% CI 8.3–9.1) according to the OLIN-Q vs 5.5% (95% CI 5.2–5.9) in the GA2LEN-Q and attacks of shortness of breath 9.6% (95% CI 9.2–10.0) vs 3.0% (95% CI 2.7–3.2).

The differences in prevalence were similar in both men and women irrespective of wording and layout (Table 2). The questions had response rates ranging from 88.2% to 99.5%; all but one had response rates above 95%.

Table 2.

Prevalence (%) and absolute difference between questionnaires (% with 95% CI) of symptoms, diseases and environmental factors by gender

Men

OLIN GA2LEN Absolute difference (95% CI)
Group I – identical between questionnaires
 Ever asthma 8.9 8.9 0.0 (−0.008–0.009)
 Any wheeze 16.3 14.3 2.0 (0.009–0.031)
 Wheeze with breathlessness 9.2 7.6 1.6 (0.008–0.025)
 Wheeze apart from cold 8.9 8.9 0.0 (−0.008–0.009)
 Wheeze with breathlessness apart from cold 5.6 5.1 0.5 (−0.003–0.011)
 Waking with tight chest 7.9 8.1 −0.2 (−0.010–0.006)
 Respiratory reaction to ASA 1.3 1.2 0.1 (−0.003–0.004)
Group II – same question layout but not identical symptom asked for
 Rhinitis 26.6 24.1 2.5 (0.012–0.039)
 Physician-diagnosed COPD 2.5 1.4 1.1 (0.008–0.016)
 Nasal blockage 15.5 12.8 2.7 (0.016–0.037)
 Rhinorrhea 14.6 6.2 8.4 (0.074–0.094)
 Exposed at work 32.2 52.2 −20 (−0.214– −0.185)
Group III – similar wording but different set-up
 Productive cough 8.3 10.1 −1.8 (−0.027– −0.009)
 Ever smoker 39.4 41.7 −2.3 (−0.025–0.005)
 Asthma medication 6.9 4.7 2.2 (0.015–0.029)
 Attacks of shortness of breath 7.6 2.4 5.2 (0.045–0.058)
Women
Group I – identical between questionnaires
 Ever asthma 11.0 11.1 −0.1 (−1.017–0.770)
 Any wheeze 18.9 16.5 2.4 (0.013–0.035)
 Wheeze with breathlessness 11.8 9.9 1.9 (0.010–0.028)
 Wheeze apart from cold 10.0 9.7 0.3 (−0.004–0.013)
 Wheeze with breathlessness apart from cold 6.8 6.2 0.6 (−0.001–0.013)
 Waking with tight chest 10.2 10.4 −0.2 (−0.011–0.006)
 Respiratory reaction to ASA 2.2 2.1 0.1 (−0.003–0.005)
Group II – same question layout but not identical symptom asked for
 Rhinitis 28.5 25.3 3.2 (0.020–0.045)
 Physician-diagnosed COPD 3.7 1.5 2.2 (0.018–0.026)
 Nasal blockage 14.7 11.8 2.9 (0.019–0.038)
 Rhinorrhea 15.2 6.1 9.1 (0.082–0.100)
 Exposed at work 13.8 23.4 −9.6 (−0.106– −0.085)
Group III – similar wording but different set-up
 Productive cough 7.9 9.1 −1.2 (−0.019– −0.003)
 Ever smoker 40.7 42.3 −1.6 (−0.017–0.010)
 Asthma medication 10.2 6.3 3.9 (0.031–0.046)
 Attacks of shortness of breath 11.3 3.5 7.8 (0.071–0.086)

ASA, Aspirin Sensitive Asthma; CI, confidence interval; COPD, chronic obstructive pulmonary disease.

Two of the investigated questions concerned exposure to potential risk factors. One of these, ‘ever smoking’, had a prevalence of 40.1% in the OLIN-Q vs 42.0% in the GA2LEN-Q (Fig. 1C), while ‘exposed to gas dust or fumes at work’ was reported by 22.2% vs 36.4% (Fig. 1B).

All questions in group I had a kappa coefficient that indicated substantial or almost-perfect agreement (kappa value 0.64–0.88, Fig. 2A). ‘Ever asthma’ had the best agreement (kappa 0.89, 95% CI 0.88–0.90) followed by ‘any wheeze’ (kappa 0.81, 95% CI 0.80–0.83). In group II, two of the questions had kappa values above 0.6, while ‘physician-diagnosed COPD’ (kappa 0.51, 95% CI 0.51–0.51) and, in particular, ‘rhinorrhea’ (kappa 0.24, 95% CI 0.24–0.24) had low agreement between the Qs. The highest kappa value was found for ‘rhinitis’ with a kappa of 0.79 (95% CI 0.79–0.79), which was higher than for most of the symptoms in group I. In group III, ‘productive cough’ had a kappa value of 0.66 (95% CI 0.63–0.68), ‘ever smoker’ 0.83 (95% CI 0.82–0.084) and ‘asthma medication’ 0.75 (95% CI 0.73–0.77), thus being higher than most kappa values in group II. Only attacks of shortness of breath had a poorer degree of agreement.

Figure 2.

Figure 2

Kappa value and observed agreement with 95% confidence interval for respiratory symptoms, diseases and environmental factors. (A) Kappa values, (B) observed agreement. ASA, Aspirin Sensitive Asthma; COPD, chronic obstructive pulmonary disease.

The proportion of identical answers from corresponding questions in the two Qs was in general very high, with OA above 0.92 (Fig. 2B). Only ‘rhinorrhea’ (OA 0.85) and ‘exposed to gas dust or fumes at work’ (OA 0.82) had a somewhat lower proportion of identical answers. There were no differences in reliability between different subpopulations, such as high vs low education, non smoking vs smoking and men vs women.

A risk-factor analysis revealed no differences regarding relative risk estimates for ‘any wheeze last 12 months’ using the two Qs for either of the investigated independent variables ‘exposed to gas dust or fumes at work’ (Fig. 3A) or ‘smoking’ (Fig. 3B). Both ‘exposed to gas dust or fumes at work’ and ‘smoking’ were stronger risk factors in the OLIN-Q for ‘attacks of shortness of breath’, while ‘exposed to gas dust or fumes at work’ was a stronger risk factor also for ‘productive cough’ in the OLIN-Q. There were no differences between the two Qs in odds ratios for ‘smoking’ as a risk factor for ‘productive cough’.

Figure 3.

Figure 3

Risk-factor comparisons for the Obstructive Lung Disease in Northern Sweden Questionnaire (OLIN-Q) and Global Allergy and Asthma European Network Questionnaire (GA2LEN-Q). (A) ‘Exposure to gas, dust or fumes at work’ as the independent variable. (B) ‘Smoking’ as the independent variable. Data is presented as odds ratios with 95% confidence iinterval calculated using logistic regression.

Discussion

This study compares the GA2LEN-Q, which can be regarded as a variant of the ECRHS-Q (13), with the OLIN-Q, a Q used mainly used Northern European countries 15, 18, 20, 24). Similar estimates of prevalence of symptoms and diseases were found with a few important exceptions. OA was above 0.9, and kappa values indicated substantial or almost-perfect agreement in most cases. In general, a slightly lower prevalence was found in the GA2LEN-Q compared with the OLIN-Q. Risk estimates were dependent on the prevalence of the independent variables and generally higher with the OLIN-Q as a result of wording and the design of questions about exposure. Questions about nasal symptoms were more detailed in the GA2LEN-Q, while questions about bronchitis were more detailed in the OLIN-Q. Questions regarding symptoms common in asthma were similar or identical in the two Qs.

Nonresponse is an issue for all epidemiological studies as it might introduce bias. A nonresponse study has been performed on the study sample, and nonresponders were more likely to be male, younger, living in Gothenburg and smokers. However, this did not influence the prevalence or risk estimates (16). The large study sample, representative of the general population in the study area, ensures the validity of the study.

Results from Qs are dependent on several factors. Self-administered Qs results in higher prevalences than structured interviews (2527); translations create variability (28, 29), particularly the translation of ‘wheeze’ and responses to self-administered Qs before and after a physical demonstration of asthma symptoms results in divergent results with kappa statistics below 0.4 (30). The agreement may also vary with smoking habits and educational level (28). In two studies, the kappa statistics has decreased with increasing educational (28) and social-economical (30) status. However, in the Norwegian study (28), the agreement increased with increasing educational level. An overview of Q comparisons can be found in Table 3.

Table 3.

Observed agreement (OA) and kappa for asthma, attacks of shortness of breath, wheezing and sputum production in previous studies

Asthma Attacks of shortness of breath Wheezing Sputum production




Study OA Kappa OA Kappa OA Kappa OA Kappa
Comparisons of different questionnaires
 Arizona-Q vs NHLI-Q (26) 0.79 0.93 0.90 0.84
 Arizona-Q vs BMRC-Q (26) 0.89 0.88 0.85
 BMMRC-Q vs IUATLD-Q (31) 0.90 0.72
 BMRC-Q vs NR-Q (28) 0.91 0.73 0.88 0.51
 BMRC-Q vs NHLI-Q(27) 0.73 0.80
 BMRC-Q vs ATS-Q (25) 0.99
Comparisons of the same questionnaire
 ECRHS-Q(30) 0.69* 0.67
 EPIC-Potsdam study(34) 0.72
 IUATLD-Q§(29) 0.70–1.00 0.40–0.46 0.73–0.95
 ECSC-Q, four occasions (2) 0.96 0.72
 BMMRC-Q (2) 0.66 0.66
 ATS-DLD(2) 0.96 0.76
*

Attacks of shortness of breath upon exercise.

Interview vs self-completed.

Before and after demonstration of asthma symptoms.

§

Comparisons made in four countries.

ATS-Q, American Thoracic Society Questionnaire; BMRC-Q, British Medical Research Council Questionnaire; BMMRC-Q, British Modified Medical Research Council Questionnaire; ECRHS-Q, European Community Respiratory Health Survey Questionnaire; ECSC-Q, European Community for Coal and Steel Questionnaire; EPIC, European Prospective Investigation into Cancer and Nutrition; IUATLD-Q, International Union Against Tuberculosis and Lung Diseases Questionnaire; NHLI-Q, National Heart and Lung Institute Questionnaire; NR-Q, Norwegian Respiratory Questionnaire.

The two Qs compared in this study have slightly different foci, which influence how the data can be analyzed, and have an impact on prevalence and relative risk estimates. The GA2LEN-Q provides more information about rhinitis and eczema compared with the OLIN-Q. The OLIN-Q provides a more thorough description of bronchitis symptoms. It also detects asthma-like symptoms not only among subjects with asthma but in the general population. The GA2LEN-Q excludes all nonasthmatics to some questions as it includes qualifying questions and will therefore only report the prevalence of use of asthma medication and attacks of shortness of breath among asthmatics and cannot give an estimate of prevalence in the general population. The slight difference in target population for some questions makes comparison of prevalence estimates more difficult. To detect accurate prevalence of symptoms common in asthma, we suggest that all questions should be answered by all participants.

In line with previous comparisons of Qs regarding prevalence 25, 31, 32), identical questions and wordings yielded similar estimates of prevalence in our study. Because of the high power of the study comprising of 18 087 participants, several questions resulted in statistically significant differences despite small differences in prevalence, differences that are likely to be of limited clinical relevance. For questions with a similar layout but containing different conditions, the prevalences differed to a higher degree between Qs. Despite covering the same symptom category, significant differences in prevalence have been previously observed even for questions that appear similarly worded (28).

Despite differences in prevalence outcomes, the OA for all questions was very high, including questions with different wording and different layout. The OA in our study was greater than in many previous validation studies, including the National Heart and Lung Institute Q vs the BMRC-Q, and the International Union Against Tuberculosis and Lung Diseases Q (IUATLD-Q) against the BMRC-Q (31).

The kappa values in our study for identical questions all showed almost-perfect (>0.8) or substantial (0.6–0.8) agreement. Even though these kappa values varied from 0.64 to 0.88, we had anticipated even closer levels of agreement. However, the kappa values in the current survey are similar or better compared with studies where the same Q had been distributed twice to the same subjects a few months apart (2), and also when compared with repeatability of the IUATLD-Q (29) and the comparison of the IUATLD-Q vs the BMRC-Q (31).

In order to illustrate how the way a question is asked influence the relative risk estimates in an epidemiological study, risk-factor analyses were performed using questions from different groups. The calculations of relative risk estimates tended to yield higher odds ratios when using the OLIN-Q. If the prevalence is high, and the kappa and OA are satisfactory for the symptom in question, the risk-factor patterns will be similar. However, if the symptoms have been defined differently and hence have different prevalence outcomes, the risk-factor patterns are more divergent.

It is known that self-reports are influenced by wording, format and context (33). The precise wording and tempus of a question can thus increase or decrease the probability of a positive response, with more precise questions rendering lower prevalence and questions including words such as ‘have you ever’ rendering higher prevalence than questions using ‘have you now’ wording. This phenomenon can be seen in the ‘rhinorrhea’ and ‘nasal blockage’ questions, which are more precise in the GA2LEN-Q. Differences may also be explained by factors other than wording and layout of the questions. The two Qs together amounted to 74 questions. Although the subjects were not specifically asked to complete the Qs in a specific order, it can be assumed that a vast majority answered the OLIN-Q first as it was placed first in the booklet that contained the Qs. This could have an influence on answers to questions placed further into the booklet. Furthermore, answering questions about symptoms prior to questions about reactions to environmental conditions might also make the subject more aware of their disease and therefore more prone toward a positive response.

Conclusions

Identical questions yielded close to identical results regarding prevalence and had high levels of OAs and kappa values. Both Qs result in similar prevalence, primarily of lower respiratory symptoms. Different wording and different layout had a substantial influence on the estimated prevalence and risk-factor patterns and must be taken into account when comparisons between different studies are performed. An important aspect to consider when epidemiological methods to quantify the prevalence of asthma and symptoms common in asthma are evaluated is to remember that we lack an exact definition of the disease and cannot be certain which method correctly mirrors the truth. The importance of presenting, or referencing, the exact questions in any Q-based survey, not only in the respiratory field, cannot be emphasized strongly enough.

Acknowledgments

This study was funded by the VBG GROUP's Herman Krefting Foundation for Allergy and Asthma Research, the Swedish Heart-Lung Foundation, and the Swedish Asthma and Allergy Association. The funding sources had no involvement in study design; collection, analysis, and interpretation of data; or writing and submitting the paper.

References

  • 1.Samet JM. Epidemiologic approaches for the identification of asthma. Chest. 1987;91(6) Suppl.:74S–8S. doi: 10.1378/chest.91.6_supplement.74s. [DOI] [PubMed] [Google Scholar]
  • 2.Toren K, Brisman J, Jarvholm B. Asthma and asthma-like symptoms in adults assessed by questionnaires. A literature review. Chest. 1993;104(2):600–8. doi: 10.1378/chest.104.2.600. [DOI] [PubMed] [Google Scholar]
  • 3.Anderson HR, Gupta R, Strachan DP, Limb ES. 50 years of asthma: UK trends from 1955 to 2004. Thorax. 2007;62(1):85–90. doi: 10.1136/thx.2006.066407. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Barraclough R, Devereux G, Hendrick DJ, Stenton SC. Apparent but not real increase in asthma prevalence during the 1990s. Eur Respir J. 2002;20(4):826–33. doi: 10.1183/09031936.02.00822002. [DOI] [PubMed] [Google Scholar]
  • 5.Brögger J, Bakke P, Eide GE, Johansen B, Andersen A, Gulsvik A. Long-term changes in adult asthma prevalence. Eur Respir J. 2003;21(3):468–72. doi: 10.1183/09031936.03.00056103. [DOI] [PubMed] [Google Scholar]
  • 6.Ekerljung L, Andersson Å, Sundblad BM, Rönmark E, Larsson K, Ahlstedt S, Dahlen SE, Lundback B. Has the increase in the prevalence of asthma and respiratory symptoms reached a plateau in Stockholm, Sweden? Int J Tuberc Lung Dis. 2010;14(6):764–71. [PubMed] [Google Scholar]
  • 7.Ekerljung L, Ronmark E, Larsson K, Sundblad BM, Bjerg A, Ahlstedt S, Dahlen SE, Lundback B. No further increase of incidence of asthma: incidence, remission and relapse of adult asthma in Sweden. Respir Med. 2008;102(12):1730–6. doi: 10.1016/j.rmed.2008.07.011. [DOI] [PubMed] [Google Scholar]
  • 8.Lundback B, Ronmark E, Jonsson E, Larsson K, Sandstrom T. Incidence of physician-diagnosed asthma in adults – a real incidence or a result of increased awareness? Report from the Obstructive Lung Disease in Northern Sweden Studies. Respir Med. 2001;95(8):685–92. doi: 10.1053/rmed.2001.1126. [DOI] [PubMed] [Google Scholar]
  • 9.Eagan TM, Brogger JC, Eide GE, Bakke PS. The incidence of adult asthma: a review. Int J Tuberc Lung Dis. 2005;9(6):603–12. [PubMed] [Google Scholar]
  • 10.Toren K, Gislason T, Omenaas E, Jogi R, Forsberg B, Nystrom L, Olin AC, Svanes C, Janson C. A prospective study of asthma incidence and its predictors: the RHINE study. Eur Respir J. 2004;24(6):942–6. doi: 10.1183/09031936.04.00044804. [DOI] [PubMed] [Google Scholar]
  • 11.Cerveri I, Bruschi C, Ricciardi M, Zocchi L, Zoia MC, Rampulla C. Epidemiological diagnosis of asthma: methodological considerations of prevalence evaluation. Eur J Epidemiol. 1987;3(2):202–5. doi: 10.1007/BF00239760. [DOI] [PubMed] [Google Scholar]
  • 12.Lundback B, Stjernberg N, Rosenhall L, Lindstrom M, Jonsson E, Andersson S. Methacholine reactivity and asthma. Report from the Northern Sweden Obstructive Lung Disease Project. Allergy. 1993;48(2):117–24. doi: 10.1111/j.1398-9995.1993.tb00696.x. [DOI] [PubMed] [Google Scholar]
  • 13.Burney PG, Luczynska C, Chinn S, Jarvis D. The European Community Respiratory Health Survey. Eur Respir J. 1994;7(5):954–60. doi: 10.1183/09031936.94.07050954. [DOI] [PubMed] [Google Scholar]
  • 14.Lundbäck B, Nyström L, Rosenhall L, Stjernberg N. Obstructive lung disease in northern Sweden: respiratory symptoms assessed in a postal survey. Eur Respir J. 1991;4(3):257–66. [PubMed] [Google Scholar]
  • 15.Lötvall J, Ekerljung L, Rönmark EP, Wennergren G, Linden A, Rönmark E, Toren K, Lundback B. West Sweden Asthma Study: prevalence trends over the last 18 years argues no recent increase in asthma. Respir Res. 2009;10:94. doi: 10.1186/1465-9921-10-94. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Rönmark EP, Ekerljung L, Lötvall J, Torén K, Rönmark E, Lundbäck B. Large scale questionnaire survey on respiratory health in Sweden: effects of late- and non-response. Respir Med. 2009;103(12):1807–15. doi: 10.1016/j.rmed.2009.07.014. [DOI] [PubMed] [Google Scholar]
  • 17.Kotaniemi JT, Lundback B, Nieminen MM, Sovijarvi AR, Laitinen LA. Increase of asthma in adults in northern Finland? – A report from the FinEsS study. Allergy. 2001;56(2):169–74. doi: 10.1034/j.1398-9995.2001.056002169.x. [DOI] [PubMed] [Google Scholar]
  • 18.Meren M, Jannus-Pruljan L, Loit HM, Polluste J, Jonsson E, Kiviloog J, Lundback B. Asthma, chronic bronchitis and respiratory symptoms among adults in Estonia according to a postal questionnaire. Respir Med. 2001;95(12):954–64. doi: 10.1053/rmed.2001.1188. [DOI] [PubMed] [Google Scholar]
  • 19.Larsson L, Boethius G. Differences in utilization of asthma drugs between two neighbouring Swedish provinces: relation to treatment in individuals with airway disease. J Intern Med. 1995;238(4):307–16. doi: 10.1111/j.1365-2796.1995.tb01203.x. [DOI] [PubMed] [Google Scholar]
  • 20.Lundback B, Stjernberg N, Nystrom L, Lundback K, Lindstrom M, Rosenhall L. An interview study to estimate prevalence of asthma and chronic bronchitis. The obstructive lung disease in Northern Sweden study. Eur J Epidemiol. 1993;9(2):123–33. doi: 10.1007/BF00158781. [DOI] [PubMed] [Google Scholar]
  • 21.Bousquet J, Van Cauwenberge P, Khaltaev N. Allergic rhinitis and its impact on asthma. J Allergy Clin Immunol. 2001;108(5) Suppl.:S147–334. doi: 10.1067/mai.2001.118891. [DOI] [PubMed] [Google Scholar]
  • 22.Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Meas. 1960;20(1):37–46. [Google Scholar]
  • 23.Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33(1):159–74. [PubMed] [Google Scholar]
  • 24.Pallasaho P, Lundback B, Laspa SL, Jonsson E, Kotaniemi J, Sovijarvi AR, Laitinen LA. Increasing prevalence of asthma but not of chronic bronchitis in Finland? Report from the FinEsS-Helsinki Study. Respir Med. 1999;93(11):798–809. doi: 10.1016/s0954-6111(99)90265-2. [DOI] [PubMed] [Google Scholar]
  • 25.Comstock GW, Tockman MS, Helsing KJ, Hennesy KM. Standardized respiratory questionnaires: comparison of the old with the new. Am Rev Respir Dis. 1979;119(1):45–53. doi: 10.1164/arrd.1979.119.1.45. [DOI] [PubMed] [Google Scholar]
  • 26.Lebowitz MD, Burrows B. Comparison of questionnaires: the BMRC and NHLI respiratory questionnaires and a new self-completion questionnaire. Am Rev Respir Dis. 1976;113(5):627–35. doi: 10.1164/arrd.1976.113.5.627. [DOI] [PubMed] [Google Scholar]
  • 27.Samet JM. A historical and epidemiologic perspective on respiratory symptoms questionnaires. Am J Epidemiol. 1978;108(6):435–46. doi: 10.1093/oxfordjournals.aje.a112642. [DOI] [PubMed] [Google Scholar]
  • 28.Brogger JC, Bakke PS, Gulsvik A. Comparison of respiratory symptoms questionnaires. Int J Tuberc Lung Dis. 2000;4(1):83–90. [PubMed] [Google Scholar]
  • 29.Burney PG, Laitinen LA, Perdrizet S, Huckauf H, Tattersfield AE, Chinn S, Poisson N, Heeren A, Britton JR, Jones T. Validity and repeatability of the IUATLD (1984) Bronchial Symptoms Questionnaire: an international comparison. Eur Respir J. 1989;2(10):940–5. [PubMed] [Google Scholar]
  • 30.Smeeton NC, Rona RJ, Oyarzun M, Diaz PV. Agreement between responses to a standardized asthma questionnaire and a questionnaire following a demonstration of asthma symptoms in adults. Am J Epidemiol. 2006;163(4):384–91. doi: 10.1093/aje/kwj052. [DOI] [PubMed] [Google Scholar]
  • 31.Abramson MJ, Hensley MJ, Saunders NA, Wlodarczyk JH. Evaluation of a new asthma questionnaire. J Asthma. 1991;28(2):129–39. doi: 10.3109/02770909109082737. [DOI] [PubMed] [Google Scholar]
  • 32.Helsing KJ, Comstock GW, Speizer FE, Ferris BG, Lebowitz MD, Tockman MS, Burrows B. Comparison of three standardized questionnaires on respiratory symptoms. Am Rev Respir Dis. 1979;120(6):1221–31. doi: 10.1164/arrd.1979.120.6.1221. [DOI] [PubMed] [Google Scholar]
  • 33.Schwarz N. Self-reports – how the questions shape the answers. Am Psychol. 1999;54(2):93–105. [Google Scholar]
  • 34.Bergmann MM, Jacobs EJ, Hoffmann K, Boeing H. Agreement of self-reported medical history: comparison of an in-person interview with a self-administered questionnaire. Eur J Epidemiol. 2004;19(5):411–16. doi: 10.1023/b:ejep.0000027350.85974.47. [DOI] [PubMed] [Google Scholar]

Articles from The Clinical Respiratory Journal are provided here courtesy of Wiley

RESOURCES