Control of Allergic Rhinitis and Asthma Test (CARAT): dissemination and applications in primary care

Abstract

Asthma frequently occurs in association with allergic rhinitis and a combined management approach has been suggested. The Control of Allergic Rhinitis and Asthma Test (CARAT) is the first questionnaire to assess control of both diseases concurrently. However, to have an impact on healthcare it needs to be disseminated and adopted. In this paper we discuss the dissemination of CARAT in different countries and its possible applications in primary care. At present, the adaptation of CARAT for use in different languages and cultures is being led by volunteer researchers and clinicians in 15 countries. Website and smartphone applications have been developed, and a free open model of distribution was adopted to contribute to the dissemination of CARAT. Examples of dissemination activities include distribution of leaflets and posters, educational sessions on the use of the questionnaire in the follow-up of patients, development of clinical studies, collaborations with professional organisations and health authorities, and the inclusion of CARAT in clinical guidelines. The adoption of innovations is an important challenge in healthcare today, and research on the degree of success of dissemination strategies using suitable methods and metrics is much needed. We propose that CARAT can be used in a range of settings and circumstances in primary care for clinical, research and audit purposes, within the overall aim of increasing awareness of the level of disease control and strengthening the partnership between patients and doctors in the management of asthma and rhinitis.

Introduction

Asthma is a heterogeneous syndrome with multiple phenotypes, the most prevalent of which is allergic asthma in association with allergic rhinitis.¹ The World Health Organization (WHO) recognises the close relationship between asthma and rhinitis through the Allergic Rhinitis and its Impact on Asthma (ARIA)² guidelines and the Global Alliance against Chronic Respiratory Diseases (GARD) inititative.³ This recognition has resulted in a call for a change in asthma management and led to a combined approach for asthma and its comorbidities, particularly allergic rhinitis.^4–7 Such an approach, however, needs simple assessment tools that can be readily used in clinical practice, and in primary care in particular.^5,8

In 2007 a group of Portuguese allergologists, respiratory physicians, family physicians, and paediatricians identified the need for a questionnaire to assess asthma and allergic rhinitis control simultaneously. The initial goal of the Control of Allergic Rhinitis and Asthma Test (CARAT) project was to develop a questionnaire that would meet the needs of both patients and physicians. The questionnaire, which was designed to be self-administered by adults with a prior diagnosis of asthma and rhinitis, was developed and evaluated in three stages using different methodologies. We have described these stages elsewhere.^9–11

The CARAT questionnaire is composed of 10 questions that address upper and lower airway symptoms, sleep interference, activity limitation, and the need to increase medication over a four-week period (see Appendix 1, available online at www.thepcrj.org). The answers are rated on a four-point scale, with a total possible score ranging from 0 (minimum control) to 30 (maximum control). The properties of the questionnaire are summarised in Table 1. The questionnaire meets nine of the 10 items on the COSMIN (COnsensus-based Standards for the selection of health Measurement INstruments) checklist for evaluating the methodological quality of studies on measurement properties of patient-reported outcomes.¹²

Table 1. CARAT characteristics and properties.

The use of a formal methodological approach in the development of the questionnaire and the good measurement properties observed in the validation studies suggest that CARAT can be used in both clinical studies and clinical practice, allowing comparison between groups and the evaluation of individual patients over time.

While questionnaires have been developed to assess the level of control of asthma^13,14 and more recently of rhinitis,^15,16 CARAT is the only questionnaire that concurrently assesses the control of both disorders. This concurrent approach has previously been used to assess disease-specific quality of life in the RHINASTHMA questionnaire.¹⁷ CARAT has recently been recognised by the ARIA group as the first tool to help implement ARIA guidelines in primary care.³ CARAT also meets the demand for a simple, feasible, and acceptable tool for assessing asthma and/or rhinitis in primary care. The need for such a tool was underlined in the recent International Primary Care Respiratory Group (IPCRG) respiratory research needs statement¹⁸ and in the group's analysis of the prioritisation of these needs.¹⁹

In this paper we discuss the dissemination of CARAT in different countries and its possible applications in primary care.

Importance of dissemination

One of the challenges facing medicine today is the quick and efficient translation of evidence into practice.²⁰ Dissemination refers to a set of planned efforts designed to make a tool, technology, programme, or innovation more widely available.²¹ The use of different approaches can help to increase awareness and use among target populations. Moreover, new tools, technologies, and resources need to be easily accessible and simple to use in different settings and situations. If CARAT is to be successfully implemented in primary care, its widespread availability is therefore crucial.

Cross-cultural adaptations

The ARIA group has recognised the need rapidly to test CARAT in different languages to facilitate the implementation of this tool.³ Moreover, numerous researchers, many of whom are members of the IPCRG, have expressed their interest in CARAT. The use of this questionnaire in international settings, however, requires prior translation and cross-cultural adaptation.

To assist in this task, the CARAT team has developed a protocol for the translation and cross-cultural adaptation of the questionnaire based on international recommendations and best practices.^22–24 Essentially, researchers interested in developing versions for their country/language are invited to participate in the process, which is described in detail at http://caratnetwork.org, a dedicated website which also contains a web tool to help researchers follow the stipulated protocol.

The protocol has three main steps: forward translation, back translation, and patient testing. In the forward translation step, two people independently translate the original Portuguese questionnaire into the target language. The translations are then compared and an agreed version is drawn up between the translators and the CARAT team members (first version). In the back translation step, the text is translated back into Portuguese with the support of the CARAT team. It is then compared with the original and reviewed to ensure conceptual equivalence. Written feedback is given to the researchers who produce a revised second version. The last step is the patient test phase. Ten adult patients are given the second version of CARAT and interviewed about the interpretation and wording of each item. During this phase the researchers make a note of the number of individuals interviewed, their age, the time taken to complete the questionnaire, and any difficulties encountered and solutions proposed. The results are reviewed and any changes are integrated into the third and final version of the questionnaire.

To date, research groups from 15 countries have participated in cross-cultural adaptations of CARAT. Many of the researchers involved are members of the IPCRG. The current status of country-specific versions of the questionnaire is shown in Table 2. Typically, researchers need around 12 hrs of work to complete the cross-cultural adaptation process and between 4 and 12 weeks are required to produce the CARAT for a new language/country/population. This time includes approval from a review board, a back translation report, and feedback from the CARAT team after the patient test phase.

Table 2. Current status of the CARAT cross-cultural and language adaptation process.

CARAT can be used after completion of the cross-cultural adaptation, but clinical validation studies would improve the knowledge on how CARAT performs. The CARAT team has also designed a study protocol that can be used by researchers wishing to carry out clinical validation studies in their countries.

CARAT for children

A CARAT questionnaire for children aged 6–12 years is currently under development. The first version was completed in December 2011 after consensus meetings and cognitive interviews with children and their parents, and the questionnaire is currently being evaluated in a prospective validation study.

CARAT-NETWORK and mCARAT

A website and smartphone applications have been developed to contribute to the dissemination of CARAT. In addition to providing support for cross-cultural adaptations, the CARAT-NETWORK (http://caratnetwork.org) provides access to the different formats and versions of the questionnaire. Users can complete the questionnaire online and print the results. Paper versions can also be downloaded, and links to the smartphone applications (Android and iOS operative systems) are available. After free online registration, users gain access to additional tools, which include resources for plotting and sharing the results of CARAT.

The main features of the smartphone application (mCARAT) have already been reported elsewhere.²⁵ Briefly, the patient can fill in the questionnaire, view and email the results, and synchronise with the CARAT-NETWORK website. The Android OS version of the application allows the user to set alarms for tasks such as taking medications and keeping medical appointments, and also includes features for recording symptoms, exacerbations, medication use, and scheduled or unscheduled medical visits, as well as lung function test results. Additionally, mCARAT allows customised access to online educational resources about asthma and rhinitis. The mCARAT application will shortly undergo usability and clinical usefulness evaluation.

Dissemination experiences

In Portugal, leaflets and posters with the questionnaire have been distributed in primary healthcare centres, and 80 educational sessions on the use of the questionnaire in the follow-up of patients with asthma and rhinitis have been held with the participation of over 1200 physicians, nurses, and pharmacists. Furthermore, the Portuguese Government recommended CARAT for the follow-up of patients in the 2011 asthma guidelines.

In the Netherlands the cross-cultural adaptation has been completed and further research is underway to assess asthma and rhinitis control in the Dutch population during the allergy season.

In the UK, the standard operational procedure for translation of CARAT into English has been completed and the project is currently being reviewed for ethical approval at Imperial College London.

A Spanish version has also been developed for use in Spain and Spanish-speaking countries. The questionnaire is now awaiting clinical validation.

In Italy, the cross-cultural and language adaptation process has been successfully completed, and preparations are being made in collaboration with the Italian General Practitioners' Medical Society for a preliminary evaluation of the use of CARAT in primary care.

The Greek version of the questionnaire has also been produced, with results showing that it is easy to complete for both clinicians and patients. Further dissemination is anticipated within the Greek Association of General Practitioners (ELEGEIA) and the Clinic of Social and Family Medicine of the University of Crete.

The Brazilian version of CARAT is under clinical validation. Unpublished preliminary data indicate that it may increase compliance with treatment, and understanding of disease, among Brazilian patients.

Use case scenarios in primary care

Currently, CARAT can be used to assess disease control in adults with a prior diagnosis of asthma and rhinitis in a range of settings and circumstances (Figure 1). These include follow-up consultations (general practice or allergy/asthma outpatient clinics), nurse consultations, pharmacy services, lung function laboratories, and patient self-monitoring.

Figure 1.

CARAT use case scenarios

The information generated by the questionnaire has three broad applications: (1) by providing an objective measure of disease control, it can be used to support clinical decision-making and increase patient awareness of their level of asthma/rhinitis control; (2) it can be used for patient-reported outcome assessments in asthma/rhinitis research; and (3) it can be used to assess and improve the quality of asthma/rhinitis care and may have a role in the benchmarking of healthcare quality.

By increasing patient awareness of their level of asthma/rhinitis control and enhancing patient empowerment, CARAT has the potential to contribute to strengthening the much needed partnership between patients and doctors. In this regard, we believe that the involvement of patient organisations in the dissemination of the questionnaire is to be encouraged. The fact that the questionnaire is freely and easily available in various formats should encourage its use among patients and help to engage them in their own care.

Questions for the future

The dissemination and adoption of any healthcare innovation is a long and difficult process, with uncertain outcomes. Evaluation of dissemination strategies should thus become a standard component of this process, but equally important are suitable methods and metrics to evaluate the effectiveness of innovations in clinical practice.

Future research in primary care settings needs to investigate whether the combined assessment of rhinitis and asthma control during routine clinical visits reduces the risk of exacerbations, emergency room attendances, and hospital admissions and improves patients' quality of life. It also needs to assess how — and how often — CARAT results change clinical decisions made by physicians in the routine assessment of asthma and how it changes the patient's understanding and adherence to the physician's therapeutic decision.

Moreover, to ensure that CARAT meets all the quality criteria of COSMIN, analysis of large longitudinal datasets is needed to establish the minimal clinically important difference of the questionnaire and the definitive cut-off values for the CARAT overall score and subscores. It is within the scope of this research group to provide these answers in the near future.

Conclusions

CARAT is the first questionnaire to assess control of asthma and allergic rhinitis concurrently. However, to have an impact on healthcare it needs to be disseminated and adopted. The dissemination approaches used were: (1) widespread availability (cross-cultural adaptations, print, web, and mobile versions); (2) a free open model of distribution; (3) user support through a dedicated website; (4) clinical educational sessions; and (5) dialogue with health authorities and integration into clinical guidelines.

At present the adaptation of CARAT for use in different languages and cultures is being led by volunteer researchers and clinicians in 15 countries. Studying the degree of success of dissemination strategies using suitable methods and metrics is much needed as adoption of innovations is an important challenge in healthcare today.

We propose that CARAT be used in primary care for clinical, research, and audit purposes, within the overall aim of strengthening the partnership between patients and doctors in the management of asthma and rhinitis.

Appendix 1. Control of Allergic Rhinitis and Asthma Test