Skip to main content
International Journal of Environmental Research and Public Health logoLink to International Journal of Environmental Research and Public Health
. 2023 Aug 15;20(16):6579. doi: 10.3390/ijerph20166579

Test–Retest Reliability, Agreement and Criterion Validity of Three Questionnaires for the Assessment of Physical Activity and Sedentary Time in Patients with Myocardial Infarction

Marcus Bargholtz 1,*, Madeleine Brosved 2, Katarina Heimburg 3, Marie Hellmark 4, Margret Leosdottir 5,6, Maria Hagströmer 7,8, Maria Bäck 2,9
Editor: Ellen Glickman
PMCID: PMC10454842  PMID: 37623164

Abstract

Regular physical activity (PA) and limited sedentary time (SED) are highly recommended in international guidelines for patients after a myocardial infarction (MI). Data on PA and SED are often self-reported in clinical practice and, hence, reliable and valid questionnaires are crucial. This study aimed to assess the test–retest reliability, criterion validity and agreement of two PA and one SED questionnaire commonly used in clinical practice, developed by the Swedish National Board of Health and Welfare (BHW) and the Swedish national quality register SWEDEHEART. Data from 57 patients (mean age 66 ± 9.2 years, 42 males) was included in this multi-centre study. The patients answered three questionnaires on PA and SED at seven-day intervals and wore an accelerometer for seven days. Test–retest reliability, criterion validity and agreement were assessed using Spearman’s rho and linearly weighted kappa. Test–retest reliability was moderate for three of the six-sub questions (k = 0.43–0.54) within the PA questionnaires. For criterion validity, the correlation was fair within three of the six sub-questions (r = 0.41–0.50) within the PA questionnaires. The SED questionnaire had low agreement (k = 0.12) and criterion validity (r = 0.30). The studied questionnaires for PA could be used in clinical practice as a screening tool and/or to evaluate the level of PA in patients with an MI. Future research is recommended to develop and/or evaluate SED questionnaires in patients with an MI.

Keywords: accelerometer, cardiac rehabilitation, myocardial infarction, physical activity, sedentary time, self-report

1. Introduction

Cardiovascular disease (CVD) is the most common cause of death worldwide [1]. Regular physical activity (PA) and limited sedentary time (SED) are strongly recommended, in terms of both the primary [2] and secondary prevention of CVD [3]. Individuals with CVD are recommended to engage in moderate-intensity physical activity (MPA), 150–300 min/week, or vigorous-intensity physical activity (VPA), 75–150 min/week, or a combination of both, and to limit SED [3]. Previous PA recommendations included bouts of 10 min or more of PA, which have now been omitted due to new evidence that supports the belief that any bout length of PA contributes to health benefits [4]. There is an associated risk of low levels of PA, high levels of SED and an increased all-cause and CVD mortality [5,6,7,8,9].

One way of screening the levels of PA and SED is through self-reported questionnaires, which are commonly used in clinical settings because they are easy to use and cost efficient [10]. Although questionnaires are widely implemented, they are prone to reporting bias. For example, individuals can have difficulty remembering their level of PA and SED over time [11]. Objective instruments for measuring PA and SED include the accelerometer. Accelerometers detect acceleration in up to three directions and are able to determine the quantity and intensity of movement [12]. They have high validity when measuring PA [13], but they are time consuming and expensive [10]. It is crucial that self-reported questionnaires are valid and reliable when assessing levels of PA and SED. Strong test–retest reliability is important to show that a questionnaire is free from measurement error and is stable over time [14].

The Swedish Web-system for Enhancement and Development of Evidence-based care in Heart disease Evaluated According to Recommended Therapies (SWEDEHEART) quality register continuously provides information on patient care needs, treatments and treatment outcomes after an acute myocardial infarction (MI) [15]. SWEDEHEART includes a questionnaire consisting of two questions on PA (Haskell-Q), which are based on the highly cited PA recommendations to promote and maintain health by Haskell et al. [16]. This questionnaire was included in the SWEDEHEART register in 2016 and is administered by physiotherapists nationwide before and after the exercise-based cardiac rehabilitation programme. The Swedish National Board of Health and Welfare (BHW) recommends different questionnaires to assess levels of PA in health care (BHW-Q) [17] and time spent as SED (GIH-SED-Q) [18,19]. The BHW-Q is intended to identify people that are insufficiently physically active and to examine the level of PA after intervention.

In a recent single-centre study, the convergent validity of the BHW-Q, Haskell-Q and GIH-SED-Q was assessed in patients with an MI [20]. Although the Haskell-Q is broadly used in clinical practice among patients with an MI and the BHW-Q and GIH-SED-Q are recommended for use as screening tools in health care, the test–retest reliability, agreement and criterion validity of these questionnaires among patients with an MI are still not known. The purpose of the present study was therefore to assess the test–retest reliability, criterion validity and agreement of the BHW-Q, Haskell-Q and GIH-SED-Q in patients after an MI.

2. Materials and Methods

2.1. Study Design and Participants

This multi-centre study was performed at five hospitals in Sweden: Lindesberg Hospital (LBG), Sahlgrenska University Hospital (SU), Skane University Hospital Malmo/Lund (SU-M/SU-L) and Orebro University Hospital (USO) between April and December 2021. The inclusion criteria were a diagnosis of MI, age < 80 years and registered in the SWEDEHEART register. The exclusion criteria were severe physical or mental illness preventing the performance of the tests and difficulty understanding spoken and written Swedish. This study was approved by the Regional Ethical Review Board at the University of Uppsala (registration number 2020-05142 with amendment 2021-01634).

2.2. Procedure

Patients were recruited consecutively from coronary care units and cardiac rehabilitation centres. On the first visit to the physiotherapist, about two to four weeks after the MI, patients were informed and asked about participation in the study and provided their written informed consent prior to being enrolled in the study. After being enrolled, the patients were asked to complete the BHW-Q, Haskell-Q, GIH-SED-Q and baseline characteristics, including age, gender, co-morbidity, civil status, education and occupation status. The patients were given a new set of questionnaires together with an ActiGraph GT3X accelerometer (ActiGraph, Pensacola, FL, USA) and a wear-time diary to take home. The patients were asked to wear the accelerometer on their hip during waking hours for seven consecutive days. They were instructed to take the accelerometer off during water-based activities (e.g., showering or swimming) and to self-register their wear time in a diary. After seven days, the patients completed the questionnaires once again and send them back, in a pre-paid envelope, together with the accelerometer and diary, to their respective CR centre. The choice of a test–retest interval of seven days is considered appropriate when evaluating questionnaires with a recall time of the previous and/or a usual week [14].

2.3. Physical Activity and Sedentary Time Questionnaire

A total of two questionnaires on PA (BHW-Q, Haskell-Q) and one on SED (GIH-SED-Q) were included in this study. Two supplementary adapted PA questions were added to this study, relating to the Haskell-Q (MPAtot) and BHW-Q (MPAtot) without 10 min bouts. This was due to the recently updated guidelines for PA where recommendation for bouts of 10 min or more has been omitted [2,4].

2.3.1. Haskell-Q

The Haskell-Q focuses on the frequency of PA during the previous week [16]. Moderate and vigorous intensity are separated. The patients are asked to mark the number of days (0–7) that correspond to the indicated activity level for each question.

  • Haskell-Q MPA: “Number of days (0–7) with moderate-intensity physical activity accumulated towards the 30-min minimum by performing bouts each lasting 10 or more minutes during the last week”.

  • Haskell-Q VPA: “Number of days (0–7) performing vigorous-intensity physical activity/exercise for a minimum of 20 min”.

  • Haskell-Q MPAtot (supplementary question): “Number of days (0–7) with moderate-intensity physical activity accumulated toward the 30-min minimum during the last week”.

2.3.2. BHW-Q

The BHW-Q focuses on time spent in VPA and MPA defined as categorical answer options during a usual week (Figure 1). The BHW-Q generates a continuous outcome of total PA, called “activity minutes”. “Activity minutes” are the number of minutes of VPA × 2 + the number of minutes of MPA [17].

Figure 1.

Figure 1

BHW-Q and GIH-SED-Q answer options.

  • BHW-Q VPA: “During a regular week, how much time do you spend exercising on a level that makes you short winded, for example running, fitness class, or ball games?”.

  • BHW-Q MPA: “During a regular week, how much time are you physically active in ways that are not exercise, for example walks, bicycling, or gardening? Add together all activities lasting at least 10 min”.

  • BHW-Q MPAtot (supplementary question): “During a regular week, how much time are you physically active in ways that are not exercise, for example walks, bicycling, or gardening? Add together all the time”.

2.3.3. GIH-SED-Q

The GIH-SED-Q focuses on time spent while sedentary during a usual day according to categorical answer options (Figure 1).

  • GIH-SED-Q sedentary time: “How much time do you sit during a usual day, excluding sleep?”.

2.4. Criterion Validity Instrument

The three-axial ActiGraph GT3X accelerometer (ActiGraph, Pensacola, FL, USA) was used objectively to measure PA and SED. The ActiLife software, version 6.13.4, was used to initialise, extract and analyse the raw data from the accelerometer. A sampling rate of 30 Hz was used and the raw data were converted to 60 sec epochs in the counts per minute (cpm) unit for the vector magnitude (VM) that combines cpm from three axes into one outcome defined as √ (x2 + y2 + z2). Non-wear time was calculated using the Choi algorithm [21]. Non-wear time was verified by time recorded in the wear-time diaries. At least 540 min and at least one valid day were required to be included in the analysis. The Sasaki [22] cut-points for the VM were used: sedentary is defined as >149 cpm; low PA (LPA) as 150–2689 cpm; moderate intensity PA (MPA) as 2690–6166 cpm and vigorous intensity PA (VPA) as ≥6167 cpm. The weekly mean and median period in wear time, LPA, MPA, VPA and SED, was calculated by dividing the sum of each variable by valid days and multiplying it by 7. “Activity minutes” were calculated by multiplying accelerometer data, VPA, by two, with the addition of MPA. Furthermore, the continuous accelerometer data were categorised into the same categories as the BHW-Q and GIH-SED-Q answer options. Accelerometer data were presented, at group level, as both the median (interquartile range (IQR)) and the mean ± one standard deviation (SD).

2.5. Statistical Analyses

Statistical analyses were performed using SPSS, version 28.0 (IBM Corp. Armonk, NY, USA). All the variables were tested for normal distribution using the Shapiro–Wilk test. Nominal data were presented in absolute numbers and percentages. To analyse the test–retest reliability and correlation, a linearly weighted kappa coefficient (k) and Spearman’s rho (r) were used. The k varies from 0 to 1, where 1 is equivalent to perfect agreement and 0 is no agreement. In this study, an agreement of >0.8 was interpreted as excellent, 0.61–0.8 as substantial, 0.41–0.60 as moderate, 0.21–0.40 as fair and 0.01–0.2 as slight agreement [23]. Spearman´s rho correlation coefficient is able to adopt values between −1 and 1, where 1 indicates a perfect correlation and −1 indicates a perfect negative correlation. The closer the coefficient is to 0, the weaker is the correlation. In this study, a correlation was interpreted as very strong (r > ±0.8), moderately strong (r ± 0.6–0.8), fair (r ± 0.3–0.6) and poor (r < ±0.3) [24]. To analyse criterion validity and agreement between objective and subjective measurements, Spearman´s rho (r) and a linearly weighted kappa coefficient (k) were used. For comparisons at group level, an accepted weighted kappa and Spearman’s rho should exceed 0.7 and 0.5, respectively [14].

3. Results

3.1. Study Population

In all, 238 patients were assessed consecutively for eligibility. A total of 81 patients were included in the study. Of these, five patients were subsequently excluded because they met the criteria for exclusion (n = 4, not being included in SEPHIA; n = 1, having a physical illness preventing them from performing the tests). In addition, 19 patients were excluded due to not having a complete set of either questionnaire data and/or accelerometer data. In all, 57 patients were included in the analysis. The number of patients included from the different hospitals were LBG: n = 10; SU: n = 17; SU-L: n = 8; SU-M: n = 4; and USÖ: n = 18.

Baseline characteristics are shown in Table 1. The majority of the patients were male, had a median age of 69 years and were overweight (mean BMI ≥ 27.6 kg/m²).

Table 1.

Baseline characteristics of study population (n = 57).

Gender, female, n (%) 15 (26)
Age, years, mean (SD) 66 (9.2)
Age, years, median (IQR) 69 (60, 72)
Height, cm (SD) 175 (10)
Weight, kg (SD) 84 (15.4)
BMI, kg/m2 (SD) 27.6 (5.3)
Current smoking 5 (9)
Previous smoker > 1 month 23 (41)
DM 4 (7)
Hypertension 23 (40)
Previous MI 8 (14)
Heart failure 5 (9)
Angina pectoris 4 (7)
Atrial fibrillation 4 (7)
Disease in the musculoskeletal system 6 (11)
Other 13 (23)

SD: standard deviation; IQR: interquartile range; BMI: body mass index; DM: diabetes mellitus; MI: myocardial infraction.

The accelerometer data revealed that 74% of the patients reached the current recommendations on PA, i.e., spent at least ≥ 150 min of MVPA, all minutes included. However, with the 10 min bout restriction, only 49% of the patients achieved at least ≥ 150 min of MVPA. A total of 54% of patients spent more than eight hours/day in SED. No significant differences are shown in patients´ self-reported MPA, VPA and SED between the two measurement occasions (Table 2). The patients spent most of their waking time in SED (mean: 479 ± 88 min/day) and second most in LPA (Table 3).

Table 2.

Descriptive data from questionnaires at test 1 and test 2.

Variable Test 1 Test 2
Haskell-Q MPA (days/w) 5 (4–7) 5 (3–7)
Haskell-Q VPA (days/w) 1 (0–3) 2 (1–5)
Haskell-Q MPAtot * (days/w) 5 (3–7) 5 (2–6)
BHW-Q VPA (min/w) 45 (0–105) 45 (0–105)
BHW-Q MPA (min/w) 225 (75–300) 225 (45–300)
BHW-Q MPAtot * (min/w) 225 (120–300) 225 (120–300)
GIH-SED-Q (hours/day) 5 (5–8) 5 (5–8)
BHW activity minutes ** 300 (143–435) 285 (139–386)
BHW activity minutes *** 300 (188–435) 300 (225–450)

Median (IQR (interquartile range)); MPA: moderate-intensity physical activity; VPA: vigorous-intensity physical activity; SED: sedentary time. * Without ≥10 min bouts; ** BHW-Q VPA × 2 + BHW-Q MPA; *** BHW-Q VPA × 2 + BHW-Q MPA*.

Table 3.

Descriptive data from accelerometer.

Variable Mean (SD) Median (IQR)
Total wear time (min/day) 845 (66) 847 (794–878)
VM CPM 558 (201) 512 (408–681)
LPA (min/w) 2238 (583) 2303 (1873–2605)
MPA (min/w) 301 (191) 256 (135–402)
VPA (min/w) 21 (56) 1 (0–10)
MVPA ≥ 10 min bouts (min/w) 162 (178) 115 (18–237)
Accelerometer activity minutes 1 342 (248) 299 (143–464)
Accelerometer activity minutes 2 204 (253) 143 (25–288)
SED (min/day) 479 (88) 486 (43–543)

SD: standard deviation; IQR: interquartile range; VM CPM: vector magnitude counts per minute; LPA: light-intensity physical activity; MPA: moderate-intensity physical activity; VPA: vigorous-intensity physical activity; MVPA: moderate- to vigorous-intensity physical activity; SED: sedentary time; 1 VPA × 2 + MPA (min/w). 2 VPA × 2 + MVPA ≥ 10 min bouts (min/w).

3.2. Test–Retest Reliability

Test–retest reliability was moderate for Haskell-Q MPA (k = 0.434), BHW-Q VPA (k = 0.521), “Activity minutes” without ≥ 10 min bouts (k = 0.442) and GIH-SED-Q (k = 0.535). The remaining questions presented a fair test–retest reliability (k = 0.219–0.375) (Table 4).

Table 4.

Test–retest reliability and correlation of the questionnaires.

Question n Kappa (95% CI) p (k) Spearman’s rho p (rho)
Haskell-Q MPA 56 0.434 (0.284–0.585) <0.001 0.573 * <0.001
Haskell-Q VPA 56 0.317 (0.152–0.482) <0.001 0.409 * 0.002
Haskell-Q MPAtot 1 55 0.375 (0.220–0.530) <0.001 0.532 * <0.001
BHW-Q VPA 56 0.521 (0.359–0.684) <0.001 0.633 * <0.001
BHW-Q MPA 56 0.295 (0.104–0.485) 0.007 0.345 * 0.009
BHW-Q MPAtot 1 55 0.337 (0.139–0.535) <0.001 0.383 * 0.004
BHW activity minutes 2 55 0.354 (0.197–0.512) <0.001 0.542 * <0.001
BHW activity minutes 3 54 0.422 (0.268–0.575) <0.001 0.619 * <0.001
GIH-SED-Q 57 0.535 (0.360–0.711) <0.001 0.602 * <0.001

Kappa: weighted kappa coefficient; 95% CI: 95% confidence interval; Spearman’s rho: Spearman’s rho correlation coefficient. 1 Without ≥10 min bouts; 2 BHW-Q VPA × 2 + BHW-Q MPA (min/w); 3 BHW-Q VPA × 2 + BHW-Q MPA 1 (min/w); * p = 0.01.

3.3. Criterion Validity and Agreement

Correlation between PA and SED questions and categorical accelerometer data was fair for Haskell-Q MPA (r = 0.407), BHW-Q MPA (r = 0.578), BHW-Q MPAtot (r = 0.501) and “Activity minutes” (r = 0.429). A fair agreement was shown by BHW-Q MPA and BHW-Q MPAtot (k = 0.341 resp. 0.237). All other questions presented a slight to poor correlation to categorical accelerometer data (r = 0.139–0.291) (Table 5).

Table 5.

Criterion validity and agreement for questionnaires of PA and SED using accelerometer.

Question n Kappa (95% CI) p (k) Spearman’s rho p (rho)
Haskell-Q MPA 56 0.129 (−0.029–0.251) 0.029 0.407 * 0.002
Haskell-Q VPA 57 0.047 (−0.015–0.109) 0.146 0.139 0.301
Haskell-Q MPAtot 1 55 0.218 (0.038–0.398) 0.013 0.282 ** 0.037
BHW-Q VPA 56 0.080 (−0.073–0.234) 0.243 0.256 0.057
BHW-Q MPA 56 0.341 (0.185–0.496) <0.001 0.578 * <0.001
BHW-Q MPAtot 1 55 0.237 (0.099–0.376) <0.001 0.501 * <0.001
Activity minutes 2 56 0.276 (0.141–0.411) <0.001 0.429 * <0.001
Activity minutes 3 54 0.254 (0.086–0.421) 0.002 0.385 * 0.004
GIH-SED-Q 57 0.116 (−0.022–0.254) 0.061 0.291 ** 0.028

Kappa: weighted kappa coefficient; 95% CI: 95% confidence interval; Spearman’s rho: Spearman’s rho correlation coefficient. 1 Without ≥ 10 min bouts; 2 BHW-Q activity minutes vs. accelerometer activity minutes; 3 BHW-Q activity minutes 1 vs. accelerometer activity minutes 1 * p = 0.01 ** p = 0.05.

4. Discussion

To our knowledge, this is the first study to assess test–retest reliability for the Haskell-Q and BHW-Q questionnaires. The main findings were that PA and SED questions in patients with an MI displayed fair to moderate test–retest reliability, with poor to fair correlation and slight to fair agreement assessed with an accelerometer.

The test–retest reliability for the Haskell-Q questionnaire was fair to moderate, with weighted kappa values between 0.32 and 0.43, which is below the recommended level of k = 0.7 [14]. The highest reliability was found for MPA, with at least 10 min bouts, but, overall, there was no large difference between MPA, MPAtot and VPA. Regarding test–retest reliability within the BHW-Q, the highest value was found for VPA (k = 0.63). One reason why test–retest values, in general, are under the recommended k = 0.7 [14] for both the Haskell-Q and BHW-Q questionnaires could be the design of the questionnaires. In the Haskell-Q questionnaire, patients are asked to rate the frequency of physical activity during the latest week and this could vary for natural reasons, for example, temporary illness. In the BHW-Q, on the other hand, patients are asked about physical activity and exercise in a regular week. In theory, it can be hypothesised that the BHW-Q would have a higher test–retest reliability than the Haskell-Q, due to its design. This indicates that the patients in the present study may refer to recall period other than a “usual week” when self-reporting their PA with the BHW-Q. The higher agreement for the BHW-Q VPA is in line with results from previous studies showing that patients generally have the same exercise routine between weeks [25]. On the other hand, activities on a moderate-intensity level may differ more between test occasions and, in addition, patients may not consider that the MPA questions are asking about a regular week. The highest correlation between the Haskell-Q questionnaire and the accelerometer is shown for MPA, with at least 10 min bouts (r = 0.41), which is slightly higher compared with another study in the same context (r = 0.28) [20]. On the other hand, Lönn et al. [20] had a higher correlation between the Haskell-Q VPA and accelerometer data (r = 0.24) than the present study (r = 0.14). The correlation between the Haskell-Q MPA and the accelerometer was higher compared with the Haskell-Q MPAtot, which may suggest that it is challenging for patients to self-report the moderate-intensity level when all the time is included. Another explanation may be that the accelerometer is sensitive to short interruptions in bouts of activity that might not be perceived as an interruption by the patients.

The correlation for the BHW-Q questionnaire and accelerometer was poor to fair in this study. There was only a slight difference between the BHW-Q MPA and BHW MPAtot, and both values are in line with the recommended correlation of r = 0.5 [14]. This suggests that both questions are sufficiently valid to measure moderate-intensity PA. The associations between the BHW-Q MPA and the accelerometer were, however, higher in the present study as compared to the study by Lönn et al. [20]. Moreover, in terms of “activity minutes”, the association between the BHW-Q MVPA/MVPAtot and the accelerometer was higher in our study compared with a study by Olsson et al. [17] in the general population.

Generally, the test–retest reliability in the present study is in line with an earlier larger review of test–retest reliability for different PA questionnaires and populations (k = 0.32–0.87) [26]. Only a few studies have examined the criterion validity of self-reported PA and accelerometer for patients with CVD [20,27,28] and the agreement between PA questions and accelerometer is generally low [28,29].

The test–retest reliability of the GIH-SED-Q was moderate in the present study, which is lower than in the study by Larsson et al. [19], who studied a healthy elderly population (≥65 years) living in a large city region. The correlation between the GIH-SED-Q and the accelerometer is similar to Lönn et al.’s [20] results, r = 0.37 (vs. 0.29). Both correlations are lower compared with the study by Kallings et al. [18] of the GIH-SED-Q and stationary time in a general population, r = 0.48 [18]. On the other hand, the correlations were higher in our study compared with other studies that have examined the validity of SED questions in a CR context (r = 0.14–0.21) [27,28,30]. The agreement was slight for the GIH-SED-Q assessed using the accelerometer in our study, which is in line with the results of Lönn et al. (0.09) [20]. The GIH-SED-Q is limited by the specific formulation about sitting time, which is regarded as sedentary time. Gardner et al. [31] have suggested that people rarely reflect on sitting as a behaviour but more as a by-product of more meaningful sitting activities, which means that self-reported sedentary time may be misclassified [31]. In a systematic review and meta-analysis by Bakker et al. [32] assessing SED in healthy adults, the correlation between the accelerometer and self-reports was strongest for logs and diaries compared with questionnaires (0.63 vs. 0.35). However, there was no major difference between multi-item questionnaires and few-item questionnaires (0.37 vs. 0.34) [32], which suggests that one-item questionnaires may be preferable in a large population, due to time consumption when answering larger multi-item questionnaires. There is, however, a need for future research to further elaborate on the design of sufficiently valid SED questionnaires.

In line with the updated PA recommendations, we assessed the reliability and validity of self-reported PA with and without at least 10 min bouts and found no meaningful difference in outcome within the BHW-Q. Another study by Kambic et al. [28] also found no meaningful difference in self-reported PA with and without at least 10 min bouts using The International Physical Activity Questionnaire short form (IPAQ-SF) when examining validity and agreement compared with an accelerometer [28]. However, regarding the Haskell-Q, the original Haskell-Q MPA with at least 10 min bouts was superior to the adapted Haskell-Q total time, even though the differences were small.

Methodological Considerations

One strength of this study is the external validity as data were collected from several CR centres in Sweden. The proportion of women included in this study reflects the general MI population in Sweden [33]. A strength of the present study was the inclusion of participants representing a wide range of physical activity levels, i.e., low to high [34,35]. A priori sample size calculation was not performed. A retrospective sample size calculation based on a desired reliability coefficient of 0.7 with a CI of 0.1 has been conducted. With a 50% assurance probability and two testing sessions, a minimum sample size of 101 participants was required. Additional studies with a larger sample size to reach sufficient power are recommended to replicate our findings.

The choice of an appropriate criterion measurement in validation studies has previously been discussed. The doubly labelled water method (DLW) is the gold standard for estimating energy expenditure in free-living individuals [36]. However, the DLW is unable to provide data on the intensity, frequency and pattern of PA or SED. As a result, accelerometer measurements have been suggested as one of the best criterion instruments and the accelerometer is the most used objective instrument when validating self-report PA instruments [37,38,39]. The accelerometer measurements were performed for the same period as the Haskell-Q. We, therefore, have no reason to believe that the patients did not refer to the same period. This is in contrast to the BHW-Q and GIH-SED-Q that consider a usual week.

Measuring PA with accelerometers does have some limitations. For example, it cannot be used in water-based activities (swimming) and activities such as strength training. Bicycling may be reported as a false low activity as the accelerometer is placed on the hip. As accelerometer measurements were performed during an exercise-based CR period where ergometer bicycle exercise is a common exercise modality within exercise-based cardiac rehabilitation, this could be one explanation of the weaker correlations between the accelerometer and self-reported VPA. Accelerometers gather information about acceleration in different directions and do not consider body position. Sedentary behaviour was assessed using a hip-placed accelerometer in terms of energy expenditure and not sedentary condition defined by both energy expenditure and posture. A hip-placed accelerometer has a tendency to misclassify different body positions, such as lying, sitting and standing [40]. This may lead to a discrepancy between SED time of accelerometer data when compared with self-reported SED time. Nonetheless, the accelerometer is frequently used in studies that measure SED [32]. Cut-off values for SED and different PA intensities used in this study are in line with a previous study of the CVD population [28].

5. Conclusions

The main findings in this study were that the BHW-Q has a higher criterion validity than the Haskell-Q and that the test–retest reliability is similar for both questionnaires. These PA questionnaires could be used in clinical practice as a screening tool and/or to evaluate the level of PA patients with an MI. On the other hand, as the criterion validity between the GIH-SED-Q and the accelerometer was poor, the further development of the design of sufficiently valid SED questionnaires in patients with an MI is recommended.

Acknowledgments

The authors would like to thank the patients for their participation. The authors would also like to thank all the CR staff at LBG, SU, SUS-M/L and USO who recruited all patients and collected data.

Author Contributions

Conceptualization, M.B. (Marcus Bargholtz) and M.B. (Maria Bäck); methodology, M.B. (Marcus Bargholtz), M.B. (Maria Bäck) and M.H. (Maria Hagströmer); validation, M.H. (Maria Hagströmer) and M.B. (Maria Bäck); formal analysis, M.B. (Marcus Bargholtz), M.H. (Maria Hagströmer) and M.B. (Maria Bäck); investigation, M.B. (Marcus Bargholtz), M.B. (Madeleine Brosved), K.H., M.H. (Marie Hellmark) and M.L.; resources, M.B. (Maria Bäck); writing—original draft preparation, M.B. (Marcus Bargholtz); writing—review and editing, M.B. (Madeleine Brosved), K.H., M.H. (Marie Hellmark), M.L., M.H. (Maria Hagströmer) and M.B. (Maria Bäck); visualization, M.B. (Marcus Bargholtz); supervision, M.H. (Maria Hagströmer) and M.B. (Maria Bäck); project administration, M.B. (Marcus Bargholtz) and M.B. (Maria Bäck). All authors have read and agreed to the published version of the manuscript.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki and approved by the Regional Ethical Review Board at the University of Uppsala (2020-05142 and with amendment 2021-01634).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Study data are not publicly available due to identifying patient data should not be shared. Upon reasonable request, de-identified data may be available from the corresponding author.

Conflicts of Interest

The authors declare no conflict of interest.

Funding Statement

This research received no external funding.

Footnotes

Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

References

  • 1.WHO The Top 10 Causes of Death. Fact Sheet. 2020. [(accessed on 2 March 2023)]. Available online: https://www.who.int/news-room/fact-sheets/detail/the-top-10-causes-of-death.
  • 2.WHO . Guidelines on Physical Activity and Sedentary Behaviour. World Health Organization; Geneva, Switzerland: 2020. [PubMed] [Google Scholar]
  • 3.Pelliccia A., Sharma S., Gati S., Bäck M., Börjesson M., Caselli S., Collet J.-P., Corrado D., Drezner J.A., Halle M., et al. 2020 ESC Guidelines on sports cardiology and exercise in patients with cardiovascular disease: The Task Force on sports cardiology and exercise in patients with cardiovascular disease of the European Society of Cardiology (ESC) Eur. Heart J. 2020;42:17–96. doi: 10.1093/eurheartj/ehaa605. [DOI] [Google Scholar]
  • 4.2018 Physical Activity Guidelines Advisory Committee . 2018 Physical Activity Guidelines Advisory Committee Scientfic Report. U.S. Department of Health and Human Service; Washington, DC, USA: 2018. [Google Scholar]
  • 5.Ballin M., Nordström P., Niklasson J., Nordström A. Associations of Objectively Measured Physical Activity and Sedentary Time with the Risk of Stroke, Myocardial Infarction or All-Cause Mortality in 70-Year-Old Men and Women: A Prospective Cohort Study. Sports Med. 2021;51:339–349. doi: 10.1007/s40279-020-01356-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Ekelund U., Tarp J., Steene-Johannessen J., Hansen B.H., Jefferis B., Fagerland M.W., Whincup P., Diaz K.M., Hooker S.P., Chernofsky A., et al. Dose-response associations between accelerometry measured physical activity and sedentary time and all cause mortality: Systematic review and harmonised meta-analysis. BMJ. 2019;366:l4570. doi: 10.1136/bmj.l4570. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Stewart R.A.H., Held C., Hadziosmanovic N., Armstrong P.W., Cannon C.P., Granger C.B., Hagström E., Hochman J.S., Koenig W., Lonn E., et al. Physical Activity and Mortality in Patients With Stable Coronary Heart Disease. J. Am. Coll. Cardiol. 2017;70:1689–1700. doi: 10.1016/j.jacc.2017.08.017. [DOI] [PubMed] [Google Scholar]
  • 8.Gorczyca A.M., Eaton C.B., LaMonte M.J., Manson J.E., Johnston J.D., Bidulescu A., Waring M.E., Manini T., Martin L.W., Stefanick M.L., et al. Change in Physical Activity and Sitting Time After Myocardial Infarction and Mortality Among Postmenopausal Women in the Women’s Health Initiative-Observational Study. J. Am. Heart Assoc. 2017;6:e005354. doi: 10.1161/JAHA.116.005354. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Ek A., Kallings L.V., Ekström M., Börjesson M., Ekblom Ö. Subjective reports of physical activity levels and sedentary time prior to hospital admission can predict utilization of hospital care and all-cause mortality among patients with cardiovascular disease. Eur. J. Cardiovasc. Nurs. 2020;19:691–701. doi: 10.1177/1474515120921986. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Dishman R.K., Washburn R.A., Schoeller D.A. Measurement of Physical Activity. Quest. 2001;53:295–309. doi: 10.1080/00336297.2001.10491746. [DOI] [Google Scholar]
  • 11.Brodin N., Swardh E., Biguet G., Opava C.H. Understanding how to determine the intensity of physical activity--an interview study among individuals with rheumatoid arthritis. Disabil. Rehabil. 2009;31:458–465. doi: 10.1080/09638280802131853. [DOI] [PubMed] [Google Scholar]
  • 12.Plasqui G., Westerterp K.R. Physical activity assessment with accelerometers: An evaluation against doubly labeled water. Obesity. 2007;15:2371–2379. doi: 10.1038/oby.2007.281. [DOI] [PubMed] [Google Scholar]
  • 13.Van Remoortel H., Giavedoni S., Raste Y., Burtin C., Louvaris Z., Gimeno-Santos E., Langer D., Glendenning A., Hopkinson N.S., Vogiatzis I., et al. Validity of activity monitors in health and chronic disease: A systematic review. Int. J. Behav. Nutr. Phys. Act. 2012;9:84. doi: 10.1186/1479-5868-9-84. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Terwee C.B., Mokkink L.B., van Poppel M.N., Chinapaw M.J., van Mechelen W., de Vet H.C. Qualitative attributes and measurement properties of physical activity questionnaires: A checklist. Sports Med. 2010;40:525–537. doi: 10.2165/11531370-000000000-00000. [DOI] [PubMed] [Google Scholar]
  • 15.Bäck M., Leosdottir M., Hagström E., Norhammar A., Hag E., Jernberg T., Wallentin L., Lindahl B., Hambraeus K. The SWEDEHEART secondary prevention and cardiac rehabilitation registry (SWEDEHEART CR registry) Eur. Heart J. Qual. Care Clin. Outcomes. 2021;7:431–437. doi: 10.1093/ehjqcco/qcab039. [DOI] [PubMed] [Google Scholar]
  • 16.Haskell W.L., Lee I.-M., Pate R.R., Powell K.E., Blair S.N., Franklin B.A., Macera C.A., Heath G.W., Thompson P.D., Bauman A. Physical Activity and Public Health: Updated Recommendation for Adults from the American College of Sports Medicine and the American Heart Association. Med. Sci. Sports Exerc. 2007;39:1423–1434. doi: 10.1249/mss.0b013e3180616b27. [DOI] [PubMed] [Google Scholar]
  • 17.Olsson S.J., Ekblom O., Andersson E., Borjesson M., Kallings L.V. Categorical answer modes provide superior validity to open answers when asking for level of physical activity: A cross-sectional study. Scand. J. Public Health. 2016;44:70–76. doi: 10.1177/1403494815602830. [DOI] [PubMed] [Google Scholar]
  • 18.Kallings L.V., Olsson S.J.G., Ekblom Ö., Ekblom-Bak E., Börjesson M. The SED-GIH: A Single-Item Question for Assessment of Stationary Behavior-A Study of Concurrent and Convergent Validity. Int. J. Environ. Res. Public Health. 2019;16:4766. doi: 10.3390/ijerph16234766. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Larsson K., Kallings L.V., Ekblom Ö., Blom V., Andersson E., Ekblom M.M. Criterion validity and test-retest reliability of SED-GIH, a single item question for assessment of daily sitting time. BMC Public Health. 2019;19:17. doi: 10.1186/s12889-018-6329-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Lönn A., Kallings L.V., Börjesson M., Ekblom Ö., Ekström M. Convergent validity of commonly used questions assessing physical activity and sedentary time in Swedish patients after myocardial infarction. BMC Sports Sci. Med. Rehabil. 2022;14:117. doi: 10.1186/s13102-022-00509-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Choi L., Liu Z., Matthews C.E., Buchowski M.S. Validation of accelerometer wear and nonwear time classification algorithm. Med. Sci. Sports Exerc. 2011;43:357–364. doi: 10.1249/MSS.0b013e3181ed61a3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Sasaki J.E., John D., Freedson P.S. Validation and comparison of ActiGraph activity monitors. J. Sci. Med. Sport. 2011;14:411–416. doi: 10.1016/j.jsams.2011.04.003. [DOI] [PubMed] [Google Scholar]
  • 23.Landis J.R., Koch G.G. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–174. doi: 10.2307/2529310. [DOI] [PubMed] [Google Scholar]
  • 24.Chan Y.H. Biostatistics 104: Correlational analysis. Singap. Med. J. 2003;44:614–619. [PubMed] [Google Scholar]
  • 25.Freene N., McManus M., Mair T., Tan R., Davey R. Objectively Measured Changes in Physical Activity and Sedentary Behavior in Cardiac Rehabilitation: A PROSPECTIVE COHORT STUDY. J. Cardiopulm. Rehabil. Prev. 2018;38:E5–E8. doi: 10.1097/HCR.0000000000000334. [DOI] [PubMed] [Google Scholar]
  • 26.Dowd K.P., Szeklicki R., Minetto M.A., Murphy M.H., Polito A., Ghigo E., van der Ploeg H., Ekelund U., Maciaszek J., Stemplewski R., et al. A systematic literature review of reviews on techniques for physical activity measurement in adults: A DEDIPAC study. Int. J. Behav. Nutr. Phys. Act. 2018;15:15. doi: 10.1186/s12966-017-0636-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Biswas A., Oh P.I., Faulkner G.E., Alter D.A. A prospective study examining the influence of cardiac rehabilitation on the sedentary time of highly sedentary, physically inactive patients. Ann. Phys. Rehabil. Med. 2018;61:207–214. doi: 10.1016/j.rehab.2017.06.003. [DOI] [PubMed] [Google Scholar]
  • 28.Kambič T., Sarabon N., Hadzic V., Lainscak M. Objectively Measured Physical Activity in Patients with Coronary Artery Disease: A Cross-Validation Study. Biosensors. 2021;11:318. doi: 10.3390/bios11090318. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Orrell A., Doherty P., Coulton S., Miles J., Stamatakis E., Lewin R. Failure to validate the Health Survey for England physical activity module in a cardiac population. Health Policy. 2007;84:262–268. doi: 10.1016/j.healthpol.2007.03.004. [DOI] [PubMed] [Google Scholar]
  • 30.Freene N., McManus M., Mair T., Tan R., Clark B., Davey R. Validity of the Past-day Adults’ Sedentary Time Questionnaire in a Cardiac Rehabilitation Population. J. Cardiopulm. Rehabil. Prev. 2020;40:325–329. doi: 10.1097/HCR.0000000000000488. [DOI] [PubMed] [Google Scholar]
  • 31.Gardner B., Flint S., Rebar A.L., Dewitt S., Quail S.K., Whall H., Smith L. Is sitting invisible? Exploring how people mentally represent sitting. Int. J. Behav. Nutr. Phys. Act. 2019;16:85. doi: 10.1186/s12966-019-0851-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Bakker E.A., Hartman Y.A.W., Hopman M.T.E., Hopkins N.D., Graves L.E.F., Dunstan D.W., Healy G.N., Eijsvogels T.M.H., Thijssen D.H.J. Validity and reliability of subjective methods to assess sedentary behaviour in adults: A systematic review and meta-analysis. Int. J. Behav. Nutr. Phys. Act. 2020;17:75. doi: 10.1186/s12966-020-00972-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.SWEDEHEART SWEDEHEART Annual Report 2021. 2022. [(accessed on 25 July 2023)]. Available online: https://www.ucr.uu.se/swedeheart/dokument-sh/arsrapporter-sh/1-swedeheart-annual-report-2021-english/viewdocument/3384.
  • 34.Hagströmer M., Ainsworth B.E., Kwak L., Bowles H.R. A checklist for evaluating the methodological quality of validation studies on self-report instruments for physical activity and sedentary behavior. J. Phys. Act. Health. 2012;9:S29–S36. doi: 10.1123/jpah.9.s1.s29. [DOI] [PubMed] [Google Scholar]
  • 35.Welk G. Physical Activity Assessments for Health-Related Research. Human Kinetics; Champaign, IL, USA: 2002. [Google Scholar]
  • 36.FAO. WHO. UNU Human energy requirements: Report of a joint FAO/WHO/UNU Expert Consultation. Food Nutr. Bull. 2005;26:166. [PubMed] [Google Scholar]
  • 37.Prince S.A., Blanchard C.M., Grace S.L., Reid R.D. Objectively-measured sedentary time and its association with markers of cardiometabolic health and fitness among cardiac rehabilitation graduates. Eur. J. Prev. Cardiol. 2016;23:818–825. doi: 10.1177/2047487315617101. [DOI] [PubMed] [Google Scholar]
  • 38.Helmerhorst H.J., Brage S., Warren J., Besson H., Ekelund U. A systematic review of reliability and objective criterion-related validity of physical activity questionnaires. Int. J. Behav. Nutr. Phys. Act. 2012;9:103. doi: 10.1186/1479-5868-9-103. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Kowalski K., Rhodes R., Naylor P.J., Tuokko H., MacDonald S. Direct and indirect measurement of physical activity in older adults: A systematic review of the literature. Int. J. Behav. Nutr. Phys. Act. 2012;9:148. doi: 10.1186/1479-5868-9-148. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Anderson J., Green A., Hall H., Yoward S. Criterion validity of an ankle or waist mounted Actigraph GT3X accelerometer in measurement of body position and step count. Physiotherapy. 2016;102:e79–e80. doi: 10.1016/j.physio.2016.10.077. [DOI] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

Study data are not publicly available due to identifying patient data should not be shared. Upon reasonable request, de-identified data may be available from the corresponding author.


Articles from International Journal of Environmental Research and Public Health are provided here courtesy of Multidisciplinary Digital Publishing Institute (MDPI)

RESOURCES