Questionable accuracy of home blood pressure measurements in the obese population – Validation of the Microlife WatchBP O3^® and Omron RS6^® devices according to the European Society of Hypertension-International Protocol

Abstract

Objective

Two oscillometric devices, the Microlife WatchBP O3^® and the Omron RS6^®, designed for self-blood pressure measurement were evaluated according to the European Society of Hypertension (ESH)-International Protocol (IP) Revision 2010 in the obese population.

Methods

The Microlife WatchBP O3 measures blood pressure (BP) at the brachial level and the Omron RS6 measures BP at the wrist level. The ESH-IP revision 2010 includes a total of 33 subjects. The difference between observers’ and device BP values was calculated for each measure. A total of 99 pairs of BP differences were classified into three categories (≤5, ≤10, and ≤15 mmHg). The protocol procedures were followed precisely in each of the two studies.

Results

Microlife WatchBP O3 and Omron RS6 failed to fulfill the criteria of the ESH-IP. The mean differences between the device and the mercury readings were: 0.3±7.8 mmHg and −1.9±6.4 mmHg for systolic BP and diastolic BP, respectively, for Microlife WatchBP O3, and 2.7±9.9 mmHg for SBP and 3.5±11.1 mmHg for diastolic BP for Omron RS6.

Conclusion

Microlife WatchBP O3 and Omron RS6 readings differing from the mercury standard by more than 5, 10, and 15 mmHg failed to fulfill the ESH-IP revision 2010 requirements in obese subjects. Therefore, the two devices cannot be recommended for use in obese subjects.

Introduction

Hypertension (HTN) is a common reason for office visits to physicians, as observed in daily clinical practice. Efforts are directed toward treatment of high blood pressure (BP) by pharmacologic and nonpharmacologic interventions to reduce the burden of the disease and its complications.¹ Screening for HTN is fundamental in medical practice because subjects who are still normotensive at age 50 have a 90% time-life risk of developing HTN.^2,3 Because HTN is only identified by measuring BP,⁴ accurate measurement is crucial for diagnosis and management.

The World Health Organization and the National Institutes of Health define subjects with a Body Mass Index (BMI) ≥25 kg/m² as overweight and those with BMI ≥30 kg/m² as obese.⁵ Accordingly, the prevalence of overweight and obesity is high in the general population.⁵ Moreover, obesity is an established risk factor for HTN,^6,7 and the pathophysiologic mechanisms by which obesity predisposes to HTN are well-understood.⁸ This has made accurate BP measurements in such population of extreme importance.

Overweight and obese patients often require the use of large-sized cuffs.⁹ Unsuitable cuff sizes are associated with inaccurate measures of BP.^10,11 The use of inappropriate cuff size is a common error in measuring BP, where small-sized cuffs lead to overestimation of BP.¹² The need of a large-sized cuff is critical because data have shown that only the standard adult size is available in practice of Home BP measurements.¹³ In addition, a potential impact of adiposity on BP is underestimated in obese individuals.⁷ Obese people have arms that are shaped as an inverted cone, with the diameter at the top of the arm greater than that at the elbow, which adds to difficulty in choosing the proper cuff size.¹⁴ Therefore, BP measurement is problematic in obese for several reasons and present a number of bias such as the arm circumference and cuff-related bias, the subcutaneous adiposity thickness, compression of the artery, and modification of the BP signal, as well as the specific hemodynamic parameters impacting the BP signal.

Three different protocols are used to validate the accuracy of BP measuring devices, such as the International protocol (IP) published by the working group on BP monitoring of the European Society of Hypertension (ESH),¹⁵ the British Hypertension Society¹⁶ protocols, and the Association for the Advancement of Medical Instrumentation protocol.¹⁷ Over the last 10 years, several automated devices have been successfully validated using these protocols,¹⁸ mostly in the general population. However, few studies^{10,19,20–23} have tested the accuracy of automated BP monitors in specific populations such as obese patients.

In 2010 and 2013, two BP devices, Microlife WatchBP O3²⁴ and Omron RS6,²⁵ were validated in the general population following the ESH-IP. None of these BP devices was validated in the obese population. The objective of the study is to assess the accuracy of automatic oscillometric BP devices: the Microlife WatchBP O3 (at the brachial level) and the Omron RS6 (at the wrist level) in obese subjects according to the ESH-IP.

Materials and methods

Ethical information

This study was approved by the local ethical committee of the Faculty of Medical Sciences at the Lebanese University. Prior to any BP measurements, all eligible subjects included in this study signed an informed written consent.

Tested devices

Omron RS6

Omron RS6 (HEM-6221-E) is an automatic device for self-measurement of BP at the wrist level by using the oscillometric method. Inflation is automatic by a pump. Deflation is fast and automatic; 2×1.5 V “AAA” batteries are needed. It weighs 85 g without the batteries. Dimensions are 87 mm (L)×64 mm (H)×14 mm (D) without the bracelet. The wrist cuff circumference is suitable for a wrist circumference of 13.5–21.5 cm. The device has a digital liquid crystal display screen that displays the measured BP and pulse rate. The unit measures pressures from 0 to 299 mmHg and pulse from 40 to 180 beats/min.

Microlife WatchBP O3

Microlife WatchBP O3 (BP 3MZ1-1) is an automatic device for office, home, and ambulatory BP measurements taken at the arm level by using the oscillometric method. Inflation and deflation are automatic; 4×1.5 V “AA” batteries are needed. It weighs 385 g including the batteries. Dimensions are 150 mm (L)×100 mm (H)×50 mm (D). The device has a digital liquid crystal display screen that displays the measured BP and pulse rate. The unit measures pressures from 0 to 299 mmHg and pulse from 40 to 200 beats/min. Several cuff sizes of nylon and polyester are included with the Microlife WatchBP O3 and are applicable to different arm circumferences ranges; the only cuff used in our study is the one provided by the manufacturer, which is the large cuff for arm circumference of 32–42 cm.

Study protocol

According to the ESH-IP revision 2010, a total of 33 participants who fulfilled the age, gender, and entry BP requirements, with a BMI ≥30 kg/m², were included in the validation of both devices, such as: age ≥25 years, with at least 10 men and 10 women, and 10–12 participants in each of the three BP recruitment ranges: 90–129, 130–160, and 161–180 mmHg for systolic BP (SBP) and 40–79, 80–100, and 101–130 mmHg for diastolic BP (DBP).

The arm circumference size of all participants was between 32 and 42 cm, and none of them had atrial fibrillation or any other arrhythmia. In these two validations, subjects were preselected from the outpatient clinics and from the inpatients at the Lebanese University affiliated hospitals (Mount-Lebanon, Lebanese Hospital Geitaoui, Rafik Hariri University Hospital, Governmental Hospital of Baabda, Rasoul el-Aazam Hospital, and Bahman Hospital).

For BP measurement, the validation team consisted of three persons: two observers trained in accurate BP measurement and a supervisor, all of whom completed training on the basis of a Compact Disc, read-only-memory specifically developed by the French Society of Hypertension for certification of observers involved in clinical studies and familiarized themselves with the use of the corresponding tested devices.

The gold standard instrument for BP measurement consisted of a mercury sphygmomanometer and a stethoscope. In our study, two parallel connected mercury sphygmomanometers and a teaching stethoscope were used by the two observers as a reference standard. The circumference of the arm was measured to ensure that the cuff size being used was adequate for the subject. The agreement between the two observers, blinded from each other’s result, was checked all over the evaluation period by the supervisor to make sure that the difference between the two observers was no more than 4 mmHg for SBP and DBP values. Otherwise, the measurement was repeated.

Measurements with the mercury sphygmomanometer were performed according to the “same arm, consecutive measurements” supported at the heart level. Measurements by the Microlife WatchBP O3 device were on the same arm supported at the heart level, whereas the ones by the Omron RS6 device were at the wrist level, as recommended by the manufacturers, with the subjects asked to relax for 5–10 min, while making sure that they were seated with their legs uncrossed and back supported. The only cuff used in our study for the standard mercury sphygmomanometer measurements was the same one provided by the manufacturer with the Microlife WatchBP O3 device, that is, the large cuff for arm circumference of 32–42 cm. In total, for each device, nine consecutive BP measurements were performed in each patient using the mercury sphygmomanometers (five times) and the tested device (four times), and were recorded as follows:

• BPA entry BP, observers 1 and 2 each with the mercury standard

• BPB device detection BP, supervisor

• BP1 observers 1 and 2 with mercury standard

• BP2 supervisor with the test instrument

• BP3 observers 1 and 2 with mercury standard

• BP4 supervisor with the test instrument

• BP5 observers 1 and 2 with mercury standard

• BP6 supervisor with the test instrument

• BP7 observers 1 and 2 with mercury standard

However, since every subject was participating in the validation of both BP devices, 13 consecutive BP measurements were performed in each patient using the mercury sphygmomanometers (five times) and both of the tested devices (four times ×2).

Data analysis

Results were analyzed and expressed according to the ESH-IP requirements to conclude if the device passed or failed to pass the validation protocol. The statistical analysis was realized by using specific analysis software developed by the International Society for Vascular Health. For each subject, the device measurements BP2, BP4, and BP6 were first compared to the observer measurements BP1, BP3, and BP5, respectively, and then to the observer measurements BP3, BP5, and BP7, respectively. Comparisons more favorable to the device were used. BP1, BP3, BP5, and BP7 were the means of the two observer measurements. Briefly, differences between tested device and control measurements were classified according to whether their values lied within 5, 10, or 15 mmHg. Differences were calculated by subtracting the observer measurement from the device measurement; they were classified separately in this way for both SBP and DBP. Data were expressed as mean ± standard deviation.

Bland–Altman plots, used to show the deviations and linear correlation coefficients, were drawn to analyze the relationship between Delta SBP (device – reference) and Mean SBP (device and reference) or Delta DBP (device – reference) and Mean DBP (device and reference). The Pearson’s correlation coefficient “r” was calculated from r²; then p was determined by software using “r” and the total number of subjects “n”, following a two-tailed probability. The p value was considered statistically significant when p<0.05.

Results

Participants

A total of 72 subjects were screened and 34 participants were recruited following the three different BP ranges as follows: 11 subjects in the range 90–129 mmHg, 11 subjects in the range 130–160 mmHg, 10 subjects in the range 161–180 mmHg, and in 2 subjects >180 mmHg, for SBP; and 11 subjects in the range 40–79 mmHg, 12 subjects in the range 80–100 mmHg, and 11 subjects in the range 101–130 mmHg for DBP. The participants were distributed as follows: there were 18 males and 16 females; the mean age of the participants was 48±12 years; their wrist circumference ranged from 16 to 20 cm and their arm circumference ranged from 32 to 41 cm. The mean recruitment SBP was 146.1±26 mmHg (108–197 mmHg) and the mean recruitment DBP was 88.1±16 mmHg (56–120 mmHg).

BP measurements

Microlife WatchBP O3

The difference between the two observers was 0.0±2.2 and −0.3±1.9 mmHg for SBP and DBP, respectively (−4 to +4 mmHg). The mean differences between the observers and the tested device were +0.3±7.8 mmHg for SBP and −1.9±6.4 mmHg for DBP. The numbers of measurements differing from the mercury standard by 5, 10, and 15 mmHg or less are shown in Table 1. Bland–Altman plots of the differences between BP measurements obtained with the Microlife WatchBP O3 and the sphygmomanometer are shown for SBP (Figure 1A) and for DBP (Figure 1B). These results are in discordance with the requested criteria of the IP. Thus, the Microlife WatchBP O3 device failed to fulfill the validation criteria of the ESH-IP Revision 2010.

Table 1.

Validation results for Microlife WatchBP O3^® according to the ESH-IP 2010

Validation results – Microlife WatchBP O3
Part 1	≤5 mmHg	≤10 mmHg	≤15 mmHg	Grade 1	Mean mmHg	SD mmHg
Pass requirements
Two of	73	87	96
All of	65	81	93
Achieved
SBP	64	86	94	Fail	0.3	7.8
DBP	62	93	101	Fail	−1.9	6.4
Part 2	2/3≤5 mmHg	0/3≤5 mmHg		Grade 2		Grade 3
Pass requirements	≥24	≤3
Achieved
SBP	22	6		Fail		Fail
DBP	20	6		Fail		Fail
Part 3						Result
						Fail

Notes: Accuracy is determined by the number differences in these ranges both for individual measurements (Part 1) and for individual subjects (Part 2). To pass, a device must achieve all the minimum pass requirements shown.

Abbreviations: DBP, diastolic blood pressure; ESH, European Society of Hypertension; IP, International Protocol; SBP, systolic blood pressure; SD, standard deviation.

Figure 1.

Plots of systolic (A) and diastolic (B) BP differences between the Microlife WatchBP O3^® and the mean of two observer readings in 34 subjects (n=102).

Notes: Delta SBP (device − reference): systolic difference between the Microlife and the mercury; mean SBP device and reference: mean systolic average values of the Microlife and the mercury sphygmomanometer. Delta DBP (device − reference): diastolic difference between the Microlife and the mercury; mean DBP device and reference: mean diastolic average values of the Microlife and the mercury sphygmomanometer.

Abbreviations: BP, blood pressure; DBP, diastolic blood pressure; SBP, systolic blood pressure.

Omron RS6

The difference between the two observers was 0.0±2.2 and −0.3±1.9 mmHg for SBP and DBP, respectively (−4 to +4 mmHg). The mean differences between the observers and the tested device were 2.7±9.9 mmHg for SBP and 3.5±11.1 mmHg for DBP. The numbers of measurements differing from the mercury standard by 5, 10, and 15 mmHg or less are shown in Table 2. Bland–Altman plots of the differences between the BP measurements obtained with the Omron RS6 and the sphygmomanometer are shown for SBP (Figure 2A) and for DBP (Figure 2B). These results are in discordance with the requested criteria of the IP. Thus, the Omron RS6 device failed to fulfill the validation criteria of the ESH-IP Revision 2010.

Table 2.

Validation results for Omron RS6^® according to the ESH-IP 2010

Validation results – Omron RS6
Part 1	≤5 mmHg	≤10 mmHg	≤15 mmHg	Grade 1	Mean mmHg	SD mmHg
Pass requirements
Two of	73	87	96
All of	65	81	93
Achieved
SBP	42	75	89	Fail	2.7	9.9
DBP	42	69	87	Fail	3.5	11.1
Part 2	2/3≤5 mmHg	0/3≤5 mmHg		Grade 2		Grade 3
Pass requirements	≥24	≤3
Achieved
SBP	13	10		Fail		Fail
DBP	13	12		Fail		Fail
Part 3						Result
						Fail

Notes: Accuracy is determined by the number differences in these ranges both for individual measurements (Part 1) and for individual subjects (Part 2). To pass, a device must achieve all the minimum pass requirements shown.

Abbreviations: DBP, diastolic blood pressure; ESH, European Society of Hypertension; IP, International Protocol; SBP, systolic blood pressure; SD, standard deviation.

Figure 2.

Plots of systolic (A) and diastolic (B) BP differences between the Omron RS6^® and the mean of two observer readings in 34 subjects (n=102).

Notes: Delta SBP (device − reference): systolic difference between the Omron RS6 and the mercury sphygmomanometer; mean SBP device and reference: mean systolic average values of the Omron RS6 and the mercury sphygmomanometer. Delta DBP (device − reference): diastolic difference between the Omron RS6 and the mercury; mean DBP device and reference: mean diastolic average values of the Omron RS6 and the mercury sphygmomanometer.

Abbreviations: BP, blood pressure; DBP, diastolic blood pressure; SBP, systolic blood pressure.

Discussion

This study provides information on the accuracy of two devices for home BP measurement in the obese population. Each of the two specified devices was previously successfully validated in the general population.^24,25 We compared the BP values obtained by the gold standard mercury sphygmomanometer with those obtained by each of the two devices. The results of the study showed that Microlife WatchBP O3 and Omron RS6 failed to meet the requirements of ESH-IP 2010 in the obese population.

In addition to the analysis required by the ESH-IP protocol, and in order to evaluate the difference according to the BP baseline values, assessment of the determinants of the differences observed between each device and the mercury sphygmomanometer may provide further information. For Microlife WatchBP O3, the difference between values from the Microlife and the mercury sphygmomanometer devices according to the mean BP level did not show significant correlation between the averaged differences and the baseline values for SBP (r=−0.074; p=0.45), but showed significant correlation for DBP (Figure 3; r=−0.292; p=0.002), which may be interpreted by a higher underestimation of the DBP (in diastolic pressure levels >80 mmHg) by the Microlife WatchBP O3 device. For the Omron RS6, the difference between values of the device and the mercury sphygmomanometer according to the mean BP level did not show significant correlations between the averaged differences and the baseline values for both SBP (r=−0.144; p=0.148) and DBP (r=+0.174; p=0.07).

Figure 3.

Correlation between the differences in DBP measured by Microlife WatchBP O3^® device and the mercury sphygmomanometer and the mean average of DBP values in the total population (34 participants). “r”, Pearson’s correlation coefficient; p value is considered statistically significant when p<0.05.

Abbreviation: DBP, diastolic blood pressure.

Important points related to both this specific population and the validation protocol need to be discussed: despite the efforts of the manufacturers to improve the quality of BP measuring devices, both the cuff and wrist characteristics of devices remain a point of weakness in this specific population. In obese people, using appropriate cuff size in BP measurement is substantial, where “miscuffing” is a serious source of error for BP readings. Indeed, BP measurement in some of our obese subjects presented some difficulties related to their arms shaped more as a cone than a cylinder; the diameter at the top of the arm is larger than the diameter of the arm in the region of the brachial artery. This shape results in a poor fit over the brachial artery and also results in inaccurate measurements.¹⁴ In addition, recent findings have demonstrated that despite using the appropriate cuff size, SBP appeared to be higher in those with bigger arms,²⁶ meaning a bigger limb may require greater pressure simply because there is more tissue to compress and not necessarily because there is fatty tissue. Indeed, they also observed that those with larger, more muscular arms were more likely to be misclassified as prehypertensive or hypertensive compared to those with smaller arms, whereas those with smaller arms may be misclassified as normal despite having elevated BP.²⁶ This study recommended that a further correction factor for arm size may be needed even when using the correct cuff size.²⁶ Nonetheless, in our study, we did not try to classify each obese participant per se, rather every participant was his own control, such as one measurement recorded with the device vs the reference measurement recorded by the sphygmomanometer; in order to limit this particular bias in our study, we just used one cuff (the one provided by the manufacturer Microlife) suitable for both the device and the sphygmomanometer.

Concerning the wrist characteristics, it also presents accuracy issues for BP measurements; therefore, it may not only be related to the arm circumference, but also to the BP signal itself. Wrist monitors appear to be more attractive for the obese population because of their large arms, where subjects experience more comfort using a device applied at their relatively small-sized wrists; for the above-mentioned reasons, more validation studies in the obese population are highly needed. Actually, there are only four studies that have established the validation of oscillometric BP devices in the obese population or those with large arms. AlTunkan et al^20,21 have validated two BP devices, the Omron M6 (HEM-7001-E) at the brachial level and the Omron 637IT at the wrist level, according to ESH-IP. El Feghali et al²² validated the Omron M7 (HEM-780-E) BP measuring device in people requiring large cuffs according to ESH-IP. In addition, Masiero et al²³ validated the Microlife WatchBP Office Ankle Brachial Index according to ESH-IP in people requiring large/extra large cuff. Thus, considering the high percentage of obesity and large circumference arms as risk factors for HTN, more validation studies of BP devices in the obese population are needed.

The IP used in this study was published in 2002 by the Working Group on Blood Monitoring of the ESH and was then revised in 2010.¹⁵ The aim of this protocol was to simplify the earlier protocols (British Hypertension Society¹⁶ and Association for the Advancement of Medical Instrumentation¹⁷) without violating their integrity. The main advantage of ESH-IP is that it requires a smaller sample size (N=33) compared to the two other protocols (N=85). However, it has some disadvantages and limitations.

Limitations

First, the specific requirements needed for the sample size concern the age of the subjects. It must be above 25 years, which, therefore, excludes children and young adults from being studied, thereby omitting data from the obese population aged 18–25 years. In addition, the gender distribution must include at least ten males and ten females; this particular point makes studies in pregnant women, for example, questionable. Furthermore, the adult population is a part of a larger heterogeneous population affected by HTN; therefore, the results of these validation studies in a selected population cannot be extrapolated to a more specific one, and may be dangerous and may negatively affect the clinical practice. Essentially, the IP concerns the general population only, with no specific requirements in specific population such as children, pregnant women, obese subjects, arrhythmic patients, and so on.

Second, following the IP, subjects are not recruited according to their arm circumference. This may lead to the use of large-sized cuff in only minority of patients in any study where the majority of the included subjects require a standard sized cuff. Thus, the results of such studies may not be applicable to obese people with large arm circumference. This issue should be taken into consideration knowing that the prevalence of obesity is growing overtime and obese people are at increased risk of developing HTN to a more extent than the general population. This poses a challenge to have an accurate BP measurement in this specific population. Therefore, it is highly recommended to perform more validations studies in specific populations.

Third, the IP does not specify the number of validation studies needed to approve the device accuracy, although there is an agreement among experts that a device should be validated in at least two different centers separately. Therefore, since both the tested devices were previously successfully validated in the general population^24,25 and failed to pass with obese subjects, it is highly recommended to check the accuracy of BP measuring devices in a specific population, such as obese people with large arm circumference, as a mandatory step in the validation process.

Conclusion

The results of the present study are of importance since they showed that the two tested devices, the Microlife WatchBP O3 that measures BP at the brachial level and the Omron RS6 that measures BP at the wrist level, failed to meet the requirements of ESH-IP 2010 in the obese population, despite their validation in the general population. Therefore, extrapolation of the results of validation studies in the general population to a more specific one may be risky and may affect the clinical practice negatively. In addition, the ESH-IP should stress on validating the BP devices in specific populations by publishing explicit criteria for such validation in these populations. Furthermore, it would be highly recommended to assess the accuracy of these two devices in other specific populations such as pregnant women, elderly subjects, arrhythmic patients, and so on.