Abstract
The purpose of our study was to clarify limitations of off-label use for low cost nonmedical use (NMU) pulse oximeters by primary care providers. These devices are widely marketed over the Internet and in drugstores but are not intended for medical use or reviewed by the Food and Drug Administration (FDA). Our study compared oxygen saturation (SpO2) in patients from 1 medical use (MU) pulse oximeter to 8 NMU pulse oximeters. Measured arterial oxygenation (SaO2) was compared with SpO2 when available. In patients who were normoxic (SpO2 ≥90%), all oximeters exhibited similar readings. This finding suggests that NMU pulse oximeters may be able to rule out hypoxemia in clinical settings.
Key words: device, oximetry, regulation, safety
INTRODUCTION
Peripheral pulse oximeters are one of the most widely used medical monitoring technologies. Although the Food and Drug Administration (FDA) considers all pulse oximeters to be prescription medical devices, most sold in drugstores or on the Internet are specifically labeled “not for medical use” and were not reviewed by FDA for accuracy.1,2 Their package inserts indicate the intended use is for “sports and aviation”3 or “wellness.”4 In contrast, “medical use” (MU) pulse oximeters are only labeled as such after rigorous testing on human volunteers and review by FDA.1 Laboratory-based research has found nonmedical use (NMU) pulse oximeters to be inaccurate when oxygen saturation is low.5 Unfortunately, most consumers, even physicians, do not read the package insert and assume all pulse oximeters are intended for medical use and have been reviewed for accuracy.
METHODS
We conducted a cross-sectional, concurrent-controlled observational study with 60 consenting adult patients (aged 18-85 years) scheduled for elective cardiothoracic or neurosurgery who required continuous postoperative pulse oximetry and intermittent arterial blood gas monitoring. Our study designated 1 MU pulse oximeter (Nellcor MAXA, Medtronic PLC) as the reference standard and compared it with 8 different brands of NMU pulse oximeters purchased from retail stores to typify consumer use (Supplemental Table 1 available at http://www.annfammed.org/content/16/6/552/suppl/DC1). As skin pigmentation is known to affect readings, subjects were stratified by Fitzpatrick score6 before randomization. Each enrolled study subject was randomized for concurrent placement of 1 MU pulse oximeter and 2 NMU pulse oximeters. To ensure the measurements were obtained simultaneously, only 3 pulse oximeters were placed on a patient at one time. The pulse oximeters were applied to adjacent fingertips of the hand contralateral to the location of arterial line for each patient. Multiple measurements were obtained on patients and all were obtained while patients’ vital signs and clinical status were stable, as is directed for volunteer hypoxia studies.1 Only the MU pulse oximeter measurement was interpreted for clinical care decisions. Laboratory measurement of arterial oxygen saturation (ABL90 FLEX analyzer, Radiometer America Inc) was performed only when clinically indicated and was compared with the 3 pulse oximetry readings when available.
Our primary outcome measure was the statistical predictive value of spot oxygen saturation (SpO2) from NMU pulse oximeters. We defined true hypoxemia as <90% oxygen saturation measured as either SpO2 from the MU pulse oximeter or arterial oxygenation (SaO2) from the laboratory.7,8
The secondary outcome measure was the calculated average differences between SpO2 on a NMU pulse oximeter and the MU pulse oximeter (or SaO2 when available) using a modified Bland Altman analysis over the entire range of SpO2 encountered in our study. Our goal was not to evaluate accuracy of each brand of oximeter, but rather to determine if NMU pulse oximeters could safely rule out hypoxemia when they displayed an SpO2 ≥90%.
Institutional Review Boards from Walter Reed National Military Medical Center and the Uniformed Services University of the Health Sciences, Bethesda, Maryland, approved this study. Written informed consent was obtained for each patient. Study registration was not required as no study intervention was performed.
RESULTS
A total of 60 adults (19 women and 41 men) were studied and 669 data points (69 to 104 per pulse oximeter model) were obtained.
The positive predictive value of the NMU pulse oximeter was 33% (12/36), indicating a low probability of correctly detecting hypoxemia compared with our reference standard MU pulse oximeter. In contrast, the negative predictive value of NMU pulse oximeter was 99% (630/633) (Table 1).
Table 1.
NMU-PO | MU-PO
|
Totals | Predictive Vaue, % | 95% CI, % | |
---|---|---|---|---|---|
Hypoxemia Present, n (Classification) | Hypoxemia Absent, n (Classification) | ||||
SpO2 <90% | 12 (true positive) | 24 (false positive) | 36 | 33a | 24-44 |
SpO2 ≥90% | 3 (false negative) | 630 (true negative) | 633 | 99b | 98-100 |
Totals | 15 | 654 | 699 |
Note: Hypoxemia present is defined as SpO2 <90% and hypoxemia absent is defined as SpO2 ≥90%.
MU-PO = medical use pulse oximeters; NMU-PO = nonmedical use pulse oximeters; SpO2 = oxygen saturation.
Positive predictive value.
Negative predictive value.
The secondary analysis of the average differences between SpO2 on a NMU pulse oximeter and the MU pulse oximeter (or SaO2 when available) over the range of SpO2 from 90% to 99% revealed no clinically significant difference (Supplemental Figure 1 available at http://www.annfammed.org/content/16/6/552/suppl/DC1). Differences of >5% between spot measurements of SpO2 and laboratory measurements of SaO2 occurred with both the MU pulse oximeter and NMU pulse oximeters, but here were too few instances to evaluate statistically.
DISCUSSION
Our clinical study revealed no meaningful differences in the displayed oxygen saturations between the MU pulse oximeter and the NMU pulse oximeters in the range from 90% to 99%, and this is consistent with laboratory findings from a prior study.5 Thus, when confirming normoxia or ruling out hypoxemia, spot measurement of SpO2 by NMU pulse oximeters appeared satisfactory among patients in a population where hypoxemia was unlikely. Because pulse oximeter measurements of oxygen saturation are less accurate for measurements below 90%, patient management decisions regarding oxygenation should be verified using a device intended for medical use whenever possible.5,9,10
Since small quantitative differences in SpO2 may not be clinically meaningful when oxygen saturation is nearly complete, NMU pulse oximeters may be helpful for family physicians and their patients to use when ruling out hypoxemia despite being labeled as not for medical use and sold without prescription. Moreover, the widespread availability of NMU pulse oximeters and their relatively low cost compared with MU pulse oximeter devices serves to improve access to rapid assessment of systemic oxygenation in many patients when it would otherwise be impractical.
Study Limitations
Our goal was to study device performance in a clinical environment, and therefore, few of our carefully managed patients were hypoxemic. It would be informative to conduct additional studies in cases when desaturation of hemoglobin is especially precipitous (SpO2 85% to 90%). Furthermore, by pooling the NMU pulse oximeter data we did not distinguish between brands or models. Our study included more men than women, reflecting military patient demographics. As our protocol was modeled on FDA guidance1 for the study of pulse oximeters, multiple measurements were taken for each study subject. Within-subject correlation of oxygen measurements could not be excluded.
Footnotes
Conflicts of interest: authors report none
To read or post commentaries in response to this article, see it online at http://www.AnnFamMed.org/content/16/6/552.
Disclaimer: The identification of specific products or scientific instrumentation is considered an integral part of the scientific endeavor and does not constitute endorsement or implied endorsement on the part of the author, Department of Defense, or any component agency. The views expressed in this manuscript are those of the author(s) and do not reflect the official policy of the Department of Army/Navy/Air Force, Department of Defense, or US Government.
Previous presentation: A poster of this work was presented at International Anesthesia Research Society Annual Meeting; May 21-24, 2016; San Francisco, California.
Supplementary materials: Available at http://www.AnnFamMed.org/content/16/6/552/suppl/DC1/.
References
- 1.Pulse Oximeters - Premarket Notification Submissions [510(k) s] Guidance for Industry and Food and Drug Administration Staff Document. http://www.fda.gov/downloads/MedicalDevices/DeviceRegulationandGuidance/GuidanceDocuments/UCM081352.pdf. Published Mar 4, 2013 Accessed Sep 5, 2018.
- 2.Federal Food Drug & Cosmetic (FD&C) Act. http://legcounsel.house.gov/Comps/FDA_CMD.pdf. Published Apr 24, 2013 Accessed Sep 5, 2018.
- 3.Product Classification FDA PGJ. Pulse oximeters intended for sporting and aviation use. http://www.accessdata.fda.gov/scripts/cdrh/cfdocs/cfPCD/classification.cfm?ID=OCH Accessed Sep 5, 2018.
- 4.Product Classification FDA PGJ. Pulse oximeters intended for wellness use. http://www.accessdata.fda.gov/SCRIPTs/cdrh/cfdocs/cfpcd/classification.cfm?ID=206 Accessed Sep 5, 2018.
- 5.Lipnick MS, Feiner JR, Au P, Bernstein M, Bickler PE. The accuracy of 6 inexpensive pulse oximeters not cleared by the food and drug administration: the possible global public health implications. Anesth Analg. 2016; 123(2): 338-345. [DOI] [PubMed] [Google Scholar]
- 6.Fitzpatrick TB. The validity and practicality of sun-reactive skin types I through VI. Arch Dermatol. 1988; 124(6): 869-871. [DOI] [PubMed] [Google Scholar]
- 7.Parikh R, Mathai A, Parikh S, Chandra Sekhar G, Thomas R. Understanding and using sensitivity, specificity and predictive values. Indian J Ophthalmol. 2008; 56(1): 45-50. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Altman DG, Bland JM. Diagnostic tests 2: predictive values. BMJ. 1994; 309(6947): 102. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Severinghaus JW. History and recent developments in pulse oximetry. Scand J Clin Lab Invest Suppl. 1993; 214: 105-111. [PubMed] [Google Scholar]
- 10.Milner QJ, Mathews GR. An assessment of the accuracy of pulse oximeters. Anaesthesia. 2012; 67(4): 396-401. [DOI] [PubMed] [Google Scholar]