In their recent article entitled “Accuracy Assessment of the GlucoMen® Day CGM System in Individuals with Type 1 Diabetes: A Pilot Study” [1], Hochfellner and colleagues presented the results of an accuracy and usability evaluation of a novel continuous glucose monitoring (CGM) system. While we appreciate the importance of assessing the accuracy of CGM systems, we would like to comment on certain aspects of the data analysis, presentation of results and conclusions.
In the section describing the data analysis (Section 2.2), it is stated that “the lag time between CGM and blood glucose data was determined for each sensor and applied prior to calculating MARD and MAD”, where MARD and MAD are common accuracy parameters representing mean absolute relative and mean absolute deviation between CGM and comparator measurements, respectively. This correction of lag time before accuracy determination was common in microdialysis-based systems [2,3] or for prototype CGM systems [4]. However, in market-ready CGM systems intended to provide real-time glucose data such as the system examined in the article, the accuracy should be evaluated with respect to the CGM values displayed to the user. The effect of the lag time correction on the reported accuracy parameters cannot be assessed because neither the average lag time mentioned in Section 2.2. nor MARD and MAD results before lag time correction are presented. In general, however, a lag time correction leads to a reduction in MARD and MAD.
Regarding the MARD, it should be pointed out that for its calculation, only glucose levels ≥100 mg/dL were used (Table 1), whereas for glucose levels <100 mg/dL, MAD results were presented. This is an important detail missing from the abstract and the discussion, where MARD results were reported.
As a consequence of choosing to correct for time lag and to use only glucose levels ≥100 mg/dL for MARD calculation, we would argue that the accuracy results reported in the article cannot be compared to the cited findings of CGM performance studies without lag time correction and MARD results determined across the full glucose range [5,6,7]. Another aspect of the reported study that impairs the comparability to previous results is the low sample size of eight subjects, which is not discussed.
Due to these differences in methodology between this and other studies, we therefore question the validity of the conclusion that the “analysis suggests the GlucoMen® Day CGM […] meets the current clinical requirements for state-of-the-art CGMs”.
Conflicts of Interest
G.F. is general manager and medical director of the IfDT (Institut für Diabetes-Technologie Forschungs-und Entwicklungsgesellschaft mbH an der Universität Ulm, Ulm, Germany), which carries out clinical studies on the evaluation of BG meters, with CGM systems and medical devices for diabetes therapy on its own initiative and on behalf of various companies. G.F./IfDT have received speakers’ honoraria or consulting fees from Abbott, Ascensia, Berlin Chemie, Beurer, BOYDsense, CRF Health, Dexcom, i-SENS, Lilly, Metronom, MySugr, Novo Nordisk, Pharmasens, Roche, Sanofi, Sensile, Terumo and Ypsomed. M.E., D.W. and S.P. are employees of the IfDT.
Footnotes
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.
References
- 1.Hochfellner D.A., Simic A., Taucher M.T., Sailer L.S., Kopanz J., Pöttler T., Mader J.K. Accuracy Assessment of the GlucoMen® Day CGM System in Individuals with Type 1 Diabetes: A Pilot Study. Biosensors. 2022;12:106. doi: 10.3390/bios12020106. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Ben Mohammadi L., Klotzbuecher T., Sigloch S., Welzel K., Goeddel M., Pieber T.R., Schaupp L. Clinical performance of a low cost near infrared sensor for continuous glucose monitoring applied with subcutaneous microdialysis. Biomed. Microdevices. 2015;17:73. doi: 10.1007/s10544-015-9983-4. [DOI] [PubMed] [Google Scholar]
- 3.De Block C.E.M., Gios J., Verheyen N., Manuel-y-Keenoy B., Rogiers P., Jorens P.G., Scuffi C., Van Gaal L.F. Randomized Evaluation of Glycemic Control in the Medical Intensive Care Unit Using Real-Time Continuous Glucose Monitoring (REGIMEN Trial) Diabetes Technol. Ther. 2015;17:889–898. doi: 10.1089/dia.2015.0151. [DOI] [PubMed] [Google Scholar]
- 4.Weinstock R.S., Bristol S., Armenia A., Gesswein A.C., Bequette B.W., Willis J.P. Pilot Study of a Prototype Minimally Invasive Intradermal Continuous Glucose Monitor. J. Diabetes Sci. Technol. 2012;6:1454–1463. doi: 10.1177/193229681200600627. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Bailey T., Bode B.W., Christiansen M.P., Klaff L.J., Alva S. The Performance and Usability of a Factory-Calibrated Flash Glucose Monitoring System. Diabetes Technol. Ther. 2015;17:787–794. doi: 10.1089/dia.2014.0378. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Wadwa R.P., Laffel L.M., Shah V.N., Garg S.K. Accuracy of a Factory-Calibrated, Real-Time Continuous Glucose Monitoring System During 10 Days of Use in Youth and Adults with Diabetes. Diabetes Technol. Ther. 2018;20:395–402. doi: 10.1089/dia.2018.0150. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Alva S., Bailey T., Brazg R., Budiman E.S., Castorino K., Christiansen M.P., Forlenza G., Kipnes M., Liljenquist D.R., Liu H. Accuracy of a 14-Day Factory-Calibrated Continuous Glucose Monitoring System with Advanced Algorithm in Pediatric and Adult Population With Diabetes. J. Diabetes Sci. Technol. 2022;16:70–77. doi: 10.1177/1932296820958754. [DOI] [PMC free article] [PubMed] [Google Scholar]