Abstract
Monitoring glycaemic control in patients with diabetes has evolved dramatically over the past decades. The introduction of easy-to-use systems for self-monitoring of blood glucose (SMBG) utilising capillary blood samples has resulted in the availability of a wide range of systems, providing different measurement quality. Systems for continuous glucose monitoring (CGM) – used mainly in patients with type 1 diabetes (T1D) – were made possible by the development of glucose sensors that measure glucose levels in the interstitial fluid (ISF) in the subcutaneous tissue of the skin. CGM readings might not correspond exactly to SMBG measurement results taken at the same time, especially during rapid changes in either blood glucose or ISF glucose levels. The mean absolute relative difference is the most popular method used for characterising the measurement performance of CGM systems. Unlike the International Organization for Standardization 15197:2013 criteria for SMBG systems, no accuracy standards for CGM systems exist. Measurement quality of CGM systems can vary based on several factors, limiting their safety and effective use in managing diabetes. Patients have to be trained adequately to make safe and efficient use of CGM systems (like with SMBG systems). Also, systems for CGM must be evaluated in terms of patient safety and the ability to provide accurate measurements regardless of the fluctuation of glucose levels. As new technological advancements in glucose monitoring are essential for improved management options of diabetes, such as automated insulin dosing systems, there is a need for a critical view of all such developments. It is likely that both, SMBG and CGM systems, will play important future roles in the treatment of diabetes.
Keywords: Automated insulin dosing (AID) system, continuous glucose monitoring (CGM), mean absolute relative difference (MARD), self-monitoring of blood glucose (SMBG)
Self-monitoring of blood glucose (SMBG) levels was the standard of care for achieving tight glycaemic control in patients with diabetes for several decades. Systems for continuous glucose monitoring (CGM) were introduced around 15 years ago and are employed by an increasing number of patients. The tip of the glucose sensor used by these systems is inserted into subcutaneous adipose tissue under the skin to measure glucose in the interstitial fluid (ISF). The electrical current measured by the sensor is converted into approximate blood glucose values requiring a calibration step either by factory calibration or SMBG.1
Real-time (rt) CGM systems display the current glucose reading directly to the users, with a new glucose value displayed every 5 minutes on a receiver or the smart phone. rtCGM systems incorporate alarms that alert the user when their glucose levels are too low, too high or when a rapid rise or fall indicates a risk of glucose levels becoming too low or too high. Based on the same measurement technology, but without automatic data transfer or alarm system, the intermittently scanned (isc) CGM system requires the patient to hold the receiver close to the glucose sensor. This system does not require calibration.2,3
The adoption and real-life clinical issues associated with SMBG and CGM systems, both in daily diabetes management and in their future use with automated insulin dosing (AID) systems, were discussed at a satellite symposium, sponsored by Ascensia Diabetes Care, held at the 11th International Conference on Advanced Technologies & Treatments for Diabetes (ATTD 2018) in Vienna, Austria in February 2018.
Glucose monitoring – insights from US and Europe
Adam Brown, Close Concerns, San Francisco, CA, US provided insights and market research data about the glucose monitoring market and technology adoption, also contrasting the situation in the US versus Europe. The market has changed dramatically in the last 5 years and is still evolving. While CGM technology continues to develop rapidly, market adoption is still moving slowly, more so for rtCGM systems than for the available iscCGM system. There is currently no agreement on which glucose-monitoring system (SMBG or CGM) should be used for clinical decisions with respect to diabetes management.
Data from the US indicates that 41% of patients with type 1 diabetes (T1D) typically check their blood glucose between 3–5 times daily and 40% >5 times daily (Figure 1).4 The majority of patients with type 2 diabetes (T2D) (66%) check their blood glucose <3 times a day.4 Across Europe, variation in daily checks was evident, and dependent on the monitoring system used.4 With the iscCGM system, 54% of patients with T1D or T2D reported performing no SMBG in a typical day and 80% reported <2 tests per day.4 The median number of SMBG tests was 0 per day for iscCGM users, 3 for rtCGM users, and 4 for sensor non-users.4 Nearly all iscCGM users (93%) and rtCGM users (97%) who completed this questionnaire had T1D.4 A total of 51% of glucose sensor non-users had T1D and 49% had T2D.4
The CGM market is growing, with data showing a conservative increase of around 50,000 users per quarter in the US.4 There has been a particular increase in the use of CGM in the paediatric population.4 However, the T1D Exchange Registry indicates that, in specialist centres in the US, only 24% of patients use CGM.5 It should be noted that these centres represent only a small proportion of the total diabetic population, with most seen in primary care. Globally, it is estimated that <0.5% of the diabetic population are currently using CGM.6 CGM is not yet considered standard of care, even in patients with T1D, partly due to the lack of independent, robust, randomised clinical trials demonstrating both improved outcomes for hyperglycaemia and hypoglycaemia in specific patient populations. Until recently there was a relatively insufficient evidence base supporting the accuracy and value of rtCGM in patients receiving multiple daily insulin injections (MDI) versus its use in combination with insulin pump therapy.7 However, this has now changed, with a clear benefit seen in patients with T1D using MDI.8 Additional reasons for the slow uptake of rtCGM systems has been their cost and the fact that they have to be used constantly by the patients in order to achieve a meaningful benefit.9
The main factor influencing choice of glucose monitoring systems for both patients with T1D and T2D in the US is insurance coverage.4 The next factor is performance. Fifteen and 9%, respectively, of patients asked, stated accuracy as a reason for choice.4 In Europe, the main reasons for choice included insurance and recommendations from doctors, diabetes educators, online reviews, and other patients with diabetes.4 Disregarding cost and coverage, a substantial minority of endocrinologists surveyed said they would prescribe CGM for their T1D patients (Figure 2).4
The insights from market research have demonstrated that most patients with diabetes perform few SMBG per day and those using CGM systems still continue to use SMBG, even with the factory calibrated iscCGM system.4 Although CGM usage is growing rapidly, it is still only reaching a minority of patients with T1D and very few patients with T2D.
Glucose monitoring in real-life practice
Guido Freckmann, Ulm, Germany, presented data about differences between measurement results obtained with SMBG systems and CGM systems, their performance standards, how limitations of CGM systems can have safety consequences in real-life, and that SMBG measurements are still necessary and important. CGM systems offer a comprehensive assessment of glycaemia, but uptake is currently limited due to costs and accuracy concerns, in addition to patient-related factors and difficulties encountered in data interpretation.10,11 Currently there is no internationally accepted standard for the measurement performance of CGM systems comparable with the International Organization for Standardization (ISO) 15197:2013 standard for SMBG systems, which specifies design verification procedures and the validation of performance by the intended users.12
Glucose measurement by CGM systems can lack accuracy and reliability in some situations, which can limit their use in clinical practice.13 The precision of glucose measurements with CGM systems is not equivalent to that of SMBG systems, due to the higher frequency of glucose readings and additional data generated (e.g., trend information). However, the lower level of accuracy provided by CGM systems is often acceptable in daily practice. In a study evaluating the quality/accuracy of trend information, less than two-thirds of displayed trends of blood glucose levels matched calculated trends measured 15 minutes later, and around 10% of the displayed trends deviated two or more categories (Figure 3).13 With CGM, what constitutes a ‘trend’ is also not clearly defined, leading to potentially dangerous consequences.14 As a patient does not know in advance if a trend is correct, it is important for them to consider the glucose profile of the last few hours, information about meals, insulin and physical activity when making therapeutic decisions. Therefore, patients need to be adequately educated in appropriate data interpretation by a clinician with expertise in CGM or they need to participate in a well-designed training programme.
Measurements obtained with CGM systems may differ from those of SMBG systems. The reasons for such differences are not entirely clear; however, these are at least in part due to compartment measurement differences, the specific system, used and the algorithms implemented in the CGM systems.10 These differences (and associated time lags) can have an impact on measurement accuracy.1 While the effect of the time lag for newer generation CGM systems has been reduced, it can still vary from 4–14 minutes in the same patient.10 Performance of the calibration step required with rtCGM systems using high quality SMBG systems can help to ‘correct’ for physiological and sensor-related factors (e.g., sensor drift and biofouling), which also influence the time lag between the measurement of glucose in the ISF and blood.1
Issues with accuracy and precision do still arise with CGM systems, and this appears to be more problematic at the extremes of glucose excursions.15 In particular, hypoglycaemia remains a major limiting factor in achieving satisfactory glycaemic control, with patients using iscCGM spending up to five times as long in the hypoglycaemic range versus those using rtCGM (Figure 4).16 It should be noted that in most randomised controlled trials investigating CGM systems, the primary endpoint was glycated haemoglobin (HbA1c) and not a hypoglycaemia-related endpoint.17
Two 6-month prospective, multicentre, randomised controlled trials, involving patients with T1D in the IMPACT study (N=241) and patients with T2D in the REPLACE study (N=224), reported a reduced time in low glucose levels when using iscCGM versus using SMBG.18 However, other studies have indicated that the measurement accuracy of iscCGM systems in the low glycaemic range is not optimal.19 Another key uncertainty around the evidence of a real benefit for patients with T1D is the fact that the IMPACT trial included only adults whose diabetes was well controlled.20
The iscCGM system currently on the market is positioned as a potential replacement for routine SMBG in diabetes management; however, both US and the EU labelling, requires that SMBG should be carried out with this device in numerous daily life situations prior to treatment decisions. This might also reflect the limited evidence for use of the iscCGM system.21,22
The American Association of Clinical Endocrinologists and American College of Endocrinology have emphasised the need to adequately train patients who wish to use CGM systems.23 In Germany two such education programmes exist, one for rtCGM systems (SPECTRUM, which is company-independent) and one for the iscCGM system (FLASH, which is sponsored by Abbott). The American Association of Diabetes Educators state that training is essential to understand appropriate calibration of the system, as well as the factors influencing sensor accuracy, lag time of CGM values, overall interpretation of glucose trend information, and most importantly when to verify the information provided by the given CGM system to avoid potentially dangerous therapeutic decisions based on inaccurate information.24 In real-life practice, well-informed and appropriately trained patients with T1D tend to use rtCGM whereas iscCGM is more often used by patients with T2D.2,25 As patients using iscCGM perform SMBG testing only about every second day, it is important that patients are aware of the limitations of the iscCGM system and perform SMBG as recommended.
Mean absolute relative difference – looking behind the number
Marc Breton, Charlottesville, Virginia, US, discussed CGM performance characteristics, with a focus on the mean absolute relative difference (MARD). CGM data consist of a complex set of data points that are ordered in time and dependent on each other when the time interval of sampling is relatively short.26 The average or root mean square, absolute relative difference (ARD), MARD or the ISO boundaries (%20/20: the proportion of the CGM system values that are within ±20% of relative difference of reference value at glucose levels >100 mg/dL and ±20 mg/dL of absolute difference at glucose level <100 mg/dL) have all been used to assess CGM accuracy.12 MARD is the most commonly used accuracy index used for CGMs.27 This index is the average of the absolute error between all CGM values and matched blood glucose values measured with a reference ‘method’.2 It can be presented using the SMBG standard of at least 95% of results within 15 mg/dL of reference <100 mg/dL, or within 15% of reference >100 mg/dL, to evaluate the overall accuracy performance of CGM systems.12 A lower MARD percentage indicates that the CGM readings are close to the reference glucose measurement results, whereas a larger percentage indicates greater discrepancies between the two glucose measurement methods.2 There is nearly a 100% chance of satisfying ISO 15197:2013 accuracy requirements if the MARD value is between 3.3–5.3%.28 Currently, there are no CGM systems on the market that reach this level of analytical performance. Additionally, there is a high degree of variability in MARD values for different CGM systems and even with the same CGM system across different studies, with different study designs, conditions and reference methods.29 Therefore, usage of the MARD alone is insufficient to characterise the analytical performance of a given CGM system.
The algorithms implemented in CGM systems for improving measurement results are intended to correct a number of components of CGM measurement errors, which impact performance, including time-dependent bias, drift, delay, low-frequency fluctuations and high-frequency noise (Figure 5).30
An international consensus established by a group of experts organised by leaders of the ATTD meeting recommended that only CGM systems that provide an acceptable level of sensor accuracy should be used.8 However, MARD values are computed using clinical study data, which do not just reflect the accuracy of the CGM system, but are strongly influenced by study design.31 This explains why different CGM systems with comparable MARD values can have different clinical performance characteristics.31 Therefore, published MARD values must not be taken as a precise number reflecting the accuracy of a CGM system performance.15 The MARD only partially characterises CGM systems and may conceal significant differences. CGM systems with MARDs in the 9, 10 and 11% range have high variability, so using MARD as a single measure of analytical performance for CGMs is insufficient and could lead to incorrect conclusions.32
A more complete characterisation can be obtained by computing the ARD value for each CGM system and reference blood glucose measurement pair for each subject/sensor combination.32 This methodology has been used in a study to assess CGM measures of accuracy.32 Empirical distributions (normal, lognormal, Weibull, Johnson [SU, SB, and SL] and gamma) of ARD for each subject were computed, and parametric forms were fit to these distributions. The gamma distribution was chosen as the best model for ARD.32 A linear relationship between the probability that an ARD is less than or equal to a given value (e.g., 15%) and MARD was demonstrated.32 When a range of probabilities were plotted against MARD for shape 0.8–3.5 and scale 1.5–8.0 (756 combinations), the same MARD was shown to mask different error characteristics (Figure 6).32,33 At 15% (which is considered the ISO standard), CGMs with a MARD of 10% had high variability. Sensor data indicated that the sensor was within 15% of the reference between 78–91% of the time.33
Additional measures of analytical performance are needed to provide a more complete characterisation of CGM system performance. The error probability calculation facilitated by the gamma distribution model may be used in addition to MARD to provide a more informative tool for assessing CGM system analytical performance.
Importance of accurate blood glucose measurements for artificial pancreas
Steven Russell, Boston, MA, US presented information on the interdependency of SMBG and CGM systems and the role of accuracy of these systems for a reliable performance in AID systems. The current management of diabetes requires intensive efforts by patients to count carbohydrates, closely monitor blood glucose values and make insulin dosing decisions, a drug with a narrow therapeutic window and a low margin for error.34 These collectively indicate an unmet need for better methods in diabetes management.
Usage of CGM systems has been shown to improve overall glycaemic control (lower HbA1c and frequency of hypoglycaemic events) when combined with MDI or usage of insulin pumps.35,36 However, the accuracy of rtCGM systems depends critically on appropriate performance of the calibration procedure once per day by means of SMBG. Measurements with the iscCGM system depend on the accuracy of the initial factory calibration, which does not address a patient’s individual characteristics that influence overall device performance. The accuracy of SMBG systems themselves is also critical. In a recent independent review of 17 commercially available, commonly used glucose meters and their respective test strips, from nine manufacturers, accuracy was found to be highly variable (Figure 7), exhibiting a range of MARDs from 5.6–20.8%.37 Only some SMBG systems were robust and exhibited a high degree of accuracy.37
One of the most exciting developments for the treatment of diabetes is the AID system, sometimes referred to as a closed-loop system, which aims to imitate the function of a healthy pancreas by automatically varying (without patient intervention) the subcutaneous insulin infusion rate very frequently, depending on the current glucose values. It comprises an rtCGM system, an insulin infusion pump and a SMBG device to calibrate the rtCGM or supplement the AID system when no rtCGM data are available.38 While the AID system holds promise, it adds challenges in terms of safety since it combines several components into one system and takes over the glucose control from the patient. The efficacy and safety of these devices is inherently dependent on the accuracy and reliability of each of the individual components.39 The US Food and Drug Administration (FDA) state that, “Because the accuracy of the BGD [Blood Glucose Device] exerts a tremendous impact on the quality of the calibration and the performance of the APDS [artificial pancreas device system], sponsors are encouraged to consider use of the most accurate BGD devices that are practical for patient use.”39
In September 2016, a (Hybrid) Closed Loop System (Medtronic MiniMed™, 670G hybrid closed-loop; Medtronic, Minneapolis, MN, US) became the first AID system to be approved by the FDA.40 This system requires a minimum of two, and on average four, calibration measurements each day, and has been associated with few serious or device-related adverse events in patients with T1D.41 The SMBG used (CONTOUR® NEXT LINK 2.4; Medtronic, Minneapolis, MN, US), was required to meet the FDA’s high Class III/pre-marketing approval standards for the system.
A number of other AID systems are being evaluated for use in patients with T1D, including Tandem, Bigfoot Biomedical, Beta Bionics and Insulet. According to experts, the calibration-free AID system is still a long way off. The ‘bionic’ pancreas will target and manage glucose levels close to the hypoglycaemic range and will require tighter tolerance and controls. A difference of 15 mg/dL in accuracy could result in a reading of 70 mg/dL being 55 mg/dL. At this tight range there is no margin for error and system accuracy matters.
Conclusions
Technological solutions for glucose monitoring in patients with diabetes have been improved during the last decades, and reliable systems for SMBG and CGM now exist. However, improvement in a number of areas is still needed, including the need for recalibration, variability in glycaemic patterns and lack of standardised software methods for analysis of CGM data, which mean CGM utilisation in daily practice is currently limited.
There is also a lack of randomised controlled trials, and protocols for patients to monitor the trends in glycaemia are not available. With the existence of performance standards, standards for analysis of CGM data and high-quality training programmes for patients (and physicians), usage of CGM systems is possible. Availability of accurate SMBG systems remains a cornerstone in diabetes management, and also for usage in AID systems.
Acknowledgments
Medical writing support was provided by Vanessa Lane, PhD, Senior Medical Writer, Touch Medical Media, UK, and Beth O’Connell, BS, Ascensia Diabetes Care for editorial support. Medical writing support was funded by Ascensia Diabetes Care.
Funding Statement
Support: Ascensia Diabetes Care funded the symposium described in this commentary.
References
- 1.Schmelzeisen-Redeker G, Schoemaker M, Kirchsteiger H. et al. Time delay of CGM sensors: relevance, causes, and countermeasures. J Diabetes Sci Technol. 2015;9:1006–15. doi: 10.1177/1932296815590154. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Cappon G, Acciaroli G, Vettoretti M. et al. Wearable continuous glucose monitoring sensors: A Revolution in diabetes treatment. Electronics. 2017;6:65. [Google Scholar]
- 3.Diabetes UK Consensus Guideline for Flash Glucose Monitoring 2017. Available at: www.diabetes.org.uk (accessed 22 March 2018).
- 4.dQ&A Market Research Inc. www.d-qa.com/ Available at: (accessed 20 February 2018).
- 5.Beck R. T1D Exchange Update, October 2017 Annual Meeting [Google Scholar]
- 6.Close Concerns. Available at: www.closeconcerns.com/ (accessed 20 February 2018)
- 7.Graham C. Continuous glucose monitoring and global reimbursement: An update. Diabetes Technol Ther. 2017;19((Suppl 3)):S60–6. doi: 10.1089/dia.2017.0096. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Rodbard D. Continuous Glucose Monitoring: A review of recent studies demonstrating improved glycemic outcomes. Diabetes Technol Ther. 2017;19((Suppl 3)):S25–37. doi: 10.1089/dia.2017.0035. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Haak T, Hanaire H, Ajjan R. et al. Flash glucose-sensing technology as a replacement for blood glucose monitoring for the management of insulin-treated type 2 diabetes: a multicenter, open-label randomized controlled trial. Diabetes Ther. 2017;8:55–73. doi: 10.1007/s13300-016-0223-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Freckmann G. New technologies in diabetology. How far are we from a closed loop? [Article in German] Internist (Berl) 2015;56:484–92. doi: 10.1007/s00108-014-3627-2. [DOI] [PubMed] [Google Scholar]
- 11.Freckmann G, Baumstark A, Pleus S. Do the new FDA Guidance documents help improving performance of blood glucose monitoring systems compared with ISO 15197? J Diabetes Sci Technol. 2017;11:1240–6. doi: 10.1177/1932296817713220. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.ISO 15197. In vitro diagnostic test systems – requirements for blood-glucose monitoring systems for self-testing in managing diabetes mellitus, 2013. Available at: www.iso.org/obp/ui/#iso:std:iso:15197:ed-2:v1:en (accessed 20 February 2018).
- 13.Pleus S, Kamecke U, Link M. et al. Prediction quality of glucose trend indicators in current tissue glucose monitoring systems for use in therapeutic decisions, Poster 712. Presented at 53rd EASD Annual Meeting, Lisbon, Portugal, 11–15 September 2017 [Google Scholar]
- 14.Signal M, Gottlieb R, Le Compte A, Chase JG. Continuous glucose monitoring and trend accuracy: News about a trend compass. J Diabetes Sci Technol. 2014;8:986–97. doi: 10.1177/1932296814533091. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Schnell O, Barnard K, Bergenstal R. et al. Role of continuous glucose monitoring in clinical trials: recommendations on reporting. Diabetes Technol Ther. 2017;19:391–9. doi: 10.1089/dia.2017.0054. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Pleus S, Heinemann L, Freckmann G. Blood glucose monitoring data should be reported in detail when studies about efficacy of continuous glucose monitoring systems are published. J Diabetes Sci Technol. 2018 doi: 10.1177/1932296817753629. 1932296817753629. [Epub ahead of print] [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.van Beers CA, DeVries JH. Continuous glucose monitoring: Impact on hypoglycaemia. J Diabetes Sci Technol. 2016;10:1251–8. doi: 10.1177/1932296816653411. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Twigg SM, Kazemi MR, Craig ME. Flash continuous glucose monitoring and its IMPACT to REPLACE blood glucose monitoring in the management of type 1 and type 2 diabetes. US Endocrinology. 2017;13:57–62. [Google Scholar]
- 19.Lodwig V, Kulzer B, Schnell O, Heinemann L. Current Trends in Continuous Glucose Monitoring. J Diabetes Sci Technol. 2014;8:390–6. doi: 10.1177/1932296814525826. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.National Institute for Health and Care Excellence. FreeStyle Libre for glucose monitoring, 2017. Available at: www.nice.org.uk/advice/mib110/resources/freestyle-libre-for-glucosemonitoring-pdf-2285963268047557 (accessed 19 February 2018).
- 21.Bidonde J, Fagerlund BC, Frønsdal KB. et al. FreeStyle Libre Flash Glucose Self-Monitoring System: A single-technology assessment, Norwegian Institute of Public Health. 2017. ISBN (digital): 978-82-8082-852-1. Available at: http://www.fhi.no/en/publ/2017/freestyle-libre-systemet-for-egenmaling-avblodsukker-en-hurtigmetodevurder/ (accessed 20 February 2018). [PubMed] [Google Scholar]
- 22.US Food and Drug Administration Flash glucose monitoring system. www.accessdata.fda.gov/cdrh_docs/pdf15/P150021C.pdf Available at: (accessed May 2018).
- 23.Bailey TS, Grunberger G, Bode B. et al. American Association of Clinical Endocrinologists and American College of Endocrinology 2016 outpatient glucose monitoring consensus statement. Endocrine Pract. 2016;22:231–61. doi: 10.4158/EP151124.CS. [DOI] [PubMed] [Google Scholar]
- 24.American Association of Diabetes Educators. White Paper: Continuous Glucose Monitoring Summit. Chicago, American Association of Diabetes Educators, 2015. Available at: www.diabeteseducator.org/docs/default-source/default-documentlibrary/aade-2015-cgm-summit-white-paper-final.pdf?sfvrsn=0 (accessed 3 April 2018).
- 25.Heinemann L, Freckmann G. CGM versus FGM; or, continuous glucose monitoring is not flash glucose monitoring. J Diabetes Sci Technol. 2015;9:947–50. doi: 10.1177/1932296815603528. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Clarke W, Kovatchev B. Statistical tools to analyze continuous glucose monitor data. Diabetes Technol Ther. 2009;11((Suppl 1)):S45–54. doi: 10.1089/dia.2008.0138. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Bailey TS. Clinical implications of accuracy measurements of continuous glucose sensors. Diabetes Technol Ther. 2017;19((Suppl 2)):S51–54. doi: 10.1089/dia.2017.0050. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Pardo S, Simmons DA. The quantitative relationship between ISO 15197 accuracy criteria and mean absolute relative difference (MARD) in the evaluation of analytical performance of self-monitoring of blood glucose (SMBG) systems. J Diabetes Sci Technol. 2016;10:1182–7. doi: 10.1177/1932296816644468. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Kirchsteiger H, Heinemann L, Freckmann G. et al. Performance Comparison of CGM Systems: MARD Values Are Not Always a Reliable Indicator of CGM System Accuracy. J Diabetes Sci Technol. 2015;9:1030–40. doi: 10.1177/1932296815586013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Kovatchev BP, Patek SD, Ortiz EA, Breton MD. Assessing sensor accuracy for non-adjunct use of continuous glucose monitoring. Diabetes Technol Ther. 2015;17:177–86. doi: 10.1089/dia.2014.0272. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Reiterer F, Polterauer P, Schoemaker M. et al. Significance and reliability of MARD for the accuracy of CGM systems. J Diabetes Sci Technol. 2017;11:59–67. doi: 10.1177/1932296816662047. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Pardo S, Simmons D, Zhuplatov S, Breton M. San Diego CA: Jun, 2017. A New method to evaluate analytic performance of CGM devices. Poster presented at American Diabetes Association 77th Congress; pp. 9–13. [Google Scholar]
- 33.Pardo S, Simmons D, Zhuplatov S, Breton M. A New method to evaluate analytic performance of CGM devices. Poster presented at ATTD 11th Congress, Vienna Austria. 2018 Feb;:14–17. [Google Scholar]
- 34.El-Khatib FH, Balliro C, Hillard MA. et al. Home use of a bihormonal bionic pancreas versus insulin pump therapy in adults with type 1 diabetes: a multicentre randomised crossover trial. Lancet. 2017;389:369–80. doi: 10.1016/S0140-6736(16)32567-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Yeh HC, Brown TT, Maruthur N. et al. Comparative effectiveness and safety of methods of insulin delivery and glucose monitoring for diabetes mellitus: a systematic review and meta-analysis. Ann Intern Med. 2012;157:336–47. doi: 10.7326/0003-4819-157-5-201209040-00508. [DOI] [PubMed] [Google Scholar]
- 36.Beck RW, Riddlesworth T, Ruedy K. et al. Effect of continuous glucose monitoring on glycemic control in adults with type 1 diabetes using insulin injections: The DIAMOND randomized clinical trial. JAMA. 2017;317:371–8. doi: 10.1001/jama.2016.19975. [DOI] [PubMed] [Google Scholar]
- 37.Ekhlaspour L, Mondesir D, Lautsch N. et al. Comparative accuracy of 17 point-of-care glucose meters. J Diabetes Sci Technol. 2017;11:558–66. doi: 10.1177/1932296816672237. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.US Food and Drug Administration. What is the pancreas? What is an artificial pancreas device system? Available at: www.fda.gov/MedicalDevices/ProductsandMedicalProcedures/HomeHealthandConsumer/ConsumerProducts/ArtificialPancreas/ucm259548.htm (accessed 21 February 2018)
- 39.Guidance for Industry and Food and Drug Administration Staff. The Content of Investigational Device Exemption (IDE) and Premarket Approval (PMA) Applications for Artificial Pancreas Device Systems. 9 November. 2012. Available at: www.fda.gov/downloads/medicaldevices/deviceregulationandguidance/guidancedocuments/ucm259305.pdf (accessed 21 February 2018).
- 40.US Food and Drug Administration. The Artificial Pancreas Device System. Available from: www.fda.gov/medicaldevices/productsandmedicalprocedures/homehealthandconsumer/consumerproducts/artificialpancreas/default.htm (accessed 21 February 2018)
- 41.Bergenstal RM, Garg S, Weinzimer SA. et al. Safety of a hybrid closed-loop insulin delivery system in patients with Type 1 Diabetes. JAMA. 2016;316:1407–8. doi: 10.1001/jama.2016.11708. [DOI] [PubMed] [Google Scholar]