Skip to main content
PLOS One logoLink to PLOS One
. 2022 Oct 27;17(10):e0275980. doi: 10.1371/journal.pone.0275980

Psychometric and biomedical outcomes of glycated haemoglobin target-setting in adults with type 1 and type 2 diabetes: Protocol for a mixed-methods parallel-group randomised feasibility study

Samuel J Westall 1,2,*, Simon Watmough 1, Ram Prakash Narayanan 2, Greg Irving 1, Kevin Hardy 2
Editor: Walid Kamal Abdelbasset3
PMCID: PMC9612465  PMID: 36302049

Abstract

Background

The disease burden of diabetes can have wide-ranging implications on patients’ psychological well-being and health-related quality of life. Glycated haemoglobin targets are commonly used to guide patient management in diabetes to reduce the future risk of developing diabetes complications, but little is known of the psychological impact of glycated haemoglobin target-setting. This protocol describes a study to determine the feasibility of evaluating psychological outcomes when setting explicit glycated haemoglobin targets in people with diabetes.

Methods

This single-centre randomised feasibility study will follow a mixed-methods approach across four sub-studies. In sub-study A, eligible adults (aged 18 and over) with type 1 or type 2 diabetes will complete baseline validated psychometric questionnaires evaluating health-related quality of life (EuroQoL-5D-5L), diabetes-related distress (Problem Areas In Diabetes), self-care (Summary of Diabetes Self-Care Activities), well-being (Well-Being Quetionnaire-12) and diabetes-related psychosocial self-efficacy (Diabetes Empowerment Scale-Long Form). Participants will be randomised to receive explicit glycated haemoglobin intervention targets 5mmol/mol above or below current glycated haemoglobin readings. Rates of eligibility, recruitment, retention and questionnaire response rate will be measured. Psychometric outcomes will be re-evaluated 3-months post-intervention. Sub-studies B and C will use qualitative semi-structured interviews to evaluate experiences, views and opinions of diabetes patients and healthcare professionals in relation to the acceptability of study processes, the use of glycated haemoglobin targets, the impact of diabetes on psychological well-being and, in sub-study D, barriers to participation in diabetes research.

Discussion

This mixed-methods study aims to provide a novel insight into the psychological implications of glycated haemoglobin target-setting for people with diabetes in secondary care, alongside testing the feasibility of undertaking a larger project of this nature.

Trial registration

The study is registered with the ISRCTN (registration number: 12461724; date registered: 11th June 2021). Protocol version: 2.0.5, 26th February 2021.

Introduction

Background

Glycated haemoglobin values are commonly used to guide the management of people with diabetes. Far from being a standardised approach, glycated haemoglobin targets are often individualised to the patient in response to the presence of established cardiovascular disease [13], advanced age [4, 5], long diabetes duration [6], frailty [7, 8], excessive comorbidity [9], history of severe hypoglycaemia [10] and comorbid mental health illness [11, 12].

For diabetes healthcare professionals, the importance of a personalised approach to management and goal-setting in people with diabetes has never been clearer, evidenced by the release of the joint American Diabetes Association (ADA)/European Association for the Study of Diabetes (EASD) consensus statement [13, 14]. Over time, glycated haemoglobin is a predictor of risk of developing diabetes complications [15]. Chronically high glycated haemoglobin readings have been shown to negatively impact upon the physical health of people with diabetes: diabetes is one of the leading causes of adult blindness in the UK [16], increases the risk of cancer [17, 18] and dementia [19, 20], more than doubles the risk of heart attack [21], trebles the risk of stroke [21] and is the commonest cause of end-stage renal failure [21] and non-traumatic lower limb amputation in Europe [21].

Several factors have a bearing on the achievement of glycated haemoglobin targets in people with diabetes [22]. Diabetes is recognised to have a significant impact on psychological outcomes and mental health. Indeed, mental health illnesses are seen with increased prevalence in those with diabetes [23]. Prior research has shown that a significant proportion of people with diabetes have depression at a level that impairs activities of daily living, quality of life, adherence to medical treatment, glycaemic control, and increases healthcare utilisation, healthcare cost and the risk of diabetes complications [11, 12, 24, 25]. From a patient’s perspective, lower levels of motivation and knowledge and higher levels of mental health comorbidity can create barriers to achieving optimal glycated haemoglobin levels [26]. From a healthcare perspective, contradictory guidelines and complex management options can cause confusion for clinicians in personalising glycated haemoglobin targets in patients [22].

Although awareness of the importance of achieving glycated haemoglobin targets amongst patients with diabetes is improving with patient education [27], many patients remain unaware of the preventable excess risk posed by sub-optimal glycated haemoglobin levels. Despite many new pharmacological interventions that have become available in the past decade, achievement of glycated haemoglobin treatment targets in England and Wales has remained stubbornly below 30 percent for Type 1 Diabetes and below 70 percent for Type 2 Diabetes [28]. Evidence for lack of progress in the achievement of optimal glycated haemoglobin levels is reflected in studies globally [26]. People with diabetes have historically struggled to access evidenced-based diabetes education (though this is improving) and negative patient perceptions on the intensification of diabetes treatment remain prevalent [26, 29, 30].

Awareness amongst healthcare professionals of the importance using treatment targets to drive improvement in micro- and macro-vascular outcomes is good. Compelling evidence on the use of personalised glycated haemoglobin treatment targets in response to patient factors is gaining traction amongst clinicians in primary and secondary care in the UK. Current literature points to the clear reduction in the risk of diabetes complications by having individualised treatment targets [3, 3134]. A lack of evidence persists on the impact clinician-initiated glycated haemoglobin target-setting has on psychological and self-management abilities of people with diabetes. It would therefore be valuable to determine the acceptability and preliminary impact of glycated haemoglobin target-setting on the psychological well-being of people with diabetes.

Study aims

This protocol outlines a feasibility study to achieve the following objectives:

  1. Test the feasibility of the study according to eligibility, recruitment and retention.

  2. Test the feasibility of data collection procedures.

  3. Evaluate the preliminary impact of explicit glycated haemoglobin target-setting (intervention) on health-related quality of life, diabetes-distress, self-care, well-being and diabetes-related psychosocial self-efficacy at 3-month follow-up.

  4. Evaluate the acceptability of the intervention and study processes.

  5. To understand the experiences, views and opinions of people with diabetes and their healthcare professionals on the acceptability of the study, the intervention and barriers to participation in diabetes research.

Materials and methods

Study design

This is a single-centre mixed-method study consisting of an unblinded randomised two-arm feasibility study (sub-study A) and semi-structured interviews (sub-studies B, C and D). A SPIRIT schedule of procedures and events is demonstrated in Fig 1. The 2013 SPIRIT checklist of recommendations [35] is presented in the S1 Table.

Fig 1. Schedule of procedures and assessments.

Fig 1

POC: point-of-care; HbA1c: glycated haemoglobin; BP: blood pressure; BMI: body mass index; EQ-5D-5L: EuroQoL-5D-5L; PAID: Problem Areas in Diabetes; SDSCA: Summary of Diabetes Self-care Activities; W-BQ12: Well-being Questionnaire-12; DES-LF: Diabetes Empowerment Scale-Long Form; HCP: Healthcare Professional; mmol/mol: millimoles per mole, glycated haemoglobin SI unit of measurement. † Sub-study B. Semi-structured interviews in those enrolled in sub-study A. ‡ Sub-study C. Semi-structured interviews with healthcare professionals. § Sub-study D. In those declining to take part in sub-study A, survey and semi-structured interview.

Setting

Recruitment and data collection will be from a secondary care outpatient diabetes centre in the Metropolitan Borough of St Helens, UK. St Helens is in the Northwest UK and comprises of a mixture of rural and urban wards with comparable demographics to other regions in the UK. Recorded semi-structured interviews in the study will take place via telephone.

Eligibility criteria

For sub-study A, eligible patients will be identified when registered to attend the local secondary care adult diabetes clinic. Adults aged 18 years and over with either Type 1 or Type 2 diabetes and with a glycated haemoglobin reading at recruitment between 64 and 125 mmol/mol will be eligible for recruitment. Potential participants will be excluded if they: are at risk of cardiovascular disease events; have had an episode of severe hypoglycaemia within the past 12 months; have hypoglycaemia unawareness (defined as Gold score ≥ 4 [36]); are unwilling to self-monitor blood glucose (if clinical management requires); are unwilling to inject insulin (if clinical management requires); have a body mass index ≥ 45 kg/m2; have opted-out from being contacted by researchers under the national NHS date opt-out service; have another serious illness which may limit survival; have factors that may limit adherence to study interventions; are currently participating in another trial; are pregnant; have requirement for regular venesection or blood transfusion; or, are undergoing medical therapies known to cause difficulties with glycaemic control (such as corticosteroid therapy). Eligible individuals will be invited to take part in the study. Reasons for decline will be recorded.

A purposive sample of participants enrolled will be invited into sub-study B for interview (see Allocation). Eligible patients declining to take part will be invited into sub-study D, a survey and interview evaluating barriers to participation in diabetes research. A convenience sample of diabetes healthcare professionals will be invited into sub-study C for interview.

Intervention

Glycated haemoglobin target-setting

Explicit glycaemic targets will be given to participants as described using the TIDieR checklist [37] in Table 1.

Table 1. Study intervention described using the TIDieR checklist.
Item Description
1. Name of intervention Group A: In-person (1-on-1) reset of glycaemic target to 5mmol/mol above current participant glycated haemoglobin reading.
Group B: In-person (1-on-1) reset of glycaemic target to 5mmol/mol below current participant glycated haemoglobin reading.
2. Rationale The psychological effect of glycaemic target-setting in people with diabetes is unknown.
3. Materials A supplemental study leaflet shows a visual representation of participants’ current HbA1c result (on a scale from ‘non-diabetic’ to ‘very high glycated haemoglobin levels’) alongside participants’ study target glycated haemoglobin.
4. Procedures The intervention takes place as a discussion between the intervention provider and the participant. The discussion is guided by pre-defined script.
5. Intervention provider The intervention is provided by the Main Investigator.
6. Mode of intervention delivery The intervention is delivered face-to-face on an individual basis.
7. Location The intervention is delivered in a private consultation room within a secondary care diabetes centre in the Northwest UK.
8. Time requirements/timing The intervention takes place 3-months post-allocation to allow for initial secondary care clinical management (undertaken at study entry) to be fully established. Intervention delivery is expected to take 10−15 minutes as a discussion between researcher and participant.
9. Personalisation Not applicable.
11. Ensuring intervention adherence A single intervention provider delivers the intervention in order to ensure rigorous and consistent adherence to the protocol for the duration of the trial.

Items 10 and 12 are excluded as they are not applicable until the study is complete.

In primary care in the UK, glycated haemoglobin targets are incentivised under the Quality and Outcomes framework. Recruitment of participants is undertaken from secondary care, therefore primary care target incentivisation is not anticipated to impact the intervention during the study period. As shown in Table 1, a supplemental glycated haemoglobin fillable leaflet has been developed to visually represent the new glycated haemoglobin target study intervention to participants. The leaflet will be used in conjunction with a face-to-face intervention delivery; setting participants’ glycaemic haemoglobin target 5 mmol/mol above (in those randomised to Group A) or below (Group B) current glycated haemoglobin readings (worked example, Table 2). Intervention-related new glycated haemoglobin levels will be fixed for the remainder of the study after which they will be returned to pre-study levels.

Table 2. Worked example of sub-study A intervention.
Study period Pre-baseline Baseline Intervention Endpoint
Timepoint - 0 months 3 months 6 months
Intervention Group A
Example patient ‘A’ glycated haemoglobin level 65 mmol/mol 67 mmol/mol 63 mmol/mol 62 mmol/mol
Glycated haemoglobin target < 58 mmol/mol < 58 mmol/mol ↑ < 68 mmol/mola < 58 mmol/mol
Intervention Group B
Example patient ‘B’ glycated haemoglobin level 77 mmol/mol 78 mmol/mol 74 mmol/mol 65 mmol/mol
Glycated haemoglobin target < 53 mmol/mol < 53 mmol/mol ↓ < 69 mmol/molb < 53 mmol/mol

a Group A study intervention: glycated haemoglobin target increased by 5 mmol/mol against patient’s current glycated haemoglobin level.

b Group B study intervention: glycated haemoglobin target decreased by 5 mmol/mol against patient’s current glycated haemoglobin level.

Treatment as usual

With the primary aim of this study testing feasibility—‘can this trial be done?’—a control group will not be used. Participants’ usual diabetes care will continue. Any participants highlighted by the outcome tools as needing psychological support will be signposted to relevant local providers.

Recruitment and follow-up

The schedule of procedures and events is presented in Fig 1, in accordance with the 2013 SPIRIT Statement [35]. A flowchart of study processes is demonstrated in Fig 2. Eligible participants will be invited via post to sub-study A following review of upcoming secondary care diabetes patient clinic lists. Following diabetes clinic appointments, invited persons will be screened to confirm eligibility. Written, informed consent will be obtained from eligible individuals willing to consent to study participation. Following consent, participants will be randomly allocated to group A or B (see Allocation). Trained clinic staff (registered nurses and healthcare assistants) obtain point-of-care glycated haemoglobin readings, blood pressure and body mass index for the study at enrolment, intervention and follow-up.

Fig 2. Flowchart demonstrating the study process and timeline.

Fig 2

A 3-month run-in period is allowed to optimise participant clinical management prior to intervention delivery. Following the run-in period, participants will complete baseline psychometric questionnaires after which the study intervention will be delivered according to allocation group.

At the study endpoint, 3-months post-intervention, participants complete psychometric questionnaires and a study acceptability survey.

In order to triangulate preliminary quantitative data obtained from sub-study A, a selection of participants (see Allocation) will be recruited for recorded semi-structured telephone interviews (sub-study B). Healthcare professionals involved in delivering secondary diabetes care will be invited via email to take part in a recorded semi-structured interview (sub-study C). Those declining to take part in sub-study A will be offered a survey and recorded semi-structured interview evaluating barriers to participation in research (sub-study D).

Allocation

Participants enrolled in sub-study A will be randomised using a stratified (strata: type 1 diabetes; type 2 diabetes), random permuted block strategy [38, 39] 1:1 into intervention Group A or Group B, using an online randomisation service [40]. For sub-study B, a stratified (strata: type 1 diabetes; type 2 diabetes), purposive sample of participants in sub-study A will be recruited for recorded semi-structured interviews. For sub-study C, a convenience sample of healthcare professionals directly involved in the care of people with diabetes will be recruited for recorded semi-structured interviews. For sub-study D, a stratified (strata: type 1 diabetes; type 2 diabetes), purposive sample of participants declining enrolment into sub-study A will be recruited for recorded semi-structured interviews and survey.

Sample size

A formal power calculation was not undertaken as this is usually not required for a feasibility study [41]. Influential papers [42, 43] on the sample size requirements for feasibility studies have suggested between 24 and 50 participants will be required to estimate the standard deviation of an outcome measure (often needed in the calculation of sample sizes in larger studies). To target the upper limit of these suggestions, it is projected that 72 eligible candidates will be required to recruit 50 participants, based on rates of recruitment from similarly structured studies [44, 45] with loss to follow-up expected to be less than 20 percent [46]. Depending on eligibility and recruitment rates, the sample size may have to be adapted.

For qualitative study aspects (sub-studies B, C and D) an estimated 15 participants will be required for each sub-study. Sample adequacy will be determined using the concept of information power [47].

Outcomes

Feasibility and acceptability

Feasibility and acceptability of the trial will be determined according to rates of participant eligibility, recruitment, retention and questionnaire response rates. Further data on acceptability will be captured using an end-of-study survey. In addition, barriers to participation in research will be recorded. The feasibility and acceptability data will identify if progression to a larger study is recommended.

Preliminary effectiveness

Examination of the effectiveness of the intervention is exploratory given that the study is not sufficiently powered. Preliminary effectiveness of the intervention on glycated haemoglobin levels and psychometric outcomes (see Measures) will be measured as the key variables of interest with measurements pre-intervention and endpoint (Fig 1).

Demographics and clinical characteristics

Baseline data on NHS number, age, sex, ethnicity, diabetes type, diabetes duration, postcode, point-of-care glycated haemoglobin, blood pressure, body mass index and educational status. Follow-up point-of-care glycated haemoglobin, blood pressure and body mass index at three and six months will be recorded. Prescribed glucose-lowering medications and changes to medications will be recorded from medical records at each timepoint.

Measures

Feasibility

Rates of eligibility, recruitment, retention and questionnaire response will be measured. Barriers to participation and reasons for dropout will be recorded.

Study acceptability

An 8-item Likert-type acceptability survey will evaluate the study processes, participant-facing documents, intervention, understanding of glycated haemoglobin targets, time commitments and psychometric questionnaires. Participants will be asked to rate a statement on each item (1 = ‘strongly disagree’, 5 = ‘strongly agree’).

Health-related quality of life

Health-related quality of life will be measured by EuroQoL’s EQ-5D-5L questionnaire [48]. The EQ-5D-5L consists of two pages: the EQ-5D descriptive system and the EQ visual analogue scale (EQ-VAS). The descriptive system measures dimensions of mobility, self-care, usual activities, pain/discomfort and anxiety/depression. Each dimension has five levels: ‘no problems’, ‘slight problems’, ‘moderate problems’, ‘severe problems’ and ‘extreme problems’. Participants indicate their health state ticking the box next to the most appropriate statement in each of the five dimensions. This results in a 1-digit number for each dimension. The numbers are combined into a 5-digit number describing the participant’s overall health state (e.g. ‘11111’ being the state of full health). The EQ-VAS records the participants self-rated health visually on a scale from ‘The worst health you can imagine’ to ‘The best health you can imagine’. The EQ-5D-5L tool has good internal consistency, with a Cronbach’s alpha between 0.76 and 0.83 reported in diabetes populations [49, 50].

Diabetes-related distress

The Problem Areas in Diabetes questionnaire [51] is a 20-item questionnaire in which each item relates to a different aspect of diabetes-related psychosocial distress (rated 0 = ‘not a problem’ to 4 = ‘serious problem’). The scores of each item are added up and multiplied by 1.25, generating a total score between 0 − 100. Higher scores indicate a high degree of diabetes-related distress. Participants scoring 40 or higher may be at the level of emotional burnout and warrant special attention. The tool has good internal consistency, with a Cronbach’s alpha of 0.9 [52].

Self-care

Self-care in diabetes will be measured by the Summary of Diabetes Self-care Activities questionnaire [53]. The Summary of Diabetes Self-care Activities questionnaire measures the diabetes self-care activities of ‘general diet’, ‘specific diet’, ‘exercise’, ‘blood sugar testing’ and ‘foot care’ (scored on ‘number of good days per week’, 0−7). Items are scored separately due to low levels of inter-item correlation. Higher scores indicate higher levels of self-management for each activity. Additionally, self-reported smoking status (‘yes’ or ‘no’) and average number of cigarettes smoked per day are recorded. The tool has moderate internal consistency, with a Cronbach’s alpha of 0.62 [54].

Well-being

The 12-item Well-being Questionnaire [55] provides a measure of depressed mood, anxiety and various aspects of positive and negative well-being (items rated 0 = ‘not at all’ to 3 = ‘all the time’). The 12-item Well-being Questionnaire outputs a score of general psychological well-being on a scale of 0 − 36 with higher scores indicating better general well-being. The tool has good internal consistency, with a Cronbach’s alpha of 0.87 [56].

Diabetes-related psychosocial self-efficacy

The Diabetes Empowerment Scale-Long Form [57] measures perceived self-efficacy of participants across 28-items using a Likert-type scale from 0 (‘strongly disagree’) to 5 (‘strongly agree’). Higher scores indicate higher levels of psychosocial self-efficacy in diabetes. The tool has good internal consistency, with a Cronbach’s alpha of 0.96 [57].

Point-of-care glycated haemoglobin

Glycated haemoglobin, a blood marker measuring the degree of glycaemia over a period of 8–12 weeks, is measured using capillary blood obtained from participants using a lancet device. Automated point-of-care glycated haemoglobin analysis is completed in five minutes on a DCA Vantage machine which is calibrated and maintained as per NHS laboratory standards. Glycated haemoglobin levels will be recorded at enrolment (to check eligibility), follow-up (as part of study intervention) and endpoint (to evaluate impact of the intervention).

Data analysis

Data analysis will aim to describe the feasibility of undertaking a larger trial evaluating the psychometric impact of using glycated haemoglobin targets in adults with type 1 and type 2 diabetes. Analysis of feasibility data from sub-study A will be carried out quantitatively and descriptively using International Business Machines Statistical Package for Social Sciences V.25 statistics software [58]. P-values will not be calculated. Analysis will be presented separately by randomisation group as follows:

  • Feasibility data will be presented as numbers and percentages.

  • Acceptability data will be expressed as frequencies and percentages.

  • For continuous variables, baseline characteristics will be expressed as mean (standard deviation) where normally distributed and median (interquartile range) where distributions are skewed. Categorical variables will be expressed as frequencies and percentages.

  • Glycated haemoglobin, blood pressure, body mass index values at 0, 3 and 6 months and EQ-5D-5L index, EQ-VAS, SDSCA, PAID, W-BQ12 and DES-LF questionnaire scores at 3 and 6 months. Missing data from validated questionnaires will be handled as described in the questionnaire user guides.

Qualitative data from semi-structured interviews will be transcribed verbatim, coded to highlight key themes and analysed qualitatively using the Framework Method of thematic analysis [59] in NVivo [60] qualitative data analysis support software. Data will be anonymised during transcription. Pre-defined themes of interest alongside inductively derived themes (themes arising from the data during analysis) will used in coding the qualitative data. Deductive themes, consistent with the study aims, will be derived from the interview guides (S2 File) with new codes arising inductively during transcript analysis to enhance the codebook. Coding strategy for transcript analysis will be determined by discussion amongst the coding team followed by consensus on a final coding strategy. Any disagreements will be resolved with input from a senior reviewer. This approach will allow the team to contrast themes from the patient and healthcare professional perspective.

Interviewing participants taking part in the quantitative study aspects will enable a deeper understanding of the themes of glycated haemoglobin target individualisation, mental health in diabetes and study acceptability and their relationship with health-related quality of life, self-care, diabetes-related distress and well-being. Quantitative and qualitative data will be triangulated to inform on the acceptability of the study processes and patient experiences in relation to glycated haemoglobin target-setting.

Monitoring

Rates of eligibility, recruitment and retention will be monitored and recorded in a detailed database, including reasons for drop-out. Data will be reported monthly to the research team and sponsor. Adverse and serious adverse events will be recorded alongside these data and reported immediately to the sponsor and Chief Investigator who, together with the research team, determine the severity and association of the event with the study intervention to determine necessary actions.

A green (proceed: there are no concerning issues that threaten the success of a future trial), amber (amend: where there are remediable issues, thereafter, proceed with caution), red (stop: there are intractable issues which cannot be remedied) system will be used to determine progression to a larger trial.

For sub-study A, 50 recruits are required. Each week in the diabetes centre, 13 distinct face-to-face diabetes clinic lists are timetabled, with an average of seven patients per clinic. After accounting for expected non-attenders (2-3/clinic), clinic closures (3-4/week) and clinician unavailability (rare), a lower estimate of 156 patients per month will be available for screening, of which 25 percent (n = 0.25×156 = 39) are expected to be eligible. To recruit the required number of participants into sub-study A within the timeframe, successful recruitment of 13 participants per month will be required, meaning recruitment rate is expected to be a minimum of 33 percent (13÷39). Considering these estimates, conservative progression criteria will be: (1) identification of 39 or more eligible patients per month through screening, (2) recruitment of 13 or more participants per month, (3) monitoring of significant off-protocol deviation; (4) retention of 80 percent or more at follow-up, and; (5) questionnaire response rate of 75 percent of more.

Failure to meet these criteria would result in an amber situation. Remediable adjustments will be identified by the investigators and implemented. Failure to meet progression criteria following remediable adjustments of in the absence of remediable adjustments will prompt review to prevent trial progression.

Ethics and dissemination

The study has been approved by the Health Research Authority in the United Kingdom (Cornwall and Plymouth Research Ethics Committee, REC reference 21/SW/0043, IRAS ID: 291245, 30th April 2021) and Edge Hill University (Health-related Research Ethics Committee, REC reference ETH2021-0017, 31st March 2021). Internal and external peer review has been undertaken by St Helens and Knowsley Teaching Hospitals NHS Trust as the study sponsor organisation (sponsorship reference: STHK-2021-003). Written, informed consent is obtained from all participants prior to participation in line with UK regulatory requirements.

Study data will be stored on NHS password-protected, encrypted computers or locked filing cabinets on NHS sites. All participant data will be anonymised and assigned a unique study code on database entry. A list of patient identifiers linked to study codes is kept separately in case re-identification is necessary. Biological specimens obtained in the study will not be stored and will be safely disposed of in accordance with the UK’s Human Tissue Authority Code of Practice (S1 File).

Any minor or substantial amendments to the study protocol will be reviewed by the Health Research Authority and Edge Hill University Health-related Research Ethics Committee. Such amendments will be communicated to the study sponsor, investigators, trial registry and journals accordingly.

Dissemination plans include publication of study results in scientific, peer-reviewed journals and conferences. Participants will be posted a lay summary of the study findings. Findings also form part of one of the author’s (S.J.W.) doctoral thesis. On completion of the study, an anonymised trial dataset and related metadata will be made available via Edge Hill University’s online Research Data Repository.

Discussion

With the rising prevalence of diabetes and a drive by Diabetes UK and the UK government to improve mental health awareness, managing the psychological implications of diabetes is of increasing importance. Psychological comorbidities in diabetes can significantly impact upon self-care and self-management with subsequent detrimental effects on glycated haemoglobin levels in the long-term. Gaining new insights into the psychological impact that diabetes care processes have on people with diabetes may highlight areas where improvements can be made. This study will output valuable data on the feasibility of studying psychometric outcomes in people with diabetes and preliminarily demonstrate the impact glycated haemoglobin targets have on psychological metrics in people with diabetes. Furthermore, this study will provide qualitative viewpoints of the experiences of participants on study acceptability, the views of participants on the use of glycated haemoglobin targets and ways in which glycated haemoglobin target usage impacts upon their well-being.

Recruitment for quantitative aspects of the study began in June 2021. All participants have been recruited, with follow-up and data collection expected to be completed by April 2022. Qualitative semi-structured interview components of the study will take place during this time period.

Conclusion

The present mixed-methods study protocol aims to provide a novel insight into the psychological implications of glycated haemoglobin target-setting in people with diabetes in secondary care, alongside testing the feasibility of undertaking a larger project of this nature.

Supporting information

S1 Table. SPIRIT (2013) checklist of standard protocol items.

(DOCX)

S1 File. Description of the handling of biological specimens.

(DOCX)

S2 File. HRA approved protocol version 2.0.5.

(PDF)

Acknowledgments

This work forms part of the first author’s PhD. S.J.W. is supported by the Department of Diabetes and Endocrinology, St Helens and Knowsley Teaching Hospitals NHS Trust, UK.

Data Availability

No datasets were generated or analysed during the current study. All relevant data from this study will be made available upon study completion. All relevant data from this study will be made available on study completion. Anonymised data will be deposited in the Edge Hill University online research data repository, https://figshare.edgehill.ac.uk.

Funding Statement

The authors received no specific funding for this work.

References

  • 1.Mellbin LG, Rydén L, Riddle MC, Probstfield J, Rosenstock J, Díaz R, et al. Does hypoglycaemia increase the risk of cardiovascular events? A report from the ORIGIN trial. Eur Heart J. 2013;34: 3137–3144. doi: 10.1093/eurheartj/eht332 [DOI] [PubMed] [Google Scholar]
  • 2.Mukamal KJ, Nesto RW, Cohen MC, Muller JE, Maclure M, Sherwood JB, et al. Impact of diabetes on long-term survival after acute myocardial infarction: Comparability of risk with prior myocardial infarction. Diabetes Care. 2001;24: 1422–1427. doi: 10.2337/diacare.24.8.1422 [DOI] [PubMed] [Google Scholar]
  • 3.The ACCORD Study Group. Effects of Intensive Glucose Lowering in Type 2 Diabetes. N Engl J Med. 2008;358: 2545–2559. doi: 10.1056/NEJMoa0802743 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Lipska KJ, Ross JS, Miao Y, Shah ND, Lee SJ, Steinman MA. Potential Overtreatment of Diabetes Mellitus in Older Adults With Tight Glycemic Control. JAMA Intern Med. 2015;175: 356. doi: 10.1001/jamainternmed.2014.7345 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Shorr RI. Incidence and Risk Factors for Serious Hypoglycemia in Older Persons Using Insulin or Sulfonylureas. Arch Intern Med. 1997;157: 1681. doi: 10.1001/archinte.1997.00440360095010 [DOI] [PubMed] [Google Scholar]
  • 6.Monami M, Vitale V, Lamanna C, Bartoli N, Martelli D, Zannoni S, et al. HbA1c levels and all-cause mortality in type 2 diabetic patients: Epidemiological evidence of the need for personalised therapeutic targets. Nutr Metab Cardiovasc Dis. 2013;23: 300–306. doi: 10.1016/j.numecd.2012.01.003 [DOI] [PubMed] [Google Scholar]
  • 7.Liccini AP, Malmstrom TK. Frailty and Sarcopenia as Predictors of Adverse Health Outcomes in Persons With Diabetes Mellitus. J Am Med Dir Assoc. 2016;17: 846–851. doi: 10.1016/j.jamda.2016.07.007 [DOI] [PubMed] [Google Scholar]
  • 8.Yanagita I, Fujihara Y, Eda T, Tajima M, Yonemura K, Kawajiri T, et al. Low glycated hemoglobin level is associated with severity of frailty in Japanese elderly diabetes patients. J Diabetes Investig. 2018;9: 419–425. doi: 10.1111/jdi.12698 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Kalyani RR, Saudek CD, Brancati FL, Selvin E. Association of diabetes, comorbidities, and A1C with functional disability in older adults: Results from the National Health and Nutrition Examination Survey (NHANES), 1999–2006. Diabetes Care. 2010;33: 1055–1060. doi: 10.2337/dc09-1597 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Zoungas S, Patel A, Chalmers J, de Galan BE, Li Q, Billot L, et al. Severe Hypoglycemia and Risks of Vascular Events and Death. N Engl J Med. 2010;363: 1410–1418. doi: 10.1056/NEJMoa1003795 [DOI] [PubMed] [Google Scholar]
  • 11.Ciechanowski P, Katon WJ, Russo J. Depression and Diabetes. Arch Intern Med. 2000;160: 3278–3285. doi: 10.4088/JCP.11bk06921 [DOI] [PubMed] [Google Scholar]
  • 12.Egede LE, Nietert PJ, Zheng D. Depression and All-Cause and Coronary Heart Disease Mortality Among Adults With and Without Diabetes. Diabetes Care. 2005;28: 1339–1345. doi: 10.2337/diacare.28.6.1339 [DOI] [PubMed] [Google Scholar]
  • 13.Davies MJ D ’Alessio DA, Fradkin J, Kernan WN, Mathieu C, Mingrone G, et al. Management of hyperglycaemia in type 2 diabetes, 2018. A consensus report by the American Diabetes Association (ADA) and the European Association for the Study of Diabetes (EASD). Diabetologia. 2018;61: 2461–2498. doi: 10.1007/s00125-018-4729-5 [DOI] [PubMed] [Google Scholar]
  • 14.Davies MJ D ’Alessio DA, Fradkin J, Kernan WN, Mathieu C, Mingrone G, et al. Correction to: Management of hyperglycaemia in type 2 diabetes, 2018. A consensus report by the American Diabetes Association (ADA) and the European Association for the Study of Diabetes (EASD) (Diabetologia, (2018), 61, 12, (2461–2498), 10.1007/s00125-01. Diabetologia. 2019; 221–228. doi: 10.1007/s00125-019-4845-x [DOI] [PubMed] [Google Scholar]
  • 15.World Health Organization. Definition, Diagnosis and Classification of Diabetes Mellitus and its Complications. 1999. Available: https://apps.who.int/iris/bitstream/handle/10665/66040/WHO_NCD_NCS_99.2.pdf?sequence=1&isAllowed=y [Google Scholar]
  • 16.Liew G, Michaelides M, Bunce C. A comparison of the causes of blindness certifications in England and Wales in working age adults (16–64 years), 1999–2000 with 2009–2010. BMJ Open. 2014;4: 4015. doi: 10.1136/bmjopen-2013 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Noto H, Tsujimoto T, Sasazuki T, Noda M. Significantly Increased Risk of Cancer in Patients with Diabetes Mellitus: A Systematic Review and Meta-Analysis. Endocr Pract. 2011;17: 616–628. doi: 10.4158/EP10357.RA [DOI] [PubMed] [Google Scholar]
  • 18.Ohkuma T, Peters SAE, Woodward M. Sex differences in the association between diabetes and cancer: a systematic review and meta-analysis of 121 cohorts including 20 million individuals and one million events. Diabetologia. 2018; 2140–2154. doi: 10.1007/s00125-018-4664-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Cheng G, Huang C, Deng H, Wang H. Diabetes as a risk factor for dementia and mild cognitive impairment: a meta-analysis of longitudinal studies. Intern Med J. 2012;42: 484–491. doi: 10.1111/j.1445-5994.2012.02758.x [DOI] [PubMed] [Google Scholar]
  • 20.Chatterjee S, Peters SAE, Woodward M, Arango SM, Batty GD, Beckett N, et al. Type 2 Diabetes as a Risk Factor for Dementia in Women Compared With Men: A Pooled Analysis of 2.3 Million People Comprising More Than 100,000 Cases of Dementia. Diabetes Care. 2016;39: 300–307. doi: 10.2337/dc15-1588 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Digital NHS. National Diabetes Audit, 2015–16 Report 2a: Complications and Mortality (complications of diabetes). 2016. Available: https://files.digital.nhs.uk/pdf/4/t/national_diabetes_audit__2015-16__report_2a.pdf [Google Scholar]
  • 22.Ali MK, Bullard KM, Saaddine JB, Cowie CC, Imperatore G, Gregg EW. Achievement of Goals in U.S. Diabetes Care, 1999–2010. N Engl J Med. 2013;368: 1613–1624. doi: 10.1056/NEJMsa1213829 [DOI] [PubMed] [Google Scholar]
  • 23.González-Castro TB, Escobar-Chan YM, Fresan A, López-Narváez ML, Tovilla-Zárate CA, Juárez-Rojop IE, et al. Higher risk of depression in individuals with type 2 diabetes and obesity: Results of a meta-analysis. J Health Psychol. 2021;26: 1404–1419. doi: 10.1177/1359105319876326 [DOI] [PubMed] [Google Scholar]
  • 24.Anderson RJ, Freedland KE, Clouse RE, Lustman PJ. The prevalence of comorbid depression in adults with diabetes: A meta-analysis. Diabetes Care. 2001;24: 1069–1078. doi: 10.2337/diacare.24.6.1069 [DOI] [PubMed] [Google Scholar]
  • 25.Egbuonu I, Trief PM, Roe C, Weinstock RS. Glycemic outcomes related to depression in adults with type 1 diabetes: J Health Psychol. 2021;26: 786–794. doi: 10.1177/1359105319845134 [DOI] [PubMed] [Google Scholar]
  • 26.Khunti K, Ceriello A, Cos X, De Block C. Achievement of guideline targets for blood pressure, lipid, and glycaemic control in type 2 diabetes: a meta-analysis. Diabetes Res Clin Pract. 2018;137: 137–148. doi: 10.1016/j.diabres.2017.12.004 [DOI] [PubMed] [Google Scholar]
  • 27.Berikai P, Meyer PM, Kazlauskaite R, Savoy B, Kozik K, Fogelfeld L. Gain in patients’ knowledge of diabetes management targets is associated with better glycemic control. Diabetes Care. 2007;30: 1587–1589. doi: 10.2337/dc06-2026 [DOI] [PubMed] [Google Scholar]
  • 28.Digital NHS. National Diabetes Audit, 2017–18 Care Processes and Treatment Targets short report. 2018. Available: https://files.digital.nhs.uk/E6/369B83/National Diabetes Audit 2017–18 Short Report%2C Care Processes and Treatment Targets.pdf [Google Scholar]
  • 29.Grant RW, Pabon-Nau L, Ross KM, Youatt EJ, Pandiscio JC, Park ER. Diabetes Oral Medication Initiation and Intensification. Diabetes Educ. 2011;37: 78–84. doi: 10.1177/0145721710388427 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.O’Connor PJ, Crabtree BF, Yanoshik MK. Differences between diabetic patients who do and do not respond to a diabetes care intervention: a qualitative analysis. Fam Med. 1997;29: 424–8. Available: http://www.ncbi.nlm.nih.gov/pubmed/9193915 [PubMed] [Google Scholar]
  • 31.Control Diabetes and Complications Trial Research Group. The effect of intensive treatment of diabetes on the development and progression of long-term complications in insulin-dependent diabetes mellitus. N Engl J Med. 1993;329: 977–86. doi: 10.1056/NEJM199309303291401 [DOI] [PubMed] [Google Scholar]
  • 32.UK Prospective Diabetes Study (UKPDS) Group. Intensive blood-glucose control with sulphonylureas or insulin compared with conventional treatment and risk of complications in patients with type 2 diabetes (UKPDS 33). Lancet. 1998;352: 837–853. doi: 10.1016/S0140-6736(98)07019-6 [DOI] [PubMed] [Google Scholar]
  • 33.Turner R. Effect of intensive blood-glucose control with metformin on complications in overweight patients with type 2 diabetes (UKPDS 34). Lancet. 1998;352: 854–865. doi: 10.1016/S0140-6736(98)07037-8 [DOI] [PubMed] [Google Scholar]
  • 34.Ismail-Beigi F, Moghissi E, Tiktin M, Hirsch B, Inzucchi SE, Genuth S. Individualizing glycemic targets in type 2 diabetes mellitus: Implications of recent clinical trials. Ann Intern Med. 2011;154: 554–559. doi: 10.7326/0003-4819-154-8-201104190-00007 [DOI] [PubMed] [Google Scholar]
  • 35.Chan A-W, Tetzlaff JM, Altman DG, Laupacis A, Gøtzsche PC, Krleža-Jerić K, et al. SPIRIT 2013 Statement: Defining Standard Protocol Items for Clinical Trials. Ann Intern Med. 2013;158: 200. doi: 10.7326/0003-4819-158-3-201302050-00583 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Gold AE, Macleod KM, Frier BM. Frequency of severe hypoglycemia in patients with type I diabetes with impaired awareness of hypoglycemia. Diabetes Care. 1994;17: 697–703. doi: 10.2337/diacare.17.7.697 [DOI] [PubMed] [Google Scholar]
  • 37.Hoffmann TC, Glasziou PP, Boutron I, Milne R, Perera R, Moher D, et al. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ. 2014;348: g1687. doi: 10.1136/bmj.g1687 [DOI] [PubMed] [Google Scholar]
  • 38.Altman DG, Bland JM. How to randomise. British Medical Journal. 1999. pp. 703–704. doi: 10.1136/bmj.319.7211.703 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Suresh KP. An overview of randomization techniques: An unbiased assessment of outcome in clinical research. J Hum Reprod Sci. 2011;4: 8–11. doi: 10.4103/0974-1208.82352 [DOI] [PMC free article] [PubMed] [Google Scholar] [Retracted]
  • 40.Sealed Envelope Ltd. Simple randomisation service. 2020. [cited 14 Sep 2020]. Available: https://www.sealedenvelope.com/simple-randomiser/v1/ [Google Scholar]
  • 41.Arain M, Campbell MJ, Cooper CL, Lancaster GA. What is a pilot or feasibility study? A review of current practice and editorial policy. BMC Med Res Methodol. 2010;10: 67. doi: 10.1186/1471-2288-10-67 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Julious SA. Sample size of 12 per group rule of thumb for a pilot study. Pharm Stat. 2005;4: 287–291. doi: 10.1002/pst.185 [DOI] [Google Scholar]
  • 43.Sim J, Lewis M. The size of a pilot study for a clinical trial should be calculated in relation to considerations of precision and efficiency. J Clin Epidemiol. 2012;65: 301–308. doi: 10.1016/j.jclinepi.2011.07.011 [DOI] [PubMed] [Google Scholar]
  • 44.DAFNE Study Group. Training in flexible, intensive insulin management to enable dietary freedom in people with type 1 diabetes: dose adjustment for normal eating (DAFNE) randomised controlled trial. BMJ. 2002;325: 746–746. doi: 10.1136/bmj.325.7367.746 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Davies MJ, Heller S, Skinner TC, Campbell MJ, Carey ME, Cradock S, et al. Effectiveness of the diabetes education and self management for ongoing and newly diagnosed (DESMOND) programme for people with newly diagnosed type 2 diabetes: cluster randomised controlled trial. BMJ. 2008;336: 491–495. doi: 10.1136/bmj.39474.922025.BE [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Dettori J. Loss to follow-up. Evid Based Spine Care J. 2011;2: 7–10. doi: 10.1055/s-0030-1267080 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Malterud K, Siersma VD, Guassora AD. Sample Size in Qualitative Interview Studies: Guided by Information Power. Qual Health Res. 2016;26: 1753–1760. doi: 10.1177/1049732315617444 [DOI] [PubMed] [Google Scholar]
  • 48.Herdman M, Gudex C, Lloyd A, Janssen MF, Kind P, Parkin D, et al. Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L). Qual Life Res. 2011;20: 1727–1736. doi: 10.1007/s11136-011-9903-x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Abedini MR, Bijari B, Miri Z, Shakhs Emampour F, Abbasi A. The quality of life of the patients with diabetes type 2 using EQ-5D-5 L in Birjand. Health Qual Life Outcomes. 2020;18: 1–9. doi: 10.1186/s12955-020-1277-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Parik P, Patel V. Health-related quality of life of patients with type 2 diabetes mellitus at a tertiary care hospital in India using EQ 5D 5L. Indian J Endocrinol Metab. 2019;23: 407–411. doi: 10.4103/ijem.IJEM_29_19 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Polonsky WH, Anderson BJ, Lohrer PA, Welch G, Jacobson AM, Aponte JE, et al. Assessment of diabetes-related distress. Diabetes Care. 1995;18: 754–760. doi: 10.2337/diacare.18.6.754 [DOI] [PubMed] [Google Scholar]
  • 52.Welch G, Weinger K, Anderson B, Polonsky WH. Responsiveness of the Problem Areas In Diabetes (PAID) questionnaire. Diabet Med. 2003;20: 69–72. doi: 10.1046/j.1464-5491.2003.00832.x [DOI] [PubMed] [Google Scholar]
  • 53.Toobert DJ, Hampson SE, Glasgow RE. The summary of diabetes self-care activities measure: results from 7 studies and a revised scale. Diabetes Care. 2000;23: 943–950. doi: 10.2337/diacare.23.7.943 [DOI] [PubMed] [Google Scholar]
  • 54.Weinger K, Butler HA, Welch GW, Greca AM La. Measuring Diabetes Self-Care: A psychometric analysis of the Self-Care Inventory-revised with adults. Diabetes Care. 2005;28: 1346. doi: 10.2337/DIACARE.28.6.1346 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Plowright R, Witthaus E, Bradley C. Evaluating the 12-item Well-being Questionnaire for use in multinational trials. Qual Life Res. 1999;8: 650. [Google Scholar]
  • 56.Mitchell J, Bradley C. Psychometric evaluation of the 12-item Well-being Questionnaire for use with people with macular disease. Qual Life Res. 2001;10: 465–473. doi: 10.1023/a:1012540100613 [DOI] [PubMed] [Google Scholar]
  • 57.Anderson RM, Funnell MM, Fitzgerald JT, Marrero DG. The Diabetes Empowerment Scale: a measure of psychosocial self-efficacy. Diabetes Care. 2000;23: 739–743. doi: 10.2337/diacare.23.6.739 [DOI] [PubMed] [Google Scholar]
  • 58.Corp IBM. IBM SPSS Statistics for Windows. Armonk, N.Y., USA; 2017. [Google Scholar]
  • 59.Gale NK, Heath G, Cameron E, Rashid S, Redwood S. Using the framework method for the analysis of qualitative data in multi-disciplinary health research. BMC Med Res Methodol. 2013;13: 117. doi: 10.1186/1471-2288-13-117 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 60.QSR International Pty Ltd. NVivo. 2018. Available: https://www.qsrinternational.com/nvivo-qualitative-data-analysis-software/home [Google Scholar]

Decision Letter 0

Jianhong Zhou

1 May 2022

PONE-D-21-33122Psychometric and biomedical outcomes of glycated haemoglobin target-setting in adults with type 1 and type 2 diabetes: Protocol for a mixed-methods parallel-group randomised feasibility studyPLOS ONE

Dear Dr. Westall,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Jun 13 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Jianhong Zhou

Staff Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at 

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. We note that the grant information you provided in the ‘Funding Information’ and ‘Financial Disclosure’ sections do not match. 

When you resubmit, please ensure that you provide the correct grant numbers for the awards you received for your study in the ‘Funding Information’ section.

3. Thank you for stating the following in the Acknowledgments Section of your manuscript: "The authors thank Mrs Jeanette Anders for assistance with ethical approval and sponsorship of the research, Dr Niall Furlong for advice and support and Dr Sumudu Bujawansa for pastoral support."

We note that you have provided funding information that is not currently declared in your Funding Statement. However, funding information should not appear in the Acknowledgments section or other areas of your manuscript. We will only publish funding information present in the Funding Statement section of the online submission form. 

Please remove any funding-related text from the manuscript and let us know how you would like to update your Funding Statement. Currently, your Funding Statement reads as follows: "The corresponding author (S.J.W.) is a PhD student funded by the Department of Diabetes and Endocrinology, St Helens and Knowsley Teaching Hospitals NHS Trust (STHK). The study is sponsored by STHK (sponsorship reference STHK-2021-003). STHK are not involved in the study design, the preparation of this paper or the decision to submit the paper for publication. The funding body will not be involved in data collection, analysis or interpretation. St Helens and Knowsley Teaching Hospitals NHS Trust (STHK): https://www.sthk.nhs.uk"

Please include your amended statements within your cover letter; we will change the online submission form on your behalf.

4. In your Data Availability statement, you have not specified where the minimal data set underlying the results described in your manuscript can be found. PLOS defines a study's minimal data set as the underlying data used to reach the conclusions drawn in the manuscript and any additional data required to replicate the reported study findings in their entirety. All PLOS journals require that the minimal data set be made fully available. For more information about our data policy, please see http://journals.plos.org/plosone/s/data-availability.

Upon re-submitting your revised manuscript, please upload your study’s minimal underlying data set as either Supporting Information files or to a stable, public repository and include the relevant URLs, DOIs, or accession numbers within your revised cover letter. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories. Any potentially identifying patient information must be fully anonymized.

Important: If there are ethical or legal restrictions to sharing your data publicly, please explain these restrictions in detail. Please see our guidelines for more information on what we consider unacceptable restrictions to publicly sharing data: http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. Note that it is not acceptable for the authors to be the sole named individuals responsible for ensuring data access.

We will update your Data Availability statement to reflect the information you provide in your cover letter.

5. Please note that in order to use the direct billing option the corresponding author must be affiliated with the chosen institute. Please either amend your manuscript to change the affiliation or corresponding author, or email us at plosone@plos.org with a request to remove this option.

6. Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Does the manuscript provide a valid rationale for the proposed study, with clearly identified and justified research questions?

The research question outlined is expected to address a valid academic problem or topic and contribute to the base of knowledge in the field.

Reviewer #1: Yes

**********

2. Is the protocol technically sound and planned in a manner that will lead to a meaningful outcome and allow testing the stated hypotheses?

The manuscript should describe the methods in sufficient detail to prevent undisclosed flexibility in the experimental procedure or analysis pipeline, including sufficient outcome-neutral conditions (e.g. necessary controls, absence of floor or ceiling effects) to test the proposed hypotheses and a statistical power analysis where applicable. As there may be aspects of the methodology and analysis which can only be refined once the work is undertaken, authors should outline potential assumptions and explicitly describe what aspects of the proposed analyses, if any, are exploratory.

Reviewer #1: Yes

**********

3. Is the methodology feasible and described in sufficient detail to allow the work to be replicable?

Descriptions of methods and materials in the protocol should be reported in sufficient detail for another researcher to reproduce all experiments and analyses. The protocol should describe the appropriate controls, sample size calculations, and replication needed to ensure that the data are robust and reproducible.

Reviewer #1: Yes

**********

4. Have the authors described where all data underlying the findings will be made available when the study is complete?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception, at the time of publication. The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above and, if applicable, provide comments about issues authors must address before this protocol can be accepted for publication. You may also include additional comments for the author, including concerns about research or publication ethics.

You may also provide optional suggestions and comments to authors that they might find helpful in planning their study.

(Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: This protocol paper was a pleasure to read and is exploring a very important yet under researched topic of how clinician-initiated HbA1c testing and setting A1c targets affects the wellbeing and self-care of people living with diabetes. The manuscript was easy to read and the introduction had a strong rationale leading to a good description of the methods and analyses. The mixed-methods design is appropriate. My only concern was the statistical analysis section. As this is a feasibility study and underpowered the authors should not be conducting any statistical tests (e.g. t-tests) looking for differences from baseline to post-intervention but rather simply reporting means and SDs. Also the qualitative analysis section was very brief.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2022 Oct 27;17(10):e0275980. doi: 10.1371/journal.pone.0275980.r002

Author response to Decision Letter 0


14 May 2022

Reviewer comments and author responses:

Reviewer #1: This protocol paper was a pleasure to read and is exploring a very important yet under researched topic of how clinician-initiated HbA1c testing and setting A1c targets affects the wellbeing and self-care of people living with diabetes. The manuscript was easy to read and the introduction had a strong rationale leading to a good description of the methods and analyses. The mixed-methods design is appropriate. My only concern was the statistical analysis section. As this is a feasibility study and underpowered the authors should not be conducting any statistical tests (e.g. t-tests) looking for differences from baseline to post-intervention but rather simply reporting means and SDs. Also the qualitative analysis section was very brief.

Author response:

Thank you. We agree with the reviewer’s comments regarding statistical analysis and have adjusted the manuscript accordingly. We have also expanded the qualitative analysis section with additional detail. (Pages 15 and 16, lines 328–354)

Kind Regards,

Sam Westall (corresponding author)

Attachment

Submitted filename: Response to reviewers.docx

Decision Letter 1

Jamie Royle

25 Jul 2022

PONE-D-21-33122R1Psychometric and biomedical outcomes of glycated haemoglobin target-setting in adults with type 1 and type 2 diabetes: Protocol for a mixed-methods parallel-group randomised feasibility studyPLOS ONE

Dear Dr. Westall,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Aug 29 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Jamie Royle

Staff Editor

PLOS ONE

Journal Requirements:

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Does the manuscript provide a valid rationale for the proposed study, with clearly identified and justified research questions?

The research question outlined is expected to address a valid academic problem or topic and contribute to the base of knowledge in the field.

Reviewer #2: Yes

**********

2. Is the protocol technically sound and planned in a manner that will lead to a meaningful outcome and allow testing the stated hypotheses?

The manuscript should describe the methods in sufficient detail to prevent undisclosed flexibility in the experimental procedure or analysis pipeline, including sufficient outcome-neutral conditions (e.g. necessary controls, absence of floor or ceiling effects) to test the proposed hypotheses and a statistical power analysis where applicable. As there may be aspects of the methodology and analysis which can only be refined once the work is undertaken, authors should outline potential assumptions and explicitly describe what aspects of the proposed analyses, if any, are exploratory.

Reviewer #2: Yes

**********

3. Is the methodology feasible and described in sufficient detail to allow the work to be replicable?

Descriptions of methods and materials in the protocol should be reported in sufficient detail for another researcher to reproduce all experiments and analyses. The protocol should describe the appropriate controls, sample size calculations, and replication needed to ensure that the data are robust and reproducible.

Reviewer #2: Yes

**********

4. Have the authors described where all data underlying the findings will be made available when the study is complete?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception, at the time of publication. The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above and, if applicable, provide comments about issues authors must address before this protocol can be accepted for publication. You may also include additional comments for the author, including concerns about research or publication ethics.

You may also provide optional suggestions and comments to authors that they might find helpful in planning their study.

(Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #2: I will focus on methods and reporting, as the statistical reviewer. Methods and approach to the sample are appropriate. I only have a couple of minor points to raise.

1) eligibility criteria. There are numerous ongoing interventions and the participants need to be at least asked about such participation so that can be included in the analyses (rather than as an additional exclusion criterion).

2) In the UK, under the Quality and outcomes framework, HbA1c targets are incentivised at the practice level. Does that run a risk of contaminating the trial in any way? Treatment information will be collected the authors say, but needs to be collected very well and possibly not be self-reported. Detailed information is needed in this space.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #2: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2022 Oct 27;17(10):e0275980. doi: 10.1371/journal.pone.0275980.r004

Author response to Decision Letter 1


19 Aug 2022

14th August 2022

Re: PLOS ONE Decision: Revision required [PONE-D-21-33122] - [EMID:c1e2bb034c361eaf]

Dear Editor and Reviewers,

On behalf of my co-authors, I would like to thank you for reviewing our article entitled “Psychometric and biomedical outcomes of glycated haemoglobin target-setting in adults with type 1 and type 2 diabetes: Protocol for a mixed-methods parallel-group randomised feasibility study” with opportunity to revise and resubmit.

We found the reviewer’s comments helpful in revising the manuscript and have carefully considered their suggestions. We revised the manuscript in accordance with the reviewer’s comments.

Below, we have outlined each of the reviewer comments followed by our responses, prefaced “Author response”. Corresponding changes are highlighted in the tracked manuscript text file in red using the ‘track changes’ function.

Yours Sincerely,

Review comments and author responses

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Does the manuscript provide a valid rationale for the proposed study, with clearly identified and justified research questions?

The research question outlined is expected to address a valid academic problem or topic and contribute to the base of knowledge in the field.

Reviewer #2: Yes

________________________________________

2. Is the protocol technically sound and planned in a manner that will lead to a meaningful outcome and allow testing the stated hypotheses?

The manuscript should describe the methods in sufficient detail to prevent undisclosed flexibility in the experimental procedure or analysis pipeline, including sufficient outcome-neutral conditions (e.g. necessary controls, absence of floor or ceiling effects) to test the proposed hypotheses and a statistical power analysis where applicable. As there may be aspects of the methodology and analysis which can only be refined once the work is undertaken, authors should outline potential assumptions and explicitly describe what aspects of the proposed analyses, if any, are exploratory.

Reviewer #2: Yes

________________________________________

3. Is the methodology feasible and described in sufficient detail to allow the work to be replicable?

Descriptions of methods and materials in the protocol should be reported in sufficient detail for another researcher to reproduce all experiments and analyses. The protocol should describe the appropriate controls, sample size calculations, and replication needed to ensure that the data are robust and reproducible.

Reviewer #2: Yes

________________________________________

4. Have the authors described where all data underlying the findings will be made available when the study is complete?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception, at the time of publication. The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #2: Yes

________________________________________

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #2: Yes

________________________________________

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above and, if applicable, provide comments about issues authors must address before this protocol can be accepted for publication. You may also include additional comments for the author, including concerns about research or publication ethics.

You may also provide optional suggestions and comments to authors that they might find helpful in planning their study.

(Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #2: I will focus on methods and reporting, as the statistical reviewer. Methods and approach to the sample are appropriate. I only have a couple of minor points to raise.

1) eligibility criteria. There are numerous ongoing interventions and the participants need to be at least asked about such participation so that can be included in the analyses (rather than as an additional exclusion criterion).

2) In the UK, under the Quality and outcomes framework, HbA1c targets are incentivised at the practice level. Does that run a risk of contaminating the trial in any way? Treatment information will be collected the authors say, but needs to be collected very well and possibly not be self-reported. Detailed information is needed in this space.

Author response:

6 – 1) Thank you for your comments.

We have added a sentence under the eligibility sub-heading to clarify that eligible individuals will be invited to take part and that, where declined, reasons for decline will be recorded (lines 148, 180, 183).

6 – 2) HbA1c target incentivisation was considered as a potential confounder in this trial, however with recruitment occurring from a secondary care diabetes clinic, primary care target incentivisation during the study period is not anticipated to influence study results. Certainly, if recruitment was also being undertaken from primary care, we would need to account for this. We have updated the manuscript for clarification (line 160).

The authors agree that the collection of treatment information must be thorough and accurate. These data will be obtained from medical records rather than relying on self-reported data. We have updated the manuscript to clarify this (line 242).

________________________________________

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #2: No

________________________________________

------END OF RESPONSE------

Attachment

Submitted filename: Response to reviewers.docx

Decision Letter 2

Walid Kamal Abdelbasset

27 Sep 2022

Psychometric and biomedical outcomes of glycated haemoglobin target-setting in adults with type 1 and type 2 diabetes: Protocol for a mixed-methods parallel-group randomised feasibility study

PONE-D-21-33122R2

Dear Dr. Westall,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Walid Kamal Abdelbasset, Ph.D.

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Does the manuscript provide a valid rationale for the proposed study, with clearly identified and justified research questions?

The research question outlined is expected to address a valid academic problem or topic and contribute to the base of knowledge in the field.

Reviewer #2: Yes

Reviewer #3: Yes

**********

2. Is the protocol technically sound and planned in a manner that will lead to a meaningful outcome and allow testing the stated hypotheses?

The manuscript should describe the methods in sufficient detail to prevent undisclosed flexibility in the experimental procedure or analysis pipeline, including sufficient outcome-neutral conditions (e.g. necessary controls, absence of floor or ceiling effects) to test the proposed hypotheses and a statistical power analysis where applicable. As there may be aspects of the methodology and analysis which can only be refined once the work is undertaken, authors should outline potential assumptions and explicitly describe what aspects of the proposed analyses, if any, are exploratory.

Reviewer #2: Yes

Reviewer #3: Yes

**********

3. Is the methodology feasible and described in sufficient detail to allow the work to be replicable?

Descriptions of methods and materials in the protocol should be reported in sufficient detail for another researcher to reproduce all experiments and analyses. The protocol should describe the appropriate controls, sample size calculations, and replication needed to ensure that the data are robust and reproducible.

Reviewer #2: Yes

Reviewer #3: Yes

**********

4. Have the authors described where all data underlying the findings will be made available when the study is complete?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception, at the time of publication. The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #2: Yes

Reviewer #3: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #2: Yes

Reviewer #3: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above and, if applicable, provide comments about issues authors must address before this protocol can be accepted for publication. You may also include additional comments for the author, including concerns about research or publication ethics.

You may also provide optional suggestions and comments to authors that they might find helpful in planning their study.

(Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #2: I am satisfied with the authors' responses and I do not have anything else to add.........................

Reviewer #3: Accoing to the previous review and from my point of view the authors had adressed all the required modifications

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #2: No

Reviewer #3: No

**********

Acceptance letter

Walid Kamal Abdelbasset

20 Oct 2022

PONE-D-21-33122R2

Psychometric and biomedical outcomes of glycated haemoglobin target-setting in adults with type 1 and type 2 diabetes: Protocol for a mixed-methods parallel-group randomised feasibility study

Dear Dr. Westall:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Walid Kamal Abdelbasset

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Table. SPIRIT (2013) checklist of standard protocol items.

    (DOCX)

    S1 File. Description of the handling of biological specimens.

    (DOCX)

    S2 File. HRA approved protocol version 2.0.5.

    (PDF)

    Attachment

    Submitted filename: Response to reviewers.docx

    Attachment

    Submitted filename: Response to reviewers.docx

    Data Availability Statement

    No datasets were generated or analysed during the current study. All relevant data from this study will be made available upon study completion. All relevant data from this study will be made available on study completion. Anonymised data will be deposited in the Edge Hill University online research data repository, https://figshare.edgehill.ac.uk.


    Articles from PLOS ONE are provided here courtesy of PLOS

    RESOURCES