Skip to main content
Eye logoLink to Eye
. 2022 May 6;37(6):1155–1159. doi: 10.1038/s41433-022-02050-1

Patients views on a new surveillance pathway involving allied non-medical staff for people with treated diabetic macular oedema and proliferative diabetic retinopathy

Lindsay Prior 1, Noemi Lois 2,3,; on behalf of the EMERALD Study Group
PMCID: PMC10102164  PMID: 35523861

Abstract

Background/Objective

To explore acceptability by patients and health care professionals of a new surveillance pathway for people with previously treated and stable diabetic macular oedema (DMO) and/or proliferative diabetic retinopathy (PDR).

Subject/Methods

Structured discussions in 10 focus groups with patients; two with ophthalmic photographers/graders, and one with ophthalmologists, held across the UK as part of a large diagnostic accuracy study (EMERALD).

Results

The most prominent issues raised by patients concerned (i) expertise of the various professionals within clinic, (ii) quality of interactions with clinic professionals, especially the flow of information from professionals to patients, and (iii) wish to be treated holistically. Ophthalmologists suggested such issues could be best dealt with via a programme of patient education and tended to overlook deeper implications of patient concerns for the organisation of services.

Conclusion

For patients, the clinical service should not only include the identification and treatment of disease but also exchange of information, reassurance, and mitigation of anxiety. Alterations in the standard care pathway need to take account of such concerns and their implications, in addition to any assessments of ‘efficiency’ that may flow from changes in diagnostic technology, or the division of professional labour.

Subject terms: Health care, Retinal diseases

Introduction

Ophthalmology is often the busiest outpatient speciality in Hospitals, accounting for 8% of all outpatient activity [1]. Considering the high number of people with diabetes (in the United Kingdom over 4 million, which equates to a 6% of the population) [2] and given the increasing prevalence of diabetes, diabetic retinopathy (DR) and its sight threatening complications, diabetic macular oedema (DMO) and proliferative diabetic retinopathy (PDR), ophthalmology is likely to experience a rise in the number of outpatient visits related to this disease. Problems are accentuated further by the requirement for patients with DMO and/or PDR to return to clinics at short intervals to receive treatment until their condition has been controlled and, thereafter, for life. Discrepancies between capacity and demand exist, and it is known that delayed appointments may lead to poorer visual outcomes for patients [3].

One response to a growing demand for scarce medical resources is to re-organise services. With this in mind, Effectiveness of Multimodal imaging for the Evaluation of Retinal oedema And new vesseLs in Diabetic retinopathy (EMERALD) sought to determine whether patients with DMO and/or PDR previously successfully treated (i.e. DMO cleared and PDR became quiescent) could be followed by multimodal retinal imaging and review of these images by trained ophthalmic graders [4]. EMERALD demonstrated the new ophthalmic grader pathway had adequate sensitivity to detect active disease (DMO and PDR), albeit with lower specificity [5]. This new form of surveillance would be well suited to a re-design of ophthalmic services including provision of ophthalmic grader-led “live” and “virtual” clinics. In “live clinics” images are obtained, evaluated, and results communicated to patients all on the same day. In “virtual clinics” evaluation of images does not occur on the same day; results are subsequently communicated to patients remotely (e.g. by post). Virtual clinics are increasingly used in ophthalmology; to date, these are predominantly undertaken by ophthalmologists [611]. There is none or scarce information on the acceptability of grader’s-led and virtual clinics, respectively, to patients and health professionals [10, 12]. EMERALD explored this.

Methods

To determine the acceptability of the new ophthalmic grader pathway to patients and health care professionals, focus groups (FGs) were organised in 5 of the 13 sites in the United Kingdom participating in EMERALD. Patients eligible and willing to participate in EMERALD were invited to attend FG discussions; informed consent was obtained for all participants. A total of 36 patients with either DMO, and/or PDR, took part in FG discussions.

Activities within the FGs were designed to follow a common format; proceedings were sufficiently flexible to allow participants to talk about key issues in their own terms, and to add their own concerns to those of the moderator [13]. The first stage of the meetings gathered material on patient views about various features of a standard clinic: waiting time in clinic, interactions with nurses during visual acuity testing; interactions with photographers, and time with the ophthalmologist. The prompts used for such discussions were a series of still photographs that reflected each phase of the standard care pathway (e.g. photograph of a patient undergoing a slit-lamp biomicroscopic examination by an ophthalmologist).

The second stage of the group discussions gathered reactions to the provision of a virtual clinic. Such provision was explored via the use of three fictional scenarios or vignettes [14, 15]. Vignettes offered brief stories of imaginary patients who attended a clinic in which images of the retina were taken, were told that they would be informed of the results of their visit (by letter) on another day, and that no meeting with the ophthalmologist would take place ‘today’. The words ‘virtual clinic’ were not used by either moderator or participants. During discussions, participants voiced a series of issues unanticipated or outside the planned script (one of the benefits of using FGs). Unanticipated topics included the potential use of artificial intelligence for diagnosing eye conditions, the need for a holistic approach to the treatment and management of diabetes, and concerns about anxiety. Views and opinions relating to matters of trust and confidence (in health professionals) and expertise of clinic personnel were threaded throughout the discussions.

Following the patient FGs, three further meetings were conducted; two with ophthalmic photographers and graders from four of the 13 study sites (n = 7 individuals) and one FG with ophthalmologists (n = 6) from 6 participating sites. The ‘focus’ for these three meetings was on views and opinions about care pathways derived from the patient group discussions.

Transcribed data were explored using different forms of content analysis [16, 17]. One strategy is outlined in Fig. 1. Another strategy involved simple counts of topics brought forward by FG participants. Thirty-eight such topics were identified, including those planned by the moderator (the average for the groups as a whole was 15 per meeting). The plot in Fig. 2 shows the number of ‘new’ or additional topics that arose with each meeting. The levelling-off of the accumulation curve is suggestive of a pending data saturation point [1820]. The curve reflects a characteristic pattern of data collection in qualitative studies, and its shape suggests that, despite the relatively small number of participants, recruitment of further groups and participants would most likely have yielded only few additional issues.

Fig. 1. Issues discussed in focus group (FG) Discussion 5.

Fig. 1

The web was constructed using textual codes and numerical counts. Initially, each ‘turn’ (or phase of talk) in the FG transcript was linked to an identifiable speaker. Following that, the content of the turn was allocated to a node label or code (sometimes a number of codes). Node labels used included ‘my diabetes’, ‘injections’, ‘eye test’, ‘virtual clinic’, ‘the doctor’, ‘nurse’, ‘photographer’, and so forth. A simple count of the number of times that a specific speaker could be linked to a code, and the number of times that one code was associated with another in the same turn, was subsequently used as the basis for the construction of a 20 × 20 square matrix. The matrix was then integrated into social network software (using Pajek [23]) to generate a graphical representation of the discussion. Within the graph, node size reflects the number of turns that an individual speaker took during the meeting, or the number of times that an issue was referred to. The thickness of the links between nodes (the arcs) reflects the number of times that any one code was associated with another in the responses of participants. Because the diagram was generated using a Fruchterman–Reingold projection, distances between nodes are suggestive of the closeness (or otherwise) of the links between them (unfortunately, overlapping P2–P4 nodes, had to be separated manually to enhance clarity). Given large variations in the node and arc size, the counts were scaled using a square root transformation. ANX anxiety, AI artificial intelligence for detecting change in retina, DIABETES My diabetes, DRIVE Car Driving, THE DOC Consultant; FEEDBAK Information and results for ‘me’, FOTOG Photographer, INJECT Injections, LAMPEX Slit-lamp exam with doctor, OPTOS Optos imager, VIRT CLINIC Virtual Consultation, WAIT Waiting during routine visits. Participants are labelled ‘Pn.’.

Fig. 2.

Fig. 2

Accumulation of ‘issues’ in 10 consecutive focus groups.

Ethical approval for this study was obtained (17/NI/0124) and the study was conducted following the ethical principles of the Declaration of Helsinki. EMERALD was funded by the Health Technology Assessment of the National Institute for Health Research (HTA-NIHR 15/42/08).

Results

The patient point-of-view

Topics of concern emerged in different strengths both within and across FG meetings. Using content analysis and coding Fig. 1 offers a representation of the proceedings in just one FG; it takes the form of an issue web, and it is offered as a summary of conversational proceedings. It shows, for example, that some speakers took more turns than others (P5—smaller red box—spoke least; P1—larger yellow box—the most). It also shows that the major concern of these participants was the ‘feedback’ (large pink box toward the centre of the diagram), i.e. getting information on their eye condition— usually at the time of a clinic visit. It shows participants introduced topics that were not included in the moderator’s script. Examples include references to ‘my diabetes’, driving, and the primary care (general practitioner) service. More importantly, it demonstrates differences in attitude to the acceptance of a virtual consultation (dotted lines between nodes signal negative associations), and the use of fundus imaging equipment (specifically an OptosTM imaging instrument). Thus, participants 2–4 openly disliked the idea of a virtual, or even a grader-led clinic. Finally, we can see that participants frequently cross-reference issues (line thickness indicates a strength of association between one topic and another); indeed, they rarely talked in terms of single issues or themes. For the sake of clarity, however, the presentation of findings that follows is focussed on views relating to the provision of a patient-care pathway in which a consultation with a medical professional is absent. Such views are best summed up via an analysis of three topics, namely (a) the distribution of expertise within the clinic; (b) interaction with clinic professionals and flow of information from professionals to patients; and (c) The needs of people with diabetes. Reactions of clinic professionals to those issues are also presented.

The distribution of expertise

In the FG meetings issues of expertise, skill, and knowledge were prominent. Participants valued expertise, and in the perceived hierarchy of expertise it was the ophthalmologist that was seen as what one participant in FG6 called, ‘the main one’.

According to FG participants, meeting the ophthalmologist during a clinic visit was above all, ‘reassuring’. Thus, one of the male FG3 participants claimed that reassurance flowed from the fact that “there’s questions that you ask that probably only [the ophthalmologist] could answer”. (A view independently supported by one of the ophthalmic graders at their FG discussion.) Whilst a female participant (FG2) stated that meeting the ophthalmologist offered “a great reassurance … you know you’re going to be looked at”.

Participants recognised other clinic personnel had skills, but such skills had to be underpinned by the expertise of the clinician to carry any weight. Thus, a member of FG4 recognised the photographer (referred to as the “guy on the machine”) was, “skilled at what he does”, but added that his work was always checked by the ophthalmologist. When the issue of skill was raised in FG6, one of the respondents agreed that clinic professionals were “very” skilled, but the skill was “in handling people”. Later in the same group the moderator asked, “Would you imagine the photographer would have diagnostic skills?” The answer was brief, but clear. “No, no”. In FG8 participants suggested they would be happy to get ‘results’ of investigations from the photographer only as long as it was confirmed by the ophthalmologist. Thus, one female speaking of scan results stated, “I would just like it confirmed. If [the photographer] want to tell us, that’s fine, but as long as [the ophthalmologist] has seen everything.” When faced with the same question a member of FG3 stated; “There’s things that can’t be picked up in the photographs but which would be picked up if every patient actually saw the ophthalmologist”. Whilst another member of FG3 suggested that even if the photographer can detect something awry, “well that’s all they’re doing, they’re just seeing the difference, they don’t know why”. A member of FG5 argued that images alone were never sufficient to detect change in the retina and that, “for peace of mind of the patient, they should be seen by the ophthalmologist and get the slit lamp and all the rest of it”. A member of FG10 even pointed to the existence of tacit knowledge in the detection of fundus damage when he stated that by using slit-lamp biomicroscopy the ophthalmologist was likely to see, “Something that the scan hasn’t caught”.

It is clear, then, that patients participating in the FGs recognised a variety of expertise within the clinic combined with an unequal distribution of skill and knowledge among professionals. Nursing staff and photographers were respected for what they did, and the way they did it, but, in the view of patients, they were not sufficiently trained to diagnose or deal with the problems patients faced. Put simply, they were “not as good as the ophthalmologist” (Female, FG 8).

Interaction with clinic professionals and the flow of information

Issues about information exchange and face-to-face interactions with clinic professionals overlapped with issues about skill and expertise. During FG proceedings, the moderator asked patients whether they talked to the nurse and/or the photographer. As far as nursing staff were concerned, the response of one of the men in FG10 sums up the general position: “There’s no clinical discussion, as such. It’s just ‘how you are today? Left eye, right eye, do you have your glasses with you?” Participants in most of the FGs reported that verbal interactions with the nursing staff were just ‘chat’—e.g. “just about the weather” (FG8).

Nurse–patient interactions were reported as being brief, business-like, and involving a minimal amount of information exchange. Some participants even spoke of a refusal or inability on behalf of nurses to give patients any information. ‘John’ (FG9) stated, “if I ask a question, the nurse will say to me… She’ll say to me, ‘right, I’m unable to answer that question, John, but you’ll be seeing the doctor and he will put you right’”.

Similar patterns of interaction were reported in relation to the meeting with photographers, though with the latter there were some additional complications; namely that patients had little idea about the skills, credentials, or occupational status of the individuals who scanned their eyes. Thus, when the moderator asked members of FG6 whether they ever discussed their condition with the photographers one participant asked, “What photographers do we meet?” On further clarification (from another participant) she then referred to “The lady who runs the scan machine”. Getting information from the photographer was regarded as insufficient, for he or she is after all, “Just the photographer” (FG2).

For patients, asking questions and getting informed answers (‘there and then’) constituted the high point of a routine clinic visit. Indeed, the capacity for getting ‘feedback’, and obtaining ‘information’ was regarded as a central function of patient–doctor interaction, as shown Fig. 1. It was the potential loss of this capacity in any service re-organization that primarily concerned patients. Not getting information—on the day of a clinic visit—offers the worst of all possible worlds; a world set up to generate anxiety and worry. As a member of FG6 stated, “I think that’s the problem, it’s waiting for [the results of a scan]… Like the sword of Damocles hanging over me”. Indeed, leaving the clinic with “an answer”, “that’s the most important thing” (Male, FG9).

Treating people with diseases

Whenever they reflected on the nature of their eye condition patients frequently referred to ‘worry’, ‘anxiety’, and need for ‘reassurance’. For the participants in FG2, for example, worry, anxiety, fear, nervousness, and the overwhelming need to be reassured about the status of their condition dominated the FG discussion. Even short delays in getting a clinic appointment could be critical. “You’re sitting at home [waiting], and you are terrified you are losing your sight” (Female FG2). Commenting on his clinic’s appointment system, a member of FG3 stated, “I would say that we all worry about our sight being lost”. Whilst in reaction to the first of the virtual clinic vignettes (and the suggestion that the result of eye scans be sent by post) a member of FG8 stated “you’re worrying, you’re anxious. And the thing is, with diabetes, being anxious and stressed doesn’t do it any good”. Commenting on the same vignette a woman in FG6 stated, “That means [the patient’s] got an undefined period of time of worry, probably acute worry”. A second participant in FG10 was quite clear about the wider implications of adopting virtual clinics; “On a practical level, I don’t see a problem with it. On an ideological level, as good practice, it’s not good”.

The aforementioned reference to diabetes serves to underline another important characteristic of this patient group—that diabetes is central to their everyday identity. Diabetes seemingly dominated daily routine and was not a separate feature from the eye conditions. Consequently, many participants argued that “Holistically is the only way to deal with diabetes. If you miss one part of it then, it’ll kill you, that’s the bit that will get you. It’s a killer disease” (Male FG10). Whilst a member of FG4 compared his treatment in two different clinics; suggesting one was clearly preferable to the other in its approach to his health because it adopted what he called a ‘holistic’ approach.

It was for such reasons that provision of a virtual clinical service was variously described as ‘a backward step’, ‘retrograde’, leaving patients ‘isolated’ and ‘cast adrift’, without an opportunity to ‘have a talk [with the ophthalmologist], and get any problems in…’

Viewpoints of clinic professionals

For photographers, graders, and ophthalmologists the provision of virtual clinics was viewed, for the most part, as a means of organising scarce resources to meet growing demand. In that frame, reservations voiced by patients were ones that supposedly needed to be corrected through ‘patient education’; pointing out, for example, that most patients are ‘low risk’ and have no routine need to see an ophthalmologist. Some ophthalmologists suggested patients were merely ‘resistant’ to change and would soon ‘get used’ to a virtual service. Others proposed various ad hoc responses to the issues of anxiety and worry (e.g. providing patients with their office phone number). Graders and photographers also held to such views, but also expressed reluctance to get involved with detailed discussion with patients about their eye conditions. Providing factual information might be acceptable, but discussing implications (e.g. for treatment) was not.

Discussion

EMERALD explored patient and health professional’s views on a new care pathway that would not include routine face-to-face examination by the ophthalmologist. Most patients felt that restricting face-to-face clinical interactions would be a negative step; mainly because patients valued a consultation with a medically trained professional from which they could obtain detailed information (‘results’ of investigations), expert opinion, and reassurance.

Professionals who worked in clinics, however, tended to view the adoption of a grader-led clinic (“virtual” or “live”) mainly in the context of a need to rationalise scarce resources; to focus on ‘high risk’ rather than ‘low-risk’ patients. Photographers and consultants argued patient concerns could be best managed via programmes of patient education. In other respects their views echoed those in the available literature, wherein the emphasis is predominantly on technical matters of diagnostic accuracy (using images alone) [21, 22]. Yet the adoption of a grader-led clinic holds important implications for doctor–patient communication, the management of information and anxiety, and the re-distribution of professional skills. In the absence of face-to-face clinics, immediate feed-back to patients from graders, and periodic, even if at less frequent intervals, evaluations by ophthalmologists would be more acceptable to patients and should be considered prior to the introduction of this new care pathway. Patient education regarding professional identity, training and performance of ophthalmic graders would be also essential.

One advantage of this study was a capacity to explore patient views in detail rather than as straightforward responses to structured pre-set questions. The study also drew upon patient views from widely different areas of the UK. Unfortunately, the response rate to FG participation was low—though as previously indicated, there are strong grounds for considering the coverage of opinions robust.

Currently, virtual clinics are used for managing of other chronic eye conditions, such as age-related macular degeneration and glaucoma, besides diabetic retinopathy. Consequently, the results of EMERALD may be useful and applicable to the management of other eye diseases.

Summary

What was known before

  • There was a lack of information before about the acceptance by patients of allied non-medical staff-led clinics.

What this study adds

  • Through focus group discussions EMERALD found out patients prefer face-to-face examinations done by an ophthalmologist. In their absence, they would accept the new surveillance pathway (ophthalmic grader’s pathway) provided they get immediate feedback and still see the ophthalmologist from time to time.

Acknowledgements

The authors would like to thank all individuals that participated in the EMERALD focus group discussions.

Author contributions

LP with input from NL, designed the study, conducted the Focus Group Discussions, and analysed the findings. LP and NL, as well as members of the EMERALD Study Group interpreted the results. LP drafted, with input from NL, this manuscript, which was approved by the study team. NL prepared the submission and submitted the manuscript.

Funding

EMERALD was funded by the Health Technology Assessment of the National Institute for Health Research (HTA-NIHR 15/42/08).

Data availability

All data generated or analysed during this study are included in this published article.

Competing interests

The authors declare no competing interests.

Footnotes

In memoriam: Lindsay Prior.

Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

A list of authors and their affiliations appears at the end of the paper.

Contributor Information

Noemi Lois, Email: n.lois@qub.ac.uk.

on behalf of the EMERALD Study Group:

Ahmed Saad, Augusto Azuara-Blanco, Caroline Styles, Clare Bailey, Danny McAuley, David H. Steel, Faruque D. Ghanchi, Geeta Menon, Haralabos Eleftheriadis, Stefanos Efraimidis, Jonathan Cook, Ariel Wang, William Sones, Nachiketa Acharya, Noemi Lois, Norman Waugh, Hema Mistry, Mandy Maredza, Samia Fatum, Sobha Sivaprasad, Stephen Aldington, Peter H. Scanlon, Katerina Ivanova, Tariq M. Aslam, Victor Chong, Andrew Jackson, Christine McNally, Rachael Rice, and Lindsay Prior

References

  • 1.NHS Digital. Hospital outpatient activity 2019–2020 (England). https://digital.nhs.uk/data-and-information/publications/statistical/hospital-outpatient-activity/2019-20. Accessed 11 Sept 2020
  • 2.Diabetes UK. Diabetes prevalence. https://www.diabetes.co.uk/diabetes-prevalence.html. Accessed 1 Nov 2020
  • 3.Foot B, MacEwen C. Surveillance of sight loss due to delay in ophthalmic treatment or review: frequency, cause and outcome. Eye. 2017;31:771–5. doi: 10.1038/eye.2017.1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Lois N, Cook J, Aldington S, Waugh N, Mistry H, Sones W, et al. Effectiveness of Multimodal imaging for the Evaluation of Retinal oedema And new vesseLs in Diabetic retinopathy (EMERALD) BMJ Open. 2019;9:e027795. doi: 10.1136/bmjopen-2018-027795. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Lois N, Cook J, Wang A, Aldington S, Mistry H, Maredza M, et al. Evaluation of a new model of care for people with complications of diabetic retinopathy: the EMERALD Study. Ophthalmology. 2021;128:561–73. doi: 10.1016/j.ophtha.2020.10.030. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Tsaousis KT, Empeslidis T, Konidaris VE, Kapoor B, Deane J. The concept of virtual clinics in monitoring patients with age-related macular degeneration. Acta Ophthalmol. 2016;94:e353–5. doi: 10.1111/aos.12832. [DOI] [PubMed] [Google Scholar]
  • 7.Lee JX, Manjunath V, Talks SJ. Expanding the role of medical retina virtual clinics using multimodal ultra-widefield and optical coherence tomography imaging. Clin Ophthalmol. 2018;12:2337–45.. doi: 10.2147/OPTH.S181108. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Kortuem K, Fasler K, Charnley A, Khambati H, Fasolo S, Katz M, et al. Implementation of medical retina virtual clinics in a tertiary eye care referral centre. Br J Ophthalmol. 2018;102:1391–95.. doi: 10.1136/bjophthalmol-2017-311494. [DOI] [PubMed] [Google Scholar]
  • 9.Kern C, Kortuem K, Hamilton R, Fasolo S, Cai Y, Balaskas K, et al. Clinical outcomes of a hospital-based teleophthalmology service: what happens to patients in a virtual clinic? Ophthalmol Retin. 2019;3:422–28.. doi: 10.1016/j.oret.2019.01.011. [DOI] [PubMed] [Google Scholar]
  • 10.Ahnood D, Souriti A, Williams GS. Assessing patient acceptance of virtual clinics for diabetic retinopathy: a large scale postal survey. Can J Ophthalmol. 2018;53:207–9. doi: 10.1016/j.jcjo.2017.10.035. [DOI] [PubMed] [Google Scholar]
  • 11.Kotecha A, Baldwin A, Brookes J, Foster P. Experiences with developing and implementing a virtual clinic for glaucoma care in an NHS setting. Clin Ophthalmol. 2015;9:1915–23. doi: 10.2147/OPTH.S92409. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Gunn PJG, Marks JR, Au L, Waterman H, Spry PGD, Harper RA. Acceptability and use of glaucoma virtual clinics in the UK: a national survey of clinical leads. BMJ Open Ophthalmol. 2018;3:e000127. doi: 10.1136/bmjophth-2017-000127. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Krueger RA, Casey MA. Focus Groups: a practical guide for applied research. 5th ed. Thousand Oaks, CA: Sage; 2014
  • 14.Barter C, Renold E (1999) The use of vignettes in qualitative research. Social research update. 25. Guildford: University of Surrey.
  • 15.Rizvi S. Using fiction to reveal truth: challenges of using vignettes to understand participant experiences within qualitative research. Forum: Sozialforschung. 2019;20:1. doi: 10.17169/fqs-20.1.3101. [DOI] [Google Scholar]
  • 16.Prior L. ‘Content analysis’. In: Leavey P, editor. The Oxford handbook of qualitative research methods. 2nd ed. Oxford Library of Psychology. New York: Oxford University Press; 2020. p. 541–569.
  • 17.Wilkinson S. Analysing focus group data. In: Silverman D, editor. Qualitative research. 5th ed. Ch.6. London: Sage; 23/12/2020.
  • 18.Hancock ME, Amankwaa L, Revell MA, Mueller D. Focus group data saturation: a new approach to data analysis. Qual Rep. 2016;21:2124–30. [Google Scholar]
  • 19.Hennink MM, Kaiser BN, Marconi VC. Code saturation versus meaning saturation. How many interviews are enough? Qual Health Res. 2017;27:591–608. doi: 10.1177/1049732316665344. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Saunders B, Sim J, Kingstone T, Baker S, Waterfield J, Bartlam B, et al. ‘Saturation in qualitative research: exploring its conceptualization and operationalization’. Qual Quant. 2018;52:1893–907. doi: 10.1007/s11135-017-0574-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Clarke J, Puertas R, Kotecha A, Foster PJ, Barton K. Virtual clinics in glaucoma care: face-to-face versus remote decision-making. Br J Ophthalmol. 2017;101:892–5. doi: 10.1136/bjophthalmol-2016-308993. [DOI] [PubMed] [Google Scholar]
  • 22.Kotecha A, Longstaff S, Azuara-Blanco A, Kirwan JF, Morgan JE, Spencer AF, et al. Developing standards for the development of glaucoma virtual clinics using a modified Delphi approach. Br J Ophthalmol. 2018;102:531–4. doi: 10.1136/bjophthalmol-2017-310504. [DOI] [PubMed] [Google Scholar]
  • 23.de Nooy W, Mrvar A, Batagelj V. Exploratory social network analysis with Pajek. 3rd ed. Cambridge: Cambridge University Press; 2018.

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

All data generated or analysed during this study are included in this published article.


Articles from Eye are provided here courtesy of Nature Publishing Group

RESOURCES