Dear Editor,
We read the interesting article by Ramesh et al.[1] on artificial intelligence in glaucoma, highlighting the human-in-the-loop machine learning for glaucomatous defects. The authors have aptly highlighted the use of Microsoft’s Visual Object Tagging Tool (VoTT) for comprehensive and customized data labelling. We believe that this is a less explored concept in the field of ophthalmology and merits further discussion.
Slow and steady, we are marching towards an era of artificial intelligence (AI) in ophthalmology. Machine and deep learning algorithms have picked up and have contributed in diagnosing numerous conditions like glaucoma, diabetic retinopathy (DR), retinopathy of prematurity (ROP), and age-related macular degeneration (ARMD). As we all know, AI’s potential in assisting ophthalmological diagnoses and screening is exceptionally high, but on every occasion, we fail to recognize the importance and contribution of data annotators.[2]
Data annotation is the method of labelling the data for AI-based tools or mobile-based applications. The data can be an image, text, audio, or video clip. Data annotators are highly skilled medical professionals who assist in time-consuming data annotation and conceptual build-up of AI algorithms.[3] Day in and out, they deal with a large quantity of data, label it and form the backbone of all AI and machine learning models. They are the real unsung heroes in the AI revolution.[4] The more data annotated and added to the AI-based models, the more reliable and smarter the application becomes. Data annotators are the future of AI globally, and their demand will increase in the future. The data annotation market is massive, and there is a huge requirement of annotators there.[5]
Several strategic steps have been taken to make data annotation attractive to ophthalmologists, like the Google-backed company DeepMind which has built a prototype to diagnose complex ocular pathologies in real-time. This prototype was developed in collaboration with Moorfields Eye Hospital, London.[6]
Critical roles of data annotators
The essential aspect of a data annotator is the quality of data annotated. Once the quality check is passed, only then can the data be merged to bring out a meaningful AI algorithm.
Their other important role is to manage the crashes associated with data annotation when machine learning fails to process. Hence, they are also called data annotation specialists.
In a nutshell, AI is still dependent on data annotators, and we must not forget that they are the unacclaimed heroes of the AI revolution in ophthalmology.
Financial support and sponsorship
Nil.
Conflicts of interest
There are no conflicts of interest.
Acknowledgements
Aravind Eye Hospital and Post Graduate Institute of Ophthalmology, Pondicherry.
References
- 1.Ramesh PV, Ramesh SV, Aji K, Ray P, Tamilselvan S, Parthasarathi S, et al. Modeling and mitigating human annotations to design processing systems with human-in-the-loop machine learning for glaucomatous defects: The future in artificial intelligence. Indian J Ophthalmol. 2021;69:2892–94. doi: 10.4103/ijo.IJO_1820_21. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Ting DS, Pasquale LR, Peng L, Campbell JP, Lee AY, Raman R, et al. Artificial intelligence and deep learning in ophthalmology. Br J Ophthalmol. 2019;103:167–75. doi: 10.1136/bjophthalmol-2018-313173. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Willemink MJ, Koszek WA, Hardell C, et al. Preparing medical imaging data for machine learning. Radiology. 2020;295:4–15. doi: 10.1148/radiol.2020192224. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Meskó B, et al. Data annotators are the unsung heroes of medicine's artificial intelligence revolution. J Med Artif Intell. 2020;3:1. [Google Scholar]
- 5.Ghose A, Roy S, Vasdev N, et al. The emerging role of artificial intelligence in the fight against COVID-19. Eur Urol. 2020;78:775–6. doi: 10.1016/j.eururo.2020.09.031. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Murgia M. Artificial intelligence group DeepMind readies first commercial product. Financial Times. 2019. [Last accessed on 2022 Feb 19]. Available from: https://www.ft.com/content/0e099914-514a-11e9-9c76-bf4a0c|ne37d49 .