Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2021 Jun 8.
Published in final edited form as: Am J Ophthalmol. 2020 May 18;216:A3–A4. doi: 10.1016/j.ajo.2020.03.039

Who could know who I am The possibility of patient identification with retinal imaging

Richard K Parrish II 1, Louis R Pasquale 2, Aaron Y Lee 3, Robert Folberg 4, Michael W Stewart 5, Sarah L Duncan Powers 6
PMCID: PMC8185635  NIHMSID: NIHMS1704377  PMID: 32456787

When fugitive Jean Valjean rhetorically asks, “Who am I?” in the musical version of Victor Hugo’s Les Miserables, he feared what would happen if someone recognized his face and identified him by the convict number on his yellow passport. Almost 200 years later, digital imaging of unique biological characteristics has expanded the possible means of identification. Simon and Goldstein first described a unique patient-specific retinal vascular network for identification in 1935.1 Since the concept’s advent, several variations on the assessment of retinal vessels have been proposed to improve the accuracy of identification.24 Hill developed a retinal identification system for use in humans5, but its application has mainly been limited to high-end security systems rather than patient care.6 Beyond human use, county fairs have used retinal vessel patterns in fraud prevention to verify prize-winning livestock7 and identify cattle8 and sheep. 9,10

In recent years, digital technologies, such as spectral-domain optical coherence tomography, have all but replaced film-based photographic images to record retinal, optic nerve, and choroidal anatomy. This digitally-encoded data can be readily acquired, stored, and accessed. We estimate that more than 500,000 patient-specific retinal images exist at the University of Miami Miller School of Medicine alone (Rams I, personal communication, January 27, 2020). Although the use of these data to identify specific patients may seem farfetched, an artificial intelligence (AI) algorithm based on retinal photographs can identify not only age, but smoking status, systolic blood pressure, cardiac adverse events, and birth sex with 97% specificity.11 An AI algorithm capable of distilling this level of information from a color fundus photograph could potentially re-identify a unique individual given the retrieval of enough identifiers. The New York Times recently described the facial image identification algorithm by Clearview AI as follows: “The system – whose backbone is a database of more than three billion images that Clearview claims to have scraped from Facebook, YouTube, Venmo, and millions of other websites –goes far beyond anything ever constructed by the United States government or any Silicon Valley giant.”12 This app has successfully identified suspects of criminal activity based on facial characteristics, although Clare Garvie of the Georgetown University Center on Privacy and Technology warned, “We have no data to suggest this tool is accurate.” The attorney general of New Jersey, fearing the misuse of patient identification, blocked the use of Clearview for facial recognition of criminal suspects in that state, while law enforcement officials elsewhere may use it without restriction.13 Beyond Clearview AI, emerging experimental machine learning technologies may permit the creation of synthetic analogs of a specific image or train a model to mimic the distribution of images within a location. It is also possible to identify patients using unique iris and conjunctival vessel images.14,15

To safeguard the future confidentiality of a patient whose retinal, conjunctival, or iridial images may appear in a publication, the American Journal of Ophthalmology strives to prevent unauthorized access to possible protected health information. Going forward, the Journal will require that authors obtain written permission of patients to publish their retinal images, expanding on the current policy of obtaining consent for publishing full-face photographs. This policy change will not impede the exchange of critical information or limit ethical scientific communication. Although clinical trials may continue to serve as a repository for thousands of retinal images, written consent will be required only from patients whose images appear in print. Further, the Journal will work with authors to mask noncritical features in retinal photographs in ways that disable algorithms that could reidentify subjects. While these AI identification possibilities may yet be on the horizon as a danger to patient confidentiality, the Journal considers the following advice from Wayne Gretsky’s father to his famous son: “Skate to where the puck is going, not where it has been.”

References

  • 1.Simon C, Goldstein I. A new scientific method of identification. NY State J Med 1935;35:901–906. [Google Scholar]
  • 2.Rahman NA, Mohamed AS, Rasmy ME. Retinal identification. Proceedings of the 2008 IEEE, CIBEC Cairo International 1–4. [Google Scholar]
  • 3.Kose CA, Ikibas C. A personal identification system using retinal vasculature in retinal fundus images. Expert Syst Appl 2011;38:13670–13681. [Google Scholar]
  • 4.Meng X, Yin Y, Yang G, Xi X. Retinal identification based on an improved circular Gabor filter and scale invariant feature transform. Sensors 2013;13:9248–9266. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Hill RB. Retina identification. In Jain A, Bolle R, Pantaki S, editors. Biometrics: Personal identification in Networked Society. Berlin: Springer, 2005:126. [Google Scholar]
  • 6.Amiri MD, Tab FA, Barkhoda W. Retinal identification based on the pattern of blood vessels using angular and radial partitioning. Lecture Notes in Computer Science, 2009;5807:732–739. [Google Scholar]
  • 7.Weld County Government. Retinal imagining verifies ID of showmanship livestock. Available at http://www.weldcountyfair.com/livestock. Accessed January 13, 2020.
  • 8.Allen A, Golden B, Taylor M, Patterson D, Henriksen D, Skuce R. Evaluation of retinal imaging technology for the biometric identification of bovine animals in Northern Ireland. Livest Sci 2008;116:42–52. [Google Scholar]
  • 9.Gonzales-Barron U, Corkery G, Barry B, Butler F, McDonell K, Ward S. Assessment of retinal recognition technology as a biometric method for sheep identification Comput Electron Argic 2008;60:156–166. [Google Scholar]
  • 10.Rojas-Olivares MA, Caja G, Carne S, Salama AAK, Adell N, Puig P. Retinal image recognition for verifying the identity of fattening and replacement lambs. J Anim Sci 2011;89:2603–2613. [DOI] [PubMed] [Google Scholar]
  • 11.Poplin R, Varadarajan AV, Blumer K, McConnell MV, Corrado GS, Peng L, Webster DR. Prediction of cardiovascular risk factors from retinal fundus photographs vis deep learning. Nature Biomed Engin 2018;2:158–164. [DOI] [PubMed] [Google Scholar]
  • 12.Hill K The Secretive Company That Might End Privacy as We Know It. The New York Times. January 18, 2020. Available at https://www.nytimes.com/2020/01/18/technology/clearview-privacy-facial-recognition.html. Accessed March 26, 2020.
  • 13.Hill K New Jersey Bars Police From Using Clearview Facial Recognition App. The New York Times. January 24, 2020. Available at https://www.nytimes.com/2020/01/24/technology/clearview-ai-new-jersey.html. Accessed March 26, 2020.
  • 14.Derakhshani R, Ross A. A texture-based neural network classifier for biometric identification using ocular surface vasculature. In: Proceedings of The International Joint Conference on Neural Networks. Orlando: IJCNN; 2007: 2982–2987. [Google Scholar]
  • 15.Masek L Recognition of human iris patterns for biometric identification [thesis]. Perth, Western Australia: University of Western Australia; 2003. [Google Scholar]

RESOURCES