Skip to main content
Elsevier - PMC COVID-19 Collection logoLink to Elsevier - PMC COVID-19 Collection
. 2023 Jan 31;218:1485–1496. doi: 10.1016/j.procs.2023.01.127

Simulating Federated Transfer Learning for Lung Segmentation using Modified UNet Model

Sateesh Ambesange a, B Annappa a, Shashidhar G Koolagudi a
PMCID: PMC9886334  PMID: 36743787

Abstract

Lung segmentation helps doctors in analyzing and diagnosing lung diseases effectively. Covid -19 pandemic highlighted the need for such artificial intelligence (AI) model to segment Lung X-ray images and diagnose patient covid conditions, in a short time, which was not possible due to huge number of patient influx at hospitals with the limited radiologist to diagnose based on test report in short time. AI models developed to assist doctors to diagnose faster, faces another challenge of data privacy. Such AI Models, for better performance, need huge data collected from multiple hospitals/diagnostic centres across the globe into single place to train the AI models. Federated Learning (FL) framework, using transfer learning approach addresses these concerns as FL framework doesn't need data to be shared to outside hospital ecosystem, as AI model get trained on local system and AI model get trained on distributed data. FL with Transfer learning doesn't need the parallel training of the model at all participants nodes like other FL. Paper simulates Federated Transfer learning for Image segmentation using transfer learning technique with few participating nodes and each nodes having different size dataset. The proposed method also leverages other healthcare data available at local system to train the proposed model to overcome lack of more data. Paper uses pre-trained weights of U-net Segmentation Model trained for MRI image segmentation to lung segmentation model. Paper demonstrates using such similar healthcare data available at local system helps improving the performance of the model. The paper uses Explainable AI approach to explain the result. Using above three techniques, Lung segmentation AI model gets near perfect segmentation accuracy.

Keywords: Federated Learning, Transfer Learning, Federated Transfer Learning, X-ray Image segmentation, MRI image segmentation, data privacy, Lung image segmentation, U-net Architecture

References

  • 1.H. Brendan McMahan, Eider Moore, Daniel Ramage, Seth Hampson, Blaise Agüera y Arcas,(2017) “Communication-Efficient Learning of Deep Networks from Decentralised Data”, https://arxiv.org/abs/1602.05629.
  • 2.Jakub Konecn´y, H. Brendan McMahan, Daniel Ramage, Peter Richt´arik, (2016) “Federated Optimization: Distributed Machine Learning for On-Device Intelligence”, https://arxiv.org/pdf/1610.02527.pdf
  • 3.Chaoyang He, Songze Li, Jinhyun So, Xiao Zeng, Mi Zhang, Hongyi Wang, Xiaoyang Wang, Praneeth Vepakomma, Abhishek Singh, Hang Qiu, Xinghua Zhu, Jianzong Wang, Li Shen, Peilin Zhao, Yan Kang, Yang Liu, Ramesh Raskar, Qiang Yang, Murali Annavaram∗,(2020) Salman Avestimehr, “FedML: A Research Library and Benchmark for Federated Machine Learning”, https://arxiv.org/pdf/2007.13518v4.pdf
  • 4.Dimitriadis Dimitrios, Kumatani Kenichi, Gmyr Robert, Gaur Yashesh. Federated Transfer Learning with Dynamic Gradient Aggregation. Sefik Emre Eskimez. 2020 https://arxiv.org/abs/2008.02452 [Google Scholar]
  • 5.Jaeger S, Candemir S, Antani S, Wáng YX, Lu PX, Thoma G. Two public chest X-ray datasets for computer-aided screening of pulmonary diseases. Quant Imaging Med Surg. 2014;4(6):475–477. doi: 10.3978/j.issn.2223-4292.2014.11.20. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Uppin R., Ambesange S., Sangameshwar S.Aralikatti, M. G.V. 2021 Third International Conference on Inventive Research in Computing Applications (ICIRCA) 2021. Respiratory Sound Abnormality Classification using Multipath Deep Learning Method; pp. 903–915. [DOI] [Google Scholar]
  • 7.Selvaraju R.R., Cogswell M., Das A., Vedantam R., Parikh D., Batra D. 2017 IEEE International Conference on Computer Vision (ICCV. 2017. Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization; pp. 618–626. [DOI] [Google Scholar]
  • 8.Rastogi Priyanka, Khanna Kavita, Singh Vijendra. LeuFeatx: Deep learning–based feature extractor for the diagnosis of acute leukemia from microscopic images of peripheral blood smear. Computers in Biology and Medicine. 2022;142 doi: 10.1016/j.compbiomed.2022.105236. [DOI] [PubMed] [Google Scholar]
  • 9.Rastogi P., Khanna K., Singh V. Gland segmentation in colorectal cancer histopathological images using U-net inspired convolutional network. Neural Computation and Application. 2021:1–12. doi: 10.1007/s00521-021-06687-z. [DOI] [Google Scholar]
  • 10.Ronneberger, O., Fischer, P., Brox, T. (2015). U-Net: Convolutional Networks for Biomedical Image Segmentation. In: Navab, N., Hornegger, J., Wells, W., Frangi, A. (eds) Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015. MICCAI 2015. Lecture Notes in Computer Science( ), vol 9351. Springer, Cham. https://doi.org/10.1007/978-3-319-24574-4_28
  • 11.Peng T., Gu Y., Ye Z., Cheng X., Wang J. A-LugSeg: Automatic and explainability-guided multi-site lung detection in chest X-ray images. Expert Systems with Applications. 2022;198 doi: 10.1016/j.eswa.2022.116873. [ ] [DOI] [Google Scholar]

Articles from Procedia Computer Science are provided here courtesy of Elsevier

RESOURCES