Table 15.
Multimodal Deep Learning for Convergent Applications in Cancer Diagnosis
| Fusion Data Types | Application Cases | Effect |
|---|---|---|
| EHR + CT images + genomic data | Integrating EHR, CT images and genomic data into a multimodal deep learning framework for improved detection sensitivity in lung cancer detection170 | Improved sensitivity and accuracy |
| EHR + Genetic Data | BERT-based modeling to extract risk factors and treatment response in cancer patients171 | Outperforms traditional machine learning methods |
| EHR + Image Data | The DSS system developed by Lee et al combines CT images and clinical data to predict the pathological stage of lung cancer172 | Provide a visual explanation of staging |