Figure 5.

This diagram illustrates the process of medical image captioning using language models. Based on different captioning methods, it can be broadly categorized into direct generation approaches, retrieval-based approaches, and deep learning-based approaches. Among the deep learning approaches, there is further classification based on the involvement of an attention mechanism, leading to encoder–decoder-based approaches and attention-based approaches. Most medical image captioning methods primarily focus on encoder–decoder approaches.