Fig. 3. Framework of XAI mental model differences and recommendations how to reduce the differences (see textbox).

ML Developers’ mental models (left) relate to model interpretability, a data-centered assessment, and an exploration mindset. Clinician’s mental models (right) aim for clinical plausibility, a patient-centered assessment, and an exploitation mindset.