Algorithm 1.

Interleaving update algorithm

Require: Conditional encoder E(·, ·), GCN G(·, ·).

Input: Image patch $x_i^j$ , anatomical landmark pj, adjacency matrix Ai.

for step t = 1, Tmax do

for step tl = 1, Tl do

Randomly sample a batch of Bl subjects

for j = 1, N do

$h_i^j\leftarrow E\left(aug\left(x_i^j\right),p^j\right)$

Update E by backpropagating ${\mathcal{L}}_l$

end for

end for

for step tg = 1 ,Tg do

Randomly sample a batch of Bg subjects

$S_i\leftarrow G\left(\text{concat}\left({\left\{E\left(aug\left(x_i^n\right),p^n\right)\right\}}_{n=1}^N\right),A_i\right)$

Update G by backpropagating ${\mathcal{L}}_g$

end for

end for