Skip to main content
. 2026 Mar 5;26(5):1650. doi: 10.3390/s26051650
Algorithm 1 Forward Rendering and Gated Optimization in Lumina-4DGS
  • Require: 

    3D Gaussians Θ={μ,Σ,csh,α}, Camera Pose P, Time t, Image Igt

  • Ensure: 

    Final Rendered Image Ifinal, Updated Parameters

  •   1:

    Initialization: Global AE/AWB parameters (at,bt), Bilateral Grid Gt, Threshold τt

  •   2:

    //—Stage 1: Forward Rendering (Pixel-wise integration)—

  •   3:

    for each ray r traversing sorted Gaussians do

  •   4:

       Calculate canonical color via Spherical Harmonics: ccanonical=SH2RGB(csh,r)

  •   5:

       // Step A: Global AWB and AE Compensation

  •   6:

       Apply channel-wise gain (AWB) and global bias (AE):

  •   7:

          cglobal=exp(at)ccanonical+bt

  •   8:

       // Step B: Local Photometric Refinement

  •   9:

       Sample grid affine matrix Γt for spatial position μ:

  • 10:

          Γt=Interpolate(Gt,μ)

  • 11:

       Apply local affine correction:

  • 12:

          clocal=Γt×[cglobal,1]T

  • 13:

       // Step C: Volumetric Alpha Blending

  • 14:

       Accumulate transmittance Ti and final color:

  • 15:

          Cfinal(r)=iαiTiclocal,i

  • 16:

    end for

  • 17:

    Assemble pixels to form Ifinal

  • 18:

    //—Stage 2: Object-Aware SSIM-Gated Optimization—

  • 19:

    Render raw geometry image Irender without exposure compensation

  • 20:

    Calculate object-level structural reliability: S=SSIMobj(Irender,Igt)

  • 21:

    if S>τt then

  • 22:

       Mgate1    // Structure is reliable, unfreeze appearance

  • 23:

    else

  • 24:

       Mgate0    // Structure is chaotic, freeze appearance

  • 25:

    end if

  • 26:

    //—Stage 3: Gradient Modulation—

  • 27:

    Compute total loss Ltotal (see Equation (20))

  • 28:

    Update Geometry: ΘΘηΘLtotal

  • 29:

    Update Exposure: ΘexpΘexpηMgate·ΘexpLtotal

  • 30:

    return Ifinal