Skip to main content
. Author manuscript; available in PMC: 2021 Mar 18.
Published in final edited form as: IEEE Trans Inf Theory. 2018 Aug 16;66(8):5003–5021. doi: 10.1109/tit.2020.2971991

Algorithm 5.

Approximating the entropy via random projection matrices

1: INPUT: Integer n (dimensions of matrix R) and integer k (with rank of R at most kn, see eqn. (2)).
2: Construct the random projection matrix ΠRn×s (see Section V-B for details on Π and s).
3: Compute R~=RΠRn×s.
4: Compute and return the (at most) k non-zero singular values of R~, denoted by p~i, i = 1 … k.
5: OUTPUT: p~i, i = 1 … k and H^(R)=i=1kp~iln1p~i.