FIG. 10.

Geometric interpretation of least squares regression. The regression function g defines a hyperplane in ${ℝ}^p$ (green solid line, here we have p = 2) while the residual of data point x⁽ⁱ⁾ (hollow circles) is its projection onto this hyperplane (barended dashed line).