compression

When there's no exact solution, project. When data is high-dimensional, compress. The SVD is the Swiss Army knife that does both — and more. Master orthogonal projection, the normal equations, the Singular Value Decomposition, low-rank approximation, and the pseudoinverse.