The residual vector r=Ax∗−b is orthogonal to the column space C(A) because Ax∗ is the orthogonal projection of b onto C(A). Orthogonality to C(A) means r is in the orthogonal complement C(A)⊥.
Conditions: Ax∗ is the orthogonal projection of b onto C(A); C(A)⊥=N(AT) (Fundamental Theorem of Linear Algebra); Matrix multiplication distributes over subtraction
The residual vector r=Ax∗−b is orthogonal to the column space C(A) because Ax∗ is the orthogonal projection of b onto C(A). Orthogonality to C(A) means r is in the orthogonal complement C(A)⊥.
Conditions: Ax∗ is the orthogonal projection of b onto C(A); C(A)⊥=N(AT) (Fundamental Theorem of Linear Algebra); Matrix multiplication distributes over subtraction