Skip to content
← All questions

Why is the residual vector y minus the projection perpendicular to the line spanned by v?

The residual vector is defined as yy minus its projection onto the line spanned by vv. By the geometric definition of orthogonal projection, the difference between a vector and its projection onto a subspace is orthogonal to that subspace. Therefore, the residual is perpendicular to vv and the line it spans.

Conditions

  • vv is a nonzero vector.
  • The projection is orthogonal.

Reasoning, step by step

  1. Define the projection p=y⋅vv⋅vvp = \frac{y \cdot v}{v \cdot v} v.
  2. Define the residual r=y−pr = y - p.
  3. Recall the property of orthogonal projection: the error vector (residual) is orthogonal to the subspace being projected onto.
  4. Conclude that r⋅v=0r \cdot v = 0, meaning rr is perpendicular to the line spanned by vv.

Example

The script states: 'The residual y minus this projection is perpendicular to the line.'

Common misconceptions

  • Thinking the residual is parallel to the line.
  • Confusing orthogonal projection with parallel projection.
  • Believing the residual is zero unless y is already on the line.

Watch the explanation

Connected concepts

Explore next

Related questions

Find a method

↗
Meet the concept

↗

Answers are generated from source material and independently checked. Consult the original video or creator if something is unclear.