In what direction does the reconstruction error point in PCA according to the video?
The reconstruction error points precisely along the direction of the dropped principal components. In the 3D to 2D example, the error aligns with the third principal component (PC3), which was discarded during projection.
Conditions
- A subset of principal components has been dropped during dimensionality reduction.
- The data is reconstructed using only the retained principal components.
Reasoning, step by step
- Identify the retained principal components (e.g., PC1 and PC2).
- Identify the dropped principal components (e.g., PC3).
- Observe the vector difference between the original point and the reconstructed point.
- Note that this difference vector is perpendicular to the subspace spanned by the retained components.
- Conclude that the error direction aligns with the dropped principal component(s).
Example
The video displays a diagram with red vertical lines connecting original points to reconstructed points, and explicitly labels the direction of these lines as 'PC3 = Error Direction'.
Common misconceptions
- Assuming the reconstruction error is randomly distributed in all directions.
- Believing the error points along one of the retained principal components.
Watch the explanation
Explore next
Answers are generated from source material and independently checked. Consult the original video or creator if something is unclear.