Skip to content
Back to exploration
Mathematical modeling / English

Determine the Singular Values of a Matrix

Mathispower4u · YouTube · 3:24

Open original
READ & KEEP

The explanation, unpacked.

Saves 0

Reviewed learning material · Video analysis · English
Read the full overview

This 160-second lecture segment introduces singular values of an m x n matrix A as the square roots of the positive eigenvalues of ATAA^T A or AA^T, and states that these two Gram matrices have the same positive eigenvalues. It then works through the example A=[[1,−1,3],[3,1,1]]A = [[1, -1, 3], [3, 1, 1]], computes ATA^T, ATAA^T A, and AA^T, and chooses the smaller matrix AA^T=[[11,5],[5,11]]T = [[11, 5], [5, 11]] for the eigenvalue calculation. The remainder recalls the characteristic equation det(A - lambda I)=0, applies it to AA^T, expands the determinant to lambda^2 - 22 lambda + 96=096 = 0, factors it as (lambda - 16)(lambda - 6)=0, and obtains eigenvalues 16 and 6. The clip ends before explicitly writing the final square-root step for the singular values. This video demonstrates how to find the singular values of a 2x3 matrix A. It begins by computing the product AA^T, resulting in a 2x2 symmetric matrix. The characteristic equation det(AA^T - lambda I) = 0 is then solved to find the eigenvalues lambda = 16 and lambda = 6. Finally, the singular values are determined by taking the square roots of these positive eigenvalues, yielding sigma_1 = 4 and sigma_2 = sqrt(6). A reminder emphasizes using only positive eigenvalues.

Use the learning inspector for key ideas and moments, or open the reading tabs for the complete notes.

Chapters

0:00Definition of singular values0:23Example matrix and transpose0:45Compute ATAA^T A and AA^T1:05Choose the smaller Gram matrix1:26Eigenvalue recall and characteristic equation1:44Solve for eigenvalues of AA^T2:40Calculating Eigenvalues of AA^T2:50Determining Singular Values3:18Conclusion and Outro

Learning script

Generated from the video's visuals and explanation; not verbatim speech.

The lesson opens by defining the singular values of an m×nm \times n matrix A. The key statement is that these singular values are the square roots of the positive eigenvalues of either ATAA^T A or AA^T.

It immediately adds a practical fact: ATAA^T A and AA^T have the same positive eigenvalues. That is why the later example can choose whichever product is easier to handle.

The example then takes A=[[1,−1,3],[3,1,1]]A = [[1, -1, 3], [3, 1, 1]] and asks for its singular values. The first computational step is to form ATA^T by turning rows into columns, giving AT=[[1,3],[−1,1],[3,1]]A^T = [[1, 3], [-1, 1], [3, 1]].

Next the video computes ATA=[[10,2,6],[2,2,−2],[6,−2,10]]A^T A = [[10, 2, 6], [2, 2, -2], [6, -2, 10]], noting that this is a3×3a 3 \times 3 matrix. It also computes AA^T=[[11,5],[5,11]]T = [[11, 5], [5, 11]], which is only 2×22 \times 2.

Because the positive eigenvalues of ATAA^T A and AA^T agree, the lesson chooses AA^T for the eigenvalue calculation. This reduces the amount of algebra needed.

A new slide recalls the eigenvalue criterion: a scalar λ is an eigenvalue of a square matrix when det(A - λI) = 0, equivalently det(λI - A) = 0. Here the matrix A in that formula is replaced by AA^T.

The characteristic equation is set up as det([[11, 5], [5, 11]] - λ[[1, 0], [0, 1]]) = 0, which becomes det([[11 - λ, 5], [5, 11 - λ]]) = 0.

Evaluating the 2×22 \times 2 determinant gives (11 - λ)(11 - λ) - 5⋅5=05\cdot 5 = 0. Expanding yields 121−22λ+λ2−25=0121 - 22λ + λ^2 - 25 = 0, and combining constants produces λ2−22λ+96=0λ^2 - 22λ + 96 = 0.

The quadratic factors as (λ - 16)(λ - 6) = 0, so the eigenvalues of AA^T are λ=16λ = 16 and λ=6λ = 6. By the definition stated at the start, the singular values would be the square roots of these positive eigenvalues, although that final square-root line is not shown before the clip ends.

The segment starts with the conclusion of the eigenvalue calculation for the matrix AATAA^T. The narrator notes that the solutions are λ=16\lambda = 16 and λ=6\lambda = 6, emphasizing that both are positive. This positivity is crucial because singular values are derived from the square roots of eigenvalues.

The video transitions to the definition of singular values. The formula σi=λi\sigma_i = \sqrt{\lambda_i} is presented. The narrator applies this formula to the previously found eigenvalues. For λ1=16\lambda_1 = 16, the first singular value is calculated as σ1=16=4\sigma_1 = \sqrt{16} = 4.

Next, the second singular value is determined using λ2=6\lambda_2 = 6. The calculation yields σ2=6\sigma_2 = \sqrt{6}. A visual reminder appears on screen stating 'Only use the positive eigenvalues to find the singular values,' reinforcing the mathematical constraint.

The final result is summarized: the singular values of the original matrix AA are σ1=4\sigma_1 = 4 and σ2=6\sigma_2 = \sqrt{6}. The video concludes with an outro screen displaying the presenter's name and website.

Knowledge cards

01

Singular values from positive eigenvalues

For an m×nm \times n matrix A, the singular values are defined as the square roots of the positive eigenvalues of ATAA^T A or AA^T. The video emphasizes that only positive eigenvalues enter this square-root step.

σi=λi, λi>0, λi∈spec⁡(ATA) or spec⁡(AAT)\sigma_i=\sqrt{\lambda_i},\ \lambda_i>0,\ \lambda_i\in\operatorname{spec}(A^TA)\text{ or }\operatorname{spec}(AA^T)
02

ATAA^T A and AA^T share positive eigenvalues

The lesson states that ATAA^T A and AA^T always have the same positive eigenvalues. This fact allows one to choose the computationally simpler Gram matrix when finding singular values.

spec⁡>0(ATA)=spec⁡>0(AAT)\operatorname{spec}_{>0}(A^TA)=\operatorname{spec}_{>0}(AA^T)
03

Transpose rule used in the example

To compute ATA^T, each row of A becomes a column. For A=[[1,−1,3],[3,1,1]]A = [[1, -1, 3], [3, 1, 1]], this gives AT=[[1,3],[−1,1],[3,1]]A^T = [[1, 3], [-1, 1], [3, 1]].

A=[1−13311]⇒AT=[13−1131]A=\begin{bmatrix}1&-1&3\\3&1&1\end{bmatrix}\Rightarrow A^T=\begin{bmatrix}1&3\\-1&1\\3&1\end{bmatrix}
04

Gram matrices in the worked example

The example computes both products: ATAA^T A is 3×33 \times 3, while AA^T is 2×22 \times 2. The smaller matrix is then selected for the eigenvalue calculation.

ATA=[102622−26−210],AAT=[115511]A^TA=\begin{bmatrix}10&2&6\\2&2&-2\\6&-2&10\end{bmatrix},\quad AA^T=\begin{bmatrix}11&5\\5&11\end{bmatrix}
05

Eigenvalue characteristic equation

An eigenvalue λ of a square matrix satisfies det(A - λI)=0, equivalently det(λI - A)=0. In this lesson, A is replaced by AA^T.

det⁡(A−λI)=0ordet⁡(λI−A)=0\det(A-\lambda I)=0\quad\text{or}\quad \det(\lambda I-A)=0
06

Solving the example eigenvalue problem

For AA^T=[[11,5],[5,11]]T = [[11,5],[5,11]], the determinant equation becomes (11-λ)^2−25=02 - 25 = 0, which simplifies to λ2−22λ+96=0λ^2 - 22λ + 96 = 0 and factors as (λ-16)(λ-6)=0. Hence the eigenvalues are 16 and 6.

λ2−22λ+96=0⇒(λ−16)(λ−6)=0⇒λ=16 or λ=6\lambda^2-22\lambda+96=0\Rightarrow(\lambda-16)(\lambda-6)=0\Rightarrow\lambda=16\text{ or }\lambda=6
07

Definition of Singular Values

The singular values σi\sigma_i of a matrix AA are defined as the square roots of the positive eigenvalues λi\lambda_i of the matrix product AATAA^T (or ATAA^TA). Formula: σi=λi\sigma_i = \sqrt{\lambda_i}.

σi=λi\sigma_i = \sqrt{\lambda_i}
08

Characteristic Equation Method

To find eigenvalues of a square matrix MM, solve det⁡(M−λI)=0\det(M - \lambda I) = 0. For a 2x2 matrix, this results in a quadratic equation which can be factored to find λ\lambda.

det⁡(M−λI)=0\det(M - \lambda I) = 0
09

Constraint on Eigenvalues

When calculating singular values, only positive eigenvalues of AATAA^T should be used. Since AATAA^T is positive semi-definite, its eigenvalues are non-negative. Zero eigenvalues correspond to zero singular values.

Detailed learning notes

Explore conditions, steps and evidence. Supplementary explanations are labeled separately from content shown in the video.

Symbols · 15

A

Clear evidence
Shown in the video
Evidence
  1. Formula
    Observation

    The slide states "Let A be an m x n matrix" and later gives the example matrix A=[[1,−1,3],[3,1,1]]A = [[1, -1, 3], [3, 1, 1]].

Symbol

A

Meaning

A general m x n matrix; in the worked example, the specific 2 x 3 matrix [[1, -1, 3], [3, 1, 1]].

Domain

m x n matrices in general; 2 x 3 matrices in the example

m, n

Clear evidence
Shown in the video
Evidence
  1. Formula
    Observation

    The opening statement reads "Let A be an m x n matrix."

Symbol

m, n

Meaning

Dimensions of the matrix A, with m rows and n columns.

Domain

Positive integers

ATA^T

Clear evidence
Shown in the video
Evidence
  1. Formula
    Observation

    The slide uses ATA^T in the expressions ATAA^T A and AA^T.

  2. Audio
    Observation

    The narrator says "A transpose times A or A times A transpose."

Symbol

ATA^T

Meaning

The transpose of A, obtained by turning rows into columns.

Domain

n x m matrix when A is m x n

positive eigenvalues of ATAA^T A or AA^T

Clear evidence
Shown in the video
Evidence
  1. Formula
    Observation

    The definition line says singular values are the square roots of the positive eigenvalues of ATAA^T A or AA^T.

Symbol

positive eigenvalues of ATAA^T A or AA^T

Meaning

Eigenvalues used to compute singular values; only the positive ones are taken for square roots.

Domain

Spectrum of the symmetric Gram matrices ATAA^T A and AA^T

lambda

Clear evidence
Shown in the video
Evidence
  1. Formula
    Observation

    The recall line defines an eigenvalue as a scalar lambda satisfying det(A - lambda I) = 0 or det(lambda I - A) = 0.

  2. Audio
    Observation

    The narrator says "an eigenvalue ... is a scalar lambda such that the determinant ... equals zero."

Symbol

lambda

Meaning

Scalar eigenvalue variable in the characteristic equation.

Domain

Scalars over the underlying field, here real numbers

I

Clear evidence
Shown in the video
Evidence
  1. Formula
    Observation

    The formula uses lambda I inside det(A - lambda I).

Symbol

I

Meaning

Identity matrix of the same size as the matrix whose eigenvalues are being computed.

Domain

Square identity matrix

det

Clear evidence
Shown in the video
Evidence
  1. Formula
    Observation

    The characteristic equations are written using det(A - lambda I) and det(lambda I - A).

Symbol

det

Meaning

Determinant operator applied to a square matrix.

Domain

Square matrices

AA^T

Clear evidence
Shown in the video
Evidence
  1. Formula
    Observation

    The worked example computes AA^T=[[11,5],[5,11]]T = [[11, 5], [5, 11]].

Symbol

AA^T

Meaning

In the example, the 2 x 2 product matrix [[11, 5], [5, 11]] whose eigenvalues are found next.

Domain

2 x 2 real symmetric matrix in this example

lambda = 16 or lambda = 6

Clear evidence
Shown in the video
Evidence
  1. Formula
    Observation

    The final displayed line on the slide is lambda = 16 or lambda = 6.

  2. Audio
    Observation

    The narrator concludes "resulting in two eigenvalues where we have lambda equals 16" before the clip ends.

Uncertainties
  1. The spoken sentence reaches only lambda = 16 before the clip ends, but the displayed line also shows lambda = 6.

Symbol

lambda = 16 or lambda = 6

Meaning

The two eigenvalues obtained from the characteristic polynomial of AA^T in the example.

Domain

Real scalars

A

Clear evidence
Shown in the video
Evidence
  1. Formula
    Observation

    The matrix A is shown as [[1, -1, 3], [3, 1, 1]].

Symbol

A

Meaning

The original 2x3 matrix whose singular values are being determined.

Domain

2x3 real matrix

AA^T

Clear evidence
Shown in the video
Evidence
  1. Formula
    Observation

    The product AA^T is computed and shown as [[11, 5], [5, 11]].

Symbol

AA^T

Meaning

The product of matrix A and its transpose, used to find eigenvalues for singular values.

Domain

2x2 real symmetric matrix

λ\lambda

Clear evidence
Shown in the video
Evidence
  1. Formula
    Observation

    The variable lambda is used in the characteristic equation det(A - lambda I) = 0.

Symbol

λ\lambda

Meaning

Eigenvalue of the matrix AA^T.

Domain

Real scalar

Knowledge points · 8

Definition of singular values via positive eigenvalues

Clear evidence
Shown in the video
Evidence
  1. Formula
    Observation

    Slide text: "The singular values of A are the square roots of the positive eigenvalues of ATAA^T A or AA^T."

  2. Audio
    Observation

    Narrator repeats the same definition verbatim.

Definition
Explanation

For an m x n matrix A, the singular values are defined as the square roots of the positive eigenvalues of either ATAA^T A or AA^T. The video presents these two Gram matrices as interchangeable sources for the same positive eigenvalues.

Formula
σi=λi,λi>0,λi∈spec⁡(ATA) or spec⁡(AAT)\sigma_i = \sqrt{\lambda_i},\quad \lambda_i>0,\quad \lambda_i\in \operatorname{spec}(A^TA)\text{ or }\operatorname{spec}(AA^T)
Conditions
  1. A is an m x n matrix.

  2. Only positive eigenvalues are used in the square-root step.

Prerequisites
  1. Computing the transpose of a matrix

Equality of positive eigenvalues of ATAA^T A and AA^T

Clear evidence
Shown in the video
Evidence
  1. Formula
    Observation

    Slide text: "ATAA^T A and AA^T have the same positive eigenvalues."

  2. Audio
    Observation

    Narrator says they "will always have the same positive eigenvalues."

Uncertainties
  1. The video states the fact but does not prove it within this clip.

Method
Explanation

The lesson states that ATAA^T A and AA^T share the same positive eigenvalues, so one may choose whichever product is computationally easier when finding singular values.

Formula
spec⁡>0(ATA)=spec⁡>0(AAT)\operatorname{spec}_{>0}(A^TA)=\operatorname{spec}_{>0}(AA^T)
Conditions
  1. A is an m x n matrix.

  2. The claim is about positive eigenvalues only.

Prerequisites
  1. Definition of singular values via positive eigenvalues

Computing the transpose of a matrix

Clear evidence
Shown in the video
Evidence
  1. Audio
    Observation

    Narrator explains that the first row of A becomes the first column of ATA^T and the second row becomes the second column.

  2. Formula
    Observation

    Example shows A=[[1,−1,3],[3,1,1]]A = [[1,-1,3],[3,1,1]] and AT=[[1,3],[−1,1],[3,1]]A^T = [[1,3],[-1,1],[3,1]].

Method
Explanation

To form ATA^T, rewrite each row of A as a column. In the example, the row (1, -1, 3) becomes the first column and the row (3, 1, 1) becomes the second column.

Formula
A=[1−13311]⇒AT=[13−1131]A=\begin{bmatrix}1&-1&3\\3&1&1\end{bmatrix}\quad\Rightarrow\quad A^T=\begin{bmatrix}1&3\\-1&1\\3&1\end{bmatrix}
Conditions
  1. Applies to any rectangular matrix.

Choosing the smaller Gram matrix for eigenvalues

Clear evidence
Shown in the video
Evidence
  1. Audio
    Observation

    Narrator notes that AA^T is a 2 x 2 matrix and therefore chooses it for the eigenvalue computation.

  2. Formula
    Observation

    Slide text: "Let's find the eigenvalues of AA^T since AA^T is a 2 by 2 matrix."

Method
Explanation

After computing both ATAA^T A and AA^T, the video selects AA^T because it is 2 x 2 rather than 3 x 3. This reduces the size of the characteristic polynomial that must be solved.

Formula
dim⁡(ATA)=n×n,dim⁡(AAT)=m×m\dim(A^TA)=n\times n,\quad \dim(AA^T)=m\times m
Conditions
  1. Useful when one of m,n is smaller than the other.

  2. Relies on the stated equality of positive eigenvalues.

Prerequisites
  1. Equality of positive eigenvalues of ATAA^T A and AA^T

Eigenvalue definition via characteristic determinant

Clear evidence
Shown in the video
Evidence
  1. Formula
    Observation

    Slide text: "Recall: An eigenvalue of A is a scalar lambda s.t. det(A - lambda I) = 0 or det(lambda I - A) = 0."

  2. Audio
    Observation

    Narrator reads the same recall statement.

Definition
Explanation

An eigenvalue of a square matrix A is a scalar lambda for which the determinant of A - lambda I vanishes. The video also gives the equivalent form det(lambda I - A)=0.

Formula
det⁡(A−λI)=0ordet⁡(λI−A)=0\det(A-\lambda I)=0\quad\text{or}\quad \det(\lambda I-A)=0
Conditions
  1. A must be square.

  2. I is the identity matrix of the same size as A.

Prerequisites
  1. Definition of singular values via positive eigenvalues

Definition of Singular Values via Eigenvalues

Clear evidence
Shown in the video
Evidence
  1. Formula
    Observation

    The text 'The singular values are A are: sigma_i = sqrt(lambda_i)' is displayed.

  2. Audio
    Observation

    Narrator states: 'The singular values of A are sigma sub i equal to the square root of lambda sub i'.

Definition
Explanation

The singular values of a matrix A are defined as the square roots of the positive eigenvalues of the matrix product AA^T (or A^TA). In this context, sigma_i = sqrt(lambda_i), where lambda_i are the eigenvalues of AA^T.

Formula
σi=λi\sigma_i = \sqrt{\lambda_i}
Conditions
  1. lambda_i must be non-negative

  2. lambda_i are eigenvalues of AA^T

Prerequisites
  1. Characteristic Equation for Eigenvalues

Characteristic Equation for Eigenvalues

Clear evidence
Shown in the video
Evidence
  1. Formula
    Observation

    Text reads: 'Recall: An eigenvalue of A is a scalar lambda s.t. det(A - lambda I) = 0 or det(lambda I - A) = 0.'

  2. Formula
    Observation

    Step-by-step derivation shows det([[11, 5], [5, 11]] - lambda[[1, 0], [0, 1]]) = 0 leading to (11-lambda)(11-lambda) - (5)(5) = 0.

Method
Explanation

To find the eigenvalues of a square matrix M, one solves the characteristic equation det(M - lambda I) = 0. For the 2x2 matrix AA^T, this expands to a quadratic polynomial in lambda.

Formula
det⁡(M−λI)=0\det(M - \lambda I) = 0
Conditions
  1. M is a square matrix

  2. I is the identity matrix of same dimension

Computation of AA^T

Clear evidence
Shown in the video
Evidence
  1. Formula
    Observation

    The calculation [[1, -1, 3], [3, 1, 1]] * [[1, 3], [-1, 1], [3, 1]] = [[11, 5], [5, 11]] is shown.

Method
Explanation

The matrix product AA^T is calculated by multiplying the rows of A by the columns of ATA^T (which are the rows of A). This results in a symmetric 2x2 matrix.

Formula
AAT=[1−13311][13−1131]=[115511]AA^T = \begin{bmatrix} 1 & -1 & 3 \\ 3 & 1 & 1 \end{bmatrix} \begin{bmatrix} 1 & 3 \\ -1 & 1 \\ 3 & 1 \end{bmatrix} = \begin{bmatrix} 11 & 5 \\ 5 & 11 \end{bmatrix}
Conditions
  1. A is a real matrix

Claims and conditions · 4

ATAA^T A and AA^T have the same positive eigenvalues

Clear evidence
Shown in the video
Evidence
  1. Formula
    Observation

    Displayed bullet: "ATAA^T A and AA^T have the same positive eigenvalues."

  2. Audio
    Observation

    Narrator states the same fact.

Uncertainties
  1. No proof is provided in this clip.

Proposition
Statement

For an m x n matrix A, the matrices ATAA^T A and AA^T have the same positive eigenvalues.

Hypotheses
  1. A is an m x n matrix.

Quantifiers

For all matrices A of size m x n, the positive parts of the spectra of ATAA^T A and AA^T coincide.

Characteristic-equation characterization of eigenvalues

Clear evidence
Shown in the video
Evidence
  1. Formula
    Observation

    Recall line on slide gives det(A - lambda I)=0 or det(lambda I - A)=0.

  2. Audio
    Observation

    Narrator reads the same characterization.

Proposition
Statement

A scalar lambda is an eigenvalue of a square matrix A exactly when det(A - lambda I)=0, equivalently det(lambda I - A)=0.

Hypotheses
  1. A is square.

  2. I is the identity matrix of the same size as A.

Quantifiers

For every square matrix A and scalar lambda, lambda is an eigenvalue if and only if the displayed determinant condition holds.

Eigenvalues of AA^T are Positive

Clear evidence
Shown in the video
Evidence
  1. Audio
    Observation

    Narrator says: 'Notice both are positive eigenvalues, and therefore we use these values to determine the singular values...'

  2. Formula
    Observation

    Screen shows lambda = 16 or lambda = 6.

Proposition
Statement

For the given matrix A, the eigenvalues of AA^T are 16 and 6, which are both positive.

Hypotheses
  1. A=[[1,−1,3],[3,1,1]]A = [[1, -1, 3], [3, 1, 1]]

Quantifiers

Existential (for this specific A)

Constraint on Eigenvalues for Singular Values

Clear evidence
Shown in the video
Evidence
  1. Caption evidence
    Observation

    A reminder box appears stating: 'Reminder: Only use the positive eigenvalues to find the singular values.'

Proposition
Statement

Only positive eigenvalues of AA^T are used to calculate the singular values of A.

Quantifiers

Universal (implied rule)

Derivations and proofs · 4

Compute ATA^T, ATAA^T A, and AA^T for the example matrix

Clear evidence
Shown in the video
Evidence
  1. Formula
    Observation

    The slide successively displays ATA^T, then ATA=[[10,2,6],[2,2,−2],[6,−2,10]]A^T A = [[10,2,6],[2,2,-2],[6,-2,10]], then AA^T=[[11,5],[5,11]]T = [[11,5],[5,11]].

  2. Audio
    Observation

    Narrator explains the transpose rule and comments on the resulting matrix sizes.

Proof
Steps
  1. Expression
    A=[1−13311]A=\begin{bmatrix}1&-1&3\\3&1&1\end{bmatrix}
    Explanation

    Start from the given 2 x 3 example matrix.

    Justification

    Given in the problem statement.

    Shown in the video
  2. Expression
    AT=[13−1131]A^T=\begin{bmatrix}1&3\\-1&1\\3&1\end{bmatrix}
    Explanation

    Convert each row of A into a column of ATA^T.

    Justification

    Definition of matrix transpose.

    Shown in the video
  3. Expression
    ATA=[13−1131][1−13311]=[102622−26−210]A^TA=\begin{bmatrix}1&3\\-1&1\\3&1\end{bmatrix}\begin{bmatrix}1&-1&3\\3&1&1\end{bmatrix}=\begin{bmatrix}10&2&6\\2&2&-2\\6&-2&10\end{bmatrix}
    Explanation

    Multiply ATA^T by A to obtain the 3 x 3 Gram matrix.

    Justification

    Matrix multiplication.

    Shown in the video
  4. Expression
    AAT=[1−13311][13−1131]=[115511]AA^T=\begin{bmatrix}1&-1&3\\3&1&1\end{bmatrix}\begin{bmatrix}1&3\\-1&1\\3&1\end{bmatrix}=\begin{bmatrix}11&5\\5&11\end{bmatrix}
    Explanation

    Multiply A by ATA^T to obtain the 2 x 2 Gram matrix.

    Justification

    Matrix multiplication.

    Shown in the video
Conclusion

For the example, ATAA^T A is 3 x 3 and AA^T is 2 x 2, so the smaller matrix AA^T is selected for the eigenvalue step.

Find the eigenvalues of AA^T by solving its characteristic equation

Clear evidence
Shown in the video
Evidence
  1. Formula
    Observation

    The slide shows det([[11,5],[5,11]] - lambda[[1,0],[0,1]]) = 0, then simplifies to (11-lambda)(11-lambda)-(5)(5)=0, then to lambda^2-22lambda+96=096=0, then to (lambda-16)(lambda-6)=0, and finally lambda=16 or lambda=6.

  2. Audio
    Observation

    Narrator verbally follows the same algebraic sequence.

Proof
Steps
  1. Expression
    det⁡([115511]−λ[1001])=0\det\left(\begin{bmatrix}11&5\\5&11\end{bmatrix}-\lambda\begin{bmatrix}1&0\\0&1\end{bmatrix}\right)=0
    Explanation

    Set up the characteristic equation for the 2 x 2 matrix AA^T.

    Justification

    Eigenvalue definition via det(A - lambda I)=0.

    Shown in the video
  2. Expression
    det⁡([11−λ5511−λ])=0\det\left(\begin{bmatrix}11-\lambda&5\\5&11-\lambda\end{bmatrix}\right)=0
    Explanation

    Subtract lambda I entrywise from AA^T.

    Justification

    Scalar multiplication and matrix subtraction.

    Shown in the video
  3. Expression
    (11−λ)(11−λ)−(5)(5)=0(11-\lambda)(11-\lambda)-(5)(5)=0
    Explanation

    Evaluate the 2 x 2 determinant.

    Justification

    Determinant formula for a 2 x 2 matrix.

    Shown in the video
  4. Expression
    121−22λ+λ2−25=0121-22\lambda+\lambda^2-25=0
    Explanation

    Expand the square and simplify the constant term.

    Justification

    Algebraic expansion.

    Shown in the video
  5. Expression
    λ2−22λ+96=0\lambda^2-22\lambda+96=0
    Explanation

    Combine like terms to get the quadratic characteristic polynomial.

    Justification

    Arithmetic simplification.

    Shown in the video
  6. Expression
    (λ−16)(λ−6)=0(\lambda-16)(\lambda-6)=0
    Explanation

    Factor the quadratic.

    Justification

    Factoring a monic quadratic with roots summing to 22 and product 96.

    Shown in the video
  7. Expression
    λ=16orλ=6\lambda=16\quad\text{or}\quad \lambda=6
    Explanation

    Read off the two eigenvalues from the factored equation.

    Justification

    Zero-product property.

    Shown in the video
Conclusion

The eigenvalues of AA^T in the example are 16 and 6.

Derivation of Eigenvalues from Characteristic Polynomial

Clear evidence
Shown in the video
Evidence
  1. Formula
    Observation

    Visual steps show expansion of determinant: (11-lambda)(11-lambda) - 25=025 = 0 -> 121 - 22lambda + lambda^2−25=02 - 25 = 0 -> lambda^2 - 22lambda + 96=096 = 0 -> (lambda-16)(lambda-6) = 0.

Proof
Steps
  1. Expression
    det⁡([115511]−λ[1001])=0\det\left(\begin{bmatrix} 11 & 5 \\ 5 & 11 \end{bmatrix} - \lambda \begin{bmatrix} 1 & 0 \\ 0 & 1 \end{bmatrix}\right) = 0
    Explanation

    Set up the characteristic equation for the matrix AA^T.

    Justification

    Definition of eigenvalues via determinant.

    Shown in the video
  2. Expression
    (11−λ)(11−λ)−(5)(5)=0(11 - \lambda)(11 - \lambda) - (5)(5) = 0
    Explanation

    Compute the determinant of the resulting 2x2 matrix.

    Justification

    Formula for 2x2 determinant ad-bc.

    Shown in the video
  3. Expression
    121−22λ+λ2−25=0121 - 22\lambda + \lambda^2 - 25 = 0
    Explanation

    Expand the terms.

    Justification

    Algebraic expansion.

    Shown in the video
  4. Expression
    λ2−22λ+96=0\lambda^2 - 22\lambda + 96 = 0
    Explanation

    Combine constant terms (121−25=96121 - 25 = 96).

    Justification

    Arithmetic simplification.

    Shown in the video
  5. Expression
    (λ−16)(λ−6)=0(\lambda - 16)(\lambda - 6) = 0
    Explanation

    Factor the quadratic equation.

    Justification

    Factoring technique finding roots 16 and 6.

    Shown in the video
  6. Expression
    λ=16 or λ=6\lambda = 16 \text{ or } \lambda = 6
    Explanation

    Solve for lambda.

    Justification

    Zero product property.

    Shown in the video
Conclusion

The eigenvalues of AA^T are 16 and 6.

Calculation of Singular Values from Eigenvalues

Clear evidence
Shown in the video
Evidence
  1. Formula
    Observation

    Screen shows sigma_1 = sqrt(16) = 4 and sigma_2 = sqrt(6).

Proof
Steps
  1. Expression
    σi=λi\sigma_i = \sqrt{\lambda_i}
    Explanation

    Apply the definition relating singular values to eigenvalues.

    Justification

    Definition of singular values.

    Shown in the video
  2. Expression
    σ1=16=4\sigma_1 = \sqrt{16} = 4
    Explanation

    Substitute the first eigenvalue lambda_1 = 16.

    Justification

    Given eigenvalue value.

    Shown in the video
  3. Expression
    σ2=6\sigma_2 = \sqrt{6}
    Explanation

    Substitute the second eigenvalue lambda_2 = 6.

    Justification

    Given eigenvalue value.

    Shown in the video
Conclusion

The singular values of A are 4 and sqrt(6).

Worked examples · 2

Worked example: set up singular values for a 2 x 3 matrix

Clear evidence
Shown in the video
Evidence
  1. Formula
    Observation

    The slide introduces Example with A=[[1,−1,3],[3,1,1]]A = [[1,-1,3],[3,1,1]] and asks to find the singular values of A.

  2. Audio
    Observation

    Narrator says "Let's take a look at an example" and proceeds through transpose, products, and eigenvalues.

Uncertainties
  1. The clip ends after finding eigenvalues 16 and 6; it does not display the final square-root step explicitly.

Problem

Let A=[[1,−1,3],[3,1,1]]A = [[1, -1, 3], [3, 1, 1]]. Find the singular values of A.

Given
  1. A is the 2 x 3 matrix [[1, -1, 3], [3, 1, 1]].

  2. Singular values are square roots of positive eigenvalues of ATAA^T A or AA^T.

  3. ATAA^T A and AA^T have the same positive eigenvalues.

Goal

Reduce the problem to finding eigenvalues of the smaller Gram matrix and compute those eigenvalues.

Steps
  1. Expression
    AT=[13−1131]A^T=\begin{bmatrix}1&3\\-1&1\\3&1\end{bmatrix}
    Explanation

    Transpose A by converting rows to columns.

    Justification

    Definition of transpose.

    Shown in the video
  2. Expression
    ATA=[102622−26−210]A^TA=\begin{bmatrix}10&2&6\\2&2&-2\\6&-2&10\end{bmatrix}
    Explanation

    Compute the 3 x 3 product ATAA^T A.

    Justification

    Matrix multiplication.

    Shown in the video
  3. Expression
    AAT=[115511]AA^T=\begin{bmatrix}11&5\\5&11\end{bmatrix}
    Explanation

    Compute the 2 x 2 product AA^T.

    Justification

    Matrix multiplication.

    Shown in the video
  4. Expression
    Choose AAT because it is 2×2.\text{Choose }AA^T\text{ because it is }2\times2.
    Explanation

    Select the smaller Gram matrix for the eigenvalue calculation.

    Justification

    Stated strategy in the video, based on equal positive eigenvalues.

    Shown in the video
  5. Expression
    det⁡([11−λ5511−λ])=0\det\left(\begin{bmatrix}11-\lambda&5\\5&11-\lambda\end{bmatrix}\right)=0
    Explanation

    Write the characteristic equation for AA^T.

    Justification

    Eigenvalue definition.

    Shown in the video
  6. Expression
    (11−λ)2−25=0(11-\lambda)^2-25=0
    Explanation

    Evaluate the 2 x 2 determinant.

    Justification

    2 x 2 determinant formula.

    Shown in the video
  7. Expression
    λ2−22λ+96=0\lambda^2-22\lambda+96=0
    Explanation

    Expand and simplify to a quadratic.

    Justification

    Algebra.

    Shown in the video
  8. Expression
    (λ−16)(λ−6)=0(\lambda-16)(\lambda-6)=0
    Explanation

    Factor the quadratic.

    Justification

    Factoring.

    Shown in the video
  9. Expression
    λ=16orλ=6\lambda=16\quad\text{or}\quad \lambda=6
    Explanation

    Obtain the two eigenvalues of AA^T.

    Justification

    Zero-product property.

    Shown in the video
Answer

The example reaches eigenvalues 16 and 6 of AA^T. By the definition stated earlier, the singular values would be their positive square roots, but that final square-root line is not shown within this clip.

Verification

Substitute lambda=16 and lambda=6 into lambda^2-22lambda+96=096=0; both give 0, confirming they are roots of the characteristic polynomial.

Finding Singular Values of a 2x3 Matrix

Clear evidence
Shown in the video
Evidence
  1. Formula
    Observation

    Full problem setup and solution displayed on slides.

Problem

Determine the singular values of the matrix A=[[1,−1,3],[3,1,1]]A = [[1, -1, 3], [3, 1, 1]].

Given
  1. A=[1−13311]A = \begin{bmatrix} 1 & -1 & 3 \\ 3 & 1 & 1 \end{bmatrix}

Goal

Find sigma_1 and sigma_2.

Steps
  1. Expression
    AAT=[115511]AA^T = \begin{bmatrix} 11 & 5 \\ 5 & 11 \end{bmatrix}
    Explanation

    Calculate the product of A and its transpose.

    Justification

    Matrix multiplication rules.

    Shown in the video
  2. Expression
    det⁡(AAT−λI)=0⇒λ2−22λ+96=0\det(AA^T - \lambda I) = 0 \Rightarrow \lambda^2 - 22\lambda + 96 = 0
    Explanation

    Form and simplify the characteristic equation.

    Justification

    Eigenvalue definition.

    Shown in the video
  3. Expression
    λ1=16,λ2=6\lambda_1 = 16, \lambda_2 = 6
    Explanation

    Solve the quadratic equation for eigenvalues.

    Justification

    Factoring.

    Shown in the video
  4. Expression
    σ1=16=4,σ2=6\sigma_1 = \sqrt{16} = 4, \sigma_2 = \sqrt{6}
    Explanation

    Take the square root of each positive eigenvalue.

    Justification

    Singular value definition.

    Shown in the video
Answer

The singular values are sigma_1 = 4 and sigma_2 = sqrt(6).

Verification

Both eigenvalues were positive, satisfying the condition for real singular values.

Visual events · 4

Slide change from setup to eigenvalue computation

Clear evidence
Shown in the video
Evidence
  1. Animation
    Observation

    The screen changes from the first slide containing the definition and example setup to a new slide titled around finding eigenvalues of AA^T.

Objects
  1. First slide with definition and example matrices

  2. Second slide with eigenvalue recall and characteristic equation

Changes
  1. Content shifts from computing ATA^T, ATAA^T A, and AA^T to recalling the eigenvalue definition and solving det(AA^T - lambda I)=0.

Invariants
  1. The topic remains singular values of the same example matrix A.

  2. The chosen matrix for eigenvalues remains AA^T.

Interpretation

The visual transition marks the move from constructing the Gram matrices to solving the eigenvalue problem for the smaller one.

Cursor-guided emphasis on formulas

Clear evidence
Shown in the video
Evidence
  1. Animation
    Observation

    A yellow cursor/highlight moves across formulas as the narrator reads them, including the definition lines, matrix products, and the determinant expansion.

Objects
  1. Yellow cursor/highlight

  2. Displayed formulas and matrices

Changes
  1. The highlight moves from the definition bullets to the example matrix, then to ATA^T, ATAA^T A, AA^T, and finally the characteristic equation steps.

Invariants
  1. The underlying slide content stays static except for newly revealed lines.

Interpretation

The moving highlight synchronizes spoken explanation with the exact formula being discussed, helping identify which matrix or algebraic step is active.

Slide Transition to Singular Values

Clear evidence
Shown in the video
Evidence
  1. Animation
    Observation

    The slide content changes from the eigenvalue calculation to the singular value definition and final results.

Objects
  1. Previous slide with determinant calculations

  2. New slide with sigma formulas

Changes
  1. Content replacement

Invariants
  1. Title bar 'Singular Values of a Matrix'

Interpretation

Marks the shift from finding intermediate eigenvalues to computing the final singular values.

Appearance of Reminder Box

Clear evidence
Shown in the video
Evidence
  1. Animation
    Observation

    A grey box with text 'Reminder: Only use the positive eigenvalues...' fades in on the right side.

Objects
  1. Grey reminder box

Changes
  1. Box appears

Invariants
  1. Main calculation area

Interpretation

Highlights a crucial constraint in the definition of singular values.

Misconceptions · 4

Do not take square roots of non-positive eigenvalues

Clear evidence
Shown in the video
Evidence
  1. Formula
    Observation

    The definition explicitly says "square roots of the positive eigenvalues".

  2. Audio
    Observation

    Narrator repeats "positive eigenvalues" twice.

Misconception

One might think any eigenvalue of ATAA^T A or AA^T can be square-rooted to get singular values.

Clarification

The video specifically restricts the definition to positive eigenvalues.

ATAA^T A and AA^T need not be treated as giving different positive spectra

Clear evidence
Shown in the video
Evidence
  1. Formula
    Observation

    Bullet states "ATAA^T A and AA^T have the same positive eigenvalues."

Misconception

One might assume ATAA^T A and AA^T produce unrelated eigenvalue lists.

Clarification

The lesson states that their positive eigenvalues are the same, so either product may be used for singular values.

Do not always default to ATAA^T A

Clear evidence
Shown in the video
Evidence
  1. Audio
    Observation

    Narrator chooses AA^T because it is 2 x 2 instead of 3 x 3.

  2. Formula
    Observation

    Slide text: "Let's find the eigenvalues of AA^T since AA^T is a 2 by 2 matrix."

Misconception

One might think the standard route is always to use ATAA^T A regardless of size.

Clarification

The video demonstrates choosing the smaller Gram matrix to simplify the eigenvalue computation.

Using Negative Eigenvalues for Singular Values

Clear evidence
Shown in the video
Evidence
  1. Caption evidence
    Observation

    Text explicitly warns: 'Only use the positive eigenvalues to find the singular values.'

Misconception

Students might attempt to take the square root of negative eigenvalues when calculating singular values.

Clarification

Singular values are defined as the square roots of the *positive* eigenvalues of AA^T (or A^TA). Since AA^T is positive semi-definite, its eigenvalues are non-negative, but zero eigenvalues yield zero singular values, and negative ones (if arising from numerical error or wrong matrix) are not used for real singular values.

Concept relations · 7

Definition of singular values via positive eigenvalues → Equality of positive eigenvalues of ATAA^T A and AA^T

Clear evidence
Shown in the video
Evidence
  1. Formula
    Observation

    Definition line introduces singular values via eigenvalues of ATAA^T A or AA^T.

Prerequisite
Explanation

The equality of positive eigenvalues justifies choosing either ATAA^T A or AA^T in the definition.

Computing the transpose of a matrix → Worked example: set up singular values for a 2 x 3 matrix

Clear evidence
Shown in the video
Evidence
  1. Audio
    Observation

    Narrator applies the transpose rule directly in the worked example.

Application
Explanation

The example begins by computing ATA^T using the transpose method.

Choosing the smaller Gram matrix for eigenvalues → Equality of positive eigenvalues of ATAA^T A and AA^T

Clear evidence
Shown in the video
Evidence
  1. Formula
    Observation

    Both ATAA^T A and AA^T are displayed before the slide states to use AA^T because it is 2 x 2.

Proof dependency
Explanation

Choosing the smaller Gram matrix is valid because the two products have the same positive eigenvalues.

Eigenvalue definition via characteristic determinant → Find the eigenvalues of AA^T by solving its characteristic equation

Clear evidence
Shown in the video
Evidence
  1. Formula
    Observation

    The recall line is immediately followed by det(AA^T - lambda I)=0 and its simplification.

Prerequisite
Explanation

The characteristic-equation derivation uses the recalled definition of eigenvalues.

Worked example: set up singular values for a 2 x 3 matrix → Find the eigenvalues of AA^T by solving its characteristic equation

Clear evidence
Shown in the video
Evidence
  1. Formula
    Observation

    The example matrix AA^T=[[11,5],[5,11]]T = [[11,5],[5,11]] is substituted into the eigenvalue equation.

Application
Explanation

The worked example is carried out by applying the eigenvalue derivation to AA^T.

Characteristic Equation for Eigenvalues → Definition of Singular Values via Eigenvalues

Clear evidence
Shown in the video
Evidence
  1. Formula
    Observation

    Formula sigma_i = sqrt(lambda_i) links the two concepts directly.

Prerequisite
Explanation

Finding the eigenvalues of AA^T is a necessary prerequisite step before calculating the singular values of A.

Computation of AA^T → Characteristic Equation for Eigenvalues

Clear evidence
Shown in the video
Evidence
  1. Formula
    Observation

    The calculation of AA^T precedes the determinant setup.

Prerequisite
Explanation

Computing the matrix product AA^T is required to form the matrix for which eigenvalues are calculated.

Find an answer · 8

How are the singular values of a matrix defined in terms of eigenvalues?

Clear evidence
Shown in the video
Evidence
  1. Formula
    Observation

    Opening definition slide.

Knowledge points
  1. Definition of singular values via positive eigenvalues
  2. Equality of positive eigenvalues of ATAA^T A and AA^T

Why does the video switch from ATAA^T A to AA^T when computing singular values?

Clear evidence
Shown in the video
Evidence
  1. Audio
    Observation

    Narrator explains choosing AA^T because it is 2 x 2.

Knowledge points
  1. Choosing the smaller Gram matrix for eigenvalues
  2. Equality of positive eigenvalues of ATAA^T A and AA^T

How do you find the eigenvalues of the 2 x 2 matrix [[11,5],[5,11]]?

Clear evidence
Shown in the video
Evidence
  1. Formula
    Observation

    Characteristic equation and factorization are shown step by step.

Knowledge points
  1. Eigenvalue definition via characteristic determinant
  2. Find the eigenvalues of AA^T by solving its characteristic equation

What rule is used to compute ATA^T from A in this example?

Clear evidence
Shown in the video
Evidence
  1. Audio
    Observation

    Narrator states rows become columns.

Knowledge points
  1. Computing the transpose of a matrix

After obtaining eigenvalues 16 and 6, what should the singular values be according to the definition?

Clear evidence
Shown in the video
Evidence
  1. Formula
    Observation

    The clip ends at lambda = 16 or lambda = 6 without showing the square-root conclusion.

Uncertainties
  1. Final numeric singular values are not explicitly displayed in this clip.

Knowledge points
  1. Definition of singular values via positive eigenvalues
  2. Worked example: set up singular values for a 2 x 3 matrix

How do you calculate singular values from eigenvalues?

Clear evidence
Shown in the video
Evidence
  1. Audio
    Observation

    Narrator explains the process of taking square roots of eigenvalues.

Knowledge points
  1. Definition of Singular Values via Eigenvalues
  2. Calculation of Singular Values from Eigenvalues

Why must eigenvalues be positive to find singular values?

Clear evidence
Shown in the video
Evidence
  1. Caption evidence
    Observation

    Reminder box about positive eigenvalues.

Knowledge points
  1. Using Negative Eigenvalues for Singular Values
  2. Constraint on Eigenvalues for Singular Values

What are the steps to solve the characteristic equation for a 2x2 matrix?

Clear evidence
Shown in the video
Evidence
  1. Formula
    Observation

    Step-by-step algebraic expansion shown.

Knowledge points
  1. Characteristic Equation for Eigenvalues
  2. Derivation of Eigenvalues from Characteristic Polynomial
Coverage and review notes

Covered · Opening definition of singular values and the statement that ATAA^T A and AA^T share positive eigenvalues.

Covered · Example introduction, computation of ATA^T, and formation of ATAA^T A.

Covered · Computation of AA^T and explicit choice to use the smaller 2 x 2 matrix.

Covered · Recall of eigenvalue definition via determinant equations.

Covered · Full characteristic-equation setup, expansion, factorization, and conclusion lambda = 16 or lambda = 6.

Covered · Calculation of AA^T and solving for eigenvalues.

Covered · Definition of singular values and final calculation.

Covered · Outro screen with presenter information and website link; no mathematical content.

Explore the knowledge in this video

Reviewed subject paths