Singular values from positive eigenvalues
For an matrix A, the singular values are defined as the square roots of the positive eigenvalues of or AA^T. The video emphasizes that only positive eigenvalues enter this square-root step.
Mathispower4u · YouTube · 3:24
This 160-second lecture segment introduces singular values of an m x n matrix A as the square roots of the positive eigenvalues of or AA^T, and states that these two Gram matrices have the same positive eigenvalues. It then works through the example , computes , , and AA^T, and chooses the smaller matrix AA^ for the eigenvalue calculation. The remainder recalls the characteristic equation det(A - lambda I)=0, applies it to AA^T, expands the determinant to lambda^2 - 22 lambda + , factors it as (lambda - 16)(lambda - 6)=0, and obtains eigenvalues 16 and 6. The clip ends before explicitly writing the final square-root step for the singular values. This video demonstrates how to find the singular values of a 2x3 matrix A. It begins by computing the product AA^T, resulting in a 2x2 symmetric matrix. The characteristic equation det(AA^T - lambda I) = 0 is then solved to find the eigenvalues lambda = 16 and lambda = 6. Finally, the singular values are determined by taking the square roots of these positive eigenvalues, yielding sigma_1 = 4 and sigma_2 = sqrt(6). A reminder emphasizes using only positive eigenvalues.
Use the learning inspector for key ideas and moments, or open the reading tabs for the complete notes.
Generated from the video's visuals and explanation; not verbatim speech.
The lesson opens by defining the singular values of an matrix A. The key statement is that these singular values are the square roots of the positive eigenvalues of either or AA^T.
It immediately adds a practical fact: and AA^T have the same positive eigenvalues. That is why the later example can choose whichever product is easier to handle.
The example then takes and asks for its singular values. The first computational step is to form by turning rows into columns, giving .
Next the video computes , noting that this is matrix. It also computes AA^, which is only .
Because the positive eigenvalues of and AA^T agree, the lesson chooses AA^T for the eigenvalue calculation. This reduces the amount of algebra needed.
A new slide recalls the eigenvalue criterion: a scalar λ is an eigenvalue of a square matrix when det(A - λI) = 0, equivalently det(λI - A) = 0. Here the matrix A in that formula is replaced by AA^T.
The characteristic equation is set up as det([[11, 5], [5, 11]] - λ[[1, 0], [0, 1]]) = 0, which becomes det([[11 - λ, 5], [5, 11 - λ]]) = 0.
Evaluating the determinant gives (11 - λ)(11 - λ) - . Expanding yields , and combining constants produces .
The quadratic factors as (λ - 16)(λ - 6) = 0, so the eigenvalues of AA^T are and . By the definition stated at the start, the singular values would be the square roots of these positive eigenvalues, although that final square-root line is not shown before the clip ends.
The segment starts with the conclusion of the eigenvalue calculation for the matrix . The narrator notes that the solutions are and , emphasizing that both are positive. This positivity is crucial because singular values are derived from the square roots of eigenvalues.
The video transitions to the definition of singular values. The formula is presented. The narrator applies this formula to the previously found eigenvalues. For , the first singular value is calculated as .
Next, the second singular value is determined using . The calculation yields . A visual reminder appears on screen stating 'Only use the positive eigenvalues to find the singular values,' reinforcing the mathematical constraint.
The final result is summarized: the singular values of the original matrix are and . The video concludes with an outro screen displaying the presenter's name and website.
For an matrix A, the singular values are defined as the square roots of the positive eigenvalues of or AA^T. The video emphasizes that only positive eigenvalues enter this square-root step.
The lesson states that and AA^T always have the same positive eigenvalues. This fact allows one to choose the computationally simpler Gram matrix when finding singular values.
To compute , each row of A becomes a column. For , this gives .
The example computes both products: is , while AA^T is . The smaller matrix is then selected for the eigenvalue calculation.
An eigenvalue λ of a square matrix satisfies det(A - λI)=0, equivalently det(λI - A)=0. In this lesson, A is replaced by AA^T.
For AA^, the determinant equation becomes (11-λ)^, which simplifies to and factors as (λ-16)(λ-6)=0. Hence the eigenvalues are 16 and 6.
The singular values of a matrix are defined as the square roots of the positive eigenvalues of the matrix product (or ). Formula: .
To find eigenvalues of a square matrix , solve . For a 2x2 matrix, this results in a quadratic equation which can be factored to find .
When calculating singular values, only positive eigenvalues of should be used. Since is positive semi-definite, its eigenvalues are non-negative. Zero eigenvalues correspond to zero singular values.
Explore conditions, steps and evidence. Supplementary explanations are labeled separately from content shown in the video.
The slide states "Let A be an m x n matrix" and later gives the example matrix .
A
A general m x n matrix; in the worked example, the specific 2 x 3 matrix [[1, -1, 3], [3, 1, 1]].
m x n matrices in general; 2 x 3 matrices in the example
The opening statement reads "Let A be an m x n matrix."
m, n
Dimensions of the matrix A, with m rows and n columns.
Positive integers
The slide uses in the expressions and AA^T.
The narrator says "A transpose times A or A times A transpose."
The transpose of A, obtained by turning rows into columns.
n x m matrix when A is m x n
The definition line says singular values are the square roots of the positive eigenvalues of or AA^T.
positive eigenvalues of or AA^T
Eigenvalues used to compute singular values; only the positive ones are taken for square roots.
Spectrum of the symmetric Gram matrices and AA^T
The recall line defines an eigenvalue as a scalar lambda satisfying det(A - lambda I) = 0 or det(lambda I - A) = 0.
The narrator says "an eigenvalue ... is a scalar lambda such that the determinant ... equals zero."
lambda
Scalar eigenvalue variable in the characteristic equation.
Scalars over the underlying field, here real numbers
The formula uses lambda I inside det(A - lambda I).
I
Identity matrix of the same size as the matrix whose eigenvalues are being computed.
Square identity matrix
The characteristic equations are written using det(A - lambda I) and det(lambda I - A).
det
Determinant operator applied to a square matrix.
Square matrices
The worked example computes AA^.
AA^T
In the example, the 2 x 2 product matrix [[11, 5], [5, 11]] whose eigenvalues are found next.
2 x 2 real symmetric matrix in this example
The final displayed line on the slide is lambda = 16 or lambda = 6.
The narrator concludes "resulting in two eigenvalues where we have lambda equals 16" before the clip ends.
The spoken sentence reaches only lambda = 16 before the clip ends, but the displayed line also shows lambda = 6.
lambda = 16 or lambda = 6
The two eigenvalues obtained from the characteristic polynomial of AA^T in the example.
Real scalars
The matrix A is shown as [[1, -1, 3], [3, 1, 1]].
A
The original 2x3 matrix whose singular values are being determined.
2x3 real matrix
The product AA^T is computed and shown as [[11, 5], [5, 11]].
AA^T
The product of matrix A and its transpose, used to find eigenvalues for singular values.
2x2 real symmetric matrix
The variable lambda is used in the characteristic equation det(A - lambda I) = 0.
Eigenvalue of the matrix AA^T.
Real scalar
Slide text: "The singular values of A are the square roots of the positive eigenvalues of or AA^T."
Narrator repeats the same definition verbatim.
For an m x n matrix A, the singular values are defined as the square roots of the positive eigenvalues of either or AA^T. The video presents these two Gram matrices as interchangeable sources for the same positive eigenvalues.
A is an m x n matrix.
Only positive eigenvalues are used in the square-root step.
Slide text: " and AA^T have the same positive eigenvalues."
Narrator says they "will always have the same positive eigenvalues."
The video states the fact but does not prove it within this clip.
The lesson states that and AA^T share the same positive eigenvalues, so one may choose whichever product is computationally easier when finding singular values.
A is an m x n matrix.
The claim is about positive eigenvalues only.
Narrator explains that the first row of A becomes the first column of and the second row becomes the second column.
Example shows and .
To form , rewrite each row of A as a column. In the example, the row (1, -1, 3) becomes the first column and the row (3, 1, 1) becomes the second column.
Applies to any rectangular matrix.
Narrator notes that AA^T is a 2 x 2 matrix and therefore chooses it for the eigenvalue computation.
Slide text: "Let's find the eigenvalues of AA^T since AA^T is a 2 by 2 matrix."
After computing both and AA^T, the video selects AA^T because it is 2 x 2 rather than 3 x 3. This reduces the size of the characteristic polynomial that must be solved.
Useful when one of m,n is smaller than the other.
Relies on the stated equality of positive eigenvalues.
Slide text: "Recall: An eigenvalue of A is a scalar lambda s.t. det(A - lambda I) = 0 or det(lambda I - A) = 0."
Narrator reads the same recall statement.
An eigenvalue of a square matrix A is a scalar lambda for which the determinant of A - lambda I vanishes. The video also gives the equivalent form det(lambda I - A)=0.
A must be square.
I is the identity matrix of the same size as A.
The text 'The singular values are A are: sigma_i = sqrt(lambda_i)' is displayed.
Narrator states: 'The singular values of A are sigma sub i equal to the square root of lambda sub i'.
The singular values of a matrix A are defined as the square roots of the positive eigenvalues of the matrix product AA^T (or A^TA). In this context, sigma_i = sqrt(lambda_i), where lambda_i are the eigenvalues of AA^T.
lambda_i must be non-negative
lambda_i are eigenvalues of AA^T
Text reads: 'Recall: An eigenvalue of A is a scalar lambda s.t. det(A - lambda I) = 0 or det(lambda I - A) = 0.'
Step-by-step derivation shows det([[11, 5], [5, 11]] - lambda[[1, 0], [0, 1]]) = 0 leading to (11-lambda)(11-lambda) - (5)(5) = 0.
To find the eigenvalues of a square matrix M, one solves the characteristic equation det(M - lambda I) = 0. For the 2x2 matrix AA^T, this expands to a quadratic polynomial in lambda.
M is a square matrix
I is the identity matrix of same dimension
The calculation [[1, -1, 3], [3, 1, 1]] * [[1, 3], [-1, 1], [3, 1]] = [[11, 5], [5, 11]] is shown.
The matrix product AA^T is calculated by multiplying the rows of A by the columns of (which are the rows of A). This results in a symmetric 2x2 matrix.
A is a real matrix
Displayed bullet: " and AA^T have the same positive eigenvalues."
Narrator states the same fact.
No proof is provided in this clip.
For an m x n matrix A, the matrices and AA^T have the same positive eigenvalues.
A is an m x n matrix.
For all matrices A of size m x n, the positive parts of the spectra of and AA^T coincide.
Recall line on slide gives det(A - lambda I)=0 or det(lambda I - A)=0.
Narrator reads the same characterization.
A scalar lambda is an eigenvalue of a square matrix A exactly when det(A - lambda I)=0, equivalently det(lambda I - A)=0.
A is square.
I is the identity matrix of the same size as A.
For every square matrix A and scalar lambda, lambda is an eigenvalue if and only if the displayed determinant condition holds.
Narrator says: 'Notice both are positive eigenvalues, and therefore we use these values to determine the singular values...'
Screen shows lambda = 16 or lambda = 6.
For the given matrix A, the eigenvalues of AA^T are 16 and 6, which are both positive.
Existential (for this specific A)
A reminder box appears stating: 'Reminder: Only use the positive eigenvalues to find the singular values.'
Only positive eigenvalues of AA^T are used to calculate the singular values of A.
Universal (implied rule)
The slide successively displays , then , then AA^.
Narrator explains the transpose rule and comments on the resulting matrix sizes.
Start from the given 2 x 3 example matrix.
Given in the problem statement.
Convert each row of A into a column of .
Definition of matrix transpose.
Multiply by A to obtain the 3 x 3 Gram matrix.
Matrix multiplication.
Multiply A by to obtain the 2 x 2 Gram matrix.
Matrix multiplication.
For the example, is 3 x 3 and AA^T is 2 x 2, so the smaller matrix AA^T is selected for the eigenvalue step.
The slide shows det([[11,5],[5,11]] - lambda[[1,0],[0,1]]) = 0, then simplifies to (11-lambda)(11-lambda)-(5)(5)=0, then to lambda^2-22lambda+, then to (lambda-16)(lambda-6)=0, and finally lambda=16 or lambda=6.
Narrator verbally follows the same algebraic sequence.
Set up the characteristic equation for the 2 x 2 matrix AA^T.
Eigenvalue definition via det(A - lambda I)=0.
Subtract lambda I entrywise from AA^T.
Scalar multiplication and matrix subtraction.
Evaluate the 2 x 2 determinant.
Determinant formula for a 2 x 2 matrix.
Expand the square and simplify the constant term.
Algebraic expansion.
Combine like terms to get the quadratic characteristic polynomial.
Arithmetic simplification.
Factor the quadratic.
Factoring a monic quadratic with roots summing to 22 and product 96.
Read off the two eigenvalues from the factored equation.
Zero-product property.
The eigenvalues of AA^T in the example are 16 and 6.
Visual steps show expansion of determinant: (11-lambda)(11-lambda) - -> 121 - 22lambda + lambda^ -> lambda^2 - 22lambda + -> (lambda-16)(lambda-6) = 0.
Set up the characteristic equation for the matrix AA^T.
Definition of eigenvalues via determinant.
Compute the determinant of the resulting 2x2 matrix.
Formula for 2x2 determinant ad-bc.
Expand the terms.
Algebraic expansion.
Combine constant terms ().
Arithmetic simplification.
Factor the quadratic equation.
Factoring technique finding roots 16 and 6.
Solve for lambda.
Zero product property.
The eigenvalues of AA^T are 16 and 6.
Screen shows sigma_1 = sqrt(16) = 4 and sigma_2 = sqrt(6).
Apply the definition relating singular values to eigenvalues.
Definition of singular values.
Substitute the first eigenvalue lambda_1 = 16.
Given eigenvalue value.
Substitute the second eigenvalue lambda_2 = 6.
Given eigenvalue value.
The singular values of A are 4 and sqrt(6).
The slide introduces Example with and asks to find the singular values of A.
Narrator says "Let's take a look at an example" and proceeds through transpose, products, and eigenvalues.
The clip ends after finding eigenvalues 16 and 6; it does not display the final square-root step explicitly.
Let . Find the singular values of A.
A is the 2 x 3 matrix [[1, -1, 3], [3, 1, 1]].
Singular values are square roots of positive eigenvalues of or AA^T.
and AA^T have the same positive eigenvalues.
Reduce the problem to finding eigenvalues of the smaller Gram matrix and compute those eigenvalues.
Transpose A by converting rows to columns.
Definition of transpose.
Compute the 3 x 3 product .
Matrix multiplication.
Compute the 2 x 2 product AA^T.
Matrix multiplication.
Select the smaller Gram matrix for the eigenvalue calculation.
Stated strategy in the video, based on equal positive eigenvalues.
Write the characteristic equation for AA^T.
Eigenvalue definition.
Evaluate the 2 x 2 determinant.
2 x 2 determinant formula.
Expand and simplify to a quadratic.
Algebra.
Factor the quadratic.
Factoring.
Obtain the two eigenvalues of AA^T.
Zero-product property.
The example reaches eigenvalues 16 and 6 of AA^T. By the definition stated earlier, the singular values would be their positive square roots, but that final square-root line is not shown within this clip.
Substitute lambda=16 and lambda=6 into lambda^2-22lambda+; both give 0, confirming they are roots of the characteristic polynomial.
Full problem setup and solution displayed on slides.
Determine the singular values of the matrix .
Find sigma_1 and sigma_2.
Calculate the product of A and its transpose.
Matrix multiplication rules.
Form and simplify the characteristic equation.
Eigenvalue definition.
Solve the quadratic equation for eigenvalues.
Factoring.
Take the square root of each positive eigenvalue.
Singular value definition.
The singular values are sigma_1 = 4 and sigma_2 = sqrt(6).
Both eigenvalues were positive, satisfying the condition for real singular values.
The screen changes from the first slide containing the definition and example setup to a new slide titled around finding eigenvalues of AA^T.
First slide with definition and example matrices
Second slide with eigenvalue recall and characteristic equation
Content shifts from computing , , and AA^T to recalling the eigenvalue definition and solving det(AA^T - lambda I)=0.
The topic remains singular values of the same example matrix A.
The chosen matrix for eigenvalues remains AA^T.
The visual transition marks the move from constructing the Gram matrices to solving the eigenvalue problem for the smaller one.
A yellow cursor/highlight moves across formulas as the narrator reads them, including the definition lines, matrix products, and the determinant expansion.
Yellow cursor/highlight
Displayed formulas and matrices
The highlight moves from the definition bullets to the example matrix, then to , , AA^T, and finally the characteristic equation steps.
The underlying slide content stays static except for newly revealed lines.
The moving highlight synchronizes spoken explanation with the exact formula being discussed, helping identify which matrix or algebraic step is active.
The slide content changes from the eigenvalue calculation to the singular value definition and final results.
Previous slide with determinant calculations
New slide with sigma formulas
Content replacement
Title bar 'Singular Values of a Matrix'
Marks the shift from finding intermediate eigenvalues to computing the final singular values.
A grey box with text 'Reminder: Only use the positive eigenvalues...' fades in on the right side.
Grey reminder box
Box appears
Main calculation area
Highlights a crucial constraint in the definition of singular values.
The definition explicitly says "square roots of the positive eigenvalues".
Narrator repeats "positive eigenvalues" twice.
One might think any eigenvalue of or AA^T can be square-rooted to get singular values.
The video specifically restricts the definition to positive eigenvalues.
Bullet states " and AA^T have the same positive eigenvalues."
One might assume and AA^T produce unrelated eigenvalue lists.
The lesson states that their positive eigenvalues are the same, so either product may be used for singular values.
Narrator chooses AA^T because it is 2 x 2 instead of 3 x 3.
Slide text: "Let's find the eigenvalues of AA^T since AA^T is a 2 by 2 matrix."
One might think the standard route is always to use regardless of size.
The video demonstrates choosing the smaller Gram matrix to simplify the eigenvalue computation.
Text explicitly warns: 'Only use the positive eigenvalues to find the singular values.'
Students might attempt to take the square root of negative eigenvalues when calculating singular values.
Singular values are defined as the square roots of the *positive* eigenvalues of AA^T (or A^TA). Since AA^T is positive semi-definite, its eigenvalues are non-negative, but zero eigenvalues yield zero singular values, and negative ones (if arising from numerical error or wrong matrix) are not used for real singular values.
Definition line introduces singular values via eigenvalues of or AA^T.
The equality of positive eigenvalues justifies choosing either or AA^T in the definition.
Narrator applies the transpose rule directly in the worked example.
The example begins by computing using the transpose method.
Both and AA^T are displayed before the slide states to use AA^T because it is 2 x 2.
Choosing the smaller Gram matrix is valid because the two products have the same positive eigenvalues.
The recall line is immediately followed by det(AA^T - lambda I)=0 and its simplification.
The characteristic-equation derivation uses the recalled definition of eigenvalues.
The example matrix AA^ is substituted into the eigenvalue equation.
The worked example is carried out by applying the eigenvalue derivation to AA^T.
Formula sigma_i = sqrt(lambda_i) links the two concepts directly.
Finding the eigenvalues of AA^T is a necessary prerequisite step before calculating the singular values of A.
The calculation of AA^T precedes the determinant setup.
Computing the matrix product AA^T is required to form the matrix for which eigenvalues are calculated.
Opening definition slide.
Narrator explains choosing AA^T because it is 2 x 2.
Characteristic equation and factorization are shown step by step.
Narrator states rows become columns.
The clip ends at lambda = 16 or lambda = 6 without showing the square-root conclusion.
Final numeric singular values are not explicitly displayed in this clip.
Narrator explains the process of taking square roots of eigenvalues.
Reminder box about positive eigenvalues.
Step-by-step algebraic expansion shown.
Covered · Opening definition of singular values and the statement that and AA^T share positive eigenvalues.
Covered · Example introduction, computation of , and formation of .
Covered · Computation of AA^T and explicit choice to use the smaller 2 x 2 matrix.
Covered · Recall of eigenvalue definition via determinant equations.
Covered · Full characteristic-equation setup, expansion, factorization, and conclusion lambda = 16 or lambda = 6.
Covered · Calculation of AA^T and solving for eigenvalues.
Covered · Definition of singular values and final calculation.
Covered · Outro screen with presenter information and website link; no mathematical content.
Reviewed subject paths