ml.lab
Python sleeps until you run code

Module 4 · 4 lessons · about 260 minutes

Eigenvectors and eigenvalues

Eigenvectors by picture and by hand, what repeated multiplication does, stability and explosion, symmetric matrices, and the singular value decomposition.

Lessons
0/4
Exercises
0/18
Code
0/4
Checkpoint
Not taken

Already comfortable with this? Take the checkpoint cold. If you pass, move on and come back only for what you missed.

  1. 1Directions that do not turnMost vectors change direction when a matrix acts on them. A few special directions only stretch, shrink or flip. Those eigenvectors, and their stretch factors, predict what a matrix does when you apply it again and again.65 min
  2. 2Powers, stability and explosionApply a matrix again and again and every vector splits into eigen-directions, each multiplied by its own eigenvalue at every step. That one fact explains diagonalization, power iteration, stability, and why recurrent networks struggle to learn from the distant past.80 min
  3. 3Symmetric matrices and PCAA symmetric matrix has real eigenvalues and perpendicular eigenvectors, so it is a pure stretch along perpendicular axes. The covariance matrix of a dataset is symmetric, and its eigenvectors are the directions in which the data varies most, the principal components.50 min
  4. 4Singular values and the SVDEvery matrix, symmetric or not, is a rotation, a stretch along perpendicular axes and another rotation. Those stretches, the singular values, measure how much a matrix can grow a vector, bound gradients through a chain of layers, and give the best low-rank approximation.65 min
  5. Checkpoint12 questions. Pass with 80% to finish the module.

Practice sets for this module

Fresh problems every time. Use them until the mechanics feel automatic.

Practice setEigenvalue reps
3 correct in a row completes the set. A miss starts the count again.

Find the eigenvalues of A=[−3−636]\mathbf{A} = \begin{bmatrix}-3 & -6 \\ 3 & 6\end{bmatrix}. Enter them as a column, largest first.

λ₁, λ₂

One entry per box, top to bottom. 0.25, -2, 3/4 and sqrt(2) all work. Enter moves to the next empty box and checks once all are filled.

Practice setPowers reps
3 correct in a row completes the set. A miss starts the count again.

The matrix A=[11.50−0.5]\mathbf{A} = \begin{bmatrix}1 & 1.5 \\ 0 & -0.5\end{bmatrix} has eigenvectors p1=(−1,1)\mathbf{p}_1 = (-1,\allowbreak 1) with λ1=−12\lambda_1 = -\tfrac{1}{2} and p2=(1,0)\mathbf{p}_2 = (1,\allowbreak 0) with λ2=1\lambda_2 = 1. Use them to compute A9v\mathbf{A}^{9}\mathbf{v} for v=[3−2]\mathbf{v} = \begin{bmatrix}3 \\ -2\end{bmatrix}. Give each entry to 2 decimal places.

A^9 v

One entry per box, top to bottom. 0.25, -2, 3/4 and sqrt(2) all work. Enter moves to the next empty box and checks once all are filled.

Next moduleDerivatives, gradients and Jacobians