ml.lab
Python sleeps until you run code

Module 3 · 4 lessons · about 230 minutes

Determinants, inverses and rank

The determinant as area scaling, inverses as undoing, and rank as how many dimensions survive. The ideas behind LoRA and ill-conditioned training.

Lessons
0/4
Exercises
0/16
Code
0/4
Checkpoint
Not taken

Already comfortable with this? Take the checkpoint cold. If you pass, move on and come back only for what you missed.

  1. 1The determinantOne number says how much a transformation scales area and whether it turns the plane over. When that number is zero, the transformation destroys information and nothing can undo it.40 min
  2. 2Computing determinantsThree rules about columns let you compute a determinant of any size. You expand a 3x3 by hand once, see why software uses elimination instead, and learn the product rule that makes determinants useful for chains of transformations.55 min
  3. 3Inverses and systemsThe inverse runs a transformation backwards when that is possible. In practice you solve $\mathbf{A}\mathbf{x} = \mathbf{b}$ by elimination instead of forming the inverse, and nearly singular matrices show why the answer can still be fragile.60 min
  4. 4Rank and low-rank updatesRank counts how many dimensions survive a transformation. It decides when equations can be solved, and it explains why low-rank updates such as LoRA can fine-tune a huge model while training a tiny share of its numbers.75 min
  5. Checkpoint12 questions. Pass with 80% to finish the module.

Practice sets for this module

Fresh problems every time. Use them until the mechanics feel automatic.

Practice setDeterminant reps
3 correct in a row completes the set. A miss starts the count again.

A\mathbf{A} is a 2×22 \times 2 matrix with det⁡A=3\det\mathbf{A} = 3. Find det⁡(A⊤)\det(\mathbf{A}^\top).

det

Type a number: 0.25, -2, 3/4 and sqrt(2) all work. Enter checks.

Practice setInverse reps
3 correct in a row completes the set. A miss starts the count again.

Solve Ax=y\mathbf{A}\mathbf{x} = \mathbf{y} for A=[−2−523]\mathbf{A} = \begin{bmatrix}-2 & -5 \\ 2 & 3\end{bmatrix} and y=[−106]\mathbf{y} = \begin{bmatrix}-10 \\ 6\end{bmatrix}. In words: which input x\mathbf{x} does A\mathbf{A} send to y\mathbf{y}?

x

One entry per box, top to bottom. 0.25, -2, 3/4 and sqrt(2) all work. Enter moves to the next empty box and checks once all are filled.

Next moduleEigenvectors and eigenvalues