How to Learn Linear Algebra

Linear algebra is the most useful mathematics most people were taught badly. The standard course opens with row reduction and determinants — bookkeeping a computer does better than you ever will — and postpones the one idea that makes everything else obvious: a matrix is a function that moves space. Plan on about 200 hours for a genuinely solid command of the subject, or roughly 60 focused hours if your only goal is to read machine learning papers without the notation stopping you. The prerequisite that trips adults up is not arithmetic; it is fluency in reading notation as a description of a process.

Why Learn Linear Algebra?

Your Learning Path

Start with vectors as geometry, not as lists

Addition, scaling, dot products, length, and angle in two and three dimensions, drawn every time. The dot product is the one operation worth over-learning early: it measures alignment, and every later idea — projection, orthogonality, correlation, cosine similarity — is that measurement wearing a different name.

Learn a matrix as a transformation before a table of numbers

See what a matrix does to a grid: rotate, stretch, shear, flatten. Then derive matrix multiplication as composing two of those moves, which is the only explanation that makes the row-times-column rule and the non-commutativity feel necessary rather than arbitrary. Most people who find linear algebra meaningless skipped this reframe.

Solve systems, and learn what a solution set looks like

Gaussian elimination, pivots, rank, and the geometry of "no solution," "one solution," and "infinitely many." The real payload here is not the algorithm but the rank-nullity relationship: how much information a transformation destroys, and why that predicts whether your data problem is even solvable.

Take the abstraction step: vector spaces, span, basis, dimension

The chapter everyone tries to skip as "theory" is the chapter that makes the rest cheap. Once a basis is a choice of coordinates rather than a definition to memorize, change of basis, diagonalization, and feature transformations all become the same idea. Expect this to be the slowest week and to feel like it is not paying off yet.

Get orthogonality, projections, and least squares

Orthogonal bases, Gram-Schmidt, the projection of one vector onto a subspace, and the normal equations. This is where linear algebra hands you linear regression as a geometry problem — fitting a line is projecting your data onto the space your model can reach. Statistics stops being a set of formulas at this step.

Learn eigenvalues and eigenvectors as behavior over time

Eigenvectors are the directions a transformation does not rotate, and eigenvalues say how much it stretches them. Frame them as "what happens when you apply this repeatedly" and Markov chains, PageRank, stability, population models, and PCA all become one question asked in six vocabularies.

Reach the singular value decomposition and use it

SVD works on any matrix, decomposes it into rotate-stretch-rotate, and ranks directions by importance. It is the practical engine behind PCA, low-rank approximation, recommender systems, and image compression. If you only fully understand one decomposition, make it this one rather than the eigendecomposition.

Finish with numerical linear algebra and real libraries

Floating-point error, condition number, why nobody inverts a matrix in production, and how NumPy or a GPU actually performs these operations. Hand computation teaches concepts; this step teaches you why a mathematically valid method still returns garbage on real data at real scale.

Common Mistakes to Avoid

Learning matrix multiplication as a procedure instead of composition

For every product AB you compute, say out loud what each matrix does geometrically and in which order the moves happen. Do the 2x2 cases on graph paper with a drawn unit square until "AB means do B, then A" is reflexive. Everything from dimension mismatches to why AB is not BA follows from that one sentence.

Grinding row reduction by hand for weeks

Elimination is worth doing by hand perhaps a dozen times, to see pivots and rank appear. After that, delegate it. Spend the reclaimed hours on the two things a computer cannot do for you: choosing the right representation for a problem, and interpreting what the numbers mean once it finishes.

Skipping the abstract vector-space material as impractical

Do not skip it — instantiate it. Every time you meet a definition (span, basis, null space), write down two concrete examples and one non-example: polynomials of degree at most three, real-valued functions, a plane through the origin. The abstraction becomes usable the moment you can produce your own instances of it.

Treating the determinant as a formula rather than a signed volume

Learn it as the factor by which a transformation scales area or volume, with sign meaning orientation flip. Then "determinant zero means non-invertible" needs no memorization — it means space got flattened and information was destroyed. Compute the 3x3 formula rarely; use the meaning constantly.

Studying entirely on paper and never in code

After each concept, spend twenty minutes in NumPy: build the matrix, apply it to points, plot the result, check your prediction. Doing this exposes gaps paper hides — sign errors, dimension confusion, ill-conditioning — and it builds the muscle you will actually use, since no professional does this arithmetic by hand.

Structured Roadmaps

Follow a guided learning path on Mochivia:

linear algebra →mathematics →machine learning →

Frequently Asked Questions

How much linear algebra do I need for machine learning?

For reading papers and understanding models, you need vectors and norms, matrix multiplication as composition, rank and dimension, projections, eigenvectors, and the singular value decomposition — roughly 60 focused hours. You do not need to hand-compute determinants, invert matrices manually, or prove theorems. If you are implementing numerical methods or writing custom kernels, add conditioning and numerical stability to that list.

Is linear algebra hard?

Linear algebra is computationally easy and conceptually slippery, which is the opposite of what students expect. The arithmetic is mostly multiply-and-add, so nobody fails on mechanics; people stall at the abstraction step, where vectors stop being arrows and become elements of a space defined by rules. Push through that chapter deliberately and the rest of the subject is unusually smooth.

Should I learn linear algebra or calculus first?

Learn linear algebra first if your goal is data, machine learning, graphics, or economics. It needs less prerequisite repair, pays off sooner, and does not depend on calculus for its core ideas. Calculus first makes sense only if a specific curriculum or degree sequence demands it, or you are heading into physics and engineering where the two are taught interleaved anyway.

Do I need calculus before linear algebra?

No. Standard linear algebra requires only comfortable high-school algebra and the willingness to read notation carefully. Calculus becomes relevant later, at the seam where the two meet — gradients, Jacobians, and optimization — but that is a separate step you can take after linear algebra rather than before it.

How long does it take to learn linear algebra?

About 60 hours to be functional for machine learning and data work, and roughly 200 hours for a solid command including decompositions and numerical behavior. At an hour a day that is two months to usefulness and most of a year to depth. The subject rewards short daily sessions more than most, because the abstractions need sleep to consolidate.

Why does linear algebra feel pointless while I am learning it?

Because most courses order it backwards — mechanics first, meaning last. Row reduction and determinant formulas arrive before any problem worth solving, so weeks pass with no visible payoff. Fix it by pulling one application forward early: fit a line to real data with least squares, or compute an eigenvector of a small web graph. The mechanics get their motivation retroactively.

Start learning Linear Algebra today

Mochivia builds your personalized daily learning path.

Get Started Free