Matrices and Determinants

TL;DR

Matrices are rectangular grids of numbers you can use to organize and manipulate data, often for solving systems of equations. Determinants are special numbers calculated from square matrices that tell you important things, like if a system has a unique solution. Together, they're powerful tools for many real-world problems in science and engineering.

1. The Mental Model

Think of a matrix as a spreadsheet or a table. Each number has a specific spot. Determinants are like a special "score" for certain types of these tables, revealing hidden properties.

2. The Core Material

You'll use matrices to represent systems of linear equations, transformations (like rotating an image), and to store data efficiently. A matrix is just an array of numbers, called elements, arranged in rows and columns. An m x n matrix has m rows and n columns.

Types of Matrices

Photo by İlgar Yusifzade on Pexels

• Row Matrix: Has only one row (e.g., [1 2 3]).
• Column Matrix: Has only one column (e.g., [1; 2; 3]).
• Square Matrix: Has the same number of rows and columns (e.g., 2x2, 3x3).
• Zero Matrix: All elements are zero.
• Identity Matrix (I): A square matrix with ones on the main diagonal and zeros elsewhere. It acts like the number '1' in multiplication.

Matrix Operations

Photo by Markus Spiske on Pexels

Addition and Subtraction

You can only add or subtract matrices if they have the exact same dimensions. You just add or subtract corresponding elements.

A + B = C where C_ij = A_ij + B_ij

Scalar Multiplication

To multiply a matrix by a scalar (a single number), you multiply every element in the matrix by that scalar.

k * A = B where B_ij = k * A_ij

Matrix Multiplication

This is where it gets a bit trickier, but it's super important. You can multiply matrix A (m x n) by matrix B (p x q) only if n = p (the number of columns in A equals the number of rows in B). The resulting matrix C will have dimensions m x q.

To find an element C_ij in the product matrix, you take the i-th row of A and the j-th column of B, multiply corresponding elements, and sum them up.

C_ij = Sum(A_ik * B_kj) for k from 1 to n.

Transpose of a Matrix (A^T)

You get the transpose by swapping the rows and columns. The element at (i, j) in A becomes the element at (j, i) in A^T.

Determinants

A determinant is a scalar value associated with a square matrix. It gives you a lot of information, especially about invertibility (if you can "undo" the matrix operation) and solving systems of linear equations.

Determinant of a 2x2 Matrix

For A = [[a, b], [c, d]], the determinant det(A) or |A| is ad - bc.

Determinant of a 3x3 Matrix (Sarrus' Rule or Cofactor Expansion)

For a 3x3 matrix, you can use Sarrus' rule (only for 3x3!) or the more general cofactor expansion.

Cofactor Expansion (general method for any size square matrix):
Choose any row or column. For each element a_ij in that row/column:
1. Find its minor (M_ij): the determinant of the submatrix left after deleting the i-th row and j-th column.
2. Find its cofactor (C_ij): (-1)^(i+j) * M_ij.
3. The determinant is the sum of a_ij * C_ij for all elements in your chosen row/column.

graph TD
    A["Matrix Operations"] --> B["Addition/Subtraction"]
    A --> C["Scalar Multiplication"]
    A --> D["Matrix Multiplication"]
    A --> E["Transpose"]
    B --> F["Same Dimensions Required"]
    C --> G["Multiply every element"]
    D --> H["(m x n) * (n x q) = (m x q)"]
    D --> I["Row-Column Dot Product"]
    E --> J["Swap Rows & Columns"]

    K["Determinants"] --> L["Only for Square Matrices"]
    L --> M["2x2 Matrix"]
    M --> N["ad - bc"]
    L --> O["3x3 and Larger"]
    O --> P["Cofactor Expansion"]
    P --> Q["Minor (det of submatrix)"]
    P --> R["Cofactor ((-1)^(i+j) * Minor)"]
    P --> S["Sum of (element * Cofactor)"]

Inverse of a Matrix (A^-1)

Photo by Markus Spiske on Pexels

If A is a square matrix and det(A) is not zero, then A has an inverse A^-1 such that A * A^-1 = I (the identity matrix).

For a 2x2 matrix A = [[a, b], [c, d]]:
A^-1 = (1 / det(A)) * [[d, -b], [-c, a]]

For larger matrices, you generally use the formula:
A^-1 = (1 / det(A)) * adj(A)
where adj(A) is the adjoint matrix, which is the transpose of the cofactor matrix.

Applications: Solving Systems of Linear Equations

Photo by Monstera Production on Pexels

You can represent a system of linear equations like:
ax + by = e
cx + dy = f
as a matrix equation AX = B, where:
A = [[a, b], [c, d]] (coefficient matrix)
X = [[x], [y]] (variable matrix)
B = [[e], [f]] (constant matrix)

If det(A) is not zero, you can find X by X = A^-1 * B. This is super useful!

3. Worked Example

Let's solve the system of equations using matrices:
2x + 3y = 7
x - y = 1

1. Write in matrix form AX = B:
   A = [[2, 3], [1, -1]]
X = [[x], [y]]
B = [[7], [1]]

2. Calculate the determinant of A:
   det(A) = (2 * -1) - (3 * 1) = -2 - 3 = -5.
   Since det(A) is not zero, an inverse exists.

3. Find the inverse of A (A^-1):
   A^-1 = (1 / det(A)) * [[-1, -3], [-1, 2]]
A^-1 = (-1/5) * [[-1, -3], [-1, 2]]
A^-1 = [[1/5, 3/5], [1/5, -2/5]]

4. Calculate X = A^-1 * B:
   X = [[1/5, 3/5], [1/5, -2/5]] * [[7], [1]]

   x = (1/5 * 7) + (3/5 * 1) = 7/5 + 3/5 = 10/5 = 2
y = (1/5 * 7) + (-2/5 * 1) = 7/5 - 2/5 = 5/5 = 1

   So, X = [[2], [1]].

5. The solution is x = 2, y = 1. You can check this by plugging these values back into the original equations.

4. Key Takeaways

• Matrices are structured collections of numbers, often used to represent linear relationships or data.
• You can add/subtract matrices only if they have the same dimensions, operating element by element.
• Matrix multiplication requires specific dimension matching (m x n times n x q) and involves row-column dot products.
• The determinant is a scalar value for square matrices, indicating properties like invertibility.
• A non-zero determinant means a unique solution exists for a system of linear equations represented by the matrix.
• The inverse of a matrix A^-1 "undoes" the effect of A, similar to division for numbers.
• You can solve systems of linear equations using X = A^-1 * B if the coefficient matrix A is invertible.

Common mistakes to avoid:
- Trying to add or subtract matrices with different dimensions.
- Multiplying matrices in the wrong order; AB is generally not BA.
- Assuming a determinant exists for a non-square matrix.
- Incorrectly calculating cofactors, especially getting the (-1)^(i+j) sign wrong.
- Forgetting that det(A) = 0 means the matrix isn't invertible, and AX=B might have no unique solution.

5. Now Try It

Consider the matrix A = [[4, 2], [1, 3]] and B = [[-1, 5], [0, 2]].
1. Calculate A + B.
2. Calculate 2A.
3. Calculate A * B.
4. Find the determinant of A.
5. Find the inverse of A.

Success looks like:
You'll get:
1. [[3, 7], [1, 5]]
2. [[8, 4], [2, 6]]
3. [[-4, 24], [-1, 11]]
4. det(A) = 10
5. A^-1 = [[0.3, -0.2], [-0.1, 0.4]]