Unit 1: Advanced Matrix Algebra: Properties and Special Types

1. Review of Matrix Algebra

Matrix algebra involves the study of matrices and their operations. A matrix is a rectangular array of numbers, symbols, or expressions arranged in rows and columns.

1.1 Basic Matrix Operations

• Matrix Addition and Subtraction: Matrices of the same dimensions can be added or subtracted by adding or subtracting their corresponding elements.
• Scalar Multiplication: Multiplying a matrix by a scalar involves multiplying every element of the matrix by that scalar.
• Matrix Multiplication: The product of two matrices A (m × n) and B (n × p) is a matrix C (m × p) where each element c_ij is the sum of the products of elements from the i^th row of A and the j^th column of B. Matrix multiplication is generally not commutative (AB ≠ BA).

2. Special Types of Matrices

2.1 Triangular Matrices

Triangular matrices are a specific type of square matrix where all the elements either above or below the main diagonal are zero.

Definition: A square matrix A = [a_ij] is an upper triangular matrix if a_ij = 0 for all i > j. It is a lower triangular matrix if a_ij = 0 for all i < j.

Theorems and Properties related to Triangular Matrices:

• The determinant of a triangular matrix (upper or lower) is the product of its diagonal elements.
• The inverse of an upper (lower) triangular matrix, if it exists, is also an upper (lower) triangular matrix.
• The product of two upper (lower) triangular matrices is an upper (lower) triangular matrix.

2.2 Symmetric and Skew-Symmetric Matrices

These matrices are defined based on their relationship with their transpose.

Definition: A square matrix A is symmetric if A = A^T (its transpose is equal to itself). A square matrix A is skew-symmetric if A = -A^T (its transpose is equal to its negative).

Theorems and Properties related to Symmetric and Skew-Symmetric Matrices:

• For any square matrix A, the matrix (A + A^T) is symmetric.
• For any square matrix A, the matrix (A - A^T) is skew-symmetric.
• Any square matrix A can be uniquely expressed as the sum of a symmetric and a skew-symmetric matrix: A = (1/2)(A + A^T) + (1/2)(A - A^T).
• All diagonal elements of a skew-symmetric matrix are zero.

2.3 Idempotent Matrices

An idempotent matrix is a matrix which, when multiplied by itself, yields itself.

Definition: A square matrix A is idempotent if A² = A.

Property: If A is an idempotent matrix, then I - A is also idempotent.

2.4 Hermitian and Skew-Hermitian Matrices

These are complex matrix analogues of symmetric and skew-symmetric matrices, using the conjugate transpose.

Definition: A square complex matrix A is Hermitian if A = A^* (where A^* is the conjugate transpose of A). A square complex matrix A is skew-Hermitian if A = -A^*.

Properties:

• The diagonal elements of a Hermitian matrix are always real numbers.
• The diagonal elements of a skew-Hermitian matrix are purely imaginary or zero.

2.5 Orthogonal Matrices

Orthogonal matrices are real matrices whose inverse is equal to their transpose.

Definition: A real square matrix A is orthogonal if A^TA = AA^T = I, where I is the identity matrix. This implies A^-1 = A^T.

Properties:

• The determinant of an orthogonal matrix is either +1 or -1.
• The columns (or rows) of an orthogonal matrix form an orthonormal set of vectors.

2.6 Singular and Non-Singular Matrices

The singularity of a matrix is determined by its determinant and its invertibility.

Definition: A square matrix A is singular if its determinant, det(A), is 0. A square matrix A is non-singular if its determinant, det(A), is non-zero (det(A) ≠ 0).

Properties:

• A square matrix A is invertible if and only if it is non-singular.
• If a matrix is singular, its inverse does not exist.
• If a matrix is non-singular, its inverse exists and is unique.

2.7 Trace of a Matrix

The trace is a specific scalar value derived from a square matrix.

Definition: The trace of a square matrix A = [a_ij], denoted as tr(A), is the sum of the elements on its main diagonal. That is, tr(A) = ∑_i=1ⁿ a_ii.

Properties:

• tr(A + B) = tr(A) + tr(B)
• tr(cA) = c tr(A), where c is a scalar.
• tr(AB) = tr(BA), provided both products are defined.

2.8 Unitary Matrices

Unitary matrices are complex matrices whose inverse is equal to their conjugate transpose, analogous to orthogonal matrices for real numbers.

Definition: A complex square matrix A is unitary if A^*A = AA^* = I, where I is the identity matrix. This implies A^-1 = A^*.

2.9 Involutory Matrices

An involutory matrix is its own inverse.

Definition: A square matrix A is involutory if A² = I, where I is the identity matrix. This implies A = A^-1.

2.10 Nilpotent Matrices

Nilpotent matrices are matrices that become the zero matrix when raised to a certain positive integer power.

Definition: A square matrix A is nilpotent if there exists a positive integer k such that A^k = 0 (the zero matrix). The smallest such positive integer k is called the index of nilpotency.

3. Adjoint and Inverse of a Matrix

3.1 Adjoint of a Matrix

The adjoint of a matrix is crucial for calculating its inverse.

Definition: The adjoint of a square matrix A, denoted as adj(A), is the transpose of the cofactor matrix of A. The cofactor C_ij of an element a_ij is given by C_ij = (-1)^i+j M_ij, where M_ij is the minor of a_ij (determinant of the submatrix obtained by deleting the i^th row and j^th column).

Calculation Steps for adj(A):

1. For each element a_ij in matrix A, find its minor M_ij.
2. Calculate the cofactor C_ij = (-1)^i+j M_ij for all i, j.
3. Form the cofactor matrix, where each element is its corresponding cofactor C_ij.
4. The adjoint matrix, adj(A), is the transpose of this cofactor matrix.

3.2 Inverse of a Matrix

The inverse of a square matrix, if it exists, is a matrix that, when multiplied by the original matrix, yields the identity matrix.

Definition: For a square matrix A, its inverse, denoted A^-1, is a matrix such that AA^-1 = A^-1A = I, where I is the identity matrix. The inverse exists only if A is non-singular.

Formula: If A is a non-singular matrix (det(A) ≠ 0), its inverse is given by A^-1 = (1 / det(A)) * adj(A).

Properties and Related Theorems of the Inverse Matrix:

• The inverse of a square matrix A exists if and only if A is non-singular (i.e., det(A) ≠ 0).
• The inverse of a matrix, if it exists, is unique.
• If A and B are invertible matrices of the same order, then (AB)^-1 = B^-1A^-1.
• If A is an invertible matrix, then (A^T)^-1 = (A^-1)^T.
• If A is an invertible matrix and c is a non-zero scalar, then (cA)^-1 = (1/c)A^-1.
• The determinant of the inverse of a matrix is the reciprocal of the determinant of the original matrix: det(A^-1) = 1 / det(A).
• A(adj(A)) = (adj(A))A = det(A) * I.
• If A is a symmetric matrix and is invertible, then A^-1 is also symmetric.