Linear Algebra: UNIT I: Vector Spaces

Vector Spaces: Theorems Part 7

Important Theorems for Engineering Maths or Mathematics - Vector Spaces: Theorems Part 7

Vector Spaces

Theorems Part 7


Theorem 18

Let V be a vector space and B = { u1, u2, ... un} be a subset of V. Then B is a basis for V if each v V can be uniquely expressed as a linear combination of vectors of B. (i.e) It can be expressed in the form,

 v = а1u1 + а2u2 +...+ anun, for unique scalars a1, a2, ... an.

Proof:

Assume that B is a basis.

If v V then v L(B)           (`.`L (B) = V)

 v = a1u1 + a2u2+ ….. + anun & ai∈F.

(ie) v is a linear combination of vectors of B.

Suppose that there exists another representation of v,

 v = b1u1 + b2u2+ ….. + bnu bi∈F.

Subtracting the second equation from the first equation of v, we get

  0 = v‒v

 0 = (a1b1) u1 + (a2 b2) u2 + ... + (anbn) un.

Since B is linearly independent, it follows that

 a1b1 = a2−b2 = ….. = anbn = 0

Hence a1 =b1, a2 = b2, ..., an = bn.

  v is uniquely expressible as a linear combination of vectors of B.

Conversely,

Assume each vector v V can be uniquely expresses as a linear combination of B

  v = a1u1 + а2u2 + ... + anun

To prove: B is a Basis

Let α1u12u2 + ... + αnun = 0 also

 0 = 0u1 + 0u2 + ... + 0un

 α1u1 + α2u2 + …. + αnun = 0u1 + 0u2 + ... + 0un

 α1 = α2 = ... αn = 0

{u1, u2,...un} is linearly independent.

 L(B) = V.

Clearly L(B) is a basis of V.

 

Theorem 19

If a vector space V is generated by a finite set S, then some subset of S is a basis for V. Hence V has a finite basis.

Proof:

If S= ϕ (or) S={0}, then V={0} & ϕ is a subset of S that is a basis for V.

Otherwise, S contains a non−zero vector u1.

B={u1} is a linearly independent set.

Continue, if possible, choosing vectors u2, u3,…..uk in S.

such that { u1, u2, u3,…..uk } is linearly independent.

Since S is a finite set we must eventually reach a stage at which B = { u1, u2, ... uk} is a linearly independent subset of S,

but adjoining to B any vector in S not in B produces a linearly dependent set.

We claim that B is a basis for V,

because B is linearly independent by construction.

To prove: L(B) = V.

It is enough to prove that S  span (B).

Let v S. If v B, then clearly v span (B) otherwise if v B then B {v} is linearly dependent.

So v span (B)

 S  span (B).

 

Replacement Theorem


Theorem 20

Let V be a vector space that is generating by a set G containing exactly n vectors, and let L be a linearly independent subset of V containing exactly m vectors. Then m≤n and there exists a subset H of G, containing exactly n−m vectors such that LH generates V.

Proof:

The proof is by mathematical induction on m. The induction begins with m = 0; for in this case L= ϕ and so taking H=G gives the desired result.

Suppose that the theorem is true for some integer m ≥0. We prove that the theorem is true for m+ 1. Let L= { v1, v2, v3 ... vm+1 } be a linearly independent subset of V consisting of of m+1 vectors. {v1, v2, v3... vm} is linearly independent and apply the induction hypothesis to conclude that m≤n there is a subset {u1, u2, u3... un-m} at G such that {v1, v2, v3... vm} {u1, u2, u3... un-m} generates V. There exists scalars a1, a2, a3 ....am, b1, b2, b3 ....bn-m, such that

a1v1 + a2v2 + a3v3 + ... + amvm + b1u1 + b2u2 + ... + bn−mun − m = Vm+1 note that n−m> 0. Hence n >m, (ie) n ≥m +1.

Let H = { u2, u3... un-m }. Then u1 span (L H) and because v1, v2, v3... vm, u1, u2, u3... un-m span (L H)

 { v1, v2, v3... vm, u1, u2, u3... un-m span (L H)

Because { v1, v2, v3, ... vm, u1, u2, u3... un-m } generates V,

 span (L H) = V. Since H is a subset of G that contains (n − m) − 1 = n − (m+1) vectors, the theorem is true for m+1. This completes the induction.

 

Theorem 21

Let V be a vector space having a finite basis, then prove that every basis for V contains the same number of vectors.

Proof:

Suppose that B is a finite basis for V that contains exactly n vectors and let γ be any other basis for V. If γ contains more than n vectors, then we can select a subset S and γ containing exactly n+1 vectors. Since S is linearly independent and B generates V, the replacement theorem implies that n+1≤n a contradiction. Therefore, γ is finite, and the number of m of vectors in γ satisfies m≤n. Reversing at B and γ we obtain n≤m. Hence n = m.

 

Definition:

Finite Dimensional: A vector space is called finite dimensional if it has a basis consisting of a finite number of vectors. The unique number of vectors in each basis for V is called the dimension of V and is denoted by dim (V).

A vector space that is not finite−dimensional is called infinite−dimensional.

Examples:

1. The vector space {0} has dimension zero.

2. The vector space Fn has dimension n.

3. The vector space Mm×n (F) has dimension mn.

4. The vector space Pn(F) has dimension n + 1.

5. Over the field of complex numbers, the vector space of complex numbers has dimension 1. (A basis is { 1 })

6. Over the field of real numbers, the vector space of complex numbers has dimension 2. {A basis is { 1, i } }

 

Theorem 22

Let W be a subspace of a finite dimensional vector space V. Then W is finite dimensional and dim (W) ≤ dim (V). Moreover if dim (W) = dim (V) then V=W.

Proof:

Let dim (V)= n.

If W={0}, then dim (W) = 0, then W is finite dimensional and dim(W) = 0 ≤ n ≤ dim(V) otherwise, W contains a non−zero vector x1. So {x1} is a linearly independent set.

Continue for choosing vectors x1, x2, ... xk in W such that {x1, x2, ... xk} is linearly independent.

Since no linearly independent subset of V can contain more than n vectors, this process must stop at a stage where k≤n and {x1, x2,…xk } is linearly independent but adjoining any other vector from W produces a linearly independent set.

 {x1, x2,…xk } generates W and hence it is a basis for W.

 dim (W) = k ≤ n = dim (V).

 dim (W) ≤ dim (V).

If dim (W) = n, then { x1, x2,..., xn) is a basis of W which is linearly independent subset of V.

 It is also a basis for V.

  V=W

 

Maximal linearly independent subsets

 

Definition

Let S be a subset of a vector space V. A maximal linearly independent subset of S is a subset B of S satisfying both of the following conditions.

(i) B is linearly independent.

(ii) The only linearly independent subset of S that contains B is B itself.

 

Theorem 23

Let V be a vector space and S a subset that generates V. If B is a maximal linearly independent subset of S then B is a basic for V.

Proof:

Let B be a maximal linearly independent subset of S.

Since B is linearly independent it is enough to prove that B generates V.

Claim: S  span (B)

Clearly span (B)  V.

Suppose there exists a v S such that v span (B) then B {v} is linearly independent,

which is contradiction to the maximality of B.

  v ϵ span (B)          ('. Given L(S) = V)

 Hence S  span (B).

L(S)  span (B).

  V  span (B).            (' . ' L(S) = V)

 V=L (B) and B is a basis.

Hence the proof.


Theorem 24

Let S be a linearly independent subset of a vector space V. There exists a maximal linearly independent subset of V that contains S.

Corollary: Every vector space has a basis.

 

Linear Algebra: UNIT I: Vector Spaces : Tag: maths, mathematics : - Vector Spaces: Theorems Part 7


Linear Algebra: UNIT I: Vector Spaces



Under Subject


Linear Algebra

MA25C02 2nd Semester | 2025 Regulation



Related Subjects


English Essentials II

EN25C02 2nd Semester | 2025 Regulation | 2nd Semester 2025 Regulation



Linear Algebra

MA25C02 2nd Semester | 2025 Regulation


Transforms and its Applications

MA25C03 2nd Semester EEE Dept | 2025 Regulation | 2nd Semester 2025 Regulation


Applied Physics (CE) II

PH25C02 2nd Semester Civil, Agri Depts | 2025 Regulation | 2nd Semester 2025 Regulation


Applied Physics (CSIE) II

PH25C03 2nd Semester AIDS, CSE, IT, CSE(CY) Dept | 2025 Regulation | 2nd Semester 2025 Regulation


Applied Physics (EE) II

PH25C04 2nd Semester EEE Dept | 2025 Regulation | 2nd Semester 2025 Regulation


Applied Physics (ME) II

PH25C05 2nd Semester Mechanical Dept | 2025 Regulation | 2nd Semester 2025 Regulation


Applied Chemistry (CE) II

CY25C02 2nd Semester Civil Dept | 2025 Regulation | 2nd Semester 2025 Regulation


Applied Chemistry (ME) II

CY25C03 2nd Semester Mechanical Dept | 2025 Regulation | 2nd Semester 2025 Regulation


Electron Devices

EC25C01 2nd Semester ECE Dept | 2025 Regulation | 2nd Semester 2025 Regulation


Digital Principles and Computer Organization

CS25C06 2nd Semester AIDS, CSE, IT, CSE(CY) Dept | 2025 Regulation | 2nd Semester 2025 Regulation


Basic Electrical and Electronics Engineering

EE25C01 2nd Semester | 2025 Regulation | 2nd Semester 2025 Regulation


Basic Civil and Mechanical Engineering

GE25C01 2nd Semester EEE Dept | 2025 Regulation | 2nd Semester 2025 Regulation


Data Structures using CPlusPlus

CS25C05 2nd Semester ECE Dept | 2025 Regulation | 2nd Semester 2025 Regulation


Engineering Drawing

ME25C01 EEE, Mech, Agri, EEE Depts | 2025 Regulation | 2nd Semester 2025 Regulation


Data Structures and Algorithms

CS25C04 2nd Semester EEE Dept | 2025 Regulation


Circuits and Network Analysis

EC25C02 2nd Semester ECE Dept | 2025 Regulation | 2nd Semester 2025 Regulation


Engineering Mechanics

ME25C02 2nd Semester Mech, Civil, Agri Depts | 2025 Regulation | 2nd Semester 2025 Regulation


Object Oriented Programming (OOPs)

CS25C07 2nd Semester CSE, CSE(CY) Depts | 2025 Regulation | 2nd Semester 2025 Regulation