LINEAR FUNCTIONAL ANALYSIS W W L CHEN c
W W L Chen, 1983, 2008.
This chapter originates from material used by the author at Imperial College, University of London, between 1981 and 1990. It is available free to all individuals, on the understanding that it is not to be used for financial gain, and may be downloaded and/or photocopied, with or without permission from the author. However, this document may not be kept on any information storage and retrieval system without permission from the author, unless such system is not accessible to any individuals other than its owners.
Chapter 1 INTRODUCTION TO METRIC SPACES
1.1. Introduction We begin by looking at two very familiar examples. Example 1.1.1. Consider a function f : R → R. Suppose that f is continuous at a point a ∈ R. Then given any > 0, there exists δ > 0 such that |f (x) − f (a)| < whenever |x − a| < δ. Example 1.1.2. Consider a function g : R2 → R. Suppose that g converges to a limit L as (x1 , x2 ) 2 approaches a point p (a1 , a2 ) ∈ R . Then given any > 0, there exists δ > 0 such that |g(x1 , x2 ) − L| < 2 whenever 0 < (x1 − a1 ) + (x2 − a2 )2 < δ. Let us now replace all the Greek from these two examples by plain English. In Example 1.1.1, we basically say that f (x) can be made arbitrarily close to f (a) provided that x is close enough to a. In Example 1.1.2, we basically say that g(x1 , x2 ) can be made arbitrarily close to L provided that (x1 , x2 ) is close enough to (a1 , a2 ) while remaining different from (a1 , a2 ). Here what is important is not the algebraic nature of numbers in R or number pairs in R2 , but the fact that distance from one point to another is well defined and has certain properties. We now generalize this concept of distance to an arbitrary set. Definition. Suppose that X is a non-empty set. By a metric or distance function on X, we mean a real valued function ρ : X × X → R which satisfies the following conditions: (MS1) For every x, y ∈ X, we have ρ(x, y) ≥ 0. (MS2) For every x, y ∈ X, we have ρ(x, y) = 0 if and only if x = y. (MS3) For every x, y ∈ X, we have ρ(x, y) = ρ(y, x). (MS4) (TRIANGLE INEQUALITY) For every x, y, z ∈ X, we have ρ(x, z) ≤ ρ(x, y) + ρ(y, z). Definition. By a metric space (X, ρ), we mean a non-empty set X together with a metric ρ. Chapter 1 : Introduction to Metric Spaces
page 1 of 15
c
Linear Functional Analysis
W W L Chen, 1983, 2008
Example 1.1.3. In R, we can define a metric ρ : R × R → R by writing ρ(x, y) = |x − y| for every x, y ∈ R. It is easy to check that (MS1)–(MS4) are all satisfied. This is called the euclidean metric or usual metric on R. Example 1.1.4. In C, we can define a metric ρ : C × C → R by writing ρ(z, w) = |z − w| for every z, w ∈ C. It is easy to check that (MS1)–(MS4) are all satisfied. This is called the euclidean metric or usual metric on C. Example 1.1.5. In R2 , we can define a metric ρ : R2 × R2 → R by writing p ρ(x, y) = (x1 − y1 )2 + (x2 − y2 )2 for every x = (x1 , x2 ) ∈ R2 and y = (y1 , y2 ) ∈ R2 . It is easy to check that (MS1)–(MS3) are satisfied. To check (MS4), simply note that if we interpret the points x, y ∈ R2 as points on the complex plane C, then we have ρ(x, y) = |x − y|, the modulus of the complex number x − y. In this way, (MS4) is simply the Triangle inequality in C. Example 1.1.6. Suppose that r ∈ N. Then in Rr , we can define a metric ρ : Rr × Rr → R by writing p ρ(x, y) = (x1 − y1 )2 + . . . + (xr − yr )2 for every x = (x1 , . . . , xr ) ∈ Rr and y = (y1 , . . . , yr ) ∈ Rr . This metric is called the euclidean metric or usual metric on Rr , and the metric space (Rr , ρ) is called the r-dimensional euclidean space. Let us now look beyond euclidean spaces for a few other simple examples of metric spaces. Example 1.1.7. Suppose that X is a non-empty set. For every x, y ∈ X, write 0 if x = y, ρ(x, y) = 1 if x 6= y. It is easy to check that (MS1)–(MS3) are satisfied. To check (MS4), note that the result is trivial if x = z. On the other hand, if x 6= z, then ρ(x, z) = 1. But then either y 6= x or y 6= z, so that ρ(x, y) + ρ(y, z) ≥ 1. This metric is known as the discrete metric. Example 1.1.8. Suppose that r ∈ N. Consider the set Zr2 of all ordered r-tuples with entries 0 or 1. For every x = (x1 , . . . , xr ) ∈ Zr2 and y = (y1 , . . . , yr ) ∈ Zr2 , write ρ(x, y) = #{i = 1, . . . , r : xi 6= yi }. It is easy to check that (MS1)–(MS3) are satisfied. To check (MS4), note that xi 6= zi implies that xi 6= yi or yi = 6 zi . This metric is known as the Hamming metric, and has applications in coding theory. Example 1.1.9. Consider the set R2 . For every x = (x1 , x2 ) ∈ R2 and y = (y1 , y2 ) ∈ R2 , write ρ1 (x, y) = |x1 − y1 | + |x2 − y2 |
and
ρ2 (x, y) = max{|x1 − y1 |, |x2 − y2 |}.
For ρ1 , it is easy to check that (MS1)–(MS4) are all satisfied. For ρ2 , it is easy to check that (MS1)–(MS3) are satisfied. To check (MS4), note that |x1 − z1 | ≤ |x1 − y1 | + |y1 − z1 | ≤ max{|x1 − y1 |, |x2 − y2 |} + max{|y1 − z1 |, |y2 − z2 |} = ρ2 (x, y) + ρ2 (y, z). A similar argument gives |x2 − z2 | ≤ ρ2 (x, y) + ρ2 (y, z). Hence ρ2 (x, z) = max{|x1 − z1 |, |x2 − z2 |} ≤ ρ2 (x, y) + ρ2 (y, z) Chapter 1 : Introduction to Metric Spaces
page 2 of 15
c
Linear Functional Analysis
W W L Chen, 1983, 2008
as required. Observe also that ρ2 (x, y) ≤ ρ1 (x, y) ≤ 2ρ2 (x, y)
and
ρ(x, y) ≤ ρ1 (x, y) ≤ 2ρ(x, y),
where ρ is the euclidean metric on R2 . Example 1.1.10. Suppose that r ∈ N. Then in Rr , we can define metrics ρ1 and ρ2 in Rr by writing ρ1 (x, y) = |x1 − y1 | + . . . + |xr − yr |
and
ρ2 (x, y) = max{|x1 − y1 |, . . . , |xr − yr |}
for every x = (x1 , . . . , xr ) ∈ Rr and y = (y1 , . . . , yr ) ∈ Rr . Observe also that ρ2 (x, y) ≤ ρ1 (x, y) ≤ rρ2 (x, y)
and
ρ(x, y) ≤ ρ1 (x, y) ≤ rρ(x, y),
where ρ is the euclidean metric on Rr . Example 1.1.11. Suppose that (X1 , d1 ) and (X2 , d2 ) are metric spaces. We can define metrics ρ, ρ1 and ρ2 on the set X1 × X2 by writing, for every x = (x1 , x2 ) ∈ X1 × X2 and y = (y1 , y2 ) ∈ X1 × X2 , ρ(x, y) =
q
d21 (x1 , y1 ) + d22 (x2 , y2 ),
and ρ1 (x, y) = d1 (x1 , y1 ) + d2 (x2 , y2 )
and
ρ2 (x, y) = max{d1 (x1 , y1 ), d2 (x2 , y2 )}.
It can also be checked that ρ2 (x, y) ≤ ρ1 (x, y) ≤ 2ρ2 (x, y)
and
ρ(x, y) ≤ ρ1 (x, y) ≤ 2ρ(x, y).
Example 1.1.12. Suppose that r ∈ N, and that (X1 , d1 ), . . . , (Xr , dr ) are metric spaces. We can define metrics ρ, ρ1 and ρ2 on the set X1 × . . . × Xr by writing, for every x = (x1 , . . . , xr ) ∈ X1 × . . . × Xr and y = (y1 , . . . , yr ) ∈ X1 × . . . × Xr , ρ(x, y) =
q d21 (x1 , y1 ) + . . . + d2r (xr , yr ),
and ρ1 (x, y) = d1 (x1 , y1 ) + . . . + dr (xr , yr )
and
ρ2 (x, y) = max{d1 (x1 , y1 ), . . . , dr (xr , yr )}.
It can also be checked that ρ2 (x, y) ≤ ρ1 (x, y) ≤ rρ2 (x, y)
and
ρ(x, y) ≤ ρ1 (x, y) ≤ rρ(x, y).
We next turn our attention to metric spaces arising from certain types of sequences. Example 1.1.13. Consider the set `∞ of all bounded infinite sequences of complex numbers. For any two such sequences x = (x1 , x2 , x3 , . . .) and y = (y1 , y2 , y3 , . . .), write ρ(x, y) = sup |xi − yi |. i∈N
It is easy to check that (MS1)–(MS3) are satisfied. To check (MS4), note that for every i ∈ N, we have |xi − zi | ≤ |xi − yi | + |yi − zi | ≤ ρ(x, y) + ρ(y, z). The result follows on taking the supremum of the left hand side over N. Chapter 1 : Introduction to Metric Spaces
page 3 of 15
c
Linear Functional Analysis
W W L Chen, 1983, 2008
Example 1.1.14. Consider the set `2 of all infinite sequences x = (x1 , x2 , x3 , . . .) of complex numbers such that the series ∞ X
|xi |2
i=1
is convergent. For any two such sequences x = (x1 , x2 , x3 , . . .) and y = (y1 , y2 , y3 , . . .), write ρ2 (x, y) =
∞ X
!1/2 |xi − yi |
.
2
i=1
To see that the series on the right hand side is convergent, note that |xi − yi |2 ≤ 2(|xi |2 + |yi |2 ) for every i ∈ N, and apply the Comparison test. It is easy to check that (MS1)–(MS3) are satisfied. The proof of (MS4) is omitted here. Example 1.1.15. Suppose that p ∈ N. Consider the set `p of all infinite sequences x = (x1 , x2 , x3 , . . .) of complex numbers such that the series ∞ X
|xi |p
i=1
is convergent. We can define a metric ρp on `p by writing ∞ X
ρp (x, y) =
!1/p |xi − yi |p
i=1
for any two sequences x = (x1 , x2 , x3 , . . .) and y = (y1 , y2 , y3 , . . .) in `p . We omit the details here. Our last set of examples arise from certain types of functions. Example 1.1.16. Consider the set B[a, b] of all bounded complex valued functions defined on an interval [a, b]. For every f, g ∈ B[a, b], write ρ(f, g) = sup |f (t) − g(t)|. t∈[a,b]
It is easy to check that (MS1)–(MS3) are satisfied. To check (MS4), note that for every t ∈ [a, b], we have |f (t) − h(t)| ≤ |f (t) − g(t)| + |g(t) − h(t)| ≤ ρ(f, g) + ρ(g, h). The result follows on taking the supremum of the left hand side over [a, b]. Example 1.1.17. Consider the set C[a, b] of all continuous complex valued functions defined on an interval [a, b]. This is a subset of B[a, b] discussed in Example 1.1.16, and clearly forms a metric space with the metric ρ discussed previously. On the other hand, for every f, g ∈ C[a, b], write ρ1 (f, g) =
Z
b
|f (t) − g(t)| dt,
a
noting that any continuous complex valued function on a closed interval is Riemann integrable over the interval. It is easy to check that (MS1) and (MS3) are satisfied. For (MS2), see Problem 8. To check (MS4), note that for every t ∈ [a, b], we have |f (t) − h(t)| ≤ |f (t) − g(t)| + |g(t) − h(t)|. Chapter 1 : Introduction to Metric Spaces
page 4 of 15
c
Linear Functional Analysis
W W L Chen, 1983, 2008
The result follows on integrating over the interval [a, b]. We can also define a metric ρ2 on C[a, b] by writing ρ2 (f, g) =
!1/2
b
Z
|f (t) − g(t)| dt 2
a
for every f, g ∈ C[a, b]. Indeed, for every p ∈ N, we can define a metric ρp on C[a, b] by writing ρp (f, g) =
!1/p
b
Z
|f (t) − g(t)| dt p
a
for every f, g ∈ C[a, b]. We omit the details here. Example 1.1.18. We can generalize Example 1.1.16 by replacing the real interval by an arbitrary set. More precisely, suppose that X is a given non-empty set. Consider the set B(X) of all bounded complex valued functions defined on the set X. We can define a metric ρ on B(X) by writing ρ(f, g) = sup |f (x) − g(x)|, x∈X
for every f, g ∈ B(X). An interesting special case is when X = N; note that B(N) is essentially `∞ . Example 1.1.19. In fact, we can further generalize Example 1.1.18 by permitting the functions to take values in a metric space. More precisely, suppose that X is a given non-empty set, and that (Y, d) is a metric space. Consider the set B(X, Y ) of all bounded functions with domain X and codomain Y . We can define a metric ρ on B(X, Y ) by writing ρ(f, g) = sup d(f (x), g(x)), x∈X
for every f, g ∈ B(X, Y ). However, to check the details for this last generalization, we need the notion of boundedness in a metric space which we have not yet defined. The subset C(X, Y ) of all bounded continuous functions with domain X and codomain Y also forms a metric space under the same metric. Again, we have not yet defined the notion of continuity in a metric space. Example 1.1.20. Suppose that k ∈ N. Consider the set C k [a, b] of all k-times continuously differentiable complex valued functions defined on an interval [a, b]. We can define a metric ρ on C k [a, b] by writing ρ(f, g) = sup max{|f (t) − g(t)|, |f 0 (t) − g 0 (t)|, . . . , |f (k) (t) − g (k) (t)|}, t∈[a,b]
for every f, g ∈ C k [a, b]. We omit the details here.
1.2. Convergence in a Metric Space Definition. A sequence (xn )n∈N of points in a metric space (X, ρ) is said to converge to x ∈ X, denoted by xn → x as n → ∞ or lim xn = x,
n→∞
if the sequence of non-negative real numbers ρ(xn , x) → 0 as n → ∞; in other words, given any > 0, there exists N such that ρ(xn , x) < whenever n > N . Chapter 1 : Introduction to Metric Spaces
page 5 of 15
c
Linear Functional Analysis
W W L Chen, 1983, 2008
It is not difficult to show that the limit of a sequence, if it exists, is unique. Note also that the definition reduces to our familiar definition of convergence of a real sequence when (X, ρ) is R with the euclidean metric. Example 1.2.1. Consider a non-empty set X together with the discrete metric. Then the only convergent sequences are those which take the same value for all large n. Example 1.2.2. Consider the set C[1, 2] of all continuous complex valued functions defined on the interval [1, 2]. For every n ∈ N and t ∈ [1, 2], write fn (t) = (1 + tn )1/n and f (t) = t. Consider first of all the metric ρ given by ρ(f, g) = sup |f (t) − g(t)|. t∈[1,2]
Note that 0 ≤ fn (t) − f (t) = (1 + tn )1/n − t ≤ (tn + tn )1/n − t = t(21/n − 1) ≤ 2(21/n − 1) for every n ∈ N and t ∈ [1, 2], so that ρ(fn , f ) ≤ 2(21/n − 1) → 0 as n → ∞. Consider next the metric ρp given by ρp (f, g) =
Z
2
|f (t) − g(t)| dt p
1/p
,
1
where p ∈ N is fixed. Since Z
2
|f (t) − g(t)|p dt
1/p
Z ≤
1
2
(ρ(f, g))p dt
1
1/p
= ρ(f, g)
Z
2
dt
1/p
= ρ(f, g),
1
it follows that ρp (fn , f ) ≤ ρ(fn , f ) → 0 as n → ∞. Hence fn → f as n → ∞ under the metric ρ as well as under the metric ρp for any p ∈ N. Finally, consider the discrete metric. Since the sequence (fn )n∈N is non-constant, it follows from Example 1.2.1 that (fn )n∈N does not converge under the discrete metric. Note that this example illustrates the important point that a convergent sequence under one metric may be divergent under a different metric.
1.3. Open Sets and Closed Sets In this section, we fix the metric space (X, ρ) and may sometimes omit reference to the metric ρ. Definition. By an open ball B(a, r) with centre a and radius r in X, we mean a set of the form xxxxx B(a, r) = {x ∈ X : ρ(a, x) < r}, where a ∈ X and r ∈ R with r > 0. Definition. Suppose that E ⊆ X. A point c ∈ E is said to be an interior point of E if there exists > 0 such that B(c, ) ⊆ E. X E c
Chapter 1 : Introduction to Metric Spaces
page 6 of 15
Linear Functional Analysis
c
W W L Chen, 1983, 2008
Definition. A set G ⊆ X is said to be open (in X) if every point of G is an interior point of G. Definition. Suppose that E ⊆ X. (1) A point c ∈ X is said to be an accumulation point of E if, for every > 0, there exists x ∈ E such that 0 < ρ(c, x) < ; in other words, every punctured open ball B(c, ) \ {c} contains a point of E. (2) A point c ∈ E is said to be an isolated point of E if it is not an accumulation point of E. THEOREM 1A. Suppose that (X, ρ) is a metric space. Suppose further that E ⊆ X. Then the following three statements are equivalent: (a) The point c ∈ X is an accumulation point of E. (b) For every > 0, the open ball B(c, ) contains infinitely many points of E. (c) There exists a sequence (xn )n∈N of points in E such that xn 6= c and xn → c as n → ∞. Proof. It is clear that (c)⇒(b)⇒(a). To show that (a)⇒(c), note that since c is an accumulation point of E, it follows that for every n ∈ N, there exists xn ∈ E such that 0 < ρ(xn , c) < 1/n. (c) follows immediately. Definition. A set F ⊆ X is said to be closed (in X) if F contains all its accumulation points. Remark. We sometimes call a point c ∈ X a limit point of E if it is an accumulation point of E or an isolated point of E. Then c ∈ X is a limit point of E if and only if there exists a sequence (xn )n∈N of points in E such that xn → c as n → ∞. It is easily seen that a set F ⊆ X is closed (in X) if and only if F contains all its limit points. Example 1.3.1. In R and R2 with the euclidean metric, an open ball is simply an open interval and an open disc respectively. Example 1.3.2. Every element of an open ball B(a, r) is an interior point of B(a, r), so that an open ball is open. To see this, suppose that c ∈ B(a, r). We shall show that B(c, r − ρ(a, c)) ⊆ B(a, r). Suppose that x ∈ B(c, r − ρ(a, c)). Then ρ(c, x) < r − ρ(a, c). It follows from the Triangle inequality that ρ(a, x) ≤ ρ(a, c) + ρ(c, x) < r, so that x ∈ B(a, r). Example 1.3.3. Every point in a discrete metric space forms an open ball. Clearly B(x, 1) = {x} for every x ∈ X. Consequently, every set in a discrete metric space is open. On the other hand, no set in a discrete metric space has accumulation points, so that every set contains all its accumulation points (by default). Consequently, every set in a discrete metric space is closed. Example 1.3.4. In every metric space X, the sets ∅ and X are both open and closed. The set ∅ has no points, so that every point is an interior point (by default). On the other hand, it has no accumulation points, so that it contains all its accumulation points (by default). The set X contains everything, so contains all open balls, whence every point is an interior point. Clearly it also contains all its accumulation points. Example 1.3.5. A finite set in a metric space cannot have accumulation points. This follows immediately from Theorem 1A. Example 1.3.6. The set N has no accumulation points in R with the euclidean metric. This again follows immediately from Theorem 1A. Example 1.3.7. Consider the metric space R with the euclidean metric. Let E = [0, 1). The set of all accumulation points of E is [0, 1], so E is not closed. The set of all interior points of E is (0, 1), so E is not open. On the other hand, recall that the sets Q and R \ Q are dense in R. It follows that the set of all accumulation points of Q is R itself, while Q has no interior points. Remark. We say that a sequence (xn )n∈N in X is bounded if there exists an open ball B(a, r) such that xn ∈ B(a, r) for every n ∈ N. We also say that a subset E of X is bounded if there exists an open ball B(a, r) such that E ⊆ B(a, r). Chapter 1 : Introduction to Metric Spaces
page 7 of 15
c
Linear Functional Analysis
W W L Chen, 1983, 2008
THEOREM 1B. Suppose that (X, ρ) is a metric space. (a) The union of any collection of open sets in X is open (in X). (b) The intersection of any finite collection of open sets in X is open (in X). Proof. (a) Suppose that G is a collection of open sets in X. Denote by U their union. Suppose that x ∈ U . Then x ∈ G for some G ∈ G. Since G is open, it follows that x is an interior point of G, and so there exists > 0 such that B(x, ) ⊆ G ⊆ U . It follows that x is an interior point of U . (b) Suppose that the open sets are G1 , . . . , Gn . Denote by V their intersection. Suppose that x ∈ V . Then x ∈ Gk for every k = 1, . . . , n. Since Gk is open, it follows that x is an interior point of Gk , and so there exists k > 0 such that B(x, k ) ⊆ Gk . Now let = min{1 , . . . , n } > 0. Then for every k = 1, . . . , n, we have B(x, ) ⊆ B(x, k ) ⊆ Gk , so that B(x, ) ⊆ G1 ∩ . . . ∩ Gn = V . It follows that x is an interior point of V . To obtain the analogous results for closed sets, we prove the following intermediate result. THEOREM 1C. Suppose that (X, ρ) is a metric space. A set F ⊆ X is closed (in X) if and only if its complement F 0 = X \ F is open (in X). Proof. (⇒) Suppose that F is closed. Then F contains all its accumulation points, so that for every x ∈ F 0 , x is not an accumulation point of F . Hence there exists > 0 such that B(x, ) ∩ F = ∅, so that B(x, ) ⊆ F 0 . (⇐) Suppose that x 6∈ F . Then x ∈ F 0 . Since F 0 is open, it follows that there exists > 0 such that B(x, ) ⊆ F 0 , so that B(x, ) ∩ F = ∅. Hence x is not an accumulation point of F . It now follows that F must contain all its accumulation points. The theorem below now follows immediately from Theorems 1B and 1C. THEOREM 1D. Suppose that (X, ρ) is a metric space. (a) The intersection of any collection of closed sets in X is closed (in X). (b) The union of any finite collection of closed sets in X is closed (in X). Proof. Note simply De Morgan’s law, that ! \
F =X\
F ∈F
[
(X \ F )
F ∈F
for any collection F of sets in X. Example 1.3.8. In R with the euclidean metric, the set In = (−1/n, 1/n) is open for every n ∈ N, but the intersection ∞ \
In = {0}
n=1
is not open. Example 1.3.9. In R with the euclidean metric, the set Jn = [0, (n − 1)/n] is closed for every n ∈ N, but the union ∞ [
Jn = [0, 1)
n=1
is not closed. Chapter 1 : Introduction to Metric Spaces
page 8 of 15
c
Linear Functional Analysis
W W L Chen, 1983, 2008
Definition. Suppose that E ⊆ X. (1) By the interior of E, we mean the set E ◦ which contains precisely all the interior points of E. (2) By the closure of E, we mean the set E which contains precisely all the points of E and all the accumulation points of E. THEOREM 1E. Suppose that (X, ρ) is a metric space, and that E ⊆ X. Then the interior E ◦ is open (in X) and the closure E is closed (in X). Proof. Suppose that c ∈ E ◦ . Then there exists > 0 such that B(c, ) ⊆ E. Since B(c, ) is open, every point x ∈ B(c, ) is an interior point of B(c, ) and hence of E. It follows that B(c, ) ⊆ E ◦ , so that c is an interior point of E ◦ . This proves the first assertion. The second assertion follows immediately from (E)0 = (E 0 )◦ . The proof of this last identity is left as an exercise. Definition. Suppose that E ⊆ X. We say that c ∈ X is a boundary point of E if, for every > 0, the open ball B(c, ) contains at least one point of E and one point of E 0 ; in other words, B(c, ) ∩ E 6= ∅ and B(c, ) ∩ E 0 6= ∅. The set of all boundary points of E is denoted by ∂E. Remark. It can be shown that ∂E = E \ E ◦ = E ∩ E 0 . Example 1.3.10. In R with the euclidean metric, let E = (0, 1]. Then E ◦ = (0, 1), E = [0, 1] and ∂E = {0, 1}. Example 1.3.11. In Z with the euclidean metric, let E = B(c, 1). Then E ◦ = E = E, and E has no boundary. Note that E = {c}.
1.4. Limits and Continuity We now generalize our definition of limits of a function to functions whose domain and range lie in arbitrary metric spaces. Definition. Suppose that (X, ρ) and (Y, σ) are metric spaces, and that E ⊆ X. Suppose further that c is an accumulation point of E, and that l ∈ Y . For any function f : E → Y , we say that f (x) → l as x → c, or lim f (x) = l,
x→c
if, given any > 0, there exists δ > 0 such that σ(f (x), l) <
whenever x ∈ E and 0 < ρ(x, c) < δ.
Remarks. (1) It does not matter whether the point c belongs to E or not. (2) Note the special case when X = Y = R with ρ and σ the euclidean metric. Example 1.4.1. This example illustrates the importance of the subset E in the definition. Suppose that X = Y = R with the euclidean metric. Consider the function 0 if x ∈ Q, f (x) = 1 if x ∈ R \ Q. If E = Q, then f (x) → 0 as x → 0. If E = R \ Q, then f (x) → 1 as x → 0. If E = R, then f (x) does not have a limit as x → 0. Chapter 1 : Introduction to Metric Spaces
page 9 of 15
c
Linear Functional Analysis
W W L Chen, 1983, 2008
Example 1.4.2. Let X be a set and ρ the discrete metric. Then for every E ⊆ X, the set E has no accumulation points. Hence there is no theory of limits of functions defined on E or on X. THEOREM 1F. Suppose that (X, ρ) and (Y, σ) are metric spaces, and that E ⊆ X. Suppose further that c is an accumulation point of E, and that l ∈ Y . For any function f : E → Y , we have f (x) → l as x → c if and only if f (xn ) → l as n → ∞ for every sequence (xn )n∈N in E \ {c} such that xn → c as n → ∞. Proof. The proof follows exactly the same lines as that for the corresponding result in real analysis. Suppose first of all that f (x) → l as x → c. Then given any > 0, there exists δ > 0 such that σ(f (x), l) <
whenever x ∈ E and 0 < ρ(x, c) < δ.
Let (xn )n∈N be any sequence in E \ {c} such that xn → c as n → ∞. Then there exists N ∈ R such that 0 < ρ(xn , c) < δ
whenever n > N .
Hence σ(f (xn ), l) <
whenever n > N .
This shows that f (xn ) → l as n → ∞. Suppose next that f (x) 6→ l as x → c. Then there exists > 0 such that for every n ∈ N, there exists xn ∈ E \ {c} such that 0 < ρ(xn , c) <
1 n
and
σ(f (xn ), l) ≥ .
Clearly xn → c as n → ∞. However, it is not difficult to see that f (xn ) 6→ l as n → ∞. We next extend our definition of continuity to the same setting. Definition. Suppose that (X, ρ) and (Y, σ) are metric spaces, and that c ∈ X. A function f : X → Y is said to be continuous at c if, given any > 0, there exists δ > 0 such that σ(f (x), f (c)) <
whenever ρ(x, c) < δ.
(1)
The function f is said to be continuous on X if f is continuous at every c ∈ X. Remarks. (1) Note that (1) is equivalent to f (B(c, δ)) ⊆ B(f (c), ). (2) If c is an accumulation point of X, then f is continuous at c if f (x) → f (c) as x → c. (3) Note that f is continuous at every isolated point of X. Example 1.4.3. Suppose that (X, ρ) is a metric space, and that a ∈ X. Consider the function f : X → R, where R has the euclidean metric, by letting f (x) = ρ(x, a) for every x ∈ X. Then f is continuous on X. To see this, note that |f (x) − f (c)| = |ρ(x, a) − ρ(c, a)| ≤ ρ(x, c) for every x, c ∈ X. Example 1.4.4. Any function defined on a metric space with the discrete metric is continuous on the metric space, since every point in the metric space is an isolated point. THEOREM 1G. (CHAIN RULE) Suppose that (X, ρ), (Y, σ) and (W, τ ) are metric spaces. Suppose further that the function f : X → Y is continuous at the points c ∈ X and the function g : Y → W is continuous at the point d = f (c) ∈ Y . Then the function g ◦ f : X → W is continuous at c. Chapter 1 : Introduction to Metric Spaces
page 10 of 15
c
Linear Functional Analysis
W W L Chen, 1983, 2008
Proof. Since g is continuous at d = f (c), given any > 0, there exists η > 0 such that τ (g(f (x)), g(f (c))) <
whenever σ(f (x), f (c)) < η.
Since f is continuous at c, there exists δ > 0 such that σ(f (x), f (c)) < η
whenever ρ(x, c) < δ.
It follows that τ ((g ◦ f )(x), (g ◦ f )(c)) <
whenever ρ(x, c) < δ.
The result follows immediately. The next result is essentially a simple corollary of Theorem 1F. THEOREM 1H. Suppose that (X, ρ) and (Y, σ) are metric spaces, and that c ∈ X. Then a function f : X → Y is continuous at c if and only if f (xn ) → f (c) as n → ∞ for every sequence (xn )n∈N in X such that xn → c as n → ∞. We conclude this chapter by formulating continuity in terms of open sets and closed sets. Definition. Suppose that (X, ρ) and (Y, σ) are metric spaces. For every set E ⊆ Y and every function f : X → Y , we denote by f −1 (E) the pre-image of E, so that f −1 (E) = {x ∈ X : f (x) ∈ E}. THEOREM 1J. Suppose that (X, ρ) and (Y, σ) are metric spaces. For any function f : X → Y , the following three statements are equivalent: (a) The function f is continuous on X. (b) If G is open in Y , then f −1 (G) is open in X. (c) If F is closed in Y , then f −1 (F ) is closed in X. Proof. ((a)⇒(b)) If f −1 (G) is empty, then it is open. Otherwise, let c ∈ f −1 (G), so that f (c) ∈ G. Since G is open, there exists > 0 such that B(f (c), ) ⊆ G, so that y∈G
whenever σ(y, f (c)) < .
Since f is continuous at c, there exists δ > 0 such that σ(f (x), f (c)) <
whenever ρ(x, c) < δ.
It follows that f (x) ∈ G whenever ρ(x, c) < δ. In other words, we have x ∈ f −1 (G) whenever x ∈ B(c, δ). Hence B(c, δ) ⊆ f −1 (G), so that f −1 (G) is open. ((b)⇒(a)) Let c ∈ X. Given any > 0, the open ball B(f (c), ) is open in Y , so that its pre-image f −1 (B(f (c), )) is open in X. Since c ∈ f −1 (B(f (c), )), it follows that there exists δ > 0 such that B(c, δ) ⊆ f −1 (B(f (c), )). In other words, we have f (x) ∈ B(f (c), )
whenever x ∈ B(c, δ).
σ(f (x), f (c)) <
whenever ρ(x, c) < δ,
It follows that
and so f is continuous at c. Note now that this argument is valid for every c ∈ X. Hence f is continuous on X. Chapter 1 : Introduction to Metric Spaces
page 11 of 15
c
Linear Functional Analysis
W W L Chen, 1983, 2008
((b)⇔(c)) We simply take complements. Given any E ⊆ Y , we have f −1 (E) ∩ f −1 (E 0 ) = ∅
and
f −1 (E) ∪ f −1 (E 0 ) = X.
We now appeal to Theorem 1C.
Chapter 1 : Introduction to Metric Spaces
page 12 of 15
c
Linear Functional Analysis
W W L Chen, 1983, 2008
Problems for Chapter 1 1. Suppose that X is a non-empty set, and that a function ρ : X × X → R satisfies the following two conditions: a) For every x, y ∈ X, we have ρ(x, y) = 0 if and only if x = y. b) For every x, y, z ∈ X, we have ρ(x, y) ≤ ρ(x, z) + ρ(y, z). Prove that ρ is a metric on X. 2. Suppose that (xn )n∈N and (yn )n∈N are two sequences in a metric space (X, ρ) such that xn → x and yn → y as n → ∞. Prove that the real sequence (ρ(xn , yn ))n∈N converges to ρ(x, y) as n → ∞. 3. a) For every x, y ∈ R, let ρ(x, y) = |x2 − y 2 |. Is ρ a metric on R? b) For every x, y ∈ [0, ∞), let ρ(x, y) = |x2 − y 2 |. Is ρ a metric on [0, ∞)? 4. Suppose that (X, ρ) is a metric space. a) Prove that |ρ(x, z) − ρ(y, z)| ≤ ρ(x, y) for every x, y, z ∈ X. b) Prove that |ρ(x, y) − ρ(z, w)| ≤ ρ(x, z) + ρ(y, w) for every x, y, z, w ∈ X. 5. Suppose that X = {z ∈ C : |z| = 1} is the circle of radius 1 on the complex plane and centred at the origin. For any z, w ∈ X, let ρ(z, w) = 0 if z = w, let ρ(z, w) = π if z = −w, and let ρ(z, w) denote the length of the shorter arc joining z and w if z 6= ±w. Prove that ρ is a metric on X. 6. Let C(R) denote the collection of all continuous and bounded complex valued functions defined on the set R. For every f, g ∈ C(R), let Z x+h (f (t) − g(t)) dt . ρ(f, g) = sup x∈R x h∈(0,1]
Prove that ρ is a metric on C. 7. Suppose that (X, ρ) is a metric space. Prove that each of the following functions σ is a metric on the set X: a) For every x, y ∈ X, σ(x, y) = 2ρ(x, y). b) For every x, y ∈ X, σ(x, y) = min{1, ρ(x, y)}. ρ(x, y) . c) For every x, y ∈ X, σ(x, y) = 1 + ρ(x, y) 8. Let C denote the set of all real valued functions continuous on [0, 1]. For every f, g ∈ C, let ρ(f, g) = sup |f (t) − g(t)|, t∈[0,1]
and let σ(f, g) =
1
Z
|f (t) − g(t)|2 dt
1/2
and
τ (f, g) =
0
Z
1
|f (t) − g(t)| dt.
0
a) Suppose that f 6= g. Then there exists t0 ∈ [0, 1] such that f (t0 ) 6= g(t0 ). Show that there exists an interval I ⊆ [0, 1] such that |f (t) − g(t)| ≥ 21 |f (t0 ) − g(t0 )| for every t ∈ I. Hence deduce that σ(f, g) > 0 and τ (f, g) > 0. b) Prove that ρ, σ and τ are metrics on C. [Hint: In the case of σ, you will need Schwarz’s inequality for integrals, that Z
1
φ(t)ψ(t) dt
0 Chapter 1 : Introduction to Metric Spaces
2
Z ≤ 0
1
φ (t) dt 2
Z
1
ψ (t) dt .] 2
0 page 13 of 15
c
Linear Functional Analysis
W W L Chen, 1983, 2008
c) Prove that for every f, g ∈ C, we have ρ(f, g) ≥ σ(f, g) ≥ τ (f, g). d) For every n ∈ N, let fn (t) =
1 − nt 0
if 0 ≤ t ≤ n−1 , if n−1 < t ≤ 1,
and let f (t) = 0 for every t ∈ [0, 1]. (i) Prove that (fn )n∈N converges to f as n → ∞ in (C, σ). (ii) Does (fn )n∈N converge as n → ∞ in (C, τ )? Justify your assertion. (iii) Prove that (fn )n∈N does not converge as n → ∞ in (C, ρ). e) For every n ∈ N, let gn (t) =
n1/2 (1 − nt) 0
if 0 ≤ t ≤ n−1 , if n−1 < t ≤ 1.
(i) Prove that (gn )n∈N converges as n → ∞ in (C, τ ). (ii) Prove that (gn )n∈N does not converge as n → ∞ in (C, σ). (iii) Does (gn )n∈N converge as n → ∞ in (C, ρ)? Justify your assertion. 9. Give an example of a metric space (X, ρ) and two open balls B(a1 , r1 ) and B(a2 , r2 ) in X such that B(a1 , r1 ) ⊆ B(a2 , r2 ) and r1 > r2 . 10. Consider the metric space (X, ρ), where X = [0, 3) ∪ [4, 5] ∪ (6, 7) ∪ {8} and ρ is the euclidean metric in R restricted to X. For each of the following subsets, indicate whether it is open and whether it is closed, and justify your assertions: a) [0, 3) b) [4, 5) c) (6, 7) d) {8} e) [0, 3) ∪ [4, 5) f) [0, 3) ∪ (6, 7) g) (6, 7) ∪ {8} h) [1, 2) i) (1, 2) j) [1, 2] 11. Prove that any rectangle of the form (a, b) × (c, d) is open in the set R2 with the euclidean metric. 12. Prove that in a metric space (X, ρ), a set G ⊆ X is open if and only if it is a union of open balls in (X, ρ). 13. Is it possible for a metric space (X, ρ) to contain more than one point and be such that the only open sets are ∅ and X? Justify your assertion. 14. Prove that in any metric space (X, ρ), a closed ball {x ∈ X : ρ(a, x) ≤ r} is closed. 15. Prove that any non-empty bounded and closed set of real numbers contains its supremum and infimum. 16. Suppose that X is an infinite set. Show that there exists a metric ρ on X such that there is an accumulation point in the metric space (X, ρ) by following the steps below. a) It is obvious that X has a countable subset Z = {z0 , z1 , z2 , z3 , . . .}. Show that the function ρ : X × X → R, defined by for every x, y ∈ X by 0 −1 |m − n−1 | ρ(x, y) = ρ(y, x) = −1 n 1
if x = y, if x = zm and y = zn for some m, n ∈ N, if x = z0 and y = zn for some n ∈ N, otherwise,
forms a metric on X. b) Show that z0 is an accumulation point in the metric space (X, ρ). Chapter 1 : Introduction to Metric Spaces
page 14 of 15
c
Linear Functional Analysis
W W L Chen, 1983, 2008
17. Consider the metric space C with the euclidean metric. For any subset A ⊆ C and every point z ∈ C, let ρ(z, A) = inf |z − a|. a∈A
a) b) c) d)
Prove Is the Prove Prove
that if z ∈ A, then ρ(z, A) = 0. converse of part (a) true? Justify your assertion. that for fixed A, ρ(z, A) is a continuous function of z. that ρ(z, A) = 0 if and only if z ∈ A.
18. Let E be a set in a metric space (X, ρ). a) Prove that E◦ =
[
G
and
E=
\
F;
F ⊇E F closed
G⊆E G open
in other words, E ◦ is the union of all open sets which are contained in E, and E is the intersection of all closed sets containing E. b) Deduce that (E)0 = (E 0 )◦ . 19. Let E be a set in a metric space (X, ρ). Show that the set E ∗ of all accumulation points of E is closed. [Hint: Let c be an accumulation point of E ∗ . Show that c is an accumulation point of E.] 20. a) Let E1 and E2 be sets in a metric space (X, ρ). Prove that E1 ∪ E2 = E1 ∪ E2 . b) Let E be any collection of sets in a metric space (X, ρ). Prove that [ E∈E
E⊇
[
E
\
and
E∈E
E∈E
E⊆
\
E.
E∈E
c) Give an example of an infinite collection E of sets in a metric space (X, ρ) such that [ E∈E
E 6=
[
E.
E∈E
d) Give an example of two sets E1 and E2 in a metric space (X, ρ) such that E1 ∩ E2 6= E1 ∩ E2 . e) Deduce the results for interiors corresponding to parts (a) and (b). [Hint: Use Problem 18(b) and the De Morgan laws.] 21. Suppose that (X, ρ) and (Y, σ) are metric spaces, and that E ⊆ X. Suppose further that c is an accumulation point of E, and that d ∈ Y . a) Prove that if a function f : E → Y is such that f (x) → d as x → c, then d ∈ f (E). b) Suppose in addition that f is injective. Prove that d is an accumulation point of f (E). 22. Suppose that (X, ρ) and (Y, σ) are metric spaces. Prove that a function f : X → Y is continuous at c if and only if, given any open set N ⊆ Y such that f (c) ∈ N , there exists an open set M ⊆ X such that c ∈ M and f (M ) ⊆ N .
Chapter 1 : Introduction to Metric Spaces
page 15 of 15