1.4 The approximation property

Example 1.12, Example 1.19 and Example 1.28 all use the same strategy to compute the value of a supremum of a given set. In particular, to show some number ss is the least upper bound, we always argued by showing any x<sx<s is not an upper bound. This process can be repackaged as the following lemma.

Lemma 1.31 (Approximation property for suprema).

Let AA\subseteq\mathbb{R} and suppose ss\in\mathbb{R} is an upper bound for AA. Then the following are equivalent:

  1. 1

    The supremum supA\sup A exists and s=supAs=\sup A;

  2. 2

    For all33 3 Here ε\varepsilon is epsilon, the fifth letter of the Greek alphabet, which is traditionally used in mathematics to denote a small quantity. ε>0\varepsilon>0 there exists aAa\in A such that sε<ass-\varepsilon<a\leq s.

We refer to property 2 in Lemma 1.31 as the approximation property for suprema. This is an alternative way to express the fact that the supremum is the least upper bound, since it says that for any proposed smaller value (sεs-\varepsilon) we can always find an element of the set (aAa\in A) which is larger than that value – meaning that no smaller value can be an upper bound.

Before giving the proof of the lemma, we illustrate an example of it in action.

Example 1.32.

Consider the set A:={5nn+1:n}A:=\big{\{}\frac{5n}{n+1}:n\in\mathbb{N}\big{\}}. We claim that supA=5\sup A=5.

We shall prove the claim using the approximation property. To do this, given ε>0\varepsilon>0, we need to find some a=5nn+1Aa=\frac{5n}{n+1}\in A satisfying 5ε<a55-\varepsilon<a\leq 5. Before writing out the proof, we carry out some rough work to find such an aa.

Rough work. Since a=5nn+1=55n+1\displaystyle a=\frac{5n}{n+1}=5-\frac{5}{n+1}, we need nn\in\mathbb{N} such that

55n+1>5ε5n+1<εn+1>5ε.5-\frac{5}{n+1}>5-\varepsilon\quad\iff\quad\frac{5}{n+1}<\varepsilon\quad\iff% \quad n+1>\frac{5}{\varepsilon}.

So we could take n>5εn>\frac{5}{\varepsilon}.

With this in hand, we are now ready to write out the details of the proof.

Proof.

Writing 5n=5(n+1)55n=5(n+1)-5, it follows that 5nn+1=55n+15\frac{5n}{n+1}=5-\frac{5}{n+1}\leq 5 for all nn\in\mathbb{N}. Thus, 55 is an upper bound for AA.

We now show 55 satisfies the approximation property from Lemma 1.31. Let ε>0\varepsilon>0 be given. Let NN\in\mathbb{N} satisfy N>5/εN>5/\varepsilon so that 0<1N<ε50<\frac{1}{N}<\frac{\varepsilon}{5}. If we define a:=5NN+1a:=\frac{5N}{N+1}, then aAa\in A and

a=55N+1>55N>5ε.a=5-\frac{5}{N+1}>5-\frac{5}{N}>5-\varepsilon.

Thus, 5ε<a55-\varepsilon<a\leq 5, which verifies the approximation property. By Lemma 1.31, we conclude that supA=5\sup A=5, as claimed. ∎

Exercise 1.33.

Use the approximation property to give an alternative proof that A:={21/n:n}A:=\{2-1/n:n\in\mathbb{N}\} from Example 1.28 has supA=2\sup A=2.

Proof (of Lemma 1.31).

We need to show that both 1 \Rightarrow 2 and 2 \Rightarrow 1.

  • 1 \Rightarrow 2.

    We leave this as an exercise: see Exercise 1.34 below.

  • 2 \Rightarrow 1.

    Suppose property 2 holds. We know by hypothesis that ss\in\mathbb{R} is an upper bound for AA and property 2 implies that AA is nonempty (why?). Thus, by the completeness axiom, supA\sup A exists.

    It remains to verify that s=supAs=\sup A. Since, by hypothesis, ss is an upper bound for AA, all we have to do is show that ss is the least upper bound for AA. In other words, given xx\in\mathbb{R} with x<sx<s, we need to show that xx is not an upper bound for AA. If we set ε:=sx>0\varepsilon:=s-x>0, then by property 2 there exists some aAa\in A such that sε<as-\varepsilon<a. Since sε=s(sx)=xs-\varepsilon=s-(s-x)=x, we have x<ax<a. Thus, xx cannot be an upper bound for AA.

This concludes the proof. ∎

Exercise 1.34.

Complete the proof of Lemma 1.31 by showing 1 \Rightarrow 2.

Exercise 1.35.

Use the approximation property for suprema to show that

sup{12n+53n+2:n}\sup\Big{\{}\frac{12n+5}{3n+2}:n\in\mathbb{N}\Big{\}}

exists and compute its value.

Remark 1.36 (More on quantifiers).

The approximation property in Lemma 1.31 involves multiple quantifiers, which are again underlined for emphasis. Throughout the course (and beyond!), we shall see many different statements involving multiple quantifiers and it is important that you take time to process what exactly each such statement means. In particular, the precise order of the quantifiers is very important. We illustrate this by considering the following two statements:

  1. (I)

    For all students SS there exists a pencil PP such that student SS writes with PP;

  2. (II)

    There exists a pencil PP such that for all students SS, student SS writes with PP.

Statement (I) tells us that each student writes with some pencil. On the other hand, statement (II) describes a rather impractical situation (at least for a class of this size) where all the students write with the same pencil PP.

We note that (I) allows both for the situation where each student has their own individual pencil and for the situation described in (II) where all the students share the same pencil. In particular, (II) \Rightarrow (I) but (I) ⇏\not\Rightarrow (II).

Exercise 1.37.

In addition to (I) and (II) from Remark 1.36, consider the following statements:

  1. (III)

    For all pencils PP there exists a student SS such that student SS writes with PP;

  2. (IV)

    There exists a student SS such that for all pencils PP, student SS writes with PP.

Think about the precise meanings of (III) and (IV) and how they differ from one another and those of statements in (I) and (II). What are the negations of (I), (II), (III) and (IV)?

Exercise 1.38.

In addition to (I) – (IV) from Exercise 1.37, consider the following statements:

  1. (V)

    For all pencils PP and for all student SS, student SS writes with pencil PP;

  2. (VI)

    There exists a student SS and there exists a pencil PP such that student SS writes with PP.

Think about the precise meanings of (V) and (VI) and how they differ from one another and the earlier statements. What are the negations of (V) and (VI)?