The famous Weierstrass approximation theorem states that any continuous real-valued function on a compact interval can be uniformly approximated by a polynomial with an error as small as one likes. This theorem is the first significant result in approximation theory of one real variable and plays a key role in the development of general approximation theory. There are several different ways to prove this important theorem, but in this blog, we present a proof which makes use of convolution. In particular, the convolution with an approximation to the identity is the important case on which this theorem is based.
What is approximation theory? In this most general form, we say that approximation theory is dedicated to the description of elements in a topological space , which can be approximated by elements in a subset of . That is to say, given an elements , we want to approximate by an element of some subset of . The elements of are
nice'' ortractable” and we want to make and as closer as possible. In other words, approximation theory allows to characterize the closure of in .
A special case of approximation theory is the approximation of continuous function, which has significant importance in real analysis and partial differential equations. Continuous functions can be very badly behaved, for instance, they can be nowhere differentiable. One the other hand, functions such as polynomials are always very well behaved, in particular being always differentiable. Fortunately, while most continuous functions are not as well behaved as polynomials, they can always be uniformly approximated by polynomials; this important result is known as the Weierstrass approximation theorem, and is the subject of this paper. We wish to prove the following:
Theorem. (Weierstrass approximation theorem) If is an interval, is a continuous function, and , then there exists a polynomial on such that (i.e., for all ).
Another way of stating the theorem is as follows. Let be the space of continuous functions from to with uniform metric and be the space of all polynomials on ; this is a subspace of , since polynomials are continuous. The Weierstrass approximation theorem asserts that every continuous function is in the closure of :
In particular, every continuous function on is uniform limit of polynomials. Another way of saying this is that the space of polynomials is dense in the space of continuous functions with uniform topology.
The proof is fairly easy to remember in outline, once on has mastery over its ingredients.
- We can composite a linear term and assume that , . Similarly, we can subtract a liner term and assume that .
- If one takes convolution of a continuous function on with an approximation to the identity, then the result is a uniformly good approximation.
- If the approximation to the identity is a polynomial restricted to the domain , then the result convolution is a polynomial.