The n + 1 {\displaystyle \ n+1\ } Bernstein basis polynomials of degree n {\displaystyle \ n\ } are defined as
where ( n ν ) {\displaystyle \ {\tbinom {n}{\nu }}\ } is a binomial coefficient.
So, for example, b 2 , 5 ( x ) = ( 5 2 ) x 2 ( 1 − x ) 3 = 10 x 2 ( 1 − x ) 3 . {\displaystyle \ b_{2,5}(x)\ =\ {\tbinom {5}{2}}x^{2}(1-x)^{3}\ =\ 10x^{2}(1-x)^{3}~.}
The first few Bernstein basis polynomials for blending 1, 2, 3 or 4 values together are:
The Bernstein basis polynomials of degree n {\displaystyle \ n\ } form a basis for the vector space Π n {\displaystyle \ \Pi _{n}\ } of polynomials of degree at most n , {\displaystyle \ n\ ,} all with real coefficients.
A linear combination of Bernstein basis polynomials
is called a Bernstein polynomial or polynomial in Bernstein form of degree n . {\displaystyle \ n~.} 1 The coefficients β ν {\displaystyle \ \beta _{\nu }\ } are called Bernstein coefficients or Bézier coefficients.
The first few Bernstein basis polynomials from above in monomial form are:
The Bernstein basis polynomials have the following properties:
Let ƒ be a continuous function on the interval [0, 1]. Consider the Bernstein polynomial
It can be shown that
uniformly on the interval [0, 1].4567
Bernstein polynomials thus provide one way to prove the Weierstrass approximation theorem that every real-valued continuous function on a real interval [a, b] can be uniformly approximated by polynomial functions over R {\displaystyle \mathbb {R} } .8
A more general statement for a function with continuous kth derivative is
where additionally
is an eigenvalue of Bn; the corresponding eigenfunction is a polynomial of degree k.
This proof follows Bernstein's original proof of 1912.9 See also Feller (1966) or Koralov & Sinai (2007).1011
We will first give intuition for Bernstein's original proof. A continuous function on a compact interval must be uniformly continuous. Thus, the value of any continuous function can be uniformly approximated by its value on some finite net of points in the interval. This consideration renders the approximation theorem intuitive, given that polynomials should be flexible enough to match (or nearly match) a finite number of pairs ( x , f ( x ) ) {\displaystyle (x,f(x))} . To do so, we might (1) construct a function close to f {\displaystyle f} on a lattice, and then (2) smooth out the function outside the lattice to make a polynomial.
The probabilistic proof below simply provides a constructive method to create a polynomial which is approximately equal to f {\displaystyle f} on such a point lattice, given that "smoothing out" a function is not always trivial. Taking the expectation of a random variable with a simple distribution is a common way to smooth. Here, we take advantage of the fact that Bernstein polynomials look like Binomial expectations. We split the interval into a lattice of n discrete values. Then, to evaluate any f(x), we evaluate f at one of the n lattice points close to x, randomly chosen by the Binomial distribution. The expectation of this approximation technique is polynomial, as it is the expectation of a function of a binomial RV. The proof below illustrates that this achieves a uniform approximation of f. The crux of the proof is to (1) justify replacing an arbitrary point with a binomially chosen lattice point by concentration properties of a Binomial distribution, and (2) justify the inference from x ≈ X {\displaystyle x\approx X} to f ( x ) ≈ f ( X ) {\displaystyle f(x)\approx f(X)} by uniform continuity.
Suppose K is a random variable distributed as the number of successes in n independent Bernoulli trials with probability x of success on each trial; in other words, K has a binomial distribution with parameters n and x. Then we have the expected value E [ K n ] = x {\displaystyle \operatorname {\mathcal {E}} \left[{\frac {K}{n}}\right]=x\ } and
By the weak law of large numbers of probability theory,
for every δ > 0. Moreover, this relation holds uniformly in x, which can be seen from its proof via Chebyshev's inequality, taking into account that the variance of 1⁄n K, equal to 1⁄n x(1−x), is bounded from above by 1⁄(4n) irrespective of x.
Because ƒ, being continuous on a closed bounded interval, must be uniformly continuous on that interval, one infers a statement of the form
uniformly in x for each ϵ > 0 {\displaystyle \epsilon >0} . Taking into account that ƒ is bounded (on the given interval) one finds that
uniformly in x. To justify this statement, we use a common method in probability theory to convert from closeness in probability to closeness in expectation. One splits the expectation of | f ( K n ) − f ( x ) | {\displaystyle \left|f\left({\frac {K}{n}}\right)-f\left(x\right)\right|} into two parts split based on whether or not | f ( K n ) − f ( x ) | < ϵ {\displaystyle \left|f\left({\frac {K}{n}}\right)-f\left(x\right)\right|<\epsilon } . In the interval where the difference does not exceed ε, the expectation clearly cannot exceed ε. In the other interval, the difference still cannot exceed 2M, where M is an upper bound for |ƒ(x)| (since uniformly continuous functions are bounded). However, by our 'closeness in probability' statement, this interval cannot have probability greater than ε. Thus, this part of the expectation contributes no more than 2M times ε. Then the total expectation is no more than ϵ + 2 M ϵ {\displaystyle \epsilon +2M\epsilon } , which can be made arbitrarily small by choosing small ε.
Finally, one observes that the absolute value of the difference between expectations never exceeds the expectation of the absolute value of the difference, a consequence of Holder's Inequality. Thus, using the above expectation, we see that (uniformly in x)
Noting that our randomness was over K while x is constant, the expectation of f(x) is just equal to f(x). But then we have shown that E x f ( K n ) {\displaystyle \operatorname {{\mathcal {E}}_{x}} f\left({\frac {K}{n}}\right)} converges to f(x). Then we will be done if E x f ( K n ) {\displaystyle \operatorname {{\mathcal {E}}_{x}} f\left({\frac {K}{n}}\right)} is a polynomial in x (the subscript reminding us that x controls the distribution of K). Indeed it is:
In the above proof, recall that convergence in each limit involving f depends on the uniform continuity of f, which implies a rate of convergence dependent on f 's modulus of continuity ω . {\displaystyle \omega .} It also depends on 'M', the absolute bound of the function, although this can be bypassed if one bounds ω {\displaystyle \omega } and the interval size. Thus, the approximation only holds uniformly across x for a fixed f, but one can readily extend the proof to uniformly approximate a set of functions with a set of Bernstein polynomials in the context of equicontinuity.
The probabilistic proof can also be rephrased in an elementary way, using the underlying probabilistic ideas but proceeding by direct verification:1213141516
The following identities can be verified:
In fact, by the binomial theorem
( 1 + t ) n = ∑ k ( n k ) t k , {\displaystyle (1+t)^{n}=\sum _{k}{n \choose k}t^{k},}
and this equation can be applied twice to t d d t {\displaystyle t{\frac {d}{dt}}} . The identities (1), (2), and (3) follow easily using the substitution t = x / ( 1 − x ) {\displaystyle t=x/(1-x)} .
Within these three identities, use the above basis polynomial notation
and let
Thus, by identity (1)
so that
Since f is uniformly continuous, given ε > 0 {\displaystyle \varepsilon >0} , there is a δ > 0 {\displaystyle \delta >0} such that | f ( a ) − f ( b ) | < ε {\displaystyle |f(a)-f(b)|<\varepsilon } whenever | a − b | < δ {\displaystyle |a-b|<\delta } . Moreover, by continuity, M = sup | f | < ∞ {\displaystyle M=\sup |f|<\infty } . But then
The first sum is less than ε. On the other hand, by identity (3) above, and since | x − k / n | ≥ δ {\displaystyle |x-k/n|\geq \delta } , the second sum is bounded by 2 M {\displaystyle 2M} times
It follows that the polynomials fn tend to f uniformly.
Bernstein polynomials can be generalized to k dimensions – the resulting polynomials have the form Bi1(x1) Bi2(x2) ... Bik(xk).17 In the simplest case only products of the unit interval [0,1] are considered; but, using affine transformations of the line, Bernstein polynomials can also be defined for products [a1, b1] × [a2, b2] × ... × [ak, bk]. For a continuous function f on the k-fold product of the unit interval, the proof that f(x1, x2, ... , xk) can be uniformly approximated by
is a straightforward extension of Bernstein's proof in one dimension. 18
Lorentz 1953 - Lorentz, G. G. (1953), Bernstein Polynomials, University of Toronto Press ↩
Mathar, R.J. (2018). "Orthogonal basis function over the unit circle with the minimax property". Appendix B. arXiv:1802.09518 [math.NA]. /wiki/ArXiv_(identifier) ↩
Rababah, Abedallah (2003). "Transformation of Chebyshev-Bernstein polynomial basis". Computational Methods in Applied Mathematics. 3 (4): 608–622. doi:10.2478/cmam-2003-0038. S2CID 120938358. https://doi.org/10.2478%2Fcmam-2003-0038 ↩
Natanson (1964) p. 6 ↩
Feller 1966 - Feller, William (1966), An introduction to probability theory and its applications, Vol, II, John Wiley & Sons, pp. 149–150, 218–222 ↩
Beals 2004 - Beals, Richard (2004), Analysis. An introduction, Cambridge University Press, pp. 95–98, ISBN 0521600472 ↩
Natanson (1964) p. 3 ↩
Bernstein 1912 - Bernstein, S. (1912), "Démonstration du théorème de Weierstrass fondée sur le calcul des probabilités (Proof of the theorem of Weierstrass based on the calculus of probabilities)" (PDF), Comm. Kharkov Math. Soc., 13: 1–2 https://www.mn.uio.no/math/english/people/aca/michaelf/translations/bernstein_english.pdf ↩
Koralov, L.; Sinai, Y. (2007). ""Probabilistic proof of the Weierstrass theorem"". Theory of probability and random processes (2nd ed.). Springer. p. 29. ↩
Lorentz 1953, pp. 5–6 - Lorentz, G. G. (1953), Bernstein Polynomials, University of Toronto Press ↩
Goldberg 1964 - Goldberg, Richard R. (1964), Methods of real analysis, John Wiley & Sons, pp. 263–265 https://archive.org/details/in.ernet.dli.2015.134296/page/n243/mode/2up?q=bernstein ↩
Akhiezer 1956 - Akhiezer, N. I. (1956), Theory of approximation (in Russian), translated by Charles J. Hyman, Frederick Ungar, pp. 30–31 https://archive.org/details/theoryofapproxim00akhi/page/30/mode/2up?q=bernstein ↩
Burkill 1959 - Burkill, J. C. (1959), Lectures On Approximation By Polynomials (PDF), Bombay: Tata Institute of Fundamental Research, pp. 7–8 http://www.math.tifr.res.in/~publ/ln/tifr16.pdf ↩
Hildebrandt, T. H.; Schoenberg, I. J. (1933), "On linear functional operations and the moment problem for a finite interval in one or several dimensions", Annals of Mathematics, 34 (2): 327, doi:10.2307/1968205, JSTOR 1968205 /wiki/Theophil_Henry_Hildebrandt ↩