The Hurst exponent, H, is defined in terms of the asymptotic behaviour of the rescaled range as a function of the time span of a time series as follows;67
E [ R ( n ) S ( n ) ] = C n H as n → ∞ , {\displaystyle \mathbb {E} \left[{\frac {R(n)}{S(n)}}\right]=Cn^{H}{\text{ as }}n\to \infty \,,} where
For self-similar time series, H is directly related to fractal dimension, D, where 1 < D < 2, such that D = 2 - H. The values of the Hurst exponent vary between 0 and 1, with higher values indicating a smoother trend, less volatility, and less roughness.8
For more general time series or multi-dimensional process, the Hurst exponent and fractal dimension can be chosen independently, as the Hurst exponent represents structure over asymptotically longer periods, while fractal dimension represents structure over asymptotically shorter periods.9
A number of estimators of long-range dependence have been proposed in the literature. The oldest and best-known is the so-called rescaled range (R/S) analysis popularized by Mandelbrot and Wallis1011 and based on previous hydrological findings of Hurst.12 Alternatives include DFA, Periodogram regression,13 aggregated variances,14 local Whittle's estimator,15 wavelet analysis,1617 both in the time domain and frequency domain.
To estimate the Hurst exponent, one must first estimate the dependence of the rescaled range on the time span n of observation.18 A time series of full length N is divided into a number of nonoverlapping shorter time series of length n, where n takes values N, N/2, N/4, ... (in the convenient case that N is a power of 2). The average rescaled range is then calculated for each value of n.
For each such time series of length n {\displaystyle n} , X = X 1 , X 2 , … , X n {\displaystyle X=X_{1},X_{2},\dots ,X_{n}\,} , the rescaled range is calculated as follows:1920
The Hurst exponent is estimated by fitting the power law E [ R ( n ) / S ( n ) ] = C n H {\displaystyle \mathbb {E} [R(n)/S(n)]=Cn^{H}} to the data. This can be done by plotting log [ R ( n ) / S ( n ) ] {\displaystyle \log[R(n)/S(n)]} as a function of log n {\displaystyle \log n} , and fitting a straight line; the slope of the line gives H {\displaystyle H} . A more principled approach would be to fit the power law in a maximum-likelihood fashion.21 Such a graph is called a box plot. However, this approach is known to produce biased estimates of the power-law exponent. For small n {\displaystyle n} there is a significant deviation from the 0.5 slope. Anis and Lloyd22 estimated the theoretical (i.e., for white noise) values of the R/S statistic to be:
E [ R ( n ) / S ( n ) ] = { Γ ( n − 1 2 ) π Γ ( n 2 ) ∑ i = 1 n − 1 n − i i , for n ≤ 340 1 n π 2 ∑ i = 1 n − 1 n − i i , for n > 340 {\displaystyle \mathbb {E} [R(n)/S(n)]={\begin{cases}{\frac {\Gamma ({\frac {n-1}{2}})}{{\sqrt {\pi }}\Gamma ({\frac {n}{2}})}}\sum \limits _{i=1}^{n-1}{\sqrt {\frac {n-i}{i}}},&{\text{for }}n\leq 340\\{\frac {1}{\sqrt {n{\frac {\pi }{2}}}}}\sum \limits _{i=1}^{n-1}{\sqrt {\frac {n-i}{i}}},&{\text{for }}n>340\end{cases}}}
where Γ {\displaystyle \Gamma } is the Euler gamma function. The Anis-Lloyd corrected R/S Hurst exponent is calculated as 0.5 plus the slope of R ( n ) / S ( n ) − E [ R ( n ) / S ( n ) ] {\displaystyle R(n)/S(n)-\mathbb {E} [R(n)/S(n)]} .
No asymptotic distribution theory has been derived for most of the Hurst exponent estimators so far. However, Weron23 used bootstrapping to obtain approximate functional forms for confidence intervals of the two most popular methods, i.e., for the Anis-Lloyd24 corrected R/S analysis:
and for DFA:
Here M = log 2 N {\displaystyle M=\log _{2}N} and N {\displaystyle N} is the series length. In both cases only subseries of length n > 50 {\displaystyle n>50} were considered for estimating the Hurst exponent; subseries of smaller length lead to a high variance of the R/S estimates.
The basic Hurst exponent can be related to the expected size of changes, as a function of the lag between observations, as measured by E(|Xt+τ−Xt|2). For the generalized form of the coefficient, the exponent here is replaced by a more general term, denoted by q.
There are a variety of techniques that exist for estimating H, however assessing the accuracy of the estimation can be a complicated issue. Mathematically, in one technique, the Hurst exponent can be estimated such that:2526 H q = H ( q ) , {\displaystyle H_{q}=H(q),} for a time series g ( t ) , t = 1 , 2 , … {\displaystyle g(t),t=1,2,\dots } may be defined by the scaling properties of its structure functions S q {\displaystyle S_{q}} ( τ {\displaystyle \tau } ): S q = ⟨ | g ( t + τ ) − g ( t ) | q ⟩ t ∼ τ q H ( q ) , {\displaystyle S_{q}=\left\langle \left|g(t+\tau )-g(t)\right|^{q}\right\rangle _{t}\sim \tau ^{qH(q)},} where q > 0 {\displaystyle q>0} , τ {\displaystyle \tau } is the time lag and averaging is over the time window t ≫ τ , {\displaystyle t\gg \tau ,} usually the largest time scale of the system.
Practically, in nature, there is no limit to time, and thus H is non-deterministic as it may only be estimated based on the observed data; e.g., the most dramatic daily move upwards ever seen in a stock market index can always be exceeded during some subsequent day.27
In the above mathematical estimation technique, the function H(q) contains information about averaged generalized volatilities at scale τ {\displaystyle \tau } (only q = 1, 2 are used to define the volatility). In particular, the H1 exponent indicates persistent (H1 > 1⁄2) or antipersistent (H1 < 1⁄2) behavior of the trend.
For the BRW (brown noise, 1 / f 2 {\displaystyle 1/f^{2}} ) one gets H q = 1 2 , {\displaystyle H_{q}={\frac {1}{2}},} and for pink noise ( 1 / f {\displaystyle 1/f} ) H q = 0. {\displaystyle H_{q}=0.}
The Hurst exponent for white noise is dimension dependent,28 and for 1D and 2D it is H q 1 D = − 1 2 , H q 2 D = − 1. {\displaystyle H_{q}^{1D}=-{\frac {1}{2}},\quad H_{q}^{2D}=-1.}
For the popular Lévy stable processes and truncated Lévy processes with parameter α it has been found that
H q = q / α , {\displaystyle H_{q}=q/\alpha ,} for q < α {\displaystyle q<\alpha } , and H q = 1 {\displaystyle H_{q}=1} for q ≥ α {\displaystyle q\geq \alpha } . Multifractal detrended fluctuation analysis29 is one method to estimate H ( q ) {\displaystyle H(q)} from non-stationary time series. When H ( q ) {\displaystyle H(q)} is a non-linear function of q the time series is a multifractal system.
In the above definition two separate requirements are mixed together as if they would be one.30 Here are the two independent requirements: (i) stationarity of the increments, x(t+T) − x(t) = x(T) − x(0) in distribution. This is the condition that yields longtime autocorrelations. (ii) Self-similarity of the stochastic process then yields variance scaling, but is not needed for longtime memory. E.g., both Markov processes (i.e., memory-free processes) and fractional Brownian motion scale at the level of 1-point densities (simple averages), but neither scales at the level of pair correlations or, correspondingly, the 2-point probability density.
An efficient market requires a martingale condition, and unless the variance is linear in the time this produces nonstationary increments, x(t+T) − x(t) ≠ x(T) − x(0). Martingales are Markovian at the level of pair correlations, meaning that pair correlations cannot be used to beat a martingale market. Stationary increments with nonlinear variance, on the other hand, induce the longtime pair memory of fractional Brownian motion that would make the market beatable at the level of pair correlations. Such a market would necessarily be far from "efficient".
An analysis of economic time series by means of the Hurst exponent using rescaled range and Detrended fluctuation analysis is conducted by econophysicist A.F. Bariviera.31 This paper studies the time varying character of Long-range dependency and, thus of informational efficiency.
Hurst exponent has also been applied to the investigation of long-range dependency in DNA,32 and photonic band gap materials.33
Hurst, H.E. (1951). "Long-term storage capacity of reservoirs". Transactions of the American Society of Civil Engineers. 116: 770. doi:10.1061/TACEAT.0006518. /wiki/Doi_(identifier) ↩
Hurst, H.E.; Black, R.P.; Simaika, Y.M. (1965). Long-term storage: an experimental study. London: Constable. ↩
Mandelbrot, B.B.; Wallis, J.R. (1968). "Noah, Joseph, and operational hydrology". Water Resour. Res. 4 (5): 909–918. Bibcode:1968WRR.....4..909M. doi:10.1029/wr004i005p00909. /wiki/Bibcode_(identifier) ↩
Mandelbrot, Benoît B. (2006). "The (Mis)Behavior of Markets". Journal of Statistical Physics. 122 (2): 187. Bibcode:2006JSP...122..373P. doi:10.1007/s10955-005-8004-Z. S2CID 119634845. /wiki/Bibcode_(identifier) ↩
Torsten Kleinow (2002)Testing Continuous Time Models in Financial Markets, Doctoral thesis, Berlin [page needed] http://edoc.hu-berlin.de/dissertationen/kleinow-torsten-2002-07-04/PDF/Kleinow.pdf ↩
Qian, Bo; Rasheed, Khaled (2004). HURST EXPONENT AND FINANCIAL MARKET PREDICTABILITY. IASTED conference on Financial Engineering and Applications (FEA 2004). pp. 203–209. CiteSeerX 10.1.1.137.207. /wiki/CiteSeerX_(identifier) ↩
Feder, Jens (1988). Fractals. New York: Plenum Press. ISBN 978-0-306-42851-7. 978-0-306-42851-7 ↩
Mandelbrot, Benoit B. (1985). "Self-affinity and fractal dimension" (PDF). Physica Scripta. 32 (4): 257–260. Bibcode:1985PhyS...32..257M. doi:10.1088/0031-8949/32/4/001. http://users.math.yale.edu/~bbm3/web_pdfs/112selfAffinity.pdf ↩
Gneiting, Tilmann; Schlather, Martin (2004). "Stochastic Models That Separate Fractal Dimension and the Hurst Effect". SIAM Review. 46 (2): 269–282. arXiv:physics/0109031. Bibcode:2004SIAMR..46..269G. doi:10.1137/s0036144501394387. S2CID 15409721. /wiki/ArXiv_(identifier) ↩
Mandelbrot, Benoit B.; Wallis, James R. (1969-10-01). "Robustness of the rescaled range R/S in the measurement of noncyclic long run statistical dependence". Water Resources Research. 5 (5): 967–988. Bibcode:1969WRR.....5..967M. doi:10.1029/WR005i005p00967. ISSN 1944-7973. /wiki/Bibcode_(identifier) ↩
Geweke, J.; Porter-Hudak, S. (1983). "The Estimation and Application of Long Memory Time Series Models". J. Time Ser. Anal. 4 (4): 221–238. doi:10.1111/j.1467-9892.1983.tb00371.x. /wiki/Doi_(identifier) ↩
J. Beran. Statistics For Long-Memory Processes. Chapman and Hall, 1994. ↩
Robinson, P. M. (1995). "Gaussian semiparametric estimation of long-range dependence". The Annals of Statistics. 23 (5): 1630–1661. doi:10.1214/aos/1176324317. https://doi.org/10.1214%2Faos%2F1176324317 ↩
Simonsen, Ingve; Hansen, Alex; Nes, Olav Magnar (1998-09-01). "Determination of the Hurst exponent by use of wavelet transforms". Physical Review E. 58 (3): 2779–2787. arXiv:cond-mat/9707153. Bibcode:1998PhRvE..58.2779S. doi:10.1103/PhysRevE.58.2779. S2CID 55110202. /wiki/ArXiv_(identifier) ↩
R. H. Riedi. Multifractal processes. In P. Doukhan, G. Oppenheim, and M. S. Taqqu, editors, The- ory And Applications Of Long-Range Dependence, pages 625–716. Birkh¨auser, 2003. ↩
Aaron Clauset; Cosma Rohilla Shalizi; M. E. J. Newman (2009). "Power-law distributions in empirical data". SIAM Review. 51 (4): 661–703. arXiv:0706.1062. Bibcode:2009SIAMR..51..661C. doi:10.1137/070710111. S2CID 9155618. /wiki/ArXiv_(identifier) ↩
Annis, A. A.; Lloyd, E. H. (1976-01-01). "The expected value of the adjusted rescaled Hurst range of independent normal summands". Biometrika. 63 (1): 111–116. doi:10.1093/biomet/63.1.111. ISSN 0006-3444. /wiki/Doi_(identifier) ↩
Weron, Rafał (2002-09-01). "Estimating long-range dependence: finite sample properties and confidence intervals". Physica A: Statistical Mechanics and Its Applications. 312 (1–2): 285–299. arXiv:cond-mat/0103510. Bibcode:2002PhyA..312..285W. doi:10.1016/S0378-4371(02)00961-5. S2CID 3272761. /wiki/ArXiv_(identifier) ↩
Preis, T.; et al. (2009). "Accelerated fluctuation analysis by graphic cards and complex pattern formation in financial markets". New J. Phys. 11 (9): 093024. Bibcode:2009NJPh...11i3024P. doi:10.1088/1367-2630/11/9/093024. http://www.iop.org/EJ/abstract/1367-2630/11/9/093024/ ↩
Gorski, A.Z.; et al. (2002). "Financial multifractality and its subtleties: an example of DAX". Physica. 316 (1): 496–510. arXiv:cond-mat/0205482. Bibcode:2002PhyA..316..496G. doi:10.1016/s0378-4371(02)01021-x. S2CID 16889851. /wiki/ArXiv_(identifier) ↩
Mandelbrot, Benoît B., The (Mis)Behavior of Markets, A Fractal View of Risk, Ruin and Reward (Basic Books, 2004), pp. 186-195 /wiki/Beno%C3%AEt_Mandelbrot ↩
Alex Hansen; Jean Schmittbuhl; G. George Batrouni (2001). "Distinguishing fractional and white noise in one and two dimensions". Phys. Rev. E. 63 (6): 062102. arXiv:cond-mat/0007011. Bibcode:2001PhRvE..63f2102H. doi:10.1103/PhysRevE.63.062102. PMID 11415147. S2CID 13608683. /wiki/ArXiv_(identifier) ↩
J.W. Kantelhardt; S.A. Zschiegner; E. Koscielny-Bunde; S. Havlin; A. Bunde; H.E. Stanley (2002). "Multifractal detrended fluctuation analysis of nonstationary time series". Physica A: Statistical Mechanics and Its Applications. 87 (1): 87–114. arXiv:physics/0202070. Bibcode:2002PhyA..316...87K. doi:10.1016/s0378-4371(02)01383-3. S2CID 18417413. https://www.sciencedirect.com/science/article/pii/S0378437102013833 ↩
Joseph L McCauley, Kevin E Bassler, and Gemunu H. Gunaratne (2008) "Martingales, Detrending Data, and the Efficient Market Hypothesis", Physica, A37, 202, Open access preprint: arXiv:0710.2583 http://www.uh.edu/~jmccaul2/ ↩
Bariviera, A.F. (2011). "The influence of liquidity on informational efficiency: The case of the Thai Stock Market". Physica A: Statistical Mechanics and Its Applications. 390 (23): 4426–4432. Bibcode:2011PhyA..390.4426B. doi:10.1016/j.physa.2011.07.032. S2CID 120377241. /wiki/Bibcode_(identifier) ↩
Roche, Stephan; Bicout, Dominique; Maciá, Enrique; Kats, Efim (2003-11-26). "Long Range Correlations in DNA: Scaling Properties and Charge Transfer Efficiency". Physical Review Letters. 91 (22): 228101. arXiv:cond-mat/0309463. Bibcode:2003PhRvL..91v8101R. doi:10.1103/PhysRevLett.91.228101. PMID 14683275. S2CID 14067237. /wiki/ArXiv_(identifier) ↩
Yu, Sunkyu; Piao, Xianji; Hong, Jiho; Park, Namkyoo (2015-09-16). "Bloch-like waves in random-walk potentials based on supersymmetry". Nature Communications. 6: 8269. arXiv:1501.02591. Bibcode:2015NatCo...6.8269Y. doi:10.1038/ncomms9269. PMC 4595658. PMID 26373616. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4595658 ↩