Consider a discrete-time stochastic process ( y t , t = 1 , 2 , 3 , … ) {\displaystyle (y_{t},t=1,2,3,\ldots )} , and suppose that it can be written as an autoregressive process of order p:
Here, ( ε t , t = 0 , 1 , 2 , … , ) {\displaystyle (\varepsilon _{t},t=0,1,2,\ldots ,)} is a serially uncorrelated, zero-mean stochastic process with constant variance σ 2 {\displaystyle \sigma ^{2}} . For convenience, assume y 0 = 0 {\displaystyle y_{0}=0} . If m = 1 {\displaystyle m=1} is a root of the characteristic equation, of multiplicity 1:
then the stochastic process has a unit root or, alternatively, is integrated of order one, denoted I ( 1 ) {\displaystyle I(1)} . If m = 1 is a root of multiplicity r, then the stochastic process is integrated of order r, denoted I(r).
The first order autoregressive model, y t = a 1 y t − 1 + ε t {\displaystyle y_{t}=a_{1}y_{t-1}+\varepsilon _{t}} , has a unit root when a 1 = 1 {\displaystyle a_{1}=1} . In this example, the characteristic equation is m − a 1 = 0 {\displaystyle m-a_{1}=0} . The root of the equation is m = 1 {\displaystyle m=1} .
If the process has a unit root, then it is a non-stationary time series. That is, the moments of the stochastic process depend on t {\displaystyle t} . To illustrate the effect of a unit root, we can consider the first order case, starting from y0 = 0:
By repeated substitution, we can write y t = y 0 + ∑ j = 1 t ε j {\displaystyle y_{t}=y_{0}+\sum _{j=1}^{t}\varepsilon _{j}} . Then the variance of y t {\displaystyle y_{t}} is given by:
The variance depends on t since Var ( y 1 ) = σ 2 {\displaystyle \operatorname {Var} (y_{1})=\sigma ^{2}} , while Var ( y 2 ) = 2 σ 2 {\displaystyle \operatorname {Var} (y_{2})=2\sigma ^{2}} . The variance of the series is diverging to infinity with t.
There are various tests to check for the existence of a unit root, some of them are given by:
In addition to autoregressive (AR) and autoregressive–moving-average (ARMA) models, other important models arise in regression analysis where the model errors may themselves have a time series structure and thus may need to be modelled by an AR or ARMA process that may have a unit root, as discussed above. The finite sample properties of regression models with first order ARMA errors, including unit roots, have been analyzed.67
Often, ordinary least squares (OLS) is used to estimate the slope coefficients of the autoregressive model. Use of OLS relies on the stochastic process being stationary. When the stochastic process is non-stationary, the use of OLS can produce invalid estimates. Granger and Newbold called such estimates 'spurious regression' results:8 high R2 values and high t-ratios yielding results with no real (in their context, economic) meaning.
To estimate the slope coefficients, one should first conduct a unit root test, whose null hypothesis is that a unit root is present. If that hypothesis is rejected, one can use OLS. However, if the presence of a unit root is not rejected, then one should apply the difference operator to the series. If another unit root test shows the differenced time series to be stationary, OLS can then be applied to this series to estimate the slope coefficients.
For example, in the AR(1) case, Δ y t = y t − y t − 1 = ε t {\displaystyle \Delta y_{t}=y_{t}-y_{t-1}=\varepsilon _{t}} is stationary.
In the AR(2) case, y t = a 1 y t − 1 + a 2 y t − 2 + ε t {\displaystyle y_{t}=a_{1}y_{t-1}+a_{2}y_{t-2}+\varepsilon _{t}} can be written as ( 1 − λ 1 L ) ( 1 − λ 2 L ) y t = ε t {\displaystyle (1-\lambda _{1}L)(1-\lambda _{2}L)y_{t}=\varepsilon _{t}} where L is a lag operator that decreases the time index of a variable by one period: L y t = y t − 1 {\displaystyle Ly_{t}=y_{t-1}} . If λ 2 = 1 {\displaystyle \lambda _{2}=1} , the model has a unit root and we can define z t = Δ y t {\displaystyle z_{t}=\Delta y_{t}} ; then
is stationary if | λ 1 | < 1 {\displaystyle |\lambda _{1}|<1} . OLS can be used to estimate the slope coefficient, λ 1 {\displaystyle \lambda _{1}} .
If the process has multiple unit roots, the difference operator can be applied multiple times.
Economists debate whether various economic statistics, especially output, have a unit root or are trend-stationary.9 A unit root process with drift is given in the first-order case by
where c is a constant term referred to as the "drift" term, and e t {\displaystyle e_{t}} is white noise. Any non-zero value of the noise term, occurring for only one period, will permanently affect the value of y t {\displaystyle y_{t}} as shown in the graph, so deviations from the line y t = a + c t {\displaystyle y_{t}=a+ct} are non-stationary; there is no reversion to any trend line. In contrast, a trend-stationary process is given by
where k is the slope of the trend and u t {\displaystyle u_{t}} is noise (white noise in the simplest case; more generally, noise following its own stationary autoregressive process). Here any transient noise will not alter the long-run tendency for y t {\displaystyle y_{t}} to be on the trend line, as also shown in the graph. This process is said to be trend-stationary because deviations from the trend line are stationary.
The issue is particularly popular in the literature on business cycles.1011 Research on the subject began with Nelson and Plosser whose paper on GNP and other output aggregates failed to reject the unit root hypothesis for these series.12 Since then, a debate—entwined with technical disputes on statistical methods—has ensued. Some economists13 argue that GDP has a unit root or structural break, implying that economic downturns result in permanently lower GDP levels in the long run. Other economists argue that GDP is trend-stationary: That is, when GDP dips below trend during a downturn it later returns to the level implied by the trend so that there is no permanent decrease in output. While the literature on the unit root hypothesis may consist of arcane debate on statistical methods, the hypothesis carries significant practical implications for economic forecasts and policies.
"Trend-Stationary vs. Difference-Stationary Processes - MATLAB & Simulink". uk.mathworks.com. Archived from the original on 2016-06-08. Retrieved 2016-06-05. http://uk.mathworks.com/help/econ/trend-stationary-vs-difference-stationary.html ↩
"EViews Help". Archived from the original on 2020-05-27. Retrieved 2020-05-28. http://www.eviews.com/help/helpintro.html#page/content%2Fadvtimeser-Unit_Root_Testing.html%23ww184715 ↩
"Differencing and unit root tests" (PDF). Archived (PDF) from the original on 2016-10-18. http://pages.stern.nyu.edu/~churvich/Forecasting/Handouts/UnitRoot.pdf ↩
"Non-Stationary Series" (PDF). Archived (PDF) from the original on 2014-06-11. http://www.stats.ox.ac.uk/~burke/Autocorrelation/Non-Stationary%20Series.pdf ↩
Heino Bohn Nielsen. "Non-Stationary Time Series and Unit Root Tests" (PDF). Archived (PDF) from the original on 2016-11-30. http://www.econ.ku.dk/metrics/Econometrics2_05_II/Slides/08_unitroottests_2pp.pdf ↩
Sargan, J. D.; Bhargava, Alok (1983). "Testing residuals from least squares regressions for being generated by the Gaussian random walk". Econometrica. 51 (1): 153–174. doi:10.2307/1912252. JSTOR 1912252. /wiki/John_Denis_Sargan ↩
Sargan, J. D.; Bhargava, Alok (1983). "Maximum Likelihood Estimation of Regression Models with First Order Moving Average Errors when the Root Lies on the Unit Circle". Econometrica. 51 (3): 799–820. doi:10.2307/1912159. JSTOR 1912159. /wiki/Doi_(identifier) ↩
Granger, C. W. J.; Newbold, P. (1974). "Spurious regressions in econometrics". Journal of Econometrics. 2 (2): 111–120. CiteSeerX 10.1.1.353.2946. doi:10.1016/0304-4076(74)90034-7. /wiki/Journal_of_Econometrics ↩
Krugman, Paul (March 3, 2009). "Roots of evil (wonkish)". The New York Times. Archived from the original on September 5, 2015. Retrieved February 7, 2017. /wiki/Paul_Krugman ↩
Hegwood, Natalie; Papell, David H. (2007). "Are Real GDP Levels Trend, Difference, or Regime-Wise Trend Stationary? Evidence from Panel Data Tests Incorporating Structural Change" (PDF). Southern Economic Journal. 74 (1): 104–113. doi:10.1002/j.2325-8012.2007.tb00829.x. JSTOR 20111955. Archived (PDF) from the original on 2022-06-14. Retrieved 2021-08-14. http://www.shsu.edu/academics/economics-and-international-business/documents/wp_series/wp06-01.pdf ↩
Lucke, Bernd (2005). "Is Germany's GDP trend-stationary? A measurement-with-theory approach" (PDF). Jahrbücher für Nationalökonomie und Statistik. 225 (1): 60–76. doi:10.1515/jbnst-2005-0105. S2CID 209856533. Archived (PDF) from the original on 2013-12-24. Retrieved 2013-07-29. /wiki/Bernd_Lucke ↩
Nelson, Charles R.; Plosser, Charles I. (1982). "Trends and Random Walks in Macroeconomic Time Series: Some Evidence and Implications". Journal of Monetary Economics. 10 (2): 139–162. doi:10.1016/0304-3932(82)90012-5. /wiki/Journal_of_Monetary_Economics ↩
Olivier Blanchard Archived 2009-08-26 at the Wayback Machine with the International Monetary Fund makes the claim that after a banking crisis "on average, output does not go back to its old trend path, but remains permanently below it." http://www.imf.org/external/pubs/ft/fandd/2009/09/blanchardindex.htm ↩