Review Outline for Time Series
1. Fundamental concepts (2.1-2.7)
- Stationarity: covariance stationary
- Autocovariance and autocorrelation functions (ACF)
- Partial autocorrelation function (PACF)
- Sample ACF and PACF
- Stationary = has a moving average representation
- Invertible = has an autoregressive representation
- Linear difference equations: know how solution depends on roots
2. Stationary (ARMA) models (3.1-3.4)
- AR(p): difference equation representation, stationarity conditions, characteristics of ACF and PACF
- MA(q): difference equation representation, invertibility conditions, characteristics of ACF and PACF
- ARMA(p,q): difference equation representation, stationarity and invertibility conditions, characteristics of ACF and PACF
- MA representation of stationary ARMA
- AR representation of invertible ARMA
3. Nonstationary (ARIMA) models (4.1-4.3)
- Differencing: how does differencing reduce a nonstationary model to a stationary one?
- Features of ACF and PACF that suggest nonstationarity
- Random walk and IMA type models
- Variance nonstationarity and transformations: log transformation
4. ARIMA forecasting (5.1-5.3)
- Computing minimum mean square error forecasts by conditional expectations
- ARMA forecast error analysis derived from MA representation (since it is stationary) (5.2.8-5.2.10)
- Extension to ARIMA forecast error analysis: contrast forecast intervals for stationary and nonstationary processes
5. Model identification (6.1)
- Time series graphs and differenced time series graphs
- ACF and PACF: what to look for?
6. Model estimation (7.1-7.2, 7.5-7.7)
- Yule-walker equations for AR(p)
- R function arima
- Diagnostics: standardized residuals, goodness-of-fit test
- Model selection criteria: AIC(M)
7. Seasonal ARIMA models (8.1,8.3-8.4)
- Difference equation representation
- Characteristics of seasonal processes, ACFs, PACFs
For Frequency Domain, the * sections are important!
8. Spectral theory for stationary processes (12.1-12.2)
- Spectrum of absolutely summable autocovariance function:
Fourier transform
- Relation between spectrum and autocovariance generating function
- *General form of spectrum for ARMA models: study special cases,
characteristics of the spectrum