Sparse Parameter Estimation in Overcomplete Time Series Models

Authors

VESELÝ Vítězslav TONNER Jaromír

Year of publication 2006
Type Article in Periodical
Magazine / Source Austrian Journal of Statistics
MU Faculty or unit

Faculty of Economics and Administration

Citation
Web http://www.stat.tugraz.at/AJS/ausg062+3/062Vesely.pdf
Field Applied statistics, operation research
Keywords Overcomplete ARIMA model; sparse estimate; time series; forecasting; algorithm
Description We suggest a new approach to parameter estimation in time series models with large number of parameters. We use a modified version of the Basis Pursuit Algorithm (BPA) by Chen et al [SIAM Review 43 (2001), No. 1] to verify its applicability to times series modeling. For simplicity we restrict to ARIMA models of univariate stationary time series. After having accomplished and analyzed a lot of numerical simulations we can draw the following conclusions: (1) We were able to reliably identify nearly zero parameters in the model allowing us to reduce the originally badly conditioned overparametrized model. Among others we need not take care about model orders the fixing of which is a common preliminary step used by standard techniques. For short time series paths (100 or less samples) the sparse parameter estimates provide more precise predictions compared with those based on standard maximum likelihood estimators from MATLAB's System Identification Toolbox (IDENT). For longer paths (500 or more) both techniques yield nearly equal prediction paths. (2) As the model usually depends on the estimated parameters, we tried to improve their accuracy by iterating BPA several times.
Related projects:

You are running an old browser version. We recommend updating your browser to its latest version.