Forecasting Density Function: Application in Finance

Rituparna Sen¹, Changie Ma²

¹Applied Statistics Unit, Indian Statistical Institute, Chennai, India.
²Capital One, Washington DC, USA.

DOI: 10.4236/jmf.2015.55037                

Abstract

With increasing availability of data, in many situations it is now possible to reasonably estimate the probability density function (pdf) of a random variable. This is far more informative than using a few summary statistics like mean or variance. In this paper, we propose a method of forecasting the density function based on a time series of estimated density functions. The proposed method uses kernel estimation to pre-process the raw data followed by dimension reduction using functional principal components analysis (FPCA). Then we fit Vector ARMA models to the reduced data to make a prediction of the principal component scores, which can then be used to obtain the forecast for density function. We need to transform and scale the forecasts to ensure non-negativeness and integration to one. We compared our method to [1] for histogram forecasts, on simulated data as well as real data from S&P 500 and the Bombay Stock Exchange. The results showed that our method performed better on both the datasets and the simulation using uniform and Hilbert distance. The time dependence and complexity of density function are different for the two markets, which is captured by our analysis.

Keywords

Density Estimation, Functional Data Analysis, Principal Components Analysis, Vector ARMA

Conflicts of Interest

The authors declare no conflicts of interest.

References

[1]	Arroyo, J. and Maté, C. (2009) Forecasting Histogram Time Series with k-Nearest Neighbours Methods. International Journal of Forecasting, 25, 192-207. http://dx.doi.org/10.1016/j.ijforecast.2008.07.003
[2]	Gonzlez-Rivera, G., Lee, T.H. and Mishra, S. (2008) Jumps in Cross-Sectional Rank and Expected Returns: A Mixture Model. Journal of Applied Econometrics, 23, 585-606. http://dx.doi.org/10.1002/jae.1015
[3]	Ait-Sahalia, Y. and Lo, A., (1998) Nonparametric Estimation of State-Price Densities Implicit in Financial Asset Prices. Journal of Finance, 53, 499-547. http://dx.doi.org/10.1111/0022-1082.215228
[4]	Taylor, J. and Jeon, J. (2012) Using Conditional Kernel Density Estimation for Wind Power Forecasting. Journal of the American Statistical Association, 107, 66-79. http://dx.doi.org/10.1080/01621459.2011.643745
[5]	Carney, M., Cunningham, P., Dowling, J. and Lee, C. (2005) Predicting Probability Distributions for Surf Height Using an Ensemble of Mixture Density Networks. Proceedings of the 22nd International Conference on Machine Learning, Bonn, 7-11 August 2005, 113-120. http://dx.doi.org/10.1145/1102351.1102366
[6]	Ramsay, J.O. and Silverman, B.W. (2005) Functional Data Analysis. Springer, New York. http://dx.doi.org/10.1002/0470013192.bsa239
[7]	Ramsay, J. (1998) Estimating Smooth Monotone Functions. Journal of the Royal Statistical Society, 60, 365-375. http://dx.doi.org/10.1111/1467-9868.00130
[8]	Ramsay, J. (2000) Differential Equation Models for Statistical Functions. The Canadian Journal of Statistics, 28, 225-240. http://dx.doi.org/10.2307/3315975
[9]	Kneip, A. and Utikal, K. (2001) Inference for Density Families Using Functional Principal Component Analysis. Journal of the American Statistical Association, 96, 519-532. http://dx.doi.org/10.1198/016214501753168235
[10]	Bernhardt, C., Klüppelberg, C. and Meyer-Brandis, T. (2008) Estimating High Quantiles for Electricity Prices by Stable Linear Models. The Journal of Energy Markets, 1, 3-19.
[11]	Sen, R. and Klüppelberg, C. (2015) Time Series of Functional Data. Technical Report, ISI Chennai. http://www.isichennai.res.in/tr/asu/2015/1/ASU-2015-1.pdf
[12]	Laukaitis, A. (2007) An Empirical Study for the Estimation of Autoregressive Hilbertian Processes by Wavelet Packet Method. Nonlinear Analysis: Modeling and Control, 12, 65-75.
[13]	Rice, J. and Wu, C. (2000) Nonparametric Mixed Effects Models for Unequally Sampled Noisy Curves. Biometrics, 57, 253-259. http://dx.doi.org/10.1111/j.0006-341X.2001.00253.x
[14]	Müller, H.G., Stadtmüller, U. and Yao, F. (2006) Functional Variance Processes. Journal of the American Statistical Association, 101, 1007-1018. http://dx.doi.org/10.1198/016214506000000186
[15]	Damon, J. and Guillas, S. (2005) Estimation and Simulation of Autoregressive Hilbertian Processes with Exogenous Variables. Statistical Inference for Stochastic Processes, 8, 185-204. http://dx.doi.org/10.1007/s11203-004-1031-6
[16]	PACE Package for Functional Data Analysis and Empirical Dynamics (Written in Matlab). http://www.stat.ucdavis.edu/PACE