The Predictive Performance of Extreme Value Analysis Based-Models in Forecasting the Volatility of Cryptocurrencies

Abstract

This paper implements the analysis of volatility behaviour of the eight major cryptocurrencies (Bitcoin, Ethereum, Ripple, Litecoin, Monero, Stellar, Dash and Tether) for the period starting from October 13th 2015 to November 18th 2019. The GARCH-type models with heavy-tailed distributions are fitted to filter the conditional volatility exhibited by cryptocurrencies. Extreme value analysis based on the peak over threshold approach is then used to model the extreme tail behaviour of the cryptocurrencies. The predictive performance of the GARCH-EVT model in forecasting Value-at-Risk is evaluated at both 5% and 1% levels of significance. The backtesting results demonstrate the superiority of the GARCH-EVT model in both out-of-sample forecasts and goodness-of-fit properties to cryptocurrency returns and forecasting Value-at-Risk. Overall, the empirical results of this study recommend the heavy-tailed GARCH-EVT based model for modelling and forecasting the volatility of cryptocurrencies.

Share and Cite:

Omari, C. and Ngunyi, A. (2021) The Predictive Performance of Extreme Value Analysis Based-Models in Forecasting the Volatility of Cryptocurrencies. Journal of Mathematical Finance, 11, 438-465. doi: 10.4236/jmf.2021.113025.

1. Introduction

Cryptocurrencies have attracted a lot of attention since Bitcoin was first proposed by Nakamoto [1] . They are highly volatile and show extreme tail movements as compared to traditional financial markets and fiat currencies. This provides a new investment asset category to investors, practitioners, and policymakers in financial markets and portfolio management. Bitcoin is one of the most traded and still, the largest cryptocurrency, representing about 62.24% of the total estimated cryptocurrencies capitalisation as of March 2021 (https://coinmarketcap.com) [2] . As of March 28, 2021, the cryptocurrencies market capitalization was valued at about US $1517b. Remarkable growth has also been witnessed in other important digital currencies like Ethereum, Ripple, and Litecoin which are among the top ten cryptocurrencies by market capitalization. Despite being largely unregulated by government institutions, cryptocurrency prices and exchanges exhibit most stylized facts from established exchanges [3] . Nevertheless, these cryptocurrencies are characterized by periods of high volatility, large shocks and extreme price jumps.

Accurate forecasts of volatility and hence Value-at-Risk is important to investors, practitioners, and policymakers for making informed decisions and portfolio risk management. It is also important to utilize a model capable of capturing the stylized characteristics and volatility dynamics of cryptocurrencies by combining conventional and novel techniques [4] . The Generalized Autoregressive Conditional Heteroscedastic (GARCH) model and its variants are famous volatility models for modelling traditional financial time series as well as for cryptocurrencies. The popularity of GARCH-type models for describing the dynamics of cryptocurrencies volatility is due to their deterministic dependence of the conditional variance on past observations.

Several studies have employed variants of GARCH-type models for several cryptocurrencies to select the best volatility model or a superior set of models. Fakhfekh and Jeribi [5] applied various GARCH-type models with different error distributions to sixteen of the most popular cryptocurrencies and found that the TGARCH model with double exponential distribution provided the best fit. Ngunyi et al. [6] applied several GARCH-type models with different error distributions to eight of the most popular cryptocurrencies and found that the asymmetric GARCH models with long memory property and heavy-tailed innovations provided the best fit for all cryptocurrencies. Chu et al. [7] using GARCH models with different error distributions concluded that the IGARCH (1, 1) model estimates the Bitcoin volatility better than the competing models. Therefore, the selection of the appropriate distribution of cryptocurrencies returns is also a major challenge in cryptocurrencies risk management.

Alternatively, extreme value theory could be useful to better understand the characteristics of the extreme tail distribution of cryptocurrencies. However, only a few attempts have been made so far to examine extreme price movements of different cryptocurrencies. In the recent past, a limited number of studies have investigated the tail behaviour of cryptocurrencies using extreme value theory. Borri [8] modelled the conditional tail-risk in four major cryptocurrencies and the results showed that these cryptocurrencies are highly exposed to tail-risk within the crypto market contexts. Gangwal and Longin [9] presented an extreme value analysis of the returns of Bitcoin and showed that the returns followed a Frèchet distribution; Begušić et al. [10] also provided evidence that extreme prices of Bitcoin are considerably more frequent, implying that Bitcoin exhibits heavier tails than stock returns. Zhang et al. [11] utilized extreme value analysis to investigate the tail risk behaviour of the high-frequency (hourly) log-returns of the four most popular cryptocurrencies estimating value at risk and expected shortfall with varying thresholds. The empirical results found that Ripple was the riskiest cryptocurrency exhibiting the largest potential gain or loss for both positive and negative (hourly) log-returns at every percentile and threshold while Bitcoin was the least risky cryptocurrency.

In a Value-at-Risk context, Gkillas and Katsiampa [12] apply extreme value theory to estimate Value at Risk and Expected shortfall as measures of tail risk for five cryptocurrencies. Likitratcharoen et al. [13] predicted the Value at Risk (VaR) of Bitcoin, Ethereum and Ripple using historical and Gaussian parametric, VaR. Their backtesting results show that the historical VaR model is suitable for measuring cryptocurrency risk over delta normal VaR only for a high confidence level of critical values.

The objective of this study is twofold. First, a comprehensive in-sample volatility modelling is implemented utilizing a variety of GARCH-type models to account for volatility clustering and leverage effects present in cryptocurrency returns. The probability distributions assumed for the standardized innovations include the Skewed Student-t, skewed Generalized error (GED), generalized hyperbolic (GHYP), Johnson’s SU distributions. Second, we apply the GARCH-EVT model that combines the conditional heteroscedastic model and extreme value theory to examine the tail behaviour of eight major cryptocurrencies. The GARCH models and GARCH-EVT model are then used to estimate the out-of-sample 1-day-ahead Value at Risk (VaR) forecasts. The forecasting performance is evaluated using unconditional and conditional coverage tests to backtest the accuracy of VaR forecasts. The accuracy of forecast estimates is evaluated to determine which technique most accurately models extreme market risk on the eight cryptocurrencies.

The research contributes to the literature in two ways. First, it fits GARCH-type models using heavy-tailed innovations distributions to account for volatility clustering, asymmetry and leverage effects present in cryptocurrency returns. Second, it provides more accurate results based on a hybrid model combining conditional heteroscedastic model and extreme value analysis, namely the generalized Pareto distribution (GPD). The GPD is the only non-degenerate distribution that approximates asymptotically the limiting distribution of exceedances. We, therefore, consider only the relevant information of extremes providing more accurate risk estimates. The remaining part of the paper is organised as follows: Section 2 describes the methodology; GARCH modelling with selected innovations distribution, extreme value theory, value-at-risk estimation and backtesting procedures. Section 3 presents data description, empirical results and a discussion of the backtesting results. Finally, Section 4 concludes the study.

2. Methodology

2.1. GARCH Modelling

The generalized autoregressive conditional heteroscedastic (GARCH) model (Engle, [14] ; Bolleslev, [15] ) constitutes a benchmark in financial econometrics that is commonly used to estimate and forecast volatility of financial returns.

Let r t denote the daily log returns of the corresponding cryptocurrencies data series at time t for t = 1 , , n , computed as the logarithm of prices at the end of day t divided by the price at the end of the preceding day t 1 , r t = ln ( p t / p t 1 ) . The GARCH model can be specified as:

r t = μ t + σ t z t (1)

where μ t denotes the conditional mean and σ t denotes the volatility process, ( σ t 2 being the conditional variance). z t the innovations, are independent and follow a distribution with zero mean and unit variance. For brevity, all selected GARCH models are restricted to a maximum order of one ( p = q = 1 ). The parsimonious GARCH (1, 1) models tend to be more flexible, efficient and significant than higher order models in the out-of-sample analysis [16] .

In this study, several GARCH-type specifications are considered namely the Standard GARCH (SGARCH), IGARCH (1, 1), EGARCH (1, 1), GJR-GARCH (1, 1), Asymmetric Power ARCH (APARCH) (1, 1), Threshold GARCH (TGARCH) (1, 1) and Component GARCH (CGARCH) (1, 1), to model the time-varying volatility of the selected cryptocurrencies. All of the GARCH-type models selected follow the specification in Equation (1); however, they differ in the conditional variance specification.

The conditional variance for the standard GARCH (SGARCH) (1, 1) process is given by:

σ t 2 = ω + α ε t 1 2 + β σ t 1 2 , (2)

where ω > 0 , α 0 , β 0 and α + β < 1 to ensure a uniquely stationary process and positive conditional variance. The GARCH (1, 1) model captures volatility clustering in the data through the persistence parameter α + β . However, if the persistence parameter α + β equals 1, the GARCH model converges to the Integrated GARCH model, where the long term volatility bears an infinite process.

The Integrated GARCH (IGARCH) model is a special version of SGARCH (1, 1) model where, the persistence parameter ( α + β ) is equal to 1 and typically allows a unit root under the GARCH process. Thus, the conditional variance in the IGARCH (1, 1) is expressed in Equation (3), given that β is set equal to ( 1 α ) with parameter restrictions ω > 0 , α 0 and 1 α 0 :

σ t 2 = ω + α ε t 1 2 + ( 1 α ) σ t 1 2 . (3)

In both the SGARCH and IGARCH models, the impact of positive and negative news on the conditional variance is assumed to be symmetrical. These models restrict all coefficients to be greater than zero and thus cannot explain the negative correlation between return and volatility. Some long-memory GARCH-type models are also introduced to forecast cryptocurrencies price volatility by capturing some stylized facts such as asymmetry and fat tails in the cryptocurrency price return innovations and to provide better VaR’s computations.

The exponential GARCH (EGARCH) model by Nelson [17] , incorporates the asymmetric impact of positive and negative shocks on volatility whereby the latter is believed to produce greater levels of volatility, despite having the same magnitude. This model is specified in logarithmic form, which suggests that parameters are unrestricted, and are thereby allowed to take negative values while ensuring a positive conditional variance. In addition, the conditional variance is written as a function of past standardized innovations, instead of past innovations. The volatility dynamics of an EGARCH (1, 1) can be expressed as:

log e σ t 2 = ω + α 1 z t 1 + γ 1 ( | z t 1 | E | z t 1 | ) + β 1 log e ( σ t 1 2 ) (4)

where the coefficient α 1 captures the sign effect, and γ 1 > 0 the size of the leverage effect. The persistence parameter for this model is β 1 .

The Glosten-Jagannathan-Runkle GARCH (GJR-GARCH) model by Glosten et al. [18] is similar to EGARCH (1, 1) in incorporating the asymmetric impact of positive and negative shocks. The conditional variance responds asymmetrically via the use of an indicator function I. The volatility equation of a GJR-GARCH (1, 1) model is given as:

σ t 2 = ω + α 1 ε t 1 2 + γ 1 I t 1 ε t 1 2 + β 1 σ t 1 2 , (5)

where γ 1 now represents the “leverage” term. The indicator function I takes on value of 1 for ε t 1 0 and 0 otherwise. The persistence depends on the parameter γ 1 , through α 1 + β 1 + γ 1 κ , where κ denotes the expected value of the standardized residuals.

The asymmetric power ARCH (APARCH) model of Ding et al. [19] allows for both leverage and the Taylor effect, named after Taylor [20] who observed that the sample autocorrelation of absolute returns were usually larger than that of squared returns.

The APARCH (1, 1) model can be expressed as:

σ t δ = ω + α 1 ( | z t 1 | γ 1 z t 1 ) δ + β 1 σ t 1 δ , (6)

where δ R e + , is a Box-Cox transformation of σ t , and 1 < γ 1 < 1 is the coefficient in the leverage term. The persistence parameter is equal to β 1 + α 1 κ 1 , where κ 1 is the expected value of the standardized residuals under the Box-Cox transformation of the term, which includes the leverage parameter γ 1 .

The component standard GARCH (CS-GARCH) model of Engle and Lee [21] decomposes the component of the conditional variance so as to investigate the long and short-run movements of volatility. Let q t represent the permanent component of the conditional variance, the component model can be written as

σ t 2 = q t + α 1 ( z t 1 2 q t 1 ) + β 1 ( σ t 1 2 q t 1 ) (7)

q t = α 0 + ρ q t 1 + ϕ ( z t 1 σ t 1 2 )

where effectively the intercept of the GARCH model is now time-varying following first order autoregressive type dynamics.

The Nonlinear GARCH (NGARCH) model of Higgins et al. [22] is given by

σ t 2 = ω + α 1 ε t 1 2 + γ 1 ε t 1 + β 1 σ t 1 2 (8)

The Nonlinear Asymmetric GARCH (NAGARCH) model of Engle and Ng [23] is a model with the specification:

σ t 2 = ω + α ( ε t 1 θ σ t 1 ) 2 + β σ t 1 2 (9)

where α 0 , β 0 , ω > 0 and α ( 1 + θ 2 ) + β < 1 , which ensures the non-negativity and stationarity of the variance process.

For stock returns, the parameter θ is usually estimated to be positive; in this case, it reflects a phenomenon referred to as the “leverage effect”, signifying that negative returns increase future volatility by a larger amount than positive returns of the same magnitude.

For each GARCH-type model, the innovation process z t is allowed to follow one of the following four skewed and heavy-tailed distributions: the Skewed Student-t, skewed Generalized error (GED), generalized hyperbolic (GHYP), Johnson’s SU distributions since the cryptocurrencies returns have heavier tails than the normal distribution.

The skewed Student-t (SST) distribution by Azzalini and Capitanio [24] , has a density given by

f ( x ; δ , ν , μ , β ) = 1 δ t ν ( x μ δ ) 2 T ν + 1 ( β ( x μ δ ) ν + 1 ( x μ δ ) 2 + ν ) (10)

where t ν is the density of standard Student t distribution with ν degrees of freedom and T ν + 1 is the distribution function of the standard Student t distribution with ν + 1 degrees of freedom.

The skewed generalized error distribution (SGED) by Theodossiou [25] is given by

f SGED ( x ; μ , σ , k , λ ) = C σ exp ( | x μ + δ σ | k [ 1 sign ( x μ + δ σ ) λ ] k θ k σ k ) (11)

where

C = k 2 θ Γ ( 1 k ) 1 ,

θ = Γ ( 1 k ) 1 2 Γ ( 3 k ) 1 2 S ( λ ) 1 ,

δ = 2 λ A S ( λ ) 1 ,

S ( λ ) = 1 + 3 λ 2 4 A 2 λ 2 ,

and

A = Γ ( 2 k ) Γ ( 1 k ) 1 2 Γ ( 3 k ) 1 2 ,

μ and σ are the mean and standard deviation parameters respectively, λ is a skewness parameter, sign is the sign function, and Γ ( α ) = 0 z α 1 e z d z is the gamma function. The scaling parameter k and λ satisfy the following constraints k > 0 and 1 < λ < 1 . The parameter k controls the height and tails of the density function and the skewness parameter λ controls the rate of descent of the density around the mode of the random variable x, where mode ( x ) = μ δ σ .

The generalized hyperbolic (GH) distribution by Barndorff-Nielsen [26] is given by

f ( x ; λ , α , β , μ , δ ) = ( δ α 2 β 2 ) λ ( δ α ) 1 / 2 λ 2 π δ K λ ( δ α 2 β 2 ) ( 1 + ( x μ ) 2 δ 2 ) λ / 2 1 / 4 × exp ( β ( x μ ) ) K λ 1 / 2 ( α δ 1 + ( x μ ) 2 δ 2 ) (12)

where K λ is the modified third-order Bessel function. The density is defined under the following parameter restrictions.

δ 0 and | β | < α if λ > 0

δ > 0 and | β | < α if λ = 0

δ > 0 and | β | α if λ < 0

The class of generalized hyperbolic distribution variants can be obtained by changing the values of the parameter λ ; hence, λ is called the class-defining parameter.

The Johnson system of distributions consists of families of distributions that, through specified transformations, can be reduced to the standard normal random variable. A random variable X from the Johnson translation system is represented as a transformation of the normal distribution given by

X = ξ + λ r 1 ( Z γ δ )

where Z is a standard normal random variable, γ and δ are shape parameters, ξ is a location parameter, λ is a scale parameter and r ( ) denotes one of the following normalizing transformations:

r ( y ) = ( y forthe S N ( normal ) family , log ( y ) forthe S L ( lognormal ) family , log ( y / ( 1 y ) ) forthe S B ( bounded ) family , log ( y + y 2 + 1 ) forthe S U ( unbounded ) family

where X > ξ and λ = 1 for the S L family; ξ feasible combination of the skewness and kurtosis values. The cryptocurrency returns considered in this study have skewness and kurtosis values that correspond to Johnson’s S U -distribution. Thus, we only consider the S U family of the Johnson translation system. The reparameterized Johnson SU distribution, as discussed in Rigby and Stasinopoulos [27] , is a four-parameter distribution denoted by JSU ( μ , σ , ν , τ ) , with mean μ and standard deviation σ for all values of the skew and shape parameters ν and τ respectively.

The parameters of all GARCH-type models are estimated using Maximum Likelihood, since it is generally consistent and efficient, and provides asymptotic standard errors that are valid under non-normality. The most appropriate GARCH-type model is the one that minimizes the Kullback-Leibler distance between the model and the observed values. The selection is based on information criteria namely; the Akaike Information Criterion (AIC) and Bayesian Information Criterion (BIC).

2.2. Extreme Value Theory and the Peaks-over-Threshold Model

In this section, we describe how to obtain the quantile z q by applying EVT techniques to the distribution of GARCH-models filtered innovations. The Peak-over-threshold (POT) modelling approach is illustrated as follows. First, we fix a sufficiently high threshold u and assume that excess residuals over this threshold follow a generalized Pareto distribution (GPD) with tail index ξ .

G ξ , β ( y ) = ( 1 ( 1 + ξ y β ) 1 ξ if ξ 0, 1 exp ( y β ) if ξ = 0, (13)

where β > 0 is scale parameter and the support is y 0 when ξ 0 and 0 y β / ξ when ξ < 0 . ξ is the shape parameter, which governs the tail behaviour of G ξ , β ( y ) . Consider a general distribution function F and the corresponding excess distribution above the threshold u defined by:

F u ( y ) = Pr ( X u | X > u ) = F ( u + y ) F ( u ) 1 F ( u ) , y 0 (14)

For 0 y , Balkema and De Haan [28] and Pickands [29] showed that for a large class of distributions F it is possible to find a positive measurable function σ ( u ) such that

l i m u x F sup 0 y x F u | F u ( y ) G ξ , β ( u ) ( y ) | = 0 (15)

The GPD is generalized in the sense that it subsumes several other specific distributions under its parametrization. When ξ > 0 , the distribution function G ξ , β is the parameterized version of a heavy-tailed ordinary Pareto distribution; when ξ = 0 we have a light-tailed exponential distribution and when ξ < 0 we have a short-tailed Pareto type II distribution.

The tail of the underlying distribution is assumed to begin at the threshold u, with N the random variables of exceeding observations. For a random sample of size n the proportion of extremes is then N/n. Assuming that the N u excesses over the threshold are independently and identically distributed (i.i.d) with exact GPD distribution, the parameters ξ and β are estimated by maximum likelihood. Smith [30] showed that maximum likelihood estimates ξ ^ and β ^ of the GPD parameters ξ and β are consistent and asymptotically normal as N u provided ξ > 1 / 2 . Even under the weaker assumption that the excesses are i.i.d from F u ( y ) which is only approximately GPD he also obtained unbiased and asymptotically normal results for ξ and β provided a sufficient rate of convergence.

By setting x = u + y , the following equality holds for points x > u in the tail of F obtained from Equation (14):

1 F ( x ) = ( 1 F ( u ) ) ( 1 F u ( x u ) ) (16)

The first term, ( 1 F ( u ) ) , can be estimated non-parametrically using the random proportion of the data on the tail N/n and we can also estimate the term 1 F u ( x u ) , by approximating the excess distribution, F u ( y ) with a GPD fitted by maximum likelihood, to get the tail estimator:

F ^ ( x ) = 1 N u n ( 1 + ξ ^ ( x u ^ β ^ ) ) 1 ξ ^ , (17)

For x number of observations in the tail is fixed to be N = k , this gives us a random threshold at the ( k + 1 ) th order statistic. The GPD with parameter ξ and β is fitted to the data Z ( 1 ) Z ( k + 1 ) , , Z ( k ) Z ( k + 1 ) , the excess amounts over the threshold for all residuals exceeding the threshold. The tail estimator for F Z ( z ) is then given by

F ^ Z ( z ) = 1 k n ( 1 + ξ ^ ( z z ( k + 1 ) β ^ ) ) 1 / ξ ^ , (18)

For q > 1 k / n , we can invert Equation (18) to get

z ^ q = z k + 1 + β ^ ξ ^ ( ( 1 q k / n ) ξ ^ 1 ) (19)

which is the q-th quantile of the data distribution.

2.3. Measure of Value-at-Risk

Value at Risk (VaR) is a measure of risk that determines the losses that may happen in extreme events for a given confidence level. The main parameters of VaR are the significance level (confidence level 1 α ) and the risk horizon (h), which is the period of time in terms of trading days.

Consider ( X t , t Z ) a strictly stationary time series representing daily observations of the negative log-return of a financial asset price. The dynamics of X t is assumed to be given by:

X t = μ t + σ t Z t (20)

where the innovations Z t follow a strict white noise process, independent and identically distributed, with zero mean, unit variance and marginal distribution function F Z ( z ) . We assume that μ t and σ t are both measurable with respect to F t 1 the information about the return process available up to time t 1 .

Let F X ( x ) denote the marginal distribution of ( X t ) and, for a horizon h N , let F X t + 1 + + X t + h | F t ( x ) denote the predictive distribution of the return over the next h days, given information on returns up to and including day t. For 0 < q , 1 , the q-th unconditional quantile for the marginal distribution is denoted by:

x q = inf { x : P ( X > x ) 1 q } = inf { x : F X ( x ) q } , (21)

and a conditional quantile is a quantile of the predictive distribution for the return over the next h days denoted by

x q t ( h ) = inf { x : F X t + 1 + + X t + h | F t ( x ) q } (22)

We are principally interested in estimating unconditional and conditional quantiles in the tails of negative log-returns for the 1-step predictive distribution. Since

F X + t | F t ( x ) = P { μ t + 1 + σ t + 1 Z t + 1 x | F t } = F Z ( x μ t + 1 σ t + 1 )

The quantile is denoted by x q t and simplify to

x q t = μ t + 1 + σ t + 1 z q (23)

where z q is the upper q-th quantile of the marginal distribution of Z t which by assumption does not depend on t. Mathematically, VaR is the q-th quantile of the underlying distribution of returns.

To estimate risk measure, VaR for the cryptocurrency market, our main interest is on extreme value theory-based models: we consider only the conditional GPD approach and conventional GARCH models.

The Peak over Threshold: Conditional GPD Approach

Different approaches have been proposed in the literature to estimate risk measures. The unconditional GPD has the advantages that it focuses directly on the tail of the distribution. However, it doesn’t recognize the fact that returns are not i.i.d. The econometric models of volatility such as the GARCH-process under different innovation’s distributions yield VaR estimates which reflects the current volatility dynamics. The weakness of this GARCH modelling approach is that it focuses on modelling the whole conditional return distribution as time-varying, and not only the tail distribution that is of interest. This approach may sometimes fail to accurately estimate risk measures like VaR.

In order to overcome the drawbacks of each of the above methods, McNeil and Frey [31] proposed to combine ideas from these two approaches. By first filtering, the returns with a GARCH model is that we get essentially i.i.d. series on which it is straightforward to apply the EVT technique. The advantage of this GARCH?EVT combination lies in its ability to capture conditional heteroscedasticity in the time series through the GARCH framework, while simultaneously, modelling the extreme tails behaviour through the EVT method. The conditional GPD produces a VaR, which reflects the current volatility background. The combined approach denoted conditional GPD, may be presented in the following three steps:

Step 1: Fit a GARCH-type model to the return data by quasi-maximum likelihood. Estimate μ t + 1 and σ t + 1 from the fitted model and extract the standardized residuals z t .

Step 2: Consider the standardized residuals computed in Step 1 to be realizations of a white noise process, and estimate the tails of the innovations using extreme value theory. Next, compute the quantiles of the innovations.

Step 3: Construct VaR from parameters estimated in steps 1 and 2.

Assuming that the volatility dynamics of log-returns can be represented by Equation (2). Given the 1-step forecasts μ t + 1 , σ t + 1 and the estimate quantile of standardized residuals series, VaR t + 1 ( Z ) , using the Equation (19) the VaR for the return series can be estimated as:

VaR ^ t + 1 q = μ ^ t + 1 + σ ^ t + 1 z ^ q (24)

2.4. Statistical Backtesting of Model-Based VaR Forecasts

To back-test the accuracy for the estimated VaRs, we computed the empirical failure rates. By definition, the failure rate is the number of times returns (in absolute values) exceed the forecasted VaR. If the model is correctly specified, the failure rate should be equal to the specified VaR’s level. In this study, the backtesting VaR is based on the Kupiec’s [32] and Christoffersen [33] for unconditional and conditional coverage tests.

For purposes of implementing VaR forecast tests, the first step is to define the “hit sequence” of VaR violations:

I t + 1 = ( 1 if r t + 1 < VaR t + 1 α 0 if r t + 1 VaR t + 1 α (25)

where VaR t + 1 α is the VaR prediction at time t + 1 for risk quantile level α . Under the null hypothesis of correct specification the hit sequence should be an independent Bernoulli distributed variable.

H 0 : I t + 1 B e r n o u l l i ( α ) , (26)

f ( I t + 1 , p ) = ( 1 p ) 1 I t + 1 p I t + 1 . (27)

The accuracy and reliability of VaR methodology are tested by evaluating the out-of-sample performance of the estimated VaR forecasts. The backtesting procedure consists of comparing the out-of-sample VaR estimates with actual realized loss in the next period. For a VaR forecast model to be accurate in its predictions, then the average hit sequence or hit ratio or the failure rate over the full sample should be equal α for the ( 1 α ) % quantile VaR (i.e., for 95% VaR). As expected, the closer the hit ratio is to the expected value, the better the forecasts of the risk model. If the hit ratio is greater than the expectation, then the model underestimates the risk; with a hit ratio smaller than ( 1 α ) % , the model overestimates risk.

The unconditional coverage (UC) test uses the fraction/ratio of observed violations for a particular risk model π and compares it with p. For this purpose the likelihood Bernoulli function is required and is given by:

L ( π ) = π ( 1 π ) 1 I t + 1 π I t + 1 = ( 1 π ) T 0 π T 1 (28)

where T 0 , T 1 are the number of 0 s and 1 s in the sample ( T = T 0 + T 1 ) . The maximum likelihood estimator is π ^ = T 1 / T . The null hypothesis can be tested by means of the following likelihood ratio test:

L R u c = 2 ln ( L ( α ) L ( π ^ ) ) χ 1 2 (29)

Under the null hypothesis that the VaR model is correct L R u c is asymptotically chi-square distributed with one degree of freedom. However, this test focuses only on the number of exceptions.

In practice, situations arise when the VaR model passes the unconditional coverage test but all violations are clustered. To reject a VaR model with clustered violations, a test of independence of the hit sequence is required. Suppose the hit sequence is assumed to exhibit time dependence and follows a first-order Markov sequence with the following transition probability matrix:

π 1 = ( 1 π 01 π 01 1 π 11 π 11 ) (30)

where π i j = Pr ( I t = j | I t + 1 = i ) , π 01 is the probability of getting a violation tomorrow given no violation today, π 11 is the probability of getting a violation tomorrow given today is also a violation. Then the corresponding likelihood function is given as:

L ( π 1 ) = ( 1 π 01 ) T 00 π 01 T 01 ( 1 π 11 ) T 10 π 11 T 11 , (31)

where T i j is the number of observations with a j following i. If the hit sequence is independent over time, the probability of a violation tomorrow does not depend on today having a violation or not. Hence, the null hypothesis in the independence test is H 0 : π 01 = π 11 = π . The transition probability matrix will take the form:

π ^ = ( 1 π ^ π ^ 1 π ^ π ^ ) (32)

Then, independence can be tested using a likelihood ratio test statistics defined as follows:

L R i n d = 2 ln ( L ( π ^ ) L ( π ^ 1 ) ) χ 1 2 . (33)

Ultimately, VaR users are interested in being able to test simultaneously whether the hit sequence is independent and the average number of violations is correct. The conditional coverage (CC) test jointly examines whether the percentage of exceptions is statistically equal to the one expected and the serial independence of the exception indicator. A sequence of VaR forecasts at-risk level α has the correct conditional coverage if { I t ( α ) ; t = 1, , T } is an independent and identically distributed sequence of Bernoulli random variables with parameter α . In this test, the null hypothesis takes the form: H 0 : π 01 = π 11 = α . To test this hypothesis a joint test of independence of the hit sequence and the unconditional coverage of the VaR forecasts is required. Thus, under the null hypothesis of the expected proportion of exceptions equals α and the failure process is independent, the appropriate likelihood ratio test statistic is of the form:

L R c c = 2 ln ( L ( α ) L ( π ^ 1 ) ) χ 2 2 (34)

Under the null hypothesis the likelihood ratio statistic, L R c c , is asymptotically Chi-square distributed, with two degree of freedom. Note also that L R c c = L R u c + L R i n d .

3. Data Description and Empirical Results

3.1. Data Description

In this study, the data set consists of daily closing prices (in US dollars) of the eight largest cryptocurrencies in terms of market capitalization traded from August 8, 2015, to September 16, 2020 (1859 observations). The data are publicly available online at https://coinmarketcap.com/coins/. We only considered cryptocurrencies with no missing values, which resulted in eight cryptocurrencies: Bitcoin (BTC), Ethereum (ETH), Ripple (XRP), Litecoin (LTC), Monero (XMR), Stella (XLM), Dash (DASH) and Tether (USTD). Figure 1 presents time series plots for the cryptocurrency daily trading prices for the given period of August 8, 2015, to September 16, 2020. The sample period covers both relatively volatile and stable periods, with phases of price fluctuations and occasional extreme price jumps. All the cryptocurrencies display visible patterns of volatility clustering dynamics over time.

In order to expressively visualize some features for each cryptocurrency data, daily returns were computed by r t = ln ( p t / p t 1 ) with p t denoting daily closing price in time (t). The data adjustment procedure is applied to obtain stationary time-series for the returns of the cryptocurrencies considering heteroscedasticity. Figure 2 presents the dynamic evolution of log return series for all cryptocurrencies and illustrates the stylized feature of leptokurtosis that arises from a pattern of time-varying volatility clustering in the cryptocurrencies where periods of high (low) volatility are followed by periods of high (low) volatility.

Figure 1. Daily prices of the eight major cryptocurrencies for the period starting from August 8, 2015 to September 16, 2020.

Figure 2. Daily logarithmic returns of the eight major cryptocurrencies for the period starting from August 8, 2015 to September 16, 2020.

Table 1 reports summary statistics of cryptocurrencies and statistical test results. All cryptocurrencies record a negative mean which is close to zero except for Tether while standard deviation values are all slightly above zero value. Except for Bitcoin, all the other cryptocurrencies are significantly negatively skewed. Additionally, all series have excess-kurtosis implying fat-tails and non-normally distributed. Concerning the normal distribution, the Jarque-Bera test suggests that all the cryptocurrencies are not distributed normally. To test stationarity in cryptocurrencies return series, the Augmented Dickey and Fuller (ADF) test is used. The results of the ADF test accepted the null hypotheses, meaning that all the series were non-stationary at all levels. The significant autoregressive conditional heteroscedasticity (ARCH) confirmed the presence of ARCH effects in all the cryptocurrencies studied. The Ljung-Box Q statistics on lag (20) of squared returns confirmed the significant ARCH effects.

Table 1. Descriptive statistics and statistical test results for eight cryptocurrencies for the period starting from August 8, 2015 to September 8, 2020.

Note: Std Dev (Standard deviation), J.B. (Jarque-Bera), ARCH (autoregressive conditional heteroscedasticity), ADF (augmented Dickey and Fuller), the value of J.B., ADF, ARCH(5), ARCH(10), and Q(5), Q(10), Q2(5), Q2(10) Ljung are statistically significant for * at 1%.

3.2. Parameter Estimates of GARCH-Type Models

In this section, results from the estimated GARCH-type models are presented. The sampled period is divided into two sub-sample periods: the in-sample period extending from October 13th 2015 till December 3rd 2018, and the out-of-sample period covering the period from December 4th 2018 till November 18th 2019. In-sample returns are used to estimate the parameters of the selected models, subject to the assumptions and constraints of each model. Accordingly, the calculated in-sample parameters are applied to forecast the volatilities for both the in-sample and out-of-sample periods. First, we estimate GARCH, EGARCH, GJRGARCH, APARCH, CSGARCH, NGARCH and NAGARCH models concerning long memory test results to account for the long memory properties of our cryptocurrency returns.

Table 2 presents BIC values of the fitted GARCH-type specifications: GARCH, EGARCH, GJRGARCH, APARCH, CSGARCH, NGARCH and NAGARCH under different error distributions. The skewed generalized error distribution has minimum BIC values for Bitcoin, Ethereum, Ripple and Litecoin. Skewed-Student’s-t distribution, which accounts for both asymmetry and heavy tails, is selected as the most suitable distribution for modelling this data set. Thus, the results deduce that the use of fat-tailed distribution to describe innovations distribution is justified.

Table 3 (Panel A) reports the estimation results of the NGARCH model with selected innovations distribution. The mean parameters are not significantly different from zero for all eight cryptocurrency price returns indicating that the GARCH components are covariance stationery. The GARCH (1, 1)-type model results reveal that the lagged conditional volatility for each cryptocurrency is statistically significant. In addition, the shock squared term in the variance equation is statistically significant, which means the lagged volatility and current news immediately reflect in the price of the cryptocurrencies. It is observed that under different distributional assumptions, the parameters vary, implying that the distributional assumption does have a certain effect on the estimation process. The skewness parameter, having a very low p-value, is quite significant. Moreover, the shape parameters for both the Student’s-t and skewed-t distributions are significantly high, confirming the presence of heavy tails in the series. The results further show that the p-values of the GARCH parameters are very low except for LTC and ETHM, indicating that these parameters are also highly significant.

For the goodness-of-fit test (Panel B), the diagnostic results reveal that the NGARCH specifications filter the serial autocorrelation, conditional volatility dynamics and leverage effects present in cryptocurrencies return series. The Box-Pierce and ARCH-LM tests do not reject the null hypothesis of a correct model specification and show the power of the NGARCH model to take into account the major stylized facts of time series prices behaviour. However, the NGARCH model fails to capture extreme events normally experienced in the cryptocurrency markets. The standardized residuals of the NGARCH model are closer approximately independently and identically distributed (i.i.d) which is a standard requirement for extreme value theory to be applied. Therefore, we can apply successfully EVT methods to i.i.d residual series. Obviously, in what follow we choose the NGARCH-EVT approach to compute the one-day-ahead VaR for all cryptocurrencies. The forecast performance of this model should be evaluated for the out-of-sample period and using more accurate performance criteria.

Table 2. The Bayesian Information Criterion (BIC) for GARCH model selection.

Table 3. Estimation results of NGARCH (1, 1) models with selected innovations distribution.

3.3. Parameter Estimates of the GARCH-EVT Model

In Extreme value theory (EVT) modelling, Peak over threshold (POT) approach is normally used to estimate the parameters of the generalized Pareto distribution (GPD). The POT method generally depends on the selection of the threshold. In this study, an optimal threshold value is set at 90% quantile of the total observations to estimate the GPD parameters for both left and right tails. Table 4 presents parameter estimates of the fitted GPD with their corresponding standard errors enclosed in brackets for both the left and right tails of the cryptocurrencies standardized residuals. The shape parameter ( ξ ) is positive and significantly different from zero for all cryptocurrencies indicating heavy-tailed distributions and a finite variance. This also implies that the tail distribution of cryptocurrencies belongs to Frechet class which is heavy-tailed. However, the shape parameter is negative except for Ethereum on the left tail. The scale parameters are also positive and significant for all cryptocurrencies both for the left and right tails.

3.4. Forecasting Performance Analysis

To evaluate the out-of-sample performance of the VaR forecast models, we used

Table 4. Parameter estimates of the Generalized Pareto model for selected u for the daily log returns of the eight crypto-currencies.

a rolling windows scheme with a window size of 1358 days and 500 days are reserved for the out-of-sample forecast period. The evaluation is based on the one-step-ahead forecast that is produced from a series of rolling sample size with an estimation window of 1358 observations kept constant and simply rolled forward after every 25 days. The advantage of a rolling window procedure is two-fold: to assess the stability of the model over time and the accuracy of the forecasting. Stability amounts to examining whether the coefficients are time-invariant. The one-day ahead VaR is calculated at 95% and 99% confidence levels. Both levels of confidence are used for out-of-sample backtesting of VaR, following Basel II Backtesting Requirements, which stipulates that backtesting of VaR needs to be done on confidence levels other than 99%. Backtesting is used to evaluate the relative performance of conventional GARCH models and the GARCH-EVT approach to forecast value at risk. Kupiec’s unconditional coverage and Christoffersen’s conditional coverage tests are used at two different levels of significance of 95% and 99% which are considered to reflect extreme market conditions.

Table 5 presents VaR forecast violation percentages and p-values in parentheses of unconditional coverage tests for GARCH (1, 1), EGARCH (1, 1), APARCH (1, 1), NGARCH (1, 1) and GARCH (1, 1)-EVT models with skewed-t distribution for eight cryptocurrencies returns. The exceedances involve counting the number of actual realized returns that exceed the VaR forecast and comparing this number with the expected number of exceedances. The closer the observed number of exceedances is to the hypothetically expected number, the more preferable the model is for estimating accurate forecasts. More exceedances indicate that the model underestimates Value at Risk and fewer exceedances indicate that the model overestimates Value at Risk. The expected exceedances are 25 for the 95% confidence level and 5 for 99% confidence level. The null hypothesis of Kupiec’s unconditional coverage test assumes that the probability of occurrence of variations equals the expected level of significance. Under the null hypothesis, a good model should be the one that does not reject the null hypothesis. Hence, the test with a p-value greater than 0.05 for the unconditional coverage test indicates that the number of violations is statistically equal to the expected. These backtesting results demonstrate that GARCH-EVT clearly outperforms GARCH benchmark VaR predictors.

Table 5. VaR forecast violations of the cryptocurrencies in terms of actual and expected exceedances and Unconditional Coverage (UC) results.

Table 6 also presents test statistic and p-values in parentheses of conditional coverage tests for GARCH (1, 1), EGARCH (1, 1), APARCH (1, 1), NGARCH (1, 1) and GARCH (1, 1)-EVT models with skewed-t distribution. For the conditional coverage test, likewise, a good model should accept the null hypothesis, that is, correctly identifying the number of violations and being independent. The null hypothesis of the conditional coverage test indicates that the probability of occurrence of the violations equals the expected significance level and the violation is independently distributed through time. The empirical results suggest that the combined GARCH-EVT model performs best in estimating out-of-sample VaR forecasts in the specified backtesting period and this makes it relatively better in forecasting VaR. The superior performance is attributed to the combined approachability to appropriately capture the statistical features of the data.

Table 6. Conditional Coverage (CC) results of backtesting.

4. Conclusion

Cryptocurrencies unlike conventional financial assets such as currencies exchange rates and stock prices are characterized by high volatility and extreme price movements. This paper employed GARCH-type models and extreme value theory to model the volatility and tail behaviour of the cryptocurrencies returns. Modelling the tail behaviour of the returns of cryptocurrencies is of utmost importance for both investors and policy-makers. The GARCH-EVT approach is implemented in modelling the tail distribution of cryptocurrencies return series and forecasting out-of-sample value at risk. The back-testing results demonstrate the superiority of the heavy-tailed GARCH-EVT models in forecasting out-of-sample value at risk. Overall, the model provides a significant improvement in forecasting value-at-risk over the widely used conventional GARCH models. This study can be extended by considering intra-day cryptocurrencies data and more robust models such as the GARCH-EVT-Copula model that can also capture the dependence structure of between cryptocurrencies.

Conflicts of Interest

The authors declare no conflicts of interest.

References

[1] Nakamoto, S. (2008) Bitcoin: A Peer-to-Peer Electronic Cash System. Bitcoin, 4.
https://bitcoin.org/bitcoin.pdf
[2] coinmarketcap.com. (2021) Overview of Available Cryptocurrencies.
https://coinmarketcap.com
[3] Schnaubelt, M., Rende, J. and Krauss, C. (2019) Testing Stylized Facts of Bitcoin Limit Order Books. Journal of Risk and Financial Management, 12, Article No. 25.
https://doi.org/10.3390/jrfm12010025
[4] Peng, Y., Albuquerque, P.H.M., de Sá, J.M.C., Padula, A.J.A. and Montenegro, M.R. (2018) The Best of Two Worlds: Forecasting High-Frequency Volatility for Cryptocurrencies and Traditional Currencies with Support Vector Regression. Expert Systems with Applications, 97, 177-192. https://doi.org/10.1016/j.eswa.2017.12.004
[5] Fakhfekh, M. and Jeribi, A. (2020) Volatility Dynamics of Cryptocurrencies Returns: Evidence from Asymmetric and Long Memory GARCH Models. Research in International Business and Finance, 51, Article ID: 101075.
https://doi.org/10.1016/j.ribaf.2019.101075
[6] Ngunyi, A., Mundia, S. and Omari, C. (2019) Modelling Volatility Dynamics of Cryptocurrencies Using GARCH Models. Journal of Mathematical Finance, 9, 591-615. https://doi.org/10.4236/jmf.2019.94030
[7] Chu, J., Chan, S., Nadarajah, S. and Osterrieder, J. (2017) GARCH Modelling of Cryptocurrencies. Journal of Risk and Financial Management, 10, Article No. 17.
https://doi.org/10.3390/jrfm10040017
[8] Borri, N. (2019) Conditional Tail-Risk in Cryptocurrency Markets. Journal of Empirical Finance, 50, 1-19. https://doi.org/10.1016/j.jempfin.2018.11.002
[9] Gangwal, S. and Longin, F. (2018) Extreme Movements in Bitcoin Prices: A Study Based on Extreme Value Theory. ESSEC Working Paper Ser, 8, 1-17.
[10] Begušić, S., Kostanjčar, Z., Stanley, H.E. and Podobnik, B. (2018) Scaling Properties of Extreme Price Fluctuations in Bitcoin Markets. Physica A: Statistical Mechanics and its Applications, 510, 400-406. https://doi.org/10.1016/j.physa.2018.06.131
[11] Zhang, Y., Chan, S. and Nadarajah, S. (2019) Extreme Value Analysis of High-Frequency Cryptocurrencies. High Frequency, 2, 61-69.
https://doi.org/10.1002/hf2.10032
[12] Gkillas, K. and Katsiampa, P. (2018) An Application of Extreme Value Theory to Cryptocurrencies. Economics Letters, 164, 109-111.
https://doi.org/10.1016/j.econlet.2018.01.020
[13] Likitratcharoen, D., Ranong, T.N., Chuengsuksomboon, R., Sritanee, N. and Pansriwong, A. (2018) Value at Risk Performance in Cryptocurrencies. The Journal of Risk Management and Insurance, 22, 11-28.
[14] Engle, R.F. (1982) Autoregressive Conditional Heteroscedasticity with Estimates of the Variance of United Kingdom Inflation. Econometrica, 50, 987-1007.
https://doi.org/10.2307/1912773
[15] Bollerslev, T. (1986) Generalized Autoregressive Conditional Heteroskedasticity. Journal of Econometrics, 31, 307-327. https://doi.org/10.1016/0304-4076(86)90063-1
[16] Hansen, P.R. and Lunde, A. (2005) A Forecast Comparison of Volatility Models: Does Anything Beat a GARCH (1, 1)? Journal of Applied Econometrics, 20, 873-889. https://doi.org/10.1002/jae.800
[17] Nelson, D.B. (1991) Conditional Heteroskedasticity in Asset Returns: A New Approach. Econometrica, 59, 347-370. https://doi.org/10.2307/2938260
[18] Glosten, L.R., Jagannathan, R. and Runkle, D.E. (1993) On the Relation between the Expected Value and the Volatility of the Nominal Excess Return on Stocks. The Journal of Finance, 48, 1779-1801.
https://doi.org/10.1111/j.1540-6261.1993.tb05128.x
[19] Ding, Z., Granger, C.W. and Engle, R.F. (1993) A Long Memory Property of Stock Market Returns and a New Model. Journal of Empirical Finance, 1, 83-106.
https://doi.org/10.1016/0927-5398(93)90006-D
[20] Taylor, S. (1986) Modelling Financial Time Series. John Wiley & Sons, Great Britain.
[21] Engle, R. F. and Lee, G. (1999) A Long-Run and Short-Run Component Model of Stock Return Volatility. In: Cointegration, Causality, and Forecasting: A Festschrift in Honour of Clive WJ Granger, 475-497.
[22] Higgins, M.L. and Bera, A.K. (1992) A Class of Nonlinear ARCH Models. International Economic Review, 33, 137-158. https://doi.org/10.2307/2526988
[23] Engle, R. F. and Ng, V. K. (1993) Measuring and Testing the Impact of News on Volatility. The Journal of Finance, 48, 1749-1778.
https://doi.org/10.1111/j.1540-6261.1993.tb05127.x
[24] Azzalini, A. and Capitanio, A. (2003) Distributions Generated by Perturbation of Symmetry with Emphasis on a Multivariate Skew T-Distribution. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 65, 367-389.
https://doi.org/10.1111/1467-9868.00391
[25] Theodossiou, P. (2015) Skewed Generalized Error Distribution of Financial Assets and Option Pricing. Multinational Finance Journal, 19, 223-266.
https://doi.org/10.17578/19-4-1
[26] Barndorff-Nielsen, O. (1978) Hyperbolic Distributions and Distributions on Hyperbolae. Scandinavian Journal of Statistics, 5, 151-157.
[27] Rigby, R.A. and Stasinopoulos, D.M. (2005) Generalized Additive Models for Location, Scale and Shape. Journal of the Royal Statistical Society: Series C (Applied Statistics), 54, 507-554. https://doi.org/10.1111/j.1467-9876.2005.00510.x
[28] Balkema, A.A. and de Haan, L. (1974) Residual Life Time at Great Age. The Annals of Probability, 2, 792-804. https://doi.org/10.1214/aop/1176996548
[29] Pickands, J. (1975) Statistical Inference Using Extreme Order Statistics. Annals of Statistics, 3, 119-131. https://doi.org/10.1214/aos/1176343003
[30] Smith, R. L. (1987) Approximations in Extreme Value Theory. North Carolina University at Chapel Hill Center for Stochastic Processes.
[31] McNeil, A.J. and Frey, R. (2000) Estimation of Tail-Related Risk Measures for Heteroscedastic Financial Time Series: An Extreme Value Approach. Journal of Empirical Finance, 7, 271-300. https://doi.org/10.1016/S0927-5398(00)00012-8
[32] Kupiec, P.H. (1995) Techniques for Verifying the Accuracy of Risk Measurement Models. The Journal of Derivatives, 3, 73-84.
https://doi.org/10.3905/jod.1995.407942
[33] Christoffersen, P.F. (1998) Evaluating Interval Forecasts. International Economic Review, 39, 841-862. https://doi.org/10.2307/2527341

Copyright © 2024 by authors and Scientific Research Publishing Inc.

Creative Commons License

This work and the related PDF file are licensed under a Creative Commons Attribution 4.0 International License.