Bayesian Study Using MCMC of Three-Parameter Frechet Distribution Based on Type-I Censored Data ()
1. Introduction
Frechet distribution was introduced by [1] for the largest extremes and it had been derived with nonnegative initial variates. Many studies have been carried out on the Frechet distribution by a lot of researchers with the aim of estimating its parameters using different statistical approaches, some of which include [2] [3] and [4]. Furthermore, [5] estimated the scale and shape parameters of Frechet distribution using principal components and least median of squares. [6] derived the reference and matching priors for the Frechet stress-strength model and developed Bayesian approach for Frechet distribution under reference prior, respectively. [7] attained Bayesian estimators of Frechet distribution and their risks by using loss functions under Gumbel Type-II prior and Levy prior. Likewise, [8] estimated the Frechet distribution parameters with an application to the medical field. As demonstrated above, no previous study dealt with Bayesian estimations of the three-parameter Frechet distribution under Type-I censored data in survival/reliability analysis.
One of the special features of survival/reliability analysis data is the censoring mechanism. There are several types of censoring mechanisms but the focus of this manuscript is in Type-I censoring. Type-I censoring is where a study is designed to end at some pre-specified given time and an event is said to have taken place if and only if the event occurs before or at the specified time period.
In this paper we want to solve the following steps:
1) To estimate the three parameters of Frechet distribution using Type I censored data by the maximum likelihood model.
2) To estimate the three parameters of Frechet distribution using Type I censored data with Jeffreys and gamma priors via Markov Chain Monte Carlo (MCMC).
3) To extend the Bayesian estimators with two loss functions, which are squared error loss function and Linear Exponential Loss Function (LINEX).
4) To assess the performance of maximum likelihood and Bayesian models through simulation study.
2. Methodology
2.1. Maximum Likelihood Estimation of Frechet Censored Data
We introduce the concept of maximum likelihood estimation on distribution with censored data. Let
be the set of n random lifetime from the Frechet distribution with parameters
and
. The probability density function of the Frechet distribution according to [1] is:
, (1)
where the cumulative distribution function (cdf) of the Frechet distribution is given as
, (2)
with
as the scale parameter,
the shape parameter and
the location parameter of the distribution
The likelihood function for a Type-I censored data as in [9] is
, (3)
where
for failure and
for censored observation, and
is the survival function.
The logarithm of the likelihood function given in Equation (3) can be expressed as follows:
(4)
To obtain the equations for the unknown parameters, we differentiate Equation (4) partially with respect to the parameters
and
and equal it to zero. The resulting equations are given below respectively see [10],
(5)
(6)
(7)
2.2. Bayesian Estimation of Frechet Based on Type-I Censored Data
We consider Jeffreys prior for the scale and shape parameters. Moreover, the gamma prior will be in location parameter and the proposed prior is, see [8].
(8)
(9)
(10)
The joint prior distribution of three parameters is
(11)
The posterior probability density function of the three parameters given the data
is obtained by dividing the joint probability density function over the marginal density function, following [11].
(12)
(13)
With this, the Bayesian estimates for the three parameters of Frechet distribution under squared error loss function are given as:
(14)
(15)
(16)
The Bayesian estimates under Linear Exponential Loss Function (LINEX)
(17)
(18)
(19)
The parameters (scale, shape and location) of the Frechet distribution cannot be solved analytically under the Bayesian approach therefore, Metropolis-Hastings Algorithm is. Used instead.
Metropolis-Hastings Algorithm
The Metropolis-Hastings algorithm is a very general Markov Chain Mote Carlo method. It can be used to obtain random samples from any arbitrarily complicated target distribution of any dimension that is known up to a normalizing constant. In fact, Metropolis algorithm is an alternative to Gibbs sampler that does not require availability of full conditionals see [12] [13] and [14].
Therefore, the full conditional posterior density function for the three parameters given the data for Jeffreys prior with likelihood are given below
(20)
From Equation (20) we can get the conditional posterior of the scale parameter
as follows
(21)
where the others the scale parameter will be constant for the conditional posterior of the scale parameter then from the posterior we can remove and get the final formula as given in Equation (21).
The conditional posterior of the shape parameter is given below
(22)
The conditional posterior of the location parameter is given below
(23)
As shown in the conditional posterior of the three parameters, they do not follow any close form, hence the use of Metropolis-Hastings algorithm as detailed below to generate MCMC sample, see [15] and [16].
Algorithm:
1) Start with initial value
2) The current value
and generate the candidate value
from arbitrary distribution Uniform (0, 1).
3) Taken the ratio at the candidate value
and current value
The next value of
is given below as
4) Generate u from Uniform (0, 1) and accept
with probability p if
and return to step 2, otherwise accept
and return to step 2.
5) Taken the ratio at the candidate value
and current value
The next value of
is given below as
6) Generate u from Uniform (0, 1) and accept
with probability p if
and return to step 2, otherwise accept
and return to step 2.
7) Taken the ratio at the candidate value
and current value
The next value of
is given below as
8) Generate u from Uniform (0, 1) and accept
with probability p if
and return to step 2, otherwise accept
and return to step 2.
9) The Bayesian estimation of the scale, shape and location parameters under the squared error loss function is given as
(24)
(25)
(26)
10) The Bayesian estimation of the scale, shape and location parameters under the Linex loss function is given as
(27)
(28)
(29)
3. Simulation Study
The values specified for the parameters, sample sizes, censoring time and the Linex loss function were meant for illustration purposes only and were therefore not restrictive. However, to assess the performance of the Maximum likelihood and Bayesian estimations based on Type-I censored data to estimate the three parameters of Frechet distribution, the Mean Squared Errors (MSE) were calculated after running 10,000 iterations. Different sets of sample sizes as well as censoring mechanisms were considered. The samples were n = 25, 50 and 100 and that of the censoring time was 20%. The values considered for the Frechet distribution parameters were the scale parameter which was (1 and 2), the shape parameter which was (0.4 and 1.4) and the location parameter which was 3. Two values (both decreasing and increasing) were specified for the Linex loss function; these were; r = −0.7 and 0.7. The maximum likelihood (MLE) estimated the three parameters of Frechet distribution by using the numerical method with R programme in the Equation (4) via (maxLik) package. In the Bayesian estimation, the Metropolis-Hastings Algorithm was used in Algorithm via (pscl) package in R programme for Bayesian under square error loss function and LINEX loss function to estimate the three parameters of Frechet distribution, where hyper-parameters of gamma priors were equal to 1.
The results were displayed in Tables 1-6 and indicated the different choices of the three parameters, sample size, loss parameter and censoring rate.
Table 1. Estimate the scale parameter of Frechet based on Type-I censored data.
Table 2. MSE for the scale parameter of Frechet based Type-I censored data.
Table 3. Estimate the shape parameter of Frechet based Type-I censored data.
Table 4. MSE for the shape parameter of Frechet based Type-I censored data.
Table 5. Estimate the location parameter of Frechet based Type-I censored data.
Table 6. MSE for the location parameter of Frechet based Type-I censored dat.
4. Results and Discussion
Four values of the estimators which are Maximum likelihood estimation (MLE), Bayesian under squared error loss function (BS), Bayesian under Linear Exponential Loss Function with r = −0.7 (BL (r = −0.7)) and Bayesian under Linear Exponential Loss Function with r = 0.7 (BL (r = 0.7)) are shown in each column for each size.
Table 1 contains the estimate of the scale parameter of Frechet distribution based on Type-I censored data with Maximum likelihood, Bayesian under squared error loss function and under Linear Exponential Loss Function with r = −0.7 and 0.7. As shown in the results when the shape paramemter
was 1 and location pramster
was 0.4 with size 25, the Maximum Likelihood Estimation (MLE) was 1.1042, the Bayesian under squared error loss function (BS) estimation was 1.1486, BL (r = −0.7) estimation was 1.1580 and BL (r = 0.7) estimation was 1.0716, we observed that the BL (r = 0.7) was closer to true value than others estimation.
From Table 2 the results show that, the Bayesian estimation under Linear Exponential Loss Function with r = 0.7 is better compared to the others with respect to the MSE of scale parameter. We observed from Table 2 that the maximum likelihood estimation has the smallest MSE and therefore is a better estimate that Bayesian under squared error loss function as well as Bayesian under Linear Exponential Loss Function with r = −0.7 for all cases except with size 25 when.
Table 3 presented the estimates of the shape parameter of Frechet distribution based on Type-I censored data by employing the four estimators above as illustrated earlier. The initial values of the shape parameter were 0.4 and 1.4.
As shown in the results, the Maximum Likelihood Estimation (MLE) was 0.5432 and the Bayesian under squared error loss function (BS) estimation was 0.5876. When the true value of the shape parameter was 0.4, we observed that the MLE was closer to true value than BS estimation.
As shown in the results when the shape paramemter
was 1 and location pramster
was 0.4 with size 25, the Maximum Likelihood Estimation (MLE) was 0 5432, the Bayesian under squared error loss function (BS) estimation was 0.5876, BL (r = −0.7) estimation was 0.5971 and BL (r = 0.7) estimation was 0.5106, we observed that the BL (r = 0.7) was closer to true value than others estimation.
As shown in Table 4 the performance of the estimators for the estimation of the shape parameter was compared again using mean squared error (MSE). We again observed that the Bayesian estimation under Linear Exponential Loss Function with r = 0.7 performed better compared to the others with respect to the MSE of scale parameter. Moreover, the maximum likelihood estimation is better than Bayesian under squared error loss function and Bayesian under Linear Exponential Loss Function with r = −0.7 for all cases except with size 25 when also with size 50 when Table 5 presented the estimates of the location parameter of Frechet distribution based on Type-I censored data by employing the four estimators. The initial value of the location parameter was 3. The result showed that the MLE was 3.1165 and Bayesian under Linear Exponential Loss Function with r = −0.7 (BL (r = 0.7)) estimation was 3.0839. We observed that the Bayesian under Linear Exponential Loss Function with r = −0.7 (BL (r = 0.7)) estimation was closer to true value than the MLE.
In Table 6 the estimators of the location parameter were compared by mean square error (MSE) and it was observed that the Bayesian estimation under Linear Exponential Loss Function with r = 0.7 is better compared to the others with respect to the MSE of scale parameter. Moreover, the maximum likelihood estimation is better than Bayesian under squared error loss function and Bayesian under Linear Exponential Loss Function with r = −0.7.
5. Conclusion
The results from this study show that the Bayesian estimation under Linear Exponential Loss Function with r = 0.7 based on Type-I censored data was a better estimator for all the parameters (scale, shape and location) estimates. The contribution to knowledge in this manuscript was the application of the Bayesian estimation approaches based on Type-I censored data that was considered under Markov Chain Monte Carlo (MCMC) for the three parameters of Frechet distribution. The Maximum Likelihood Estimation (MLE) was better than Bayesian under square error loss function and Exponential Loss Function with r = −0.7 for all the parameters (scale, shape and location) estimates. When the number of sample size increases, the mean squared errors (MSE) decrease in all cases.