Empirical Bayesian Approach to Testing Homogeneity of Several Means of Inflated Poisson Distributions (IPD) ()

Mohamed M. Shoukri^{1*}, Maha Aleid^{2}

^{1}Department of Epidemiology and Biostatistics, Schulich School of Medicine and Dentistry, University of Western Ontario, London, Canada.

^{2}Knowledge Translation Department, Saudi National Institute of Health, Riyadh, Saudi Arabia.

**DOI: **10.4236/ojs.2023.133015
PDF
HTML XML
87
Downloads
397
Views
Citations

**Objectives:** We introduce a special form of the Generalized Poisson Distribution. The
distribution has one parameter, yet it has a variance that is larger than the
mean a phenomenon known as “over dispersion”. We discuss potential applications
of the distribution as a model of counts, and under the assumption of
independence we will perform statistical inference on the ratio of two means,
with generalization to testing the homogeneity of several means. **Methods:** Bayesian methods depend on the choice of the prior distributions of
the population parameters. In this paper, we describe a Bayesian approach for estimation and inference on the parameters of
several independent Inflated Poisson (IPD) distributions with two
possible priors, the first is the reciprocal of
the square root of the Poisson parameter and the other is a conjugate Gamma
prior. The parameters of Gamma distribution are estimated in the
empirical Bayesian framework using the maximum likelihood (ML) solution using
nonlinear mixed model (NLMIXED) in SAS. With these priors we construct the highest
posterior confidence intervals on the ratio of two IPD parameters and test the
homogeneity of several populations. **Results****: **We encountered convergence problem in estimating the
hyperparameters of the posterior distribution using the NLMIXED. However,
direct maximization of the predictive density produced solutions to the maximum
likelihood equations. We apply the methodologies to RNA-SEQ read count data of
gene expression values.

Keywords

Distributions of Over-Dispersed Counts, Lagrange Class of Distributions, Knowledge Transfer, Gamma Prior, Posterior Inference, Wilson-Hilferty Transformation, RNA_SEQ Read Counts Data

Share and Cite:

Shoukri, M. and Aleid, M. (2023) Empirical Bayesian Approach to Testing Homogeneity of Several Means of Inflated Poisson Distributions (IPD). *Open Journal of Statistics*, **13**, 285-299. doi: 10.4236/ojs.2023.133015.

1. Introduction

Bayesian methods are becoming a popular technique for estimating model parameters and hypothesis testing. Under certain conditions choosing the correct prior distribution is a critical step in Bayesian modeling. The traditional Bayesian approach assumes that all prior distribution parameters are known. Knowledge of these parameters may be based on observed data in similar studies with similar objectives. If such data are unavailable, a non-informative prior distribution may be used [1] . As a result, choosing an appropriate prior distribution is important. It is known that the Gamma distribution is used for the Poisson family of distributions. This distribution is considered conjugate in the sense that the posterior probability belongs to the class of Gamma distributions. Similarly, we shall employ the Gamma distribution as an alternative prior for the IPD parameter.

The method of maximum likelihood estimation of unknown prior distribution parameters can be used and in most situations, we need numerical algorithms to estimate the parameters of the prior distribution. In this paper we used NLMIXED procedure in SAS.

In Section 2 we introduce the functional form of the IPD and discuss some of its interesting properties. In Section 3 we investigate the Bayesian inference on the ratio of IPD parameters based on samples drawn from independent populations. Both non-informative priors and conjugate gamma priors will be used to achieve the main objectives. In Section 4 we extend the methodology to test the homogeneity of the several population parameters, and in Section 5 we apply the methods to published genomics data.

2. The Inflated Poisson Distribution (IPD)

The Poisson distribution is commonly used to model count data. However, a restriction of this distribution is that the response variable must have a mean equal to the variance. This restriction does not often hold for many biological and epidemiological data. The variance can be much larger than the mean, a phenomenon known as “overdispersion”. This overdispersion may occur due to population heterogeneity, or the presence of outliers in the data [2] . An analysis of data with overly dispersed counts can lead to the underestimation of parameter standard error if overdispersion is ignored. A review of the issue of overdispersion in both binary and count data was reviewed by Hinde and Demetrio [3] , and in a more recent review by Hayat and Higgins [4] . Diagnosing and accounting for overdispersion is not a simple issue and should be appropriately dealt with to avoid bias in interpreting the results.

When overdispersion is suspected, the Negative-Binomial (NB) distribution has been adopted as a common alternative to the Poisson distribution. The NB has two parameters and a variance that is a quadratic function of the mean and has therefore been the model of choice to model count data that exhibit overdispersion. Since accounting for measured covariates is one of the methods used to address the issue of over dispersion by including them in a regression model, Hinde [5] reviewed the methodologies of NB regression. Joe and Zhu [6] drew a comparison between the NB and a mixture-based generalization of the Poisson distribution.

In this paper, we discuss several inferential statistical issues related to a modified form of the Generalized Poisson Distribution (GPD). The GPD distribution was introduced to the statistical literature by Consul and Jain [7] and a detailed account of its properties was given by Consul [8] . The distribution has two parameters and has variance larger than the mean. This makes the GPD an attractive competitor of the Negative Binomial Distribution (NBD). The distribution has been used to analyze data in the fields of genetics [9] as a queuing model [10] [11] [12] and genomics [13] . The Bayesian statistical inference on the proposed form of the GPD, which we shall call “Inflated Poisson Distribution” (IPD) is the subject of this research paper.

We introduce three random mechanisms by which the IPD is generated and discuss some of its properties. In Section 3 we consider the Bayesian inference on the parameter of the distribution and construct the exact posterior density of the ratio of two parameters for independent populations. In Section 4 we apply the Wilson-Hilferty (WH) [14] to the posterior distribution in order to test the homogeneity of parameters of several populations. We analyze published data sets related to the read counts of RNA-SEQ.

2.1. The IPD and Its Moments

A random variable *x* is said to have IPD if the probability function is given by:

$P\left(x=x\right)=\frac{{\left(1+x\right)}^{x-1}}{x!}{\lambda}^{x}{\stackrel{\xaf}{e}}^{\lambda \left(1+x\right)}$ (1)

This distribution is a special case of the Generalized Poisson Distribution (GPD). We review the literature on the derivation of the probability function given in (1).

1) Consul and Shenton [15] showed that the Lagrange expansion of implicit Probability Generating Function. If $g\left(t\right)$ and $f\left(t\right)$ are two probability generating functions, then under the transformation:

$t=u\cdot g(\; t\; )$

and within the circle of convergence,
$f\left(t\right)$ can be expanded in powers of *u *by the Lagrange expansion, then the coefficient of
${u}^{x}$ , produces a probability distribution given as:

$P\left(x=x\right)=\frac{1}{x!}\frac{{\partial}^{x-1}}{\partial t}{\left[{\left(g\left(t\right)\right)}^{x}\frac{\partial f\left(t\right)}{\partial t}\right]}_{t=0}$ (2)

making the substitutions:

$g\left(t\right)={\text{e}}^{\lambda \left(t-1\right)}$ and $f\left(t\right)={\text{e}}^{\lambda \left(t-1\right)}$

in Equation (2) we get the probability distribution (1).

2) Consul and Shoukri [15] showed that in the special case of a Borel-Tanner distribution [16] conditional a parameter $\eta $

$P\left(x|\eta \right)=\frac{\eta}{\left(x-\eta \right)!}{x}^{x-\eta -1}{\lambda}^{x-\eta}{\stackrel{\xaf}{e}}^{\lambda x},\text{\hspace{0.17em}}\text{\hspace{0.17em}}x=\eta ,\eta +1,\cdots $ (3)

If $\eta $ has a Poisson distribution (4)

$P\left(\eta =j\right)={\stackrel{\xaf}{e}}^{\lambda x}{\lambda}^{j}/j!$ , (4)

then the unconditional distribution of *x* is

$P\left(x=x\right)={\displaystyle \sum P\left(x=x\text{|}\eta \right)P\left(\eta =j\right)}=\frac{{\left(1+x\right)}^{x-1}}{x!}{\lambda}^{x}{\stackrel{\xaf}{e}}^{\lambda \left(1+x\right)},\text{\hspace{0.17em}}\text{\hspace{0.17em}}x=0,1,\cdots $

3) The IPD arises as a limiting form of the quasi-generalized negative distribution (see: Shoukri and Aleid [17] ):

$Px=P\left(X=x\right)=\frac{\beta -1}{\left(\beta -1\right)+\beta x}\cdot \frac{\Gamma \left(\beta +\beta x\right){\theta}^{x}{\left(1-\theta \right)}^{\beta +\beta x-x-1}}{x!\Gamma \left(\beta +\beta x-x\right)}$ (5)

As $\beta \to \infty ,\theta \to 0$ , so that $\beta \theta =\alpha $ , the limiting distribution (5) becomes (1).

2.2. Moments and Variance Stabilizing Transformation

From [6] , the mean and variance of the distribution are given respectively by:

$\mu =\lambda /1-\lambda $ , $0<\lambda <1$

${\sigma}^{2}=\lambda /{\left(1-\lambda \right)}^{3}$

In terms of the mean *μ*, the parameter *λ* is given by:

$\lambda =\frac{\mu}{1+\mu}$ (6)

Therefore the variance is given in (7)

${\sigma}^{2}\left(\mu \right)=\mu {\left(1+\mu \right)}^{2}$ (7)

Shoukri and Mian [10] established a recurrence relation among the *r*-th non-central moments
${{\mu}^{\prime}}_{r}$ so that:

${{\mu}^{\prime}}_{r+1}={\sigma}^{2}\left(\mu \right)\frac{\partial {{\mu}^{\prime}}_{r}}{\partial \mu}+\mu {{\mu}^{\prime}}_{r}$ (8)

From (8) we get:

${{\mu}^{\prime}}_{0}\equiv 1,\text{\hspace{0.17em}}\text{\hspace{0.17em}}{{\mu}^{\prime}}_{1}=\mu =E(\; y\; )$

The third and fourth central moments are given respectively by

${\mu}_{3}=E{\left(y-\mu \right)}^{3}=\mu {\left(1+\mu \right)}^{3}\left(1+3\mu \right)$ (9)

${\mu}_{4}=E{\left(y-\mu \right)}^{4}=\mu {\left(1+\mu \right)}^{4}\left(1+13\mu +15{\mu}^{2}\right)$ (10)

For discrete random variables such as binomial negative binomial, and Poisson distributions a variance stabilizing transformation can be developed if the relationship between the mean and variance is known. From the definition of skewness and on using (9) and (10) we have:

skewness (*sk*) is:

$sk=\sqrt{\frac{{\left(1+3\mu \right)}^{2}}{\mu}}=\frac{1+3\mu}{\sqrt{\mu}}$

Or

$sk=\left(1+2\lambda \right)\sqrt{\frac{1-\lambda}{\lambda}}$ (11)

Clearly for $0<\lambda <1$ the distribution is positively skewed. From (11) clearly the degree of skewness is inversely related to the values of $\lambda $ .

The distribution has an interesting property in that, within the class of discrete distributions defined on $R=\left(0,1,2,\cdots ,\infty \right)$ , the IPD has a single parameter and yet it possess the property of overdispersion.

Akin to the Poisson distribution we may develop a variance stabilizing transformation. We would like to find a variance stabilizing transformation $Z=\Psi \left(x\right)$ such that $\mathrm{var}\left(z\right)={c}^{2}$ , which does not depend on the population parameter. We employ the Taylor series expansion so that:

$\Psi \left(x\right)=\Psi \left(\mu \right)+\frac{\partial \Psi}{\partial \mu}\left(x-\mu \right)+0\left(x-\mu \right)$ (12)

Solving (12) then

$\frac{\partial \Psi}{\partial \mu}\propto c\frac{1}{{\left(\mathrm{var}\left(x\right)\right)}^{1/2}}$ (13)

Solution of the differential Equation (13) is: $z={\mathrm{tan}}^{-1}\left(\sqrt{y}\right)$ which has variance = 1/4, similar to the variance stabilizing transformation ${z}_{p}=\sqrt{y}$ of the Poisson distribution.

This variance stabilizing transformation may be used to derive an approximate expression for the sample size needed to test the equality of two IPD means.

To test the null hypothesis ${H}_{0}:{\mu}_{1}={\mu}_{2}$ versus ${H}_{1}:{\mu}_{1}\ne {\mu}_{2}$ at type I error rate 5%, and power 80%, the approximate sample size drawn from each of two inflated Poisson populations is:

$N={2.48}^{2}/4{\Delta}^{2}$ (14)

where $\Delta ={\mathrm{tan}}^{-1}\sqrt{{\mu}_{1}}-{\mathrm{tan}}^{-1}\sqrt{{\mu}_{2}}$ .

In Table 1 values of *N* in equation (14) for selected values of the population parameters.

3. Bayesian Analysis

Bayesian methods are becoming a popular technique for estimating model parameters and hypothesis testing. Under certain conditions choosing the correct

Table 1. Selected values of the sample sizes.

prior distribution is a critical step in Bayesian modeling. The traditional Bayesian approach assumes that all prior distribution parameters are known. Knowledge of these parameters may be based on observed data in similar studies with similar objectives. If such data are unavailable, a non-informative prior distribution may be used [1] . As a result, choosing an appropriate prior distribution is important. It is known that the Gamma distribution is used for the Poisson family of distributions. This distribution is considered conjugate in the sense that the posterior probability belongs to the class of Gamma distributions. Similarly, we shall use the Gamma distribution as an alternative prior for the IPD parameter.

The method of maximum likelihood estimation of unknown prior distribution parameters can be used and in most situation we need numerical algorithms to estimate the parameters of the prior distribution. In this paper we used NLMIXED in SAS.

Let
$\left({x}_{i1},{x}_{i2},\cdots ,{x}_{{n}_{i}}\right)$ denotes *k* random samples of size
${n}_{i}$ from the *j*^{th} IPD. The likelihood is given in (15):

${L}_{i}={\displaystyle {\prod}_{j=1}^{{n}_{i}}{\left(1+{x}_{ij}\right)}^{{x}_{ij}-1}\frac{{\lambda}_{i}^{{x}_{ij}}}{{x}_{ij}!}{\stackrel{\xaf}{e}}^{{\lambda}_{i}\left({x}_{ij}+1\right)}}$ (15)

Clearly

${y}_{i}={\displaystyle {\sum}_{j=1}^{{n}_{i}}{x}_{ij}}$

is the sufficient statistic for ${\lambda}_{i}$ . The probability distribution of ${y}_{i}$ is given in (16) as:

$P\left({Y}_{i}={y}_{i}|{\lambda}_{i}\right)=\frac{{n}_{i}{\lambda}_{i}^{{y}_{i}}{\left({n}_{i}+{y}_{i}\right)}^{{y}_{i-1}}}{{y}_{i}!}\mathrm{exp}\left[-{\lambda}_{i}\left({n}_{i}+{y}_{i}\right)\right],\text{\hspace{0.17em}}\text{\hspace{0.17em}}i=1,2,\cdots ,k$ (16)

To achieve the main objective of this paper, we shall consider a prior distribution with a conjugacy-like distribution. Here we consider two prior specifications: the first being the vague prior and the second is the conjugate gamma prior distribution for the parameter ${\lambda}_{i}$ .

Hierarchical Bayes and Empirical Bayes are related by their goals, but quite different by the methods of how these goals are achieved. The attribute hierarchical refers mostly to the modeling strategy, while empirical is referring to the methodology. Both methods are concerned in specifying the distribution at prior level, hierarchical via Bayes inference involving additional degrees of hierarchy (hyperpriors and hyperparameters), while empirical Bayes is using data more directly.

3.1. Vague Prior

We start by using the vague prior specification for ${\lambda}_{i}$ given in (17)

$\pi \left({\lambda}_{i}\right)\propto 1/\sqrt{{\lambda}_{i}}$ (17)

The posterior density of ${\lambda}_{i}$ is therefore given by (18):

$\pi \left({\lambda}_{i}|{y}_{i}\right)=\frac{{\left({y}_{i}+{n}_{i}\right)}^{{y}_{i}+1/2}}{\Gamma \left({y}_{i}+1/2\right)}{\lambda}_{i}^{{y}_{i}-1/2}\mathrm{exp}\left[-{\lambda}_{i}\left({y}_{i}+{n}_{i}\right)\right]$ (18)

This means that the posterior density of ${\lambda}_{i}$ is such that $2{\lambda}_{i}\left({y}_{i}+{n}_{i}\right)$ has a Chi-square distribution with ${v}_{i}=2\left({y}_{i}+1/2\right)$ degrees of freedom. Therefore, the posterior mean and variance of ${\lambda}_{i}$ are given respectively as $\left({y}_{i}+1/2\right)/\left({y}_{i}+{n}_{i}\right)$ and $\left({y}_{i}+1/2\right)/{\left({y}_{i}+{n}_{i}\right)}^{2}$ .

$M\left({y}_{i}\right)={\displaystyle {\int}_{0}^{\infty}P\left({y}_{i}|{\lambda}_{i}\right)\pi \left({\lambda}_{i}|{y}_{i}\right)\text{d}{\lambda}_{i}}$ (19)

It can be easily shown that (19) has the closed form given in (20):

$M\left({y}_{i}\right)=\frac{{n}_{i}}{{n}_{i}+{y}_{i}}\frac{\Gamma \left(2{y}_{i}+1/2\right)}{\Gamma \left({y}_{i}+1/2\right)\Gamma \left({y}_{i}+1\right)}$ (20)

We can construct an HPD confidence interval on the ratio $R=\frac{{\lambda}_{1}}{{\lambda}_{2}}$ . Since,

$\frac{{\lambda}_{1}}{{\lambda}_{2}}=\frac{\left(2{y}_{1}+1\right)\left({y}_{2}+{n}_{2}\right)}{\left(2{y}_{2}+1\right)\left({y}_{1}+{n}_{1}\right)}\cdot F{v}_{1},{v}_{2}$

Therefore, the exact posterior distribution of the ratio is that of a weighted F-distribution. We can directly construct HPD limits on the ratio using the F-distribution tables after substituting the estimated values of the hyperparameters as shown below.

An $\left(1-\alpha \right)100\%$ confidence interval on $R=\frac{{\lambda}_{1}}{{\lambda}_{2}}$ is such that:

$\text{UL}=\frac{\left(2{y}_{1}+1\right)\left({y}_{2}+{n}_{2}\right)}{\left(2{y}_{2}+1\right)\left({y}_{1}+{n}_{1}\right)}{F}_{1-{\alpha}_{/2}},{v}_{1},{v}_{2}$ ,

$\text{LL}=\frac{\left(2{y}_{1}+1\right)\left({y}_{2}+{n}_{2}\right)}{\left(2{y}_{2}+1\right)\left({y}_{1}+{n}_{1}\right)}{F}_{{\alpha}_{/2}},{v}_{1},{v}_{2}$

${F}_{1-{\alpha}_{/2}},{v}_{1},{v}_{2}$ ${F}_{{\alpha}_{/2}},{v}_{1},{v}_{2}$ are respectively the upper and lower quantiles of the F-distribution with ( ${v}_{1}$ and ${v}_{2}$ ) degrees of freedom.

3.2. Gamma Prior

We consider the two parameters gamma distribution as a prior for the IPD parameter. The suggested prior density is given by:

$\pi \left({\lambda}_{i}|{a}_{i},{b}_{i}\right)=\frac{{b}_{i}^{{a}_{i}}}{\Gamma \left({a}_{i}\right)}{\lambda}_{i}^{{a}_{i-1}}{\stackrel{\xaf}{e}}^{{b}_{i}{\lambda}_{i}}$ (21)

where $0<{\lambda}_{i}<\infty $ and ${a}_{i},{b}_{i}>0$ . The prior mean and variance are easily obtained from (21) and are given respectively as ${a}_{i}/{b}_{i}$ , and ${a}_{i}/{b}_{i}^{2}$ . The posterior distribution of ${\lambda}_{i}$ is therefore given by:

$\pi \left({\lambda}_{i}|{y}_{i},{a}_{i},{b}_{i}\right)\propto {\lambda}_{i}^{{y}_{i}+{a}_{i}-1}\mathrm{exp}\left[-{\lambda}_{i}\left({y}_{i}+{n}_{i}+{b}_{i}\right)\right]$ (22)

The exact posterior density of ${\lambda}_{i}$ is thus given by (23):

$\pi \left({\lambda}_{i}|{y}_{i},{a}_{i},{b}_{i}\right)=\frac{{\left({y}_{i}+{n}_{i}+{b}_{i}\right)}^{{y}_{i}+{a}_{i}}}{\Gamma \left({y}_{i}+{a}_{i}\right)}{\lambda}_{i}^{{y}_{i}+{a}_{i}-1}\mathrm{exp}\left[-{\lambda}_{i}\left({y}_{i}+{n}_{i}+{b}_{i}\right)\right]$ (23)

This means that the posterior density of ${\lambda}_{i}$ is such that, $X=2{\lambda}_{i}\left({y}_{i}+{n}_{i}+{b}_{i}\right)$ has a Chi-square distribution with ${d}_{i}=2\left({y}_{i}+{a}_{i}\right)$ degrees of freedom. Hence,

the posterior distribution of ${\lambda}_{i}=\frac{X}{2\left({y}_{i}+{n}_{i}+{b}_{i}\right)}$ is that of a weighted Chi-square variable with $2\left({y}_{i}+{a}_{i}\right)$ degrees of freedom.

Therefore, the posterior mean and variance of ${\lambda}_{i}$ are given respectively as

$\left({y}_{i}+{a}_{i}\right)/\left({y}_{i}+{n}_{i}+{b}_{i}\right)$ and $\left({y}_{i}+{a}_{i}\right)/{\left({y}_{i}+{n}_{i}+{b}_{i}\right)}^{2}$ .

We conclude that the ratio $R=\frac{{\lambda}_{1}}{{\lambda}_{2}}$ has a weighted F distribution with ${v}_{1}$ and ${v}_{2}$ degrees of freedom, or

$R=\frac{{\lambda}_{1}}{{\lambda}_{2}}=\frac{\left({y}_{1}+{b}_{1}\right)\left({y}_{2}+{n}_{2}+{b}_{2}\right)}{\left({y}_{2}+{b}_{2}\right)\left({y}_{1}+{n}_{1}+{b}_{1}\right)}\cdot F{d}_{1},{d}_{2}$

Therefore on
$\left(1-\alpha \right)100\%$ posterior confidence (24) interval on *R *is such that:

$1-\alpha ={P}_{r}\left[{c}_{1}<R<{c}_{2}\right]$ (24)

where

${c}_{1}=\frac{\left({y}_{1}+{a}_{1}\right)\left({y}_{2}+{n}_{2}+{b}_{2}\right)}{\left({y}_{2}+{a}_{2}\right)\left({y}_{1}+{n}_{1}+{b}_{1}\right)}\cdot {F}_{1-{\alpha}_{1/2}},{d}_{1},{d}_{2}$

${c}_{2}=\frac{\left({y}_{1}+{a}_{1}\right)\left({y}_{2}+{n}_{2}+{b}_{2}\right)}{\left({y}_{2}+{a}_{2}\right)\left({y}_{1}+{n}_{1}+{b}_{1}\right)}\cdot {F}_{{\alpha}_{1/2}},{d}_{1},{d}_{2}$

The confidence limits in (24) depend on $\left({a}_{i},{b}_{i}\right)$ and their estimates are obtained by maximizing the marginal predictive density given in (25) with respect to the target parameters. The marginal predictive density is given by:

$\begin{array}{c}M\left({y}_{i}|{a}_{i},{b}_{i}\right)={\displaystyle {\int}_{0}^{\infty}P\left({y}_{i}|{\lambda}_{i}\right)\pi \left({\lambda}_{i}|{a}_{i},{b}_{i}\right)\text{d}{\lambda}_{i}}\\ =\frac{{n}_{i}\Gamma \left({y}_{i}+{a}_{i}\right)}{\Gamma \left({y}_{i}+1\right)\Gamma \left({a}_{i}\right)}{\left[\frac{{b}_{i}}{{n}_{i}+{y}_{i}+{b}_{i}}\right]}^{{a}_{i}}\frac{{\left({n}_{i}+{y}_{i}\right)}^{{y}_{i}-1}}{{\left({n}_{i}+{y}_{i}+{b}_{i}\right)}^{{y}_{i}}}\\ =\frac{{n}_{i}}{\left({n}_{i}+{y}_{i}\right)}\frac{\Gamma \left({y}_{i}+{a}_{i}\right)}{\Gamma \left({y}_{i}+1\right)\Gamma \left({a}_{i}\right)}{\left[\frac{{n}_{i}+{y}_{i}}{{n}_{i}+{y}_{i}+{b}_{i}}\right]}^{{y}_{i}}{\left[\frac{{b}_{i}}{{n}_{i}+{y}_{i}+{b}_{i}}\right]}^{{a}_{i}}\end{array}$ (25)

The maximum likelihood estimates of the hyperparameters $\left({a}_{i},{b}_{i}\right)$ are obtained by maximizing the log-likelihood $l\left({a}_{i},{b}_{i}\right)$ given by:

$l\left({a}_{i},{b}_{i}\right)={\displaystyle {\sum}_{i=1}^{k}\mathrm{log}\left[M\left({y}_{i}|{a}_{i},{b}_{i}\right)\right]}$ (26)

Therefore, the maximum likelihood estimators are $\left({\stackrel{^}{a}}_{i},{\stackrel{^}{b}}_{i}\right)=\mathrm{arg}\mathrm{max}\left\{l\left({a}_{i},{b}_{i}\right)\right\}$ .

Thus, the empirical Bayes method may be interpreted as a mixed model, and mixed model software may be used (proc NLMIXED) In the marginal likelihood function, the unknown IPD parameter is integrated out. The resulting marginal distribution is not a negative binomial (NB) distribution. The marginal predictive density is, however, a difficult vehicle for parameter estimation. As will be shown below, the convergence of the SAS optimization procedures is not always guarantied, and the solution is not necessarily a global maximum of the likelihood function even when we have large samples.

4. Application: Data Analysis: RNA_SEQ Data: Modeling the Distribution of Read Counts

Over the past decade, various statistical analysis tools have been developed to analyze expression profiling data generated by microarrays (Reviewed in [20] [21] [22] ). Before these tools can be applied to RNA-Seq data, it is worth noting that microarray data and RNA-Seq data are inherently different [20] . Microarray data is “analog” since expression levels are represented as continuous hybridization signal intensities. In contrast, RNA-Seq data is “digital”, representing expression levels as discrete counts. This inherent difference leads to the difference in the parametric statistical methods that are used since they often depend on the assumptions of the random mechanism that generates the data. The Poisson, Binomial and Negative binomial distributions are more suitable for modeling discrete data in an RNA-Seq experiment. Therefore, a statistical method developed for microarray data analysis cannot be directly applied to RNA-Seq data analysis without first examining the underlying distributions. Recently several statistical methods have been developed to deal specifically with RNA-Seq count data [17] . In an RNA-Seq dataset, the expression levels of a specific gene were modeled using the Poisson distribution. This Poisson model is verified in the case where there are only technical replicates using a single source of RNA [15] . In the Poisson model, over-dispersion occurs if the sample variance is greater than the sample mean. There could be several sources that cause over-dispersion in RNA-Seq data, including the variability in biological replicates due to heterogeneity within a population of cells, possible correlation between gene expressions due to regulation, and other uncontrolled variations [18] . The existence of over-dispersion in real data was observed in several previous studies [19] . Popular models to safeguard against over-dispersion include the negative binomial distribution, or two-stage Poisson distribution [20] , as discussed below.

When over-dispersion is observed across the samples, the gene counts cannot be estimated accurately by a simple Poisson model [21] . One way to handle this problem is to allow the Poisson mean to be a random variable and then model the gene counts by the marginal distribution of the mean count. Specifically, assume that the Poisson mean follows a Gamma distribution then the marginal distribution of the gene count has a Negative Binomial distribution with mean ${\mu}_{i}$ and variance = ${\mu}_{i}\left(1+\epsilon {\mu}_{i}\right)$ , where $\epsilon $ is the dispersion parameter [22] .

Whenever multiple samples are available and instead of modeling the raw expression, we model the gene counts as a function of the experimental sample and gene dispersion as covariates. For highly expressed genes we used the IPD for published data that we downloaded from http://woldlab.caltech.edu/rnaseq/.

The published data were downloaded from http://www.ncbi.nlm.nih.gov/sra/ as the fastq files: SRA010153 for the MAQC data, SRP000727 for the human data (the two low-coverage MAQC samples were excluded), SRX000559-SRX000564 for the yeast data.

Data Analysis Results

For highly expressed genes we used the QNB regression model for published data that we downloaded from http://woldlab.caltech.edu/rnaseq/.

The published data were downloaded from http://www.ncbi.nlm.nih.gov/sra/ as the fastq files: SRA010153 for the MAQC data, SRP000727 for the human data (the two low-coverage MAQC samples were excluded), SRX000559-SRX000564 for the yeast data.

We analyzed the read count of the Mice-Brain tissue data under four experimental conditions:

Chrom_chr11, Chrom chr9_ra, and Chrom chrUn_ra.

For the two samples case we analyzed the read count of the Mice-Brain tissue data first using the two experimental conditions: Chrom_ chr11, Chrom chr9_ra. The data analyses were done in three steps. In the first step we apply the Chi-square test if goodness of fit where the null hypothesis is that the data is drawn from and IDP. In the second step explain the approach to estimating the problem of estimating the hyperparameters (*a _{i}*,

The histogram of the read counts data show severe skewness to the right as shown in Figure 1 & Figure 2.

The Chi-square goodness of fit on the hypothesis that the random mechanism generating the data is the IPD with moment estimator of *λ *= 0.886, has a p-value = 0.245.

The Chi-square goodness of fit on the hypothesis that the random mechanism generating the data is the IPD with moment estimator of *λ* = 0.670, has a p-value = 0.242.

Therefore, we conclude that the two data sets support the IPD hypothesis against a general alternative. We present the summary statistics in Table 2.

The problem of estimating the hyperparameters

Table 2. Summary statistics of the first two read counts experiments.

Figure 1. Histogram of the Chrom_ chr11 read data.

Figure 2. Histogram of the Chrom chr9_ra.

The 95% highest posterior Bayesian interval on the ratio $\frac{{\lambda}_{1}}{{\lambda}_{2}}$ is given by:

$0.95=\text{Probability}\left(0.391<\frac{{\lambda}_{1}}{{\lambda}_{2}}<0.473\right)$

We conclude that there is no significant difference between the read counts means in the two sample.

5. Approximate Bayesian Test of Homogeneity of IPD Parameters

We shall apply the Wilson-Hilferty transformation of a Chi-square distribution with *v* degrees of freedom. The W-H is given by:

$\left[{\left({x}^{2}/v\right)}^{1/3}-\left(1-\frac{2}{9v}\right)\right]/\sqrt{\frac{2}{9v}}~N\left(0,1\right)$ (27)

Applying the transformation to the random variables:

$2{\lambda}_{i}/\left({y}_{i}+{n}_{i}+{b}_{i}\right)$ which has a Chi-square distribution with ${v}_{i}=2\left({y}_{i}+{a}_{i}\right)$ degrees of freedom we have:

${\left[\frac{2{\lambda}_{i}\left({y}_{i}+{n}_{i}+{b}_{i}\right)}{2\left({y}_{i}-{a}_{i}\right)}\right]}^{1/3}$ (28)

is approximately distributed as:

$~N\left(1-\frac{1}{9{v}_{i}},\frac{1}{9{v}_{i}}\right)$

Accordingly, the random variables ${\xi}_{i}={\lambda}_{i}^{1/3}$ , are approximately distribution as normal with mean ${m}_{i}$ , and variance ${w}_{i}^{-1}$ , where

${m}_{i}={\left[\frac{{y}_{i}+{a}_{i}}{{y}_{i}+{n}_{i}+{b}_{i}}\right]}^{1/3}\left(1-\frac{1}{9{v}_{i}}\right)$

${w}_{i}^{-1}={\left[\frac{{y}_{i}+{a}_{i}}{{y}_{i}+{n}_{i}+{b}_{i}}\right]}^{2/3}\left(\frac{1}{9{v}_{i}}\right)$

Assuming that the data are available from independent random samples can construct a test statistic based on the Chi-square test of homogeneity of several parameters.

Thus

$Q={\displaystyle {\sum}_{i=1}^{k}{w}_{i}}{\left[\left({\xi}_{i}-{m}_{i}\right)-{\displaystyle {\sum}_{i=1}^{k}{w}_{i}\left({\xi}_{i}-{m}_{i}\right)/w}\right]}^{2}$ (29)

where

$w={\displaystyle {\sum}_{i=1}^{k}{w}_{i}}$

Has approximately a Chi-square distribution with *k** *− 1 degrees of freedom.

Under the null hypothesis ${H}_{0}:{\lambda}_{1}={\lambda}_{2}=\cdots ={\lambda}_{k}$ .

*Q* in (29) reduces to:

${Q}_{0}={\displaystyle {\sum}_{i=1}^{k}{w}_{i}}{\left[{m}_{i}-m\right]}^{2}$ (30)

where

$m={\displaystyle {\sum}_{i=1}^{k}{w}_{i}{m}_{i}/w}$

Therefore, a Bayes test of equality of quasi-generalized Poisson distribution means is thus provided by treating *Q*_{0} (30) as Chi-square with *k** *− 1 degrees of freedom.

6. Application

We added the data from the third experiment of 98 read counts data points from the same data source. The added read count data together with Chrom_chr11, Chrom chr9_ra will give three groups of read counts. The estimated hyperparameters are ${a}_{3}=1.006$ , and ${b}_{3}=1.648$ . The objective here is to test the hypothesis:

${H}_{0}:{\lambda}_{1}={\lambda}_{2}={\lambda}_{3}$ . Direct computations give ${Q}_{0}=0.0009$ . From the tables of Chi-square with 2 degrees of freedom we have p-value = 0.9999. We therefore conclude that there is no enough evidence in the data to reject the homogeneity hypothesis.

7. Discussion

Knowledge translation is an approach to increase the use of evidence within policy and practice decision-making contexts. When information is available from previous experiments or accumulated data, transfer of Bayesian methods research into practice is a challenge; academic articles are not always the best enabler for mathematical adoption of research. Furthermore, synthesis of knowledge from multiple research studies is needed to provide evidence-based decision-support for research [23] .

The estimation of the ratio of Poisson rates is a problem of interest and arises in medical investigations. The frequentist approach does not provide an exact solution either to the problem estimation or to the hypothesis testing. The Bayesian methodology provides exact solutions to both problems. When samples are available from multiple sources, we proposed an approximate solution to the problem of testing homogeneity from multiple samples. An approximation based of the precise WH of the Chi-square solution was developed to address this problem.

It is important to note that the IPD which is the subject of the current investigation is the only discrete distribution defined on the set of non-negative integers with one parameter and exhibits the overdispersion property. Consul and Shenton [15] defined a wide class of discrete probability distributions in terms of Lagrange’s expansion. It is of interest to note that this class of distributions coincides with that of the distributions of tree sizes in the Benaim-Galton Watson process. By this means the branching or cascade process with discrete time and where the probability generating function for the number of children of each individual is the same, for every individual. Since the IPD is a member of the Lagrange family of distributions it will have direct applicability in the study of branching processes as pointed out by I.J. Good [24] . Consul and Shenton ( [2] : p. 239) state that the Lagrange expansion seems to be associated with queuing processes; and such an association is in fact spelled-out by Good ( [24] : p. 376) with references to some 1951 literature.

There has been a growing interest among bioinformaticians and statisticians in constructing flexible distributions for counts that exhibit overdispersion to improve the modeling of count data. As a result, significant progress has been made towards generalizing some well-known discrete models, which have been successfully applied to problems arising in several areas of research. The proposed distribution was utilized to model three data sets; it was shown to provide a better fit than several other related models.

Acknowledgements

The authors acknowledge the constructive remarks made by the reviewer that have improved on the presentation of the results.

Conflicts of Interest

The authors declare no conflicts of interest.

[1] | Carlin, B.P. and Louis, T.A. (2000) Bayes and Empirical Bayes Methods for Data Analysis. Chapman & Hall/CRC Press, Boca Raton. |

[2] |
Cox, D.R. (1983) Some Remarks on Overdispersion. Biometrika, 70, 269-274.
https://doi.org/10.1093/biomet/70.1.269 |

[3] |
Hinde, J. and Demetrio, C.G.B. (1998) Overdispersion: Models and Estimation. Computational Statistics and Data Analysis, 27, 151-170.
https://doi.org/10.1016/S0167-9473(98)00007-3 |

[4] |
Hayat, M.J. and Higgins, M. (2014) Understanding Poisson regression. Journal of Nursing Education, 53, 207-215. https://doi.org/10.3928/01484834-20140325-04 |

[5] | Hinde, J.M. (2007) Negative Binomial Regression. Cambridge University Press, Cambridge, 2011. |

[6] |
Joe, H. and Zhu, R. (2005) Generalized Poisson Distribution: the Property of Mixture of Poisson and Comparison with Negative Binomial Distribution. Biometrical Journal, 47, 219-229. https://doi.org/10.1002/bimj.200410102 |

[7] |
Consul, P.C. and Jain, G.C. (1973) A Generalization of the Poisson Distribution. Technometrics, 15, 791-799. https://doi.org/10.1080/00401706.1973.10489112 |

[8] | Consul, P.C. (1989) Generalized Poisson Distribution. Marcel Dekker Inc., New York. |

[9] |
Janardan, K.G. and Schaeffer, D.J. (1977) Models for the Analysis of Chromosomal Aberrations in Human Leukocytes. Biometrical Journal, 19, 599-612.
https://doi.org/10.1002/bimj.4710190804 |

[10] |
Shoukri, M.M. and Mian, I.U.H. (1991) Some Aspects of Statistical Inference on the Lagrange (Generalized) Poisson Distribution. Communication in Statistics: Computations and Simulations, 20, 1115-1137. https://doi.org/10.1080/03610919108812999 |

[11] |
Tanner, J.C. (1961) A Derivation of Borel Distribution. Biometrika, 48, 222-224.
https://doi.org/10.1093/biomet/48.1-2.222 |

[12] |
Consul, P.C. and Shoukri, M.M. (1988) Some Chance Mechanisms Related to a Generalized Poisson Probability Model. American Journal of Mathematical and Management Sciences, 8, 181-202. https://doi.org/10.1080/01966324.1988.10737237 |

[13] |
Srivastava, S. and Chen, L. (2010) A Two-Parameter Generalized Poisson Model to Improve the Analysis of RNA-Seq Data. Nucleic Acids Research, 38, e170.
https://doi.org/10.1093/nar/gkq670 |

[14] |
Wilson, E.B. and Hilferty, M.M. (1931) The Distribution of Chi-Square. Proceedings of the National Academy of Sciences of the United States of America, 17, 684-688.
https://doi.org/10.1073/pnas.17.12.684 |

[15] |
Consul, P.C. and Shenton, L.R. (1973). Use of Lagrange Expansion for Generating Discrete Generalized Probability Distributions. SIAM Journal of Applied Mathematics, 23, 239-248. https://doi.org/10.1137/0123026 |

[16] |
Haight, F.A. and Breuer, M.A. (1960) The Borel-Tanner Distribution. Biometrika, 47, 143-150. https://doi.org/10.1093/biomet/47.1-2.143 |

[17] |
Shoukri, M.M. and Aleid, M. (2022) Quasi-Negative Binomial: Properties, Parametric Estimation, Regression Model and Application to RNA-SEQ Data. Open Journal of Statistics, 12, 216-237. https://doi.org/10.4236/ojs.2022.122016 |

[18] |
Koch, C.M., Chiu, S.F., Akbarpour, M., Bahart, A., Ridge, K.M., Bartom, E.T. and Winter, D.R. (2018) A Beginner’s Guide to Analysis of RNA Sequencing Data. American Journal of Respiratory Cell and Molecular Biology, 59, 145-157.
https://doi.org/10.1165/rcmb.2017-0430TR |

[19] |
Pan, W. (2002) A Comparative Review of Statistical Methods for Discovering Differentially Expressed Genes in Replicated Microarray Experiments. Bioinformatics, 18, 546-554. https://doi.org/10.1093/bioinformatics/18.4.546 |

[20] |
Auer, P.L. and Doerge, R.W. (2011) A Two-Stage Poisson Model for Testing RNA-Seq Data. Statistical Applications in Genetics and Molecular Biology, 10, 1-26.
https://doi.org/10.2202/1544-6115.1627 |

[21] |
Yoon, S. and Nam, D. (2017) Gene Dispersion Is the Key Determinant of the Read Count Bias in Differential Expression Analysis of RNA-Seq Data. BMC Genomics, 18, Article No. 408. https://doi.org/10.1186/s12864-017-3809-0 |

[22] |
Robinson, M.D. and Smyth, G.K. (2008) Small-Sample Estimation of Negative Binomial Dispersion, with Applications to SAGE Data. Biostatistics, 9, 321-332.
https://doi.org/10.1093/biostatistics/kxm030 |

[23] | Badampudi, D. (2018) Decision-Making Support for Choosing among Different Component Origins. Blekinge Institute of Technology, Karlskrona. |

[24] |
Good, I.J. (1975) The Lagrange Distributions and Branching Processes. SIAM Journal on Applied Mathematics, 28, 270-275. https://doi.org/10.1137/0128022 |

Journals Menu

Contact us

+1 323-425-8868 | |

customer@scirp.org | |

+86 18163351462(WhatsApp) | |

1655362766 | |

Paper Publishing WeChat |

Copyright © 2024 by authors and Scientific Research Publishing Inc.

This work and the related PDF file are licensed under a Creative Commons Attribution 4.0 International License.