Analysis of Variance for Three-Way Unbalanced Mixed Effects Interactive Model

Emmanuel W. Okereke¹, Joy C. Nwabueze¹, Stanislaus O. Obinyelu²

¹Department of Statistics, Michael Okpara University of Agriculture Umudike, Umuhia, Nigeria.
²Department of Statistics, Federal College of Agriculture Ishiagu, Ebonyi State, Nigeria.

DOI: 10.4236/ojs.2020.102019                

Abstract

In the study, a method of solving ANOVA problems based on an unbalanced three-way mixed effects model with interaction for data when factors A and B are fixed, and factor C is random was presented, and the required EMS was derived. Under each of the appropriate null hypotheses, it was observed that none of the derived EMS was unbiased for the other. Unbiased estimators of the mean squares were determined to test hypotheses. With the unbiased estimators, appropriate F-statistics as well as their corresponding pseudo-degrees of freedom were obtained. The theoretical results presented in the paper were illustrated using a numerical example.

Keywords

Expected Mean Square (EMS), Pseudo-Degree of Freedom, Unbiased Estimate, Hypotheses, Multi-Factor Experiments

1. Introduction

The role of multi-factor experiments in agriculture, engineering and other fields cannot be overemphasized. Through a multi-factor experiment, it is possible to test the interaction effect of two or more factors. Sometimes, a multi-factor experiment conducted to compare factor levels and factor level combinations results in unbalanced data. Often, in the case of the analysis of variance (ANOVA) for unbalanced data, an exact F-test does not exist. As a remedy to this problem, authors have recommended some methods of testing effects in various multi-factor ANOVA problems. Consequently, [1] proposed an exact permutation test for fixed effects ANOVA based on balanced and unbalanced data. [2] derived expected mean squares for the unbalanced two-way random effects model with integer degrees of freedom. The F-test statistics for testing main effects as well as the interaction effects based on the two-way mixed effects model were derived by [3].

From the foregoing, it is obvious that a reasonable number of studies have been carried out on the unbalanced two-way fixed effects, random effects and mixed effects models. However, not much attention has been given to the unbalanced three-way analysis of variance problems, especially such problems requiring mixed factor effects. There are basically six cases of the unbalanced three-way mixed effects crossed classification models. This paper deals with hypothesis testing problems arising from one of the six cases, in which two (A and B) of the three factors are fixed and the other factor (C) is random. The remaining parts of this paper are organized in the following manner. Section 2 has to do with the model specification and the necessary notations. In Section 3, theoretical results pertaining to expected mean squares, F-statistics and the corresponding pseudo-degrees of freedom are derived. A numerical example and the conclusion of this paper are presented in Sections 4 and 5 respectively.

2. Model Specification and Restriction

The three-way unbalanced mixed effects cross-classification model with interaction terms, in which factors A and B are fixed while factor C is random is given by [4] and [5] as

$\begin{array}{l}{X}_{ijkl}=\mu +A_i+B_j+C_k+{\left(AB\right)}_{ij}+{\left(AC\right)}_{ik}+{\left(BC\right)}_{jk}\\ +{\left(ABC\right)}_{ijk}+e_{ijkl},\{\begin{array}{l}i=1,2,\cdots ,a\\ j=1,2,\cdots ,b\\ k=1,2,\cdots ,c\\ l=1,2,\cdots ,n_{ijk}\end{array}\end{array}$ (1)

where: $X_{ijkl}$, denotes the 1st observation at the ith level of factor A, the jth level of factor B, and the kth level of factor C, $\mu$ denotes the overall mean, $A_i$ denotes the effect of the ith level of factor A. $B_j$ denotes the effect of the jth level of factor B, $C_k$ denotes the effect of the kth level of factor C, ${\left(AB\right)}_{ij}$, ${\left(AC\right)}_{ik}$, ${\left(BC\right)}_{jk}$ denotes the effects of the two-factor interactions $A\times B$, $A\times C$, $B\times C$, respectively, ${\left(ABC\right)}_{ijk}$ denotes the effect of the three-factor interaction $A\times B\times C$, $e_{ijkl}$ denotes the customary error term.

The Model (1) is called unbalanced three-way mixed effects cross-classification model with interaction if the following assumptions by [4].

From Equation (1), if factor A and B are fixed while factor C is random.

The model follows the following assumptions as:

i) The effects ${A^{\prime }}_{i}s$ and ${B^{\prime }}_{j}s$ are assumed to be fixed subject to the constraint

${\displaystyle \underset{i}{\overset{a}{\sum }}{A}_i}={\displaystyle \underset{j}{\overset{b}{\sum }}{B}_j}={\displaystyle \underset{ij}{\overset{ab}{\sum }}{\left(AB\right)}_{ij}}=0$ ;

ii) ${C^{\prime }}_{k}s$ are assumed to be randomly and normally distributed with mean

zero and variance ${\sigma }_{\theta }^2$. i.e. $C_k~N\left(0,{\sigma }_C^2\right)$, ${\left(AC\right)}_{ik}~N\left(0,{\sigma }_{AC}^2\right)$,

${\left(BC\right)}_{jk}~N\left(0,{\sigma }_{BC}^2\right)$ and ${\left(ABC\right)}_{ijk}~N\left(0,{\sigma }_{ABC}^2\right)$.

iii) ${C^{\prime }}_{k}s$ are uncorrelated with one another ${C^{\prime }}_{k}s$ and ${e^{\prime }}_{ijk}s$ that is

$E\left(C_k{C^{\prime }}_k\right)=0,k\ne k^{\prime }$

and

$E\left(C_k{e}_{ijk}\right)=0$ for all $\left(i,j,k\right)$ ’s;

iv) Error terms are normally distributed with mean zero and variance ${\sigma }_e^2$, they are mutually independent i.e. $e_{ijkl}~N\left(0,{\sigma }_e^2\right)$.

Under the assumptions above, we consider the following notations so as to derive the requisite expected mean squares.

Now, let

$\begin{array}{c}N={\displaystyle \underset{i}{\overset{a}{\sum }}{N}_i}={\displaystyle \underset{j}{\overset{b}{\sum }}{N}_j}={\displaystyle \underset{k}{\overset{c}{\sum }}{N}_k}={\displaystyle \underset{i}{\overset{a}{\sum }}{\displaystyle \underset{j}{\overset{b}{\sum }}{n}_{ij.}}}={\displaystyle \underset{i}{\overset{a}{\sum }}{\displaystyle \underset{k}{\overset{c}{\sum }}{n}_{i.k}}}={\displaystyle \underset{j}{\overset{b}{\sum }}{\displaystyle \underset{k}{\overset{c}{\sum }}{n}_{.jk}}}\\ ={\displaystyle \underset{i}{\overset{a}{\sum }}{\displaystyle \underset{j}{\overset{b}{\sum }}{\displaystyle \underset{k}{\overset{c}{\sum }}{n}_{ijk}}}}={\displaystyle \underset{i}{\overset{a}{\sum }}{\displaystyle \underset{j}{\overset{b}{\sum }}{\displaystyle \underset{k}{\overset{c}{\sum }}{n}_{i\mathrm{..}}}}}={\displaystyle \underset{i}{\overset{a}{\sum }}{n}_{ijk}}={\displaystyle \underset{j}{\overset{b}{\sum }}{n}_{ijk}}={\displaystyle \underset{k}{\overset{c}{\sum }}{n}_{ijk}}\end{array}$ (2)

3. Main Results

The mean squares due to the three main effects and four interaction terms for Model (1) are

$M{S}_A=\frac{\left[{\displaystyle \underset{i}{\overset{a}{\sum }}{N}_i{\left({\bar{X}}_{i\mathrm{...}}-{\bar{X}}_{\mathrm{....}}\right)}^2}\right]}{a-1}$, (3)

$M{S}_B=\frac{\left[{\displaystyle \underset{j}{\overset{b}{\sum }}{N}_j{\left({\bar{X}}_{.j\mathrm{..}}-{\bar{X}}_{\mathrm{....}}\right)}^2}\right]}{b-1}$, (4)

$M{S}_C=\frac{\left[{\displaystyle \underset{k}{\overset{c}{\sum }}{N}_k{\left({\bar{X}}_{\mathrm{..}k.}-{\bar{X}}_{\mathrm{....}}\right)}^2}\right]}{c-1}$, (5)

$M{S}_{AB}=\frac{{\displaystyle \underset{ij}{\overset{ab}{\sum }}{n}_{ij.}{\left({\bar{X}}_{ij\mathrm{..}}-{\bar{X}}_{i\mathrm{...}}-{\bar{X}}_{.j\mathrm{..}}+{\bar{X}}_{\mathrm{....}}\right)}^2}}{\left(a-1\right)\left(b-1\right)}$, (6)

$M{S}_{AC}=\frac{{\displaystyle \underset{ik}{\overset{ac}{\sum }}{n}_{i.k}{\left({\bar{X}}_{i.k.}-{\bar{X}}_{i\mathrm{...}}-{\bar{X}}_{\mathrm{..}k.}+{\bar{X}}_{\mathrm{....}}\right)}^2}}{\left(a-1\right)\left(c-1\right)}$, (7)

$M{S}_{BC}=\frac{{\displaystyle \underset{jk}{\overset{bc}{\sum }}{n}_{.jk}{\left({\bar{X}}_{.jk.}-{\bar{X}}_{.j\mathrm{..}}-{\bar{X}}_{\mathrm{..}k.}+{\bar{X}}_{\mathrm{....}}\right)}^2}}{\left(b-1\right)\left(c-1\right)}$, (8)

$M{S}_{ABC}=\frac{{\displaystyle \underset{ijk}{\overset{abc}{\sum }}{n}_{ijk}{\left({\bar{X}}_{ijk.}-{\bar{X}}_{ij\mathrm{..}}-{\bar{X}}_{i.k.}-{\bar{X}}_{.jk.}+{\bar{X}}_{i\mathrm{...}}+{\bar{X}}_{.j\mathrm{..}}+{\bar{X}}_{\mathrm{..}k.}-{\bar{X}}_{\mathrm{....}}\right)}^2}}{\left(a-1\right)\left(b-1\right)\left(c-1\right)}$, (9)

and

$M{S}_E=\frac{{\displaystyle \underset{i}{\overset{a}{\sum }}{\displaystyle \underset{j}{\overset{b}{\sum }}{\displaystyle \underset{k}{\overset{c}{\sum }}{\displaystyle \underset{l}{\overset{n_{ijk}}{\sum }}{\left(X_{ijkl}-{\bar{X}}_{ijk.}\right)}^2}}}}}{N-abc}$, (10)

where: MS_A is the Mean Square for factor A, MS_B is the Mean Square for factor B, MS_C is the Mean Square for factor C, MS_AB is the Mean Square for the interaction factor A and B, MS_AC is the Mean Square for the interaction factor A and C, MS_BC is the Mean Square for interaction of factor B and C, MS_ABC is the Mean Square for interaction of factor A, B and C, and MS_E is the Mean Square for error term.

Using Brute Force Method, the expected mean squares of Equation (1) when factor A and B is fixed while factor C is random the expected mean square are shown in theorem 1.

Theorem 1: Given the model in (1), the expected mean square due to factor A is

$E\left[M{S}_A\right]=\frac{{\displaystyle \underset{i}{\overset{a}{\sum }}{N}_i{A}_i^2}}{a-1}+K_1{\sigma }_{AC}^2+K_2{\sigma }_{ABC}^2+{\sigma }_e^2$.

where $K_1=\frac{{\displaystyle \underset{i}{\overset{a}{\sum }}{N}_i^{-1}}{\displaystyle \underset{k}{\overset{c}{\sum }}{n}_{ijk}^2-N^{-1}{\displaystyle \underset{ik}{\overset{ac}{\sum }}{n}_{ijk}^2}}}{a-1}$, $K_2=\frac{N^{-1}{\displaystyle \underset{ijk}{\overset{abc}{\sum }}{n}_{ijk}^2}}{a-1}$ and ${\sigma }_e^2$ is the error variance.

Proof:

Using Equation (1), we have

${\bar{X}}_{i\mathrm{...}}=\mu +A_i+0+{\bar{C}}_{.}+0+{\left(\overline{AC}\right)}_{i.}+{\left(\overline{BC}\right)}_{\mathrm{..}}+0+{\bar{e}}_{i\mathrm{...}}$ (11)

and

${\bar{X}}_{\mathrm{.....}}=\mu +0+0+{\bar{C}}_{.}+0+{\left(\overline{AC}\right)}_{\mathrm{..}}+{\left(\overline{BC}\right)}_{\mathrm{..}}+{\left(\overline{ABC}\right)}_{\mathrm{...}}+{\bar{e}}_{\mathrm{....}}$ (12)

Substituting (11), (12) into (3), and taking expectations, we have

$\begin{array}{c}E\left[M{S}_A\right]=\frac{1}{a-1}E\left[{\displaystyle \underset{i}{\overset{a}{\sum }}{N}_i{\left[A_i+{\left(\overline{AC}\right)}_{i.}-{\left(\overline{AC}\right)}_{\mathrm{..}}-{\left(\overline{ABC}\right)}_{\mathrm{...}}+\left({\bar{e}}_{i\mathrm{...}}-{\bar{e}}_{\mathrm{....}}\right)\right]}^2}\right]\\ =\frac{1}{a-1}E\left[{\displaystyle \underset{i}{\overset{a}{\sum }}{N}_i{\left[A_i+\left[{\left(\overline{AC}\right)}_{i.}-{\left(\overline{AC}\right)}_{\mathrm{..}}\right]-{\left(\overline{ABC}\right)}_{\mathrm{...}}+\left({\bar{e}}_{i\mathrm{...}}-{\bar{e}}_{\mathrm{....}}\right)\right]}^2}\right]\\ =\frac{1}{a-1}E\left[{\displaystyle \underset{i}{\overset{a}{\sum }}{N}_i\left[A_i^2+{\left[{\left(\overline{AC}\right)}_{i.}-{\left(\overline{AC}\right)}_{\mathrm{..}}\right]}^2-{\left(\overline{ABC}\right)}_{\mathrm{...}}^2+{\left({\bar{e}}_{i\mathrm{...}}-{\bar{e}}_{\mathrm{....}}\right)}^2\right]}\right]\end{array}$

where

${\left(\overline{AC}\right)}_{i.}=\frac{N{\left(\overline{AC}\right)}_{\mathrm{..}}}{{\displaystyle \underset{i}{\overset{a}{\sum }}{N}_i}}$, $E{\left(\overline{AC}\right)}_{\mathrm{..}}^2=\frac{{\displaystyle \underset{ik}{\overset{ac}{\sum }}{n}_{ijk}^2{\sigma }_{AC}^2}}{N^2}$ and $E{\left(\overline{ABC}\right)}_{\mathrm{...}}^2=\frac{{\displaystyle \underset{ijk}{\overset{abc}{\sum }}{n}_{ijk}^2{\sigma }_{ABC}^2}}{N^2}$.

$\begin{array}{l}=\frac{1}{a-1}E\left[{\displaystyle \underset{i}{\overset{a}{\sum }}{N}_i\left[A_i^2+{\left(\overline{AC}\right)}_{i.}^2-2{\left(\overline{AC}\right)}_{i.}{\left(\overline{AC}\right)}_{\mathrm{..}}+{\left(\overline{AC}\right)}_{\mathrm{..}}^2+{\left(\overline{ABC}\right)}_{\mathrm{...}}^2+{\left({\bar{e}}_{i\mathrm{...}}-{\bar{e}}_{\mathrm{....}}\right)}^2\right]}\right]\\ =\frac{1}{a-1}E[{\displaystyle \underset{i}{\overset{a}{\sum }}{N}_i}{A}_i^2+{\displaystyle \underset{i}{\overset{a}{\sum }}{N}_i}{\left(\overline{AC}\right)}_{i.}^2-2{\displaystyle \underset{i}{\overset{a}{\sum }}{N}_i}{\left(\overline{AC}\right)}_{i.}{\left(\overline{AC}\right)}_{\mathrm{..}}+N{\left(\overline{AC}\right)}_{\mathrm{..}}^2\\ +N{\left(\overline{ABC}\right)}_{\mathrm{...}}^2+{\displaystyle \underset{i}{\overset{a}{\sum }}{N}_i}{\left({\bar{e}}_{i\mathrm{...}}-{\bar{e}}_{\mathrm{....}}\right)}^2]\\ =\frac{1}{a-1}E\left[{\displaystyle \underset{i}{\overset{a}{\sum }}{N}_i{A}_i^2+{\displaystyle \underset{i}{\overset{a}{\sum }}{N}_i{\left(\overline{AC}\right)}_{i.}^2}-N{\left(\overline{AC}\right)}_{\mathrm{..}}^2+N{\left(\overline{ABC}\right)}_{\mathrm{...}}^2+{\displaystyle \underset{i}{\overset{a}{\sum }}{N}_i}\left({\bar{e}}_{i\mathrm{...}}^2-2{\bar{e}}_{i\mathrm{...}}{\bar{e}}_{\mathrm{....}}+{\bar{e}}_{\mathrm{....}}^2\right)}\right]\end{array}$ $\begin{array}{l}=\frac{1}{a-1}[{\displaystyle \underset{i}{\overset{a}{\sum }}{N}_{i}E\left(A_i^2\right)}+{\displaystyle \underset{i}{\overset{a}{\sum }}{N}_{i}E{\left(\overline{AC}\right)}_{i.}^2}-NE{\left(\overline{AC}\right)}_{\mathrm{..}}^2+NE{\left(\overline{ABC}\right)}_{\mathrm{...}}^2+{\displaystyle \underset{i}{\overset{a}{\sum }}{N}_i}E\left({\bar{e}}_{i\mathrm{...}}^2\right)\\ -2{\displaystyle \underset{i}{\overset{a}{\sum }}{N}_i}E\left({\bar{e}}_{i\mathrm{...}}\right)E\left({\bar{e}}_{\mathrm{....}}\right)+NE\left({\bar{e}}_{\mathrm{....}}^2\right)]\\ =\frac{1}{a-1}[{\displaystyle \underset{i}{\overset{a}{\sum }}{N}_{i}E\left(A_i^2\right)}+{\displaystyle \underset{i}{\overset{a}{\sum }}{N}_i^{-1}{\displaystyle \underset{k}{\overset{c}{\sum }}{n}_{ijk}^2}{\sigma }_{AC}^2}-N^{-1}{\displaystyle \underset{ik}{\overset{ac}{\sum }}{n}_{ijk}^2}{\sigma }_{AC}^2+N^{-1}{\displaystyle \underset{ijk}{\overset{abc}{\sum }}{n}_{ijk}^2}{\sigma }_{ABC}^2\\ +{\displaystyle \underset{i}{\overset{a}{\sum }}{N}_i}\frac{{\sigma }_e^2}{N_i}-2N\frac{{\sigma }_e^2}{N}+N\frac{{\sigma }_e^2}{N}]\\ =\frac{1}{a-1}\left[{\displaystyle \underset{i}{\overset{a}{\sum }}{N}_{i}E\left(A_i^2\right)}+\left({\displaystyle \underset{i}{\overset{a}{\sum }}{N}_i^{-1}{\displaystyle \underset{k}{\overset{c}{\sum }}{n}_{ijk}^2}}-N^{-1}{\displaystyle \underset{ik}{\overset{ac}{\sum }}{n}_{ijk}^2}\right){\sigma }_{AC}^2+N^{-1}{\displaystyle \underset{ijk}{\overset{abc}{\sum }}{n}_{ijk}^2}{\sigma }_{ABC}^2+\left(a-1\right){\sigma }_e^2\right]\end{array}$

$\begin{array}{c}E\left[M{S}_A\right]=\frac{{\displaystyle \underset{i}{\overset{a}{\sum }}{N}_{i}E\left(A_i^2\right)}}{a-1}+\frac{1}{a-1}\left({\displaystyle \underset{i}{\overset{a}{\sum }}{N}_i^{-1}{\displaystyle \underset{k}{\overset{c}{\sum }}{n}_{ijk}^2}}-N^{-1}{\displaystyle \underset{ik}{\overset{ac}{\sum }}{n}_{ijk}^2}\right){\sigma }_{AC}^2\\ +\frac{1}{a-1}{N}^{-1}{\displaystyle \underset{ijk}{\overset{abc}{\sum }}{n}_{ijk}^2}{\sigma }_{ABC}^2+\frac{1}{a-1}\left(a-1\right){\sigma }_e^2\end{array}$

$E\left[M{S}_A\right]=\frac{{\displaystyle \underset{i}{\overset{a}{\sum }}{N}_i{A}_i^2}}{a-1}+K_1{\sigma }_{AC}^2+K_2{\sigma }_{ABC}^2+{\sigma }_e^2$.

where ${\bar{e}}_{i\mathrm{...}}=\frac{N{\bar{e}}_{\mathrm{....}}}{{\displaystyle \underset{i}{\overset{a}{\sum }}{N}_i}}$. This completes the proof.

Similarly, if MS_B and MS_C denote the mean squares due to factor B and factor C respectively. Then

$E\left[M{S}_B\right]=\frac{{\displaystyle \underset{j}{\overset{b}{\sum }}{N}_{j}E{\left(B_j\right)}^2}}{b-1}+K_3{\sigma }_{BC}^2+K_4{\sigma }_{ABC}^2+{\sigma }_e^2$ (13)

$E\left[M{S}_C\right]=K_{\theta }{\sigma }_C^2+K_5{\sigma }_{AC}^2+K_6{\sigma }_{BC}^2+K_7{\sigma }_{ABC}^2+{\sigma }_e^2$ (14)

$E\left[M{S}_{AB}\right]=\frac{{\displaystyle \underset{i}{\overset{a}{\sum }}{\displaystyle \underset{j}{\overset{b}{\sum }}{n}_{ij.}}E{\left(AB\right)}_{ij}^2}}{\left(a-1\right)\left(b-1\right)}+K_8{\sigma }_{ABC}^2+{\sigma }_e^2$ (15)

$E\left[M{S}_{AC}\right]=K_9{\sigma }_{AC}^2+K_{10}{\sigma }_{ABC}^2+{\sigma }_e^2$ (16)

$E\left[M{S}_{BC}\right]=K_{11}{\sigma }_{BC}^2+K_{12}{\sigma }_{ABC}^2+{\sigma }_e^2$ (17)

$E\left[M{S}_{ABC}\right]=K_{13}{\sigma }_{ABC}^2+{\sigma }_e^2$ (18)

and

$E\left[M{S}_e\right]={\sigma }_e^2$ (19)

where:

$\begin{array}{l}{K}_1=\frac{{\displaystyle \underset{i}{\overset{a}{\sum }}{N}_i^{-1}}{\displaystyle \underset{k}{\overset{c}{\sum }}{n}_{ijk}^2-N^{-1}{\displaystyle \underset{ik}{\overset{ac}{\sum }}{n}_{ijk}^2}}}{a-1},K_2=\frac{N^{-1}{\displaystyle \underset{ijk}{\overset{abc}{\sum }}{n}_{ijk}^2}}{a-1},\\ K_3=\frac{{\displaystyle \underset{j}{\overset{b}{\sum }}{N}_j^{-1}}{\displaystyle \underset{k}{\overset{c}{\sum }}{n}_{ijk}^2-N^{-1}{\displaystyle \underset{jk}{\overset{bc}{\sum }}{n}_{ijk}^2}}}{b-1},K_4=\frac{N^{-1}{\displaystyle \underset{ijk}{\overset{abc}{\sum }}{n}_{ijk}^2}}{b-1},K_5=\frac{N^{-1}{\displaystyle \underset{ik}{\overset{ac}{\sum }}{n}_{ijk}^2}}{c-1},\\ K_6=\frac{N^{-1}{\displaystyle \underset{jk}{\overset{bc}{\sum }}{n}_{ijk}^2}}{c-1},K_7=\frac{N^{-1}{\displaystyle \underset{ijk}{\overset{abc}{\sum }}{n}_{ijk}^2}}{c-1},K_8=\frac{N^{-1}{\displaystyle \underset{k}{\overset{c}{\sum }}{n}_{ijk}^2}+N^{-1}3{\displaystyle \underset{ijk}{\overset{ab}{\sum }}{n}_{ijk}^2}}{\left(a-1\right)\left(b-1\right)},\\ K_9=\frac{N-{\displaystyle \underset{i}{\overset{b}{\sum }}{N}_i^{-1}}{\displaystyle \underset{k}{\overset{c}{\sum }}{n}_{ijk}^2+N^{-1}{\displaystyle \underset{ik}{\overset{ac}{\sum }}{n}_{ijk}^2}}}{\left(a-1\right)\left(c-1\right)},K_{10}=\frac{N^{-1}{\displaystyle \underset{ijk}{\overset{abc}{\sum }}{n}_{ijk}^2}}{\left(a-1\right)\left(c-1\right)},\\ K_{11}=\frac{N^{-1}{\displaystyle \underset{ijk}{\overset{abc}{\sum }}{n}_{ijk}^2}}{\left(b-1\right)\left(c-1\right)},K_{12}=\frac{N-N{\displaystyle \underset{k}{\overset{c}{\sum }}{n}_{ijk}^2}+N^{-1}{\displaystyle \underset{jk}{\overset{ac}{\sum }}{n}_{ijk}^2}}{\left(b-1\right)\left(c-1\right)},\\ K_{13}=\frac{N^{-1}{\displaystyle \underset{j}{\overset{b}{\sum }}{n}_{ijk}^2}+N^{-1}{\displaystyle \underset{ijk}{\overset{abc}{\sum }}{n}_{ijk}^2}}{\left(a-1\right)\left(b-1\right)\left(c-1\right)}\end{array}$ (20)

A major step in the derivation of the F-statistics is to find the unbiased estimates of the mean squares due to the main factors and the interactions. Therefore, the unbiased estimates are presented as follows.

Theorem 2: Given the model in (1), if factors A and B are fixed while factor C is random, then $M{S}_{\varphi }={\varphi }_{1}M{S}_{AC}+{\varphi }_{2}M{S}_{ABC}+\left(1-{\varphi }_1-{\varphi }_2\right)M{S}_E$ is an unbiased estimate of

$M{S}_A=k_1{\sigma }_{AC}^2+k_3{\sigma }_{ABC}^2+{\sigma }_e^2$.

where, $M{S}_{\varphi }$ is the unbiased estimate of the mean square for factor A.

Proof:

If we assume that $M{S}_{AC}$ and $M{S}_{ABC}$ are independent, we take expectations, to have

$E\left(M{S}_{\varphi }\right)={\varphi }_{1}E\left(M{S}_{AC}\right)+{\varphi }_{2}E\left(M{S}_{ABC}\right)+\left(1-{\varphi }_1-{\varphi }_2\right)E\left(M{S}_E\right)$

$E\left(M{S}_{\varphi }\right)={\varphi }_1\left(K_9{\sigma }_{AC}^2+K_{10}{\sigma }_{ABC}^2+{\sigma }_e^2\right)+{\varphi }_2\left(k_{13}{\sigma }_{ABC}^2+{\sigma }_e^2\right)+\left(1-{\varphi }_1-{\varphi }_2\right){\sigma }_e^2$

$E\left(M{S}_{\varphi }\right)={\varphi }_1{K}_9{\sigma }_{AC}^2+{\varphi }_1{K}_{10}{\sigma }_{ABC}^2+{\varphi }_1{\sigma }_e^2+{\varphi }_2{K}_{13}{\sigma }_{ABC}^2+{\varphi }_2{\sigma }_e^2+{\sigma }_e^2-{\varphi }_1{\sigma }_e^2-{\varphi }_2{\sigma }_e^2$

But

${\varphi }_1=\frac{K_1}{K_9}$, ${\varphi }_2=\frac{K_2}{K_{13}}-\frac{K_1{K}_{10}}{K_9{K}_{13}}$ (21)

$\begin{array}{c}E\left(M{S}_{\varphi }\right)=\frac{K_1}{K_9}{K}_9{\sigma }_{AC}^2+\frac{K_1}{K_9}{K}_{10}{\sigma }_{ABC}^2+\frac{K_2}{K_{13}}-\frac{K_1{K}_{10}}{K_9{K}_{13}}\left(K_{13}{\sigma }_{ABC}^2\right)+{\sigma }_e^2\\ =K_1{\sigma }_{AC}^2+\left(\frac{K_1}{K_9}{K}_{10}+\frac{K_2}{K_{13}}{K}_{13}-\frac{K_1{K}_{10}}{K_9{K}_{13}}{k}_{13}\right){\sigma }_{ABC}^2+{\sigma }_e^2\end{array}$

$E\left(M{S}_{\varphi }\right)=k_1{\sigma }_{AC}^2+k_2{\sigma }_{ABC}^2+{\sigma }_e^2$ as required.

Similarly, it can be shown that $M{S}_{\lambda }={\lambda }_{1}M{S}_{BC}+{\lambda }_{2}M{S}_{ABC}+\left(1-{\lambda }_1-{\lambda }_2\right)M{S}_E$ is an unbiased estimate.

$M{S}_B=k_3{\sigma }_{AC}^2+k_4{\sigma }_{ABC}^2+{\sigma }_e^2$,

$M{X}_{\gamma }={\gamma }_{1}M{S}_{AC}+{\gamma }_{2}M{S}_{BC}+{\gamma }_{3}M{S}_{ABC}+\left(1-{\gamma }_1-{\gamma }_2-{\gamma }_3\right)M{S}_E$ is an unbiased estimate.

$M{S}_C=k_5{\sigma }_{AC}^2+k_6{\sigma }_{BC}^2+k_7{\sigma }_{ABC}^2+{\sigma }_e^2$,

$M{S}_{\pi }={\pi }_{2}M{S}_{ABC}+\left(1-{\pi }_1\right)M{S}_E$ is an unbiased estimate.

$M{S}_{ABC}=k_8{\sigma }_{ABC}^2+{\sigma }_e^2$,

$M{S}_{\rho }={\rho }_{1}M{S}_{AC}+{\rho }_{2}M{S}_{ABC}+\left(1-{\rho }_1-{\rho }_2\right)M{S}_E$ is an unbiased estimate.

$M{S}_{AC}=k_9{\sigma }_{AC}^2+k_{10}{\sigma }_{ABC}^2+{\sigma }_e^2$,

and

$M{S}_{\tau }={\tau }_{1}M{S}_{BC}+{\tau }_{2}M{S}_{ABC}+\left(1-{\tau }_1-{\tau }_2\right)M{S}_E$ is an unbiased estimate.

$M{S}_{BC}=k_{11}{\sigma }_{BC}^2+k_{12}{\sigma }_{ABC}^2+{\sigma }_e^2$.

The F-statistics for the main effects and interactions effect are given below:

$F_A=\frac{M{S}_A}{M{S}_{\varphi }}$, (22)

$F_B=\frac{M{S}_B}{M{S}_{\lambda }}$, (23)

$F_C=\frac{M{S}_C}{M{S}_{\gamma }}$, (24)

$F_{AB}=\frac{M{S}_{AB}}{M{S}_{\pi }}$, (25)

$F_{AC}=\frac{M{S}_{AC}}{M{S}_{\rho }}$, (26)

$F_{BC}=\frac{M{S}_{BC}}{M{S}_{\tau }}$, (27)

and

$F_{ABC}=\frac{M{S}_{ABC}}{M{S}_e}$, (28)

where: F_A is the F-statistic for factor A, F_B is the F-statistic for factor B, F_C is the F-statistic for factor C, F_AB is the F-statistics for the interaction factors A and B, F_AC is the F-statistics for the interaction factors A and C, F_BC is the F-statistics for the interaction factors B and C, and F_ABC is the F-statistics for the interaction factors A, B and C.

Having presented the necessary F-statistic, we also have to determine the pseudo-degree of freedom corresponding to this statistic. Using the [6], the Welch Satterthwaite equation is used to determine the pseudo-degrees of freedom in this paper.

Theorem 3: Given the model in (1) and Welch Satterthwaite Equation, let $f_{\varphi }$ be the pseudo-degree of freedom for factor A. Then

$f_{\varphi }=\left[{\left(\widehat{M{S}_{\varphi }}\right)}^2\right]{\left[\frac{{\varphi }_1^2{\left(M{S}_{AC}\right)}^2}{f_{AC}}+{\frac{{\varphi }_2^2\left(M{S}_{ABC}\right)}{f_{{}_{ABC}}}}^2+{\frac{{\left(1-{\varphi }_1-{\varphi }_2\right)}^2\left(M{S}_e\right)}{f_e}}^2\right]}^{-1}$, (29)

Proof:

Recall that

$M{S}_{\varphi }={\varphi }_{1}M{S}_{AC}+{\varphi }_{2}M{S}_{ABC}+\left(1-{\varphi }_1-{\varphi }_2\right)M{S}_e$, (30)

If we assumed that $M{S}_{AC}$ and $M{S}_{ABC}$ are independent, we obtain

$\mathrm{var}\left(M{S}_{\varphi }\right)={\varphi }_1^2\mathrm{var}\left(M{S}_{AC}\right)+{\varphi }_2^2\mathrm{var}\left(M{S}_{ABC}\right)+{\left(1-{\varphi }_1-{\varphi }_2\right)}^2\mathrm{var}\left(M{S}_e\right)$, (31)

Recall that $f_e=N-abc$

Since

$M{S}_e=\frac{{\displaystyle \underset{ijkl}{\overset{abc{n}_{ijk}}{\sum }}\left(X_{ijkl}-{\bar{X}}_{ijk.}\right)}}{N-abc}=\frac{S{S}_e}{f_e}$ and $\frac{S{S}_e}{{\sigma }_e^2}~{\chi }_{f_e}^2$,

we have

$\mathrm{var}\left(M{S}_e\right)=\frac{\mathrm{var}\left(S{S}_e\right)}{f_e^2}$, (32)

$\begin{array}{l}\mathrm{var}\left(M{S}_e\right)=\frac{2{\left({\sigma }_e^2\right)}^2{f}_e}{f_e^2}=\frac{2{\left({\sigma }_e^2\right)}^2}{f_e},\mathrm{var}\left(M{S}_{\varphi }\right)=\frac{2{\left({\sigma }_{\varphi }^2\right)}^2}{f_{\varphi }},\\ \mathrm{var}\left(M{S}_{AC}\right)=\frac{2{\left({\sigma }_{AC}^2\right)}^2}{f_{AC}},\mathrm{var}\left(M{S}_{BC}\right)=\frac{2{\left({\sigma }_{BC}^2\right)}^2}{f_{BC}},\\ \mathrm{var}\left(M{S}_{ABC}\right)=\frac{2{\left({\sigma }_{ABC}^2\right)}^2}{f_{ABC}}\end{array}$ (33)

Extending our idea of (33) into (31), leads to

$\frac{2{\left({\sigma }_{\varphi }^2\right)}^2}{f_{\varphi }}={\varphi }_1^2\left(\frac{2{\left({\sigma }_{AC}^2\right)}^2}{f_{AC}}\right)+{\varphi }_2^2\left(\frac{2{\left({\sigma }_{ABC}^2\right)}^2}{f_{ABC}}\right)+{\left(1-{\varphi }_1-{\varphi }_2\right)}^2\left(\frac{{\left(2{\sigma }_e^2\right)}^2}{f_e}\right)$

where:

${\sigma }_e^2=M{S}_e,{\sigma }_{\varphi }^2=M{S}_{\varphi },{\sigma }_{AC}^2=M{S}_{AC},{\sigma }_{BC}^2=M{S}_{BC}$ and ${\sigma }_{ABC}^2=M{S}_{ABC}$.

Consequently

$\begin{array}{c}2{\left(M{S}_{\varphi }\right)}^2{f}_{\varphi }^{-1}=2{\varphi }_1^2{\left(M{S}_{AC}\right)}^2{f}_{AC}^{-1}+2{\varphi }_2^2{\left(M{S}_{ABC}\right)}^2{f}_{ABC}^{-1}\\ +2{\left(1-{\varphi }_1-{\varphi }_2\right)}^2{\left(M{S}_e\right)}^2{f}_e^{-1}\end{array}$

$f_{\varphi }=\left[{\left(M{S}_{\varphi }\right)}^2\right]{\left[\frac{{\varphi }_1^2{\left(M{S}_{AC}\right)}^2}{f_{AC}}+{\frac{{\varphi }_2^2\left(M{S}_{ABC}\right)}{f_{ABC}}}^2+{\frac{{\left(1-{\varphi }_1-{\varphi }_2\right)}^2\left(M{S}_e\right)}{f_e}}^2\right]}^{-1}$ (34)

The degree of freedom associated with F_A is

$f_{f_A,f_{\varphi }}^{0.05}$

Similarly,

$f_{\lambda }=\left[{\left(M{S}_{\lambda }\right)}^2\right]{\left[\frac{{\lambda }_1^2{\left(M{S}_{BC}\right)}^2}{f_{BC}}+\frac{{\lambda }_2^2{\left(M{S}_{ABC}\right)}^2}{f_{{}_{ABC}}}+\frac{{\left(1-{\lambda }_1-{\lambda }_2\right)}^2{\left(M{S}_e\right)}^2}{f_e}\right]}^{-1}$ (35)

The degree of freedom associated with F_B is

$f_{f_B,f_{\lambda }}^{0.05}$

$\begin{array}{l}{f}_{\gamma }=\left[{\left(M{S}_{\gamma }\right)}^2\right]\\ \cdot {\left[\frac{{\gamma }_1^2{\left(M{S}_{AC}\right)}^2}{f_{AC}}+\frac{{\gamma }_2^2{\left(M{S}_{BC}\right)}^2}{f_{BC}}+{\frac{{\gamma }_3^2\left(M{S}_{ABC}\right)}{f_{{}_{ABC}}}}^2+{\frac{{\left(1-{\gamma }_1-{\gamma }_2-{\gamma }_3\right)}^2\left(M{S}_e\right)}{f_e}}^2\right]}^{-1}\end{array}$ (36)

The degree of freedom associated with F_C is

$f_{f_C,f_{\gamma }}^{0.05}$

$f_{\pi }=\left[{\left(M{S}_{\pi }\right)}^2\right]{\left[{\frac{{\pi }_1^2\left(M{S}_{ABC}\right)}{f_{{}_{ABC}}}}^2+{\frac{{\left(1-{\pi }_1\right)}^2\left(M{S}_e\right)}{f_e}}^2\right]}^{-1}$ (37)

The degree of freedom associated with interaction factor A and B is

$f_{f_{AB},f_{\pi }}^{0.05}$

$f_{\rho }=\left[{\left(M{S}_{\rho }\right)}^2\right]{\left[\frac{{\rho }_1^2{\left(M{S}_{AC}\right)}^2}{f_{AC}}+{\frac{{\rho }_2^2\left(M{S}_{ABC}\right)}{f_{{}_{ABC}}}}^2+{\frac{{\left(1-{\rho }_1-{\rho }_2\right)}^2\left(M{S}_e\right)}{f_e}}^2\right]}^{-1}$ (38)

The degree of freedom associated with interaction factor A and C is

$f_{f_{AC},f_{\rho }}^{0.05}$

$f_{\tau }=\left[{\left(M{S}_{\tau }\right)}^2\right]{\left[\frac{{\tau }_1^2{\left(M{S}_{BC}\right)}^2}{f_{BC}}+\frac{{\gamma }_2^2{\left(M{S}_{ABC}\right)}^2}{f_{ABC}}+{\frac{{\left(1-{\tau }_1-{\tau }_2\right)}^2\left(M{S}_e\right)}{f_e}}^2\right]}^{-1}$ (39)

The degree of freedom associated with interaction factor B and C is

$f_{f_{BC},f_{\tau }}^{0.05}$

The degree of freedom associated with the interaction factors $A\times B\times C$ is

$f_{f_{ABC,}{f}_e}^{\alpha }$

This does not involve obtaining any expression, where $f_{\lambda },f_{\gamma },f_{\pi },f_{\rho }$ and $f_{\tau }$ represent the pseudo degrees of freedom for factors B and C, the interactions $A\times B$, $A\times C$ and $B\times C$. While f_ABC and f_e are the numerator and denominator degrees of freedom respectively (Table 1).

Table 1. Table for the unbiased estimates of the mean squares under the null hypothesis.

4. Numerical Example

Consider a three-factorial experiment involving factor A (Solvents-water, ethanol, ether), factor B (Volumes of solute-25, 50 and 100 ml) and factor C (Time-40, 50, 60 and 70 mins) respectively. The solvents are of varying polarities. Arbitrary volumes of 25, 50 and 100 ml were chosen while the extraction was done at intervals of time 40, 50, 60 and 70 mins. The major aim is to determine the efficiency of different quantities of solvents on the extraction of soluble components of lemon grass per unit time.

In the experiment, the sample (lemon grass) was dried in the oven at 45˚C for 1440 mins. The dried sample was pulverized and 1 g of pulverized sample was used for each solvent in a typical extraction 1g of sample was dissolved in 25 ml of water for 40 mins. At the end of the time, the solute was filtered using a suitable filter paper (Whatman). The solution was then vaporized at 105˚C for 720 mins leaving the remaining extract which was weighted in an analytical balance. The process was repeated and replicated three times for 50, 60 and 70 mins. A similar procedure was done using different volumes of ethanol and ether as extracts at different durations of 40, 50, 60 and 70mins. Results of the extraction are shown in Table 2.

Using the information in Table 2 as well as the formulae for computing MS_A, MS_B, MS_C, MS_AB, MS_AC, MS_BC, MS_ABC and MS_E, we have

$\begin{array}{l}M{S}_A=72.4819,M{S}_B=50.5353,M{S}_C=67.0578,\\ M{S}_{AB}=53.4128,M{S}_{BC}=25.4262,M{S}_{AC}=86.2273,\\ M{S}_{ABC}=193.7391\text{and}M{S}_E=\mathrm{1.9473.}\end{array}$

Again, the constants are calculated as follows:

$\begin{array}{l}{k}_1=7.7153,k_2=1.2531,k_3=6.8274,k_4=1.2531,\\ k_5=1.7325,k_6=2.2840,k_7=0.8354,k_8=8.6482,\\ k_9=11.2040,k_{10}=0.4177,k_{11}=0.4177,\\ k_{12}=67.3453,k_{13}=4.8323\end{array}$

The ANOVA table for the data is shown in Table 3.

Our hypothesis for factor A shall be $H_{0A}:A_{\text{1}}=\cdots =A_n=0$ ;

Similarly, our hypothesis for factor B shall be $H_{0B}:B_{\text{1}}=\cdots =B_n=0$ ;

Our hypothesis for factor C shall be $H_{0C}:{\sigma }_C^2=0$ ;

Our hypothesis for factor A and B shall be $H_{0AB}:{\left(AB\right)}_{\text{1}}=\cdots ={\left(AB\right)}_n=0$ ;

Our hypothesis for factor A and C shall be $H_{0AC}:{\sigma }_{AC}^2=0$ ;

Our hypothesis for factor B and C shall be $H_{0BC}:{\sigma }_{BC}^2=0$ ;

And Our hypothesis for factor A, B and C shall be $H_{0ABC}:{\sigma }_{ABC}^2=0$.

Table 2. The extract data.

Table 3. Complete ANOVA table for extraction solution.

NOTE: UEMS= UNBIASED ESTIMATES OF THE MEAN SQUARES.

5. Conclusion

In this study, we have presented a hypothesis testing procedure based on an unbalanced three-way cross-classification mixed effects model with interaction when factors A and B are fixed while factor C is random. From the theoretical results obtained in this study, it was observed that exact F-tests do not exist for any of the hypotheses to be tested. As a consequence, approximate F-tests were considered. A numerical example was given to illustrate theoretical our results.

Conflicts of Interest

The authors declare no conflicts of interest.

References

[1]	Kherad-Pajouh, S. and Renaud, O. (2010) An Exact Permutation Method for Testing Any Effect in Balanced and Unbalanced Fixed Effect ANOVA. Computational Statistics & Data Analysis, 54, 1881-1893. https://doi.org/10.1016/j.csda.2010.02.015
[2]	Eze, F.C. and Chigbu, P.E. (2012) Unbalanced Two-Way Random Model with Integer-Value Degrees of Freedom. Journal of Natural Sciences Research, 2, 100-107.
[3]	Eze, F.C and Nwankwo, E.U. (2016) Analysis of Variance in an Unbalanced Two-Way Mixed Effect Interactive Model. Open Journal of Statistics, 6, 310-319. https://doi.org/10.4236/ojs.2016.62027
[4]	Sahai, H. and Ageel, M.I. (2000) Analysis of Variance for Fixed Random and Mixed Effect Model. Birkhauser, Boston, Basel, Berlin.
[5]	Sahai, H. and Ojeda M.M. (2004) Analysis of Variance for Random Models: Unbalanced Data. 1st Edition, Birkuhauser, Boston, 480.
[6]	Satterthwaite, F.E. (1946) An Approximate Distribution of Estimates of Variance Components. Biometrics Bulletin, 2, 110-114. https://doi.org/10.2307/3002019