Antithetic Power Transformed Random Variables in Computer Simulations: An Error Correction Mechanism

Abstract

A traditional method of Monte Carlo computer simulation is to obtain uniformly distributed random numbers on the interval from zero to one from a linear congruential generator (LCG) or other methods. Random variates can then be obtained by the inverse transformation technique applied to random numbers. The random variates can then be used as input to a computer simulation. A response variable is obtained from the simulation results. The response variable may be biased for various reasons. One reason may be the presence of small traces of serial correlation in the random numbers. The purpose of this paper is to introduce an alternative method of response variable acquisition by a power transformation applied to the response variable. The power transformation produces a new variable that is negatively correlated with the response variable. The response variable is then regressed on its power transformation to convert the units of the power transformed variable back to those of the original response variable. A weighted combination of these two variables gives the final estimate. The combined estimate is shown to have negligible bias. The correlations of various antithetic variates obtained from the power transformation are derived and illustrated to provide insights for this research and for future research into this method.

Share and Cite:

Ridley, D. and Ngnepieba, P. (2023) Antithetic Power Transformed Random Variables in Computer Simulations: An Error Correction Mechanism. Journal of Applied Mathematics and Physics, 11, 1707-1727. doi: 10.4236/jamp.2023.116111.

1. Introduction

A sequence of random numbers that are serially perfectly uncorrelated in its totality can contain what appear to be subsets of correlated sequences. Indeed, positively and negatively correlated subsets are a necessary part of true randomness. Traces of serial correlation in any subset can create a trend that biases the random numbers to the high or low side of the true value. An opposite trend can develop subsequently. But a very large number of random numbers can occur before the net bias is corrected. Proykova [1] describes random walk simulation experiments in which the walker is temporarily trapped in the vicinity of correlated numbers. Either way, apparent subsets of traces of serial correlation introduce unreliability into the simulation. Serial correlation in random numbers that are used in Monte Carlo computer simulation experiments, are known to cause bias in estimates of the response variable (Ferrenberg, Lanau and Wong [2] ). Where possible, bias and variance reduction methods can be very useful for improving accuracy in some applications. For example, physics experiments can utilize as many as 1019 random numbers. Reducing the length of a simulation for the same level of accuracy will save considerable time. Depending on the application, bias free accuracy is of paramount importance. Therefore, apart from their not repeating, the long run quality of the random numbers is irrelevant, since subsets will be correlated. Perhaps it is better to focus on methods that have the potential to improve the results obtained from random numbers that are deficient for any reason related to departure from randomness. Accordingly, some ideas are explored and discussed. The novelty of this paper is to present a new method of antithetic variables that eliminates bias error in the simulation response variable.

1.1. Background

Monte Carlo computer simulation is a widely used method for the study and analysis of complex systems that are not tractable to analytical mathematical formulae. Several methods of random number generation have been devised for use in computer simulation. Once the most common of these was the multiplicative congruential generator first suggested by Lehmer [3] . Various design issues have been identified by Marsaglia [4] and Park and Miller [5] . Pursuant to these issues and others associated with the mixed linear congruential generator, various more complicated methods have been suggested (Marsaglia [6] [7] ; Marsaglia & Tsang [8] ; Marsaglia & Tsay [9] ). Much attention has also been paid to the speed of generating random numbers (Marsaglia, MacLaren & Bray [10] ; Marsaglia & MacLaren [11] ; Marsaglia, Ananthanarayan & Paul [12] ; Marsaglia & Tsang [13] ; Leva [14] ). Kroese, Taimre & Botev [15] discusses the pros and cons of a wide variety of methods. The disconcerting outcome from the use of so called better random numbers is that the bias found by Ferrenberg, Lanau and Wong [2] is worse than that for the simpler linear congruential generator.

Inversely correlated random numbers were suggested by Hammersley and Morton [16] . They proposed a simple method for use in Monte Carlo computer simulation. In that method two simulations are conducted. One simulation uses uniformly distributed (0, 1) random numbers r i , i = 1 , 2 , 3 , . The other uses the complementary random numbers 1 r i . The output responses from the two simulations are then averaged. The method may produce an average response that has a smaller variance than for the individual simulations. Aljeddani [17] uses Bayesian methodology in Monte Carlo simulation to improve estimates where time and cost constraints are prohibitive. In practice, the variance reduction is not guaranteed and may actually increase (Cheng [18] ; Kleijnen [19] ). Cheng [18] goes on to suggest an improvement. However, reducing variance does not correct bias error. It only makes the response variable more precisely wrong. Our aim in this paper is bias elimination.

Antithetic random variables by power transformation of actual time series data was introduced by Ridley [20] . The Ridley [20] antithetic time series theorem states that “if X t > 0 , t = 1 , 2 , 3 , is a discrete realization of a lognormal stochastic process, such that ln X t ~ N ( μ , σ 2 ) , then if the correlation between X t and X t p is ρ, then lim σ 0 , p 0 ρ = 1 .” Serially correlated antithetic random variables can be combined so as to generate a new random variable that is not serially correlated. Ridley [20] provides antithetic fitted function, and antithetic fitted error variance function theorems for lognormally distributed random variables. Ridley [21] [22] [23] , Ridley, Ngnepieba & Duke [24] , Ridley & Ngnepieba [25] [26] demonstrate applications in time series analysis and forecasting. At first thought, it appears that the creation of antithetic random variables by this method might be useful for computer simulation. However, the random numbers used in computer simulation are uniformly distributed, not lognormally distributed.

1.2. Proposed Research

The proposed research is concerned with artificial sequences of antithetic random numbers and variables as opposed to the analysis of antithetic time series obtained from recorded data. We define antithetic variables as follows.

Definition. Two random variables are antithetic if their linear correlation is negative. A bivariate collection of random variables is asymptotically antithetic if its limiting correlation approaches minus one asymptotically.

Definition. r(x,i) is an ensemble of random variables, where x belongs to a sample space and i belongs to an index set representing order, such that r i is a discrete realization of a stochastic process from the ensemble, r i ~ U ( 0 , 1 ) , and r i , i = 1 , 2 , 3 , , n are serially correlated.

The objective of the proposed research is not to create better random numbers. The objective is to reduce the effect of serial correlation in random numbers on bias in the estimate of the response variable from computer simulations regardless of the particular method of random number generation. Combining antithetic computer simulations is investigated for this purpose. Therefore, the worse the random numbers are, the better is the test of efficacy of combining antithetic computer simulations. So, only the simple linear congruential generator (LCG) was used. If the random numbers, however generated, were ideal in every way, the expectation is that no improvement in the accuracy of the response variable will occur due to antithetic combining. We do not know ahead of time the distribution of the response variable. So, beyond what we know about the lognormal case from Ridley [20] , we begin by exploring the correlation between the sequence of various random variables to establish the inverse correlations that are the basis of antithetic combining. This serves to improve our general understanding of antithetic combining and gain insights for what might work best. Then we apply antithetic combining to a response variable from a computer simulation. After examining the results of the exploration, we hypothesize that the estimates of response variables from computer simulations can be combined with their antithetic counterpart to obtain a new response variable that has negligible bias.

The paper is organized as follows. In section 2 we derive the analytic function for the correlation between a uniform random number and the random variate obtained from its pth exponent. In section 3 we derive the analytic function for the correlation between antithetic exponential random variates obtained by power transformation. In Section 4 we derive the correlation between random variates from inverse and power transformations. In section 5 we present the results of a computer simulation experiment. In section 6 we explore the effect of combining a response variable from a Monte Carlo simulation performed with random variates obtained by inverse transformation and by combining the response variable with its power transformed antithetic variable counterpart. Section 7 contains conclusions and suggestions for future research.

2. Correlation between r i and r i p

Antithetic uniform random numbers theorem: If r i > 0 , i = 1 , 2 , 3 , , n is a discrete realization of a uniform stochastic process, such that r i ~ U ( a , b ) for any interval a, b, then if ρ r r p is the correlation between r i and r i p , then

lim p 0 ρ r r p = lim p 0 p | p + 1 | 2 p + 1 12 2 | p | ( p + 2 ) ( p + 1 ) = 3 2

See Appendix A for the proof.

This correlation is illustrated in Table 1 and Figure 1 for r i ~ U ( 0 , 1 ) and values of p on and between −0.1 and −0.001. The correlations are averages calculated from 1000 samples of 500 numbers each, obtained from Matlab [27] . The correlation between r i and r i p is seen to be negative, approaching −0.8666 recurring, or 3 / 2 .

Unlike the case of the lognormal distribution where the correlation between the random variable and its pth exponent is −1, here the correlation is 3 / 2 . That is, r i and r i p can only offer partial antithetic combining. In order to convert r p into the units of r, consider the regression of r p on r p , r p = f ( r p ) + ε = α + β r p + ε . Since lim p 0 C o r r ( r p , r p ) = 1 (see Appendix B),

Table 1. Correlation between r i and r i p vs p.

Figure 1. Correlation between r i and r i p vs p.

that is r p and r p are perfectly negatively correlated, it follows that lim p 0 r p = α + β r p + ε where ε 0 . That is, r p α + β r p . Let the fitted values of r p be denoted by r ^ p , let α ^ and β ^ denote least squares estimates of α and β respectively, and let s denote standard deviation. Then, r ^ p = α ^ + β ^ r p = r p ¯ + C o r r ( r p , r p ) ( s r p / s r p ) ( r p r p ¯ ) . This random variable is negatively correlated with r. However, unlike r, the probability distribution of r ^ p is not uniform. For purpose of comparison and uniformity, r ^ p can be converted back to the original scale of and distribution of r ^ p by computing the inverse transform r = ( r ^ p ) 1 / p . As it turns out, r and r are positively correlated.

3. Antithetic Variates

Antithetic random variates theorem: If r i > 0 , i = 1 , 2 , 3 , , n is a discrete realization of a uniform stochastic process, such that r i ~ U ( 0 , 1 ) , then if ρ r + p r p is the correlation between r i p and r i p , then

lim p 0 ρ r + p r p = lim p 0 ( 2 p + 1 ) ( p + 1 ) ( 2 p + 1 ) ( p + 1 ) ( 1 p ) ( 1 + p ) = 1 .

See Appendix B for the proof.

This correlation is illustrated in Table 2 and Figure 2 for values of p on and between −0.1 and −0.001. The correlations are calculated from just one sample of 100 random numbers. These correlations converge very rapidly. The correlation between r i p and r i p is seen to approach −1.

Histograms for r i ~ U ( 0 , 1 ) and lim p 0 r i p and lim σ 0 , p 0 r i p based on 300 random numbers are shown in Figure 3. The histograms illustrate that in the limit as p 0 , the distributions of r i p and r i p are similar to negative

Table 2. Correlation between r i p and r i p vs p.

Figure 2. Correlation between r i p and r i p vs p.

Figure 3. Distributional characteristics p 0 .

and positive exponential distributions, respectively.

Consider the possibility of combining response variables obtained from two computer simulations that are based on antithetic exponential random variates. Let the mean and standard deviation be 1/λ. Then, the exponential random variates can be obtained from r i p by converting the mean and standard deviation. This is accomplished by subtracting its sample average r p ¯ and dividing by the standard deviation ( s r p ), then multiply by the population standard deviation (1/λ) and adding the population mean (1/λ) of interest. This suggests that computer simulations based on the antithetic pair ( r i p r p ¯ ) / s r p λ + 1 / λ and

( r i p r p ¯ ) / s r p λ + 1 / λ might yield a combined response with improved statistics. However, if the distribution of ( r i p r p ¯ ) / s r p λ + 1 / λ matches that of the actual problem variable, the distribution of ( r i p r p ¯ ) / s r p λ + 1 / λ will not

match, and will not be a good representation. These random variates are perfectly negatively correlated.

4. Correlation between Random Variates from Inverse and Power Transformations

We established that the random variates r i p , p 0 are exponentially distributed. Therefore, we explored the comparison between exponential random variates obtained from the traditional inverse transformation and those obtained from the proposed power transformation.

Consider the exponential random variable x with parameter λ. Its pdf given by

f ( x ) = { λ e λ x for x 0 0 elsewhere

The corresponding cumulative distribution is given by

F ( x ) = P ( X < x ) = { 1 e λ x for x 0 0 elsewhere

The exponential random variate is calculated by setting r i equal to the cumulative distribution

r i = 1 e λ x i

The exponential random variate obtained by inverse transformation is given by

x i = ( 1 / λ ) ln ( 1 r i )

The exponential random variate obtained by power transformation is given by

x i = r i p r p ¯ s r p λ + 1 λ

Substituting the expected values for r p ¯ and s r p from Appendix A,

x i = r i p 1 / ( p + 1 ) ( | p | / | p + 1 | 2 p + 1 ) λ + 1 λ ,

where x i has the property of equality of mean and standard deviation.

Antithetic inverse and power transform random variates theorem: If r i ~ U ( 0 , 1 ) is a uniformly distributed random number, X i > 0 , i = 1 , 2 , 3 , , n is a discrete realization of an exponential stochastic process such that

X i ~ E ( λ ) derived from the inverse transformation x i = ( 1 / λ ) ln ( 1 r i ) with parameter λ, and X i ~ E ( λ , p ) derived from x i = r i p 1 / ( p + 1 ) ( | p | / | p + 1 | 2 p + 1 ) λ + 1 λ , then if ρ X , X is the correlation between X i and X i , then

lim p 0 ρ X , X = 1 π 2 / 6 .

See Appendix C for the proof.

This correlation is illustrated in Table 3 for values of p on and between −0.1 and −0.001 and in Figure 4. The correlations are averages calculated from 2000 samples of 500 numbers each, obtained from Matlab [27] . The correlation between x i and x i is seen to be negative, approaching −0.6484 recurring. That

Table 3. Correlation between x i and x i vs p.

is, approximately equal to 1 π 2 / 6 . This correlation falls short of the ideal correlation of −1. That is, x i and x i can offer only partial antithetic combining.

5. Computer Simulation Experiment

Consider a simple M/M/1 queue as depicted in Figure 5. There are many systems that can be modelled by queueing theory. They include waiting lines at a business establishment, library or other institution, jobs waiting to be processed by a computer central processing unit, automobile traffic, telephone calls, statistical particle physics, etc. The test system used in the following experiment is limited to a simple queue for which we know precisely the value of the response variable. The expectation is that if bias reduction is effective in the test system, it will also be effective in more complex systems where the answers are unknown and are to be determined. The schematic shows one queueing system and one Monte Carlo experiment. In both cases, entities arrive at the mean rate of λ per unit time and are served at the mean rate of μ per unit time. The time between arrivals is exponentially distributed with mean 1/λ. The service time is exponentially distributed with mean 1/μ. In the standard traditional experiment, the

Figure 4. Correlation between x i and x i vs p.

Figure 5. Simple queueing system.

experiment is conducted with an inter arrival time denoted by x a derived from r a and service time x s derived from r s . The LCG is z i = 630360016 z i 1 mod ( 2 31 ) (suggested by Harrell, Ghosh & Bowden [28] .

In the simple queue, the source population for arriving entities is infinite. The queue is un-capacitated. There is a single server. The entity processing rule is first come first served. The first actual simulation is based on a mean inter arrival time of 3 minutes and a mean service rate of 2.4 minutes. That is, λ = 1/3 per minute and μ = 1/2.4 per minute. The response variable chosen is the average time that an entity spends in the system. The average time that entities spend in the system is well known to be precisely T t h e o r i c a l = 1 / ( μ λ ) = 1 / ( 1 / 2.4 1 / 3 ) = 12 minutes. Based on a 100,000 arrivals simulation, the estimated simulation time in the system T = 11.63 (see Table 4). The bias is 12-11.65 = 0.35 = 2.92%. For most applications this level of accuracy may suffice. However, as the λ/μ ratio increases toward 1 the bias increases and the decline in accuracy is significant. Table 4 shows the results for various of λ/μ ratios. For an example of high bias, consider μ = 1/2.4, 1/λ = 2.474, λ/μ = 0.97, the T t h e o r i c a l = 1 / ( μ λ ) = 1 / ( 1 / 2.4 1 / 2.474 ) = 80.24 minutes. The estimated simulation time in the system is T = 65.3807 (see Figure 6). The bias = 65.3807 − 80.24 = −14.8593 = −18.51%. This bias is unacceptable as are many estimates in Table 4.

To reduce this bias the antithetic time in system is obtained from T p where p = −0.0001. Then T is regressed on T p to express T p in the original units of T. The estimated regression equation is given by

T = T ¯ + C o r r ( T , T p ) ( s T / s T p ) ( T p T p ¯ ) .

Figure 6. Simulation estimates of time in system T C = ω T + ( 1 ω ) T when ω = 1 .

Table 4. Computer simulation results 1/μ = 2.4 minutes and various 1/λ, λ/μ and ω.

The final result is the weighted average T C = ω T + ( 1 ω ) T , where ω and ( 1 ω ) are combining weights. For each combination of μ and λ there is an ω for the corresponding λ/μ ratio that results in negligible bias (estimated TC in bold numbers).

Ferrenberg, Lanau, & Wong [2] tried more advanced random number generators to no avail. So, the LCG simulation experiments here were repeated with the most advanced Mersenne Twister algorithm for random numbers. The results were biased similarly.

6. Optimizing the Combining Weights

A graph of ω for various λ/μ ratios that result in negligible bias (estimated TC in bold numbers) is given in Figure 7. This graph of ω is a smooth monotonically increasing function λ/μ. Optimization of the weight is done by consulting Figure 7 once the λ/μ ratio for the system design is known. A graph of simulation estimates of time in system when 1/λ = 2.474, 1/μ = 2.4 minutes, ω = 1.25 and T C = ω T + ( 1 ω ) T converges to 81.48 minutes is given is Figure 8. The graph is created once ω is obtained from Figure 7. The bias is now 80.24 − 81.48 = 1.24 = 1.5%. This is acceptable. We also observe that the shapes of the graphs in

Figure 7. Weight ω for various λ/μ ratios that result in negligible bias.

Figure 8. Simulation estimates of time in system T C = ω T + ( 1 ω ) T when ω = 1.25 .

Figure 6 and Figure 8 are essentially the same except for one is biased and one is unbiased.

7. Conclusion

The experiments in this paper were Monte Carlo computer simulations. Antithetic random variates were created by inverse transformation. The response variable was observed to be highly biased. This appears to be an artifact of a simulation that cannot be improved by the choice of random numbers. Therefore, antithetic random variables were created from the response variable and its power transformation. The idea for this came from insights that were gained from the derivations of the correlation with antithetic counterparts of known functions. These formed antithetic variables that were combined. The combined variable was demonstrated to contain negligible bias. The combined estimates were closer to their corresponding values that are known to be true from theory. Combining reduced bias in the estimated values. The simulations in this research were applied to a simple queue. Like Ferrenberg, Lanau, & Wong [2] in their study of the Ising model two-dimensional lattice gauge physics problem, we conclude here that there is bias leading to the wrong answer for time in the queueing system. Therefore, we repeat their caution here. This research supports the notion that if the bias is due to pre-simulation traces of serial correlation, then since subsets of correlation are part of overall randomness, bias cannot be avoided by better random numbers. Therefore, it is better to pursue ideas for cancelling bias, post-simulation. This research is limited to the simple queuing system. Future research might be conducted for different system designs and antithetic variables combining strategies. The Ising lattice gauge physics problem can be repeated using the method proposed in this research to see if the bias is eliminated there.

Nomenclature

Antithetic variables—Two variables that are oppositely correlated.

Antithetic power transformation—Uses an infinitesimal negative exponent to produce a new variable that is negatively correlated with the original variable.

LCG—Linear congruential generator of pseudorandom numbers.

Mersenne Twister algorithm—Fast generation of high-quality very long period pseudorandom numbers.

Monte Carlo Simulation—A mathematical method for calculating the odds of multiple possible outcomes occurring in an uncertain process through repeated random sampling.

PDF—Probability Density Function.

Random variate—Uniformly distributed [0, 1] random number sequence.

Random variable—Random number sequence that follows a distribution corresponding to a known variable.

Appendix A: Correlation between r i and r i p

Consider X i ~ U ( 0 , 1 ) with pdf

f ( x i ) = { 1 on ( 0 , 1 ) 0 otherwise

E [ X i p ] = x p d x = 0 1 x p d x = 1 p + 1 , p 1 (A.1)

E [ X i p + 1 ] = 1 p + 2 , p 2

E [ X i 2 p ] = 1 2 p + 1 , p 1 / 2

σ X = E [ X i 2 ] ( E [ X i ] ) 2 = 1 3 ( 1 2 ) 2 = 1 12

σ X p = E [ X i 2 p ] ( E [ X i p ] ) 2 = 1 2 p + 1 1 ( p + 1 ) 2 = p 2 + 2 p + 1 2 p 1 ( 2 p + 1 ) ( p + 1 ) 2 = p 2 ( 2 p + 1 ) ( p + 1 ) 2 = | p | | p + 1 | 1 2 p + 1 , p 1 , p 1 / 2 (A.2)

Next, consider r i ~ U ( a , b ) . Then r i = ( b a ) X i + a

E [ r i ] = ( b a ) E [ X i ] + a = b a 2 + a = a + b 2

σ r = ( b a ) σ X = b a 12

( r i a ) p = ( b a ) p X i p

Substituting for E [ X i p ] from (A.1)

E [ ( r i a ) p ] = ( b a ) p p + 1

Assume a = 0, b>0, then E [ r i p ] = b p p + 1 , E [ r i 2 p ] = b 2 p 2 p + 1 and σ r = b 12

σ r p = E [ r i 2 p ] ( E [ r i p ] ) 2 = b 2 p 2 p + 1 b 2 p ( p + 1 ) 2 = b p p 2 ( 2 p + 1 ) ( p + 1 ) 2 = b p | p | | p + 1 | 1 2 p + 1

ρ r r p = E [ r i p + 1 ] E [ r i p ] E [ r i ] σ r σ r p = b p + 1 p + 2 b p p + 1 b 2 b 12 b p | p | | p + 1 | 1 2 p + 1

= 1 p + 2 1 p + 1 1 2 1 12 | p | | p + 1 | 1 2 p + 1

ρ r r p = E [ r i p + 1 ] E [ r i p ] E [ r i ] σ r σ r p = b p + 1 p + 2 b p p + 1 b 2 b 12 b p | p | | p + 1 | 1 2 p + 1 = 1 p + 2 1 p + 1 1 2 1 12 | p | | p + 1 | 1 2 p + 1 = 2 p + 2 p 2 2 ( p + 2 ) ( p + 1 ) | p | 12 | p + 1 | 2 p + 1 = 12 p | p + 1 | 2 p + 1 2 | p | ( p + 2 ) ( p + 1 )

lim p 0 ρ r r p = lim p 0 12 p | p + 1 | 2 p + 1 2 | p | ( p + 2 ) ( p + 1 ) = lim p 0 p | p | lim p 0 2 p + 1 2 ( p + 2 ) lim p 0 | p + 1 | p + 1 12 = 1 1 4 1 12

lim p 0 ρ r r p = 3 2 .

This correlation is invariant with respect to the lower limit of the interval a, b.

Appendix B: Correlation between r i + p and r i p

Consider r i ~ U ( 0 , 1 ) . Then from Appendix A,

E [ r i + p ] = 1 p + 1 , p 1

E [ r i p ] = 1 p + 1 , p 1

σ r p 2 = p 2 ( 2 p + 1 ) ( p + 1 ) , p 1 , p 1 / 2

Similarly,

σ r p 2 = p 2 ( 2 p + 1 ) ( p + 1 ) , p 1 , p 1 / 2

E [ r i p r i + p ] E [ r i p ] E [ r i + p ] = E [ 1 ] E [ r i p ] E [ r i + p ] = 1 1 ( p + 1 ) 1 ( p + 1 ) = 1 1 ( 1 p ) ( 1 + p ) = ( 1 p ) ( 1 + p ) 1 ( 1 p ) ( 1 + p ) = 1 p 2 1 ( 1 p ) ( p + 1 ) = p 2 ( 1 p ) ( 1 + p )

ρ r + p r p = E [ r i p r i + p ] E [ r i p ] E [ r i + p ] σ r p σ r p = p 2 ( 1 p ) ( p + 1 ) p 2 ( 2 p + 1 ) ( p + 1 ) p 2 ( 2 p + 1 ) ( p + 1 ) = p 2 ( 1 p ) ( 1 + p ) ( 2 p + 1 ) ( p + 1 ) | p | ( 2 p + 1 ) ( p + 1 ) | p | = p 2 | p | | p | ( 2 p + 1 ) ( p + 1 ) 1 p ( 2 p + 1 ) ( p + 1 ) 1 + p = ( 2 p + 1 ) ( p + 1 ) ( 2 p + 1 ) ( p + 1 ) ( 1 p ) ( 1 + p )

Therefore,

lim p 0 ρ r + p r p = lim p 0 ( 2 p + 1 ) ( p + 1 ) ( 2 p + 1 ) ( p + 1 ) ( 1 p ) ( 1 + p ) = 1

Likewise, lim p 0 + ρ r + p r p = 1

Appendix C: Correlation between X i and X i

Given

{ X i = 1 λ ln ( 1 r i ) X i = r i p r p ¯ ( s r p ) λ + 1 λ , r i ~ U ( 0 , 1 )

The expected value of the original variable X i is

E [ X i ] = 0 1 1 λ ln ( 1 r i ) d r i

Since 0 1 ln ( 1 r i ) d r i = [ ( 1 r i ) ln ( 1 r i ) + ( 1 r i ) ] 0 1 = 1 , (C.1)

E [ X i ] = 1 λ . (C.2)

Also,

E [ X i 2 ] = 0 1 ( 1 λ ln ( 1 r i ) ) 2 d r i

and since 0 1 ln 2 ( 1 r i ) d r i = [ ( 1 r i ) ln 2 ( 1 r i ) 2 ( 1 r i ) ln ( 1 r i ) + 2 ( 1 r i ) ] 1 0 = 2 ,

E [ X i 2 ] = 2 λ 2 .

Therefore, σ X 2 = E [ X i 2 ] E [ X i ] 2 = 2 λ 2 1 λ 2 , so that

σ X 2 = 1 λ 2 . (C.3)

The expected value of the antithetic variable X i is

E [ X i ] = E [ r i p r p ¯ ( s r p ) λ + 1 λ ]

and since E [ r i p r p ¯ ] = 0 ,

E [ X i ] = 1 λ (C.4)

with variance

σ X 2 = V a r ( r i p r p ¯ ( s r p ) λ + 1 λ ) = 1 ( s r p 2 ) λ 2 V a r ( r i p r p ¯ ) .

For an n step computer simulation, V a r ( r p ¯ ) = V a r ( r i p ) / n 0 as n .

Therefore,

σ X 2 = 1 ( s r p 2 ) λ 2 V a r ( r p ) = 1 ( s r p 2 ) λ 2 s r p 2

σ X 2 = 1 λ 2 . (C.5)

Remark. E [ X i ] = σ X = E [ X i ] = σ X = 1 λ is consistent with X i & X i expontially distributed.

To obtain the expected value E [ X i X i ] , consider,

X i X i = 1 λ ln ( 1 r i ) ( r i p r p ¯ ( s r p ) λ + 1 λ )

X i X i = 1 λ 2 ln ( 1 r i ) 1 λ ln ( 1 r i ) r i p r p ¯ ( s r p ) λ (C.6)

From (A.1) and (A.2)

E [ X i p ] = 1 p + 1 and σ X p = | p | | p + 1 | 1 2 p + 1

Therefore, replacing X i with r i , E ( r i p ) with r p ¯ and σ r p with s r p ,

r i p r p ¯ ( s r p ) λ = r i p 1 p + 1 λ | p | | p + 1 | 2 p + 1 = ( p + 1 ) r p 1 | p | | p + 1 | 2 p + 1 λ ( p + 1 ) = ϕ ( p ) ψ ( p ) (C.7)

where

ϕ ( p ) = ( p + 1 ) r p 1 | p | and ψ ( p ) = | p + 1 | 2 p + 1 λ ( p + 1 ) , (C.8)

from which we obtain

lim p 0 ψ ( p ) = 1 λ . (C.9)

The Taylor expansion at p = 0 of r i p is

r i p = 1 + p ln ( r i ) + O ( p 2 ) .

Substituting for r i p in (C.8)

ϕ ( p ) = ( p + 1 ) r i p 1 | p | = p r i p + r i p 1 | p | = p ( 1 + p ln ( r i ) + O ( p 2 ) ) + 1 + p ln ( r i ) + O ( p 2 ) 1 | p | = p + p 2 ln ( r i ) + p O ( p 2 ) + p ln ( r i ) + O ( p 2 ) | p | = p | p | ( 1 + ln ( r i ) ) + p 2 ln ( r i ) + O ( p 2 ) | p |

from which we obtain

lim p 0 ϕ ( p ) = 1 ln ( r i ) . (C.10)

Substituting (C.9) and (C.10) in (C.7)

lim p 0 r i p r p ¯ ( s r p ) λ = 1 λ ( 1 + ln ( r i ) ) . (C.11)

Substituting (C.11) in (C.6)

lim p 0 X i X i = 1 λ 2 ln ( 1 r i ) + 1 λ ln ( 1 r i ) 1 λ ( 1 + ln ( r i ) ) = 1 λ 2 ln ( r i ) ln ( 1 r i ) .

From the Lebesque dominated converge theorem,

lim p 0 E [ X i X i ] = E [ lim p 0 X i X i ] .

Therefore,

lim p 0 E [ X i X i ] = 1 λ 2 E [ ln ( r i ) ln ( 1 r i ) ] ,

and since 0 1 ln ( r i ) ln ( 1 r i ) d r i = 2 π 2 / 6 (see Appendix D),

lim p 0 E [ X i X i ] = 1 λ 2 ( 2 π 2 / 6 ) . (C.12)

Finally, the correlation between X i and X i

ρ X X = C o v ( X i , X i ) / σ X σ X = E [ X i X i ] E [ X i ] E [ X i ] σ X σ X

And substituting from (C.2), (C.3), (C.4), (C.5), (C.12),

ρ X X = 1 λ 2 ( 2 π 2 / 6 ) 1 λ 1 λ 1 λ 1 λ

ρ X X = 1 π 2 / 6 .

Appendix D

0 1 ln ( r i ) ln ( 1 r i ) d r i = 0 1 ln ( r i ) n = 1 r i n n d r i = n = 1 1 n 0 1 ln ( r i ) ( r i n n ) d r i = n = 1 1 n { [ ln ( r i ) ( r i n + 1 n + 1 ) ] 0 1 0 1 1 r i r i n + 1 n + 1 } d r i = n = 1 1 n 1 n + 1 [ r i n + 1 n + 1 ] 0 1

= n = 1 1 n 1 ( n + 1 ) 2 = n = 1 1 n 1 n + 1 1 ( n + 1 ) 2 = 1 [ n = 1 1 n 2 1 ] = 2 ζ ( 2 ) = 2 π 2 6

where ζ is the Reimann zeta function. See Chapman [29] .

Conflicts of Interest

The authors declare no conflicts of interest regarding the publication of this paper.

References

[1] Proykova, A. (2000) How to Improve a Random Number Generator. Computer Physics Communications, 124, 125-131.
https://doi.org/10.1016/S0010-4655(99)00434-8
[2] Ferrenberg, A.M., Landau, D.P. and Wong, Y.J. (1992) Monte Carlo Simulations: Hidden Errors from “Good” Random Number Generators. Physical Review Letters, 69, 3382-3384.
https://doi.org/10.1103/PhysRevLett.69.3382
[3] Lehmer, D.H. (1951) Mathematical Methods in Large-Scale Computing Units. The Annals of' the Computation Laboratory of Harvard University, 26, 141-146.
[4] Marsaglia, G. (1968) Random Numbers Fall Mainly in the Planes. Proceedings of the National Academy of Sciences of the United States of America, 61, 25-28.
https://doi.org/10.1073/pnas.61.1.25
[5] Park, S.K. and Miller, K.W. (1988) Random Number Generators: Good Ones Are Hard To Find. Communications of the ACM, 31, 1192-1201.
https://doi.org/10.1145/63039.63042
[6] Marsaglia, G. (1961) Expressing a Random Variable in Terms of Uniform Random Variables. Annals of Mathematical Statistics, 32, 894-898.
https://doi.org/10.1214/aoms/1177704983
[7] Marsaglia, G. (1964) Generating a Variable from the Tail of the Normal Distribution. Technometrics, 6, 101-102.
https://doi.org/10.1080/00401706.1964.10490150
[8] Marsaglia, G. and Tsang, W.W. (1984) A Fast, Easily Implemented Method for Sampling from Decreasing or Symmetric Unimodal Density Functions. SIAM Journal of Scientific and Statistical Computing, 5, 349-359.
https://doi.org/10.1137/0905026
[9] Marsaglia, G. and Tsay, L.H. (1985) Matrices and the Structure of Random Number Sequences. Linear Algebra and its Applications, 67, 147-156.
https://doi.org/10.1016/0024-3795(85)90192-2
[10] Marsaglia, G., MacLaren, M.D. and Bray, T.A. (1964) A Fast Procedure for Generating Normal Random Variables. Communications of the ACM, 7, 3-10.
https://doi.org/10.1145/363872.363883
[11] Marsaglia, G. and MacLaren, M.D. (1964). A Fast Procedure for Generating Exponential Random Variables. Communications of the ACM, 7, 298-300.
https://doi.org/10.1145/364099.364330
[12] Marsaglia, G., Ananthanarayan, K. and Paul, N.J. (1976) Improvements on Fast Methods for Generating Normal Random Variables. Information Processing Letters, 5, 27-30.
https://doi.org/10.1016/0020-0190(76)90074-0
[13] Marsaglia, G. and Tsang, W.W. (1988). The Monte Python Method for Generating Random Variable. ACM Transactions on Mathematical Software, 24, 341-350.
https://doi.org/10.1145/292395.292453
[14] Leva, J.L. (1992) A Normal Random Number Generator. ACM Transactions Mathematical Software, 18, 454-455.
https://doi.org/10.1145/138351.138367
[15] Kroese, D.P., Taimre, T. and Botev, Z.I. (2011) Handbook of Monte Carlo Methods. John Wiley & Sons, New York.
https://doi.org/10.1002/9781118014967
[16] Hammersley, J.M. and Morton, K.W. (1956) A New Monte Carlo Technique: Antithetic Variates, Mathematical Proceedings of the Cambridge Philosophical Society, 52, 449-475.
https://doi.org/10.1017/S0305004100031455
[17] Aljeddani, S. (2022) Bayesian Variable Selection for Mixture Process Variable Design Experiment. Open Journal of Modelling and Simulation, 10, 391-416.
https://doi.org/10.4236/ojmsi.2022.104022
[18] Cheng, R.C.H. (1982) The Use of Antithetic Variates in Computer Simulations. Journal of the Operational Research Society, 33, 229-237.
https://doi.org/10.1057/jors.1982.48
[19] Kleijnen, J.P.C. (1975) Antithetic Variates, Common Random Numbers and Optimal Computer Time Allocation in Simulation. Management Science, 21, 1176-1185.
https://doi.org/10.1287/mnsc.21.10.1176
[20] Ridley, A.D. (1999) Optimal Antithetic Weights for Lognormal Time Series Forecasting. Computers and Operations Research, 26, 189-209.
https://doi.org/10.1016/S0305-0548(98)00058-6
[21] Ridley, A.D. (1995) Combining Global Antithetic Forecasts. International Transactions in Operational Research, 2, 387-398.
https://doi.org/10.1111/j.1475-3995.1995.tb00030.x
[22] Ridley, A.D. (1997) Optimal Weights for Combining Antithetic Forecasts. Computers & Industrial Engineering, 32, 371-381.
https://doi.org/10.1016/S0360-8352(96)00296-3
[23] Ridley, A.D. (2016) Advances in Antithetic Time Series: Separating Fact from Artifact. Operations Research and Decisions, 26, 57-68.
[24] Ridley, A.D., Ngnepieba, P. and Duke, D. (2013) Parameter Optimization for Combining Lognormal Antithetic Time Series. European Journal of Mathematical Sciences, 2, 235-245.
[25] Ridley, A.D. and Ngnepieba, P. (2014) Antithetic Time Series Analysis and the Companyx Data. Journal of the Royal Statistical Society Series A: Statistics in Society, 177, 83-94.
https://doi.org/10.1111/j.1467-985X.2012.12001.x
[26] Ridley, A.D. and Ngnepieba, P. (2015) General Theory of Antithetic Time Series. Journal of Applied Mathematics and Physics, 3, 1726-1741.
http://www.scirp.org/journal/jamp
https://doi.org/10.4236/jamp.2015.312197
[27] MATLAB (2008) Application Program Interface Reference. Version 8, The MathWorks, Inc, The Natick Mall.
[28] Harrell, C., Ghosh, B. and Bowden, R. (2004) Simulation Using Promodel. McGraw Hill, New York.
[29] Chapman, R. (1999) Evaluating ζ(2).
https://empslocal.ex.ac.uk/people/staff/rjchapma/etc/zeta2.pdf

Copyright © 2024 by authors and Scientific Research Publishing Inc.

Creative Commons License

This work and the related PDF file are licensed under a Creative Commons Attribution 4.0 International License.