Fourth-Order Adjoint Sensitivity Analysis of an OECD/NEA Reactor Physics Benchmark: I. Mathematical Expressions and CPU-Time Comparisons for Computing 1st-, 2nd- and 3rd-Order Sensitivities ()
1. Introduction
Until recently, only the first-order sensitivities (i.e., functional derivatives) of a computational model’s responses (i.e., quantities of interest) to the respective model’s imprecisely known (i.e., uncertain) parameters have been considered when assessing the uncertainties induced in the respective responses by the parameter uncertainties. The second- and higher-order sensitivities could not be computed, except for very simple models comprising a handful of parameters, so these sensitivities were ignored. The Second-Order Adjoint Sensitivity Analysis Methodology (2nd-ASAM) recently conceived by Cacuci [1] is the only practical method that enables the exact computation of the large number of 2nd-order sensitivities arising in large-scale problems comprising many parameters. The application of the 2nd-ASAM to a multiplying nuclear system with source [2] [3] [4] has opened the way for the large-scale application presented in [5] - [10] to a polyethylene-reflected plutonium (acronym: PERP) OECD/NEA reactor physics benchmark [11]. The numerical model of the PERP benchmark comprises 21,976 uncertain parameters, of which 7477 parameters have nonzero values, as follows: 180 group-averaged total microscopic cross sections, 7101 non-zero group-averaged scattering microscopic cross sections (the other scattering cross sections, of which there are 21,600 in total, are zero); 120 fission process parameters; 60 fission spectrum parameters; 10 parameters describing the experiment’s nuclear sources; and 6 isotopic number densities.
All of the non-zero first-order sensitivities and second-order sensitivities of the PERP leakage response with respect to the benchmark’s parameters were computed, ranked, and analyzed in [5] - [10]. The results obtained in [5] - [10] showed that the 2nd-order sensitivities of the leakage response with respect to the group-averaged microscopic total cross sections are the largest (by comparison to the 2nd-order sensitivities of the leakage response with respect to the other uncertain model parameters) and have therefore the largest impact on the uncertainties induced in the leakage response. For example, neglecting the 2nd-order sensitivities of the leakage response with respect to the total cross sections could cause an error as large as 2000% in the expected value of the leakage response and up to 6000% in the variance of the leakage response [5]. Given that the effects of these 2nd-order sensitivities are much larger than the effects of the 1st-order sensitivities [5] [10], it is logical to quantify the magnitudes and contributions that would stem from the 3rd-order sensitivities of the PERP benchmark’s total leakage response with respect to the microscopic total cross sections. To enable the computation of such 3rd-order sensitivities, Cacuci [12] has recently conceived the “third order adjoint sensitivity analysis methodology for reaction rate responses in a multiplying nuclear system with source” and then applied this general theory to the PERP benchmark in order to derive the exact analytical expressions of the 3rd-order sensitivities of the PERP benchmark’s leakage response with respect to this benchmark’s microscopic total cross sections [13] [14] [15]. These works [13] [14] [15] have shown that the largest 3rd-order sensitivities involve the microscopic total cross section for the lowest (30th) energy group of isotope 1H (i.e.,
). In particular, the largest overall 3rd-order sensitivity is the mixed 3rd-order sensitivity
, which also involves the microscopic total cross section for the 30th energy group of isotope 239Pu (i.e.,
). The largest unmixed 3rd-order sensitivity is also with respect to
, namely
. These sensitivities significantly larger than the largest lower-order sensitivities; by comparison, the largest 1st-, 2nd- and 3rd-order sensitivities are
,
and
, respectively. The results obtained in [5] - [10] and [13] [14] [15] indicated that the total microscopic cross section of isotopes 1H and 239Pu are the most important parameters affecting the PERP benchmark’s leakage response, since they are responsible for the largest 1st-, 2nd- and 3rd-order sensitivities.
This work is organized as follows: Section 2 presents the computational modeling of the PERP Benchmark. Section 3 presents the main features and the CPU-times required for applying the three fundamental deterministic (as opposed to “statistical”) methods for computing the 1st-order response sensitivities, namely 1) finite differences; 2) the forward sensitivity analysis method (FSAM); and 3) the 1st-Order Comprehensive Adjoint Sensitivity Analysis Methodology (1st-CASAM) for linear systems. Section 4 presents the main features and the CPU-times required for applying the three fundamental deterministic methods (i.e., finite differences, FSAM the 2nd-CASAM, respectively) for computing the 2nd-order response sensitivities. The results presented in Section 4 clearly highlight the fact that the 2nd-CASAM is the only method that can be used in practice to compute 1st- and 2nd-order sensitivities of a response of a large-scale system, involving many parameters. Section 5 presents comparisons of the CPU times required for computing the 3rd-order sensitivities of the PERP benchmark’s leakage response solely to the group-averaged total cross sections. These results underscore the fact that the 3rd-CASAM is exact, introducing no intrinsic methodological errors in the computation of sensitivities, and is by far more efficient than any other method. Section 6 concludes this work, noting that the expressions and results for the 4th-order sensitivities will be presented in companion works [16] [17]. Notably, the original mathematical concepts underlying the 1st-order FSAM and 1st-CASAM were presented in [18] [19] [20] while the general theory underlying the 4th-Order Comprehensive Adjoint Sensitivity Analysis Methodology (4th-CASAM) for linear systems is presented in [21].
2. Mathematical/Computational Model of the PERP Benchmark
The spherical polyethylene-reflected plutonium (acronym: PERP) benchmark comprises a metallic inner sphere (“core”) containing the following 4 isotopes: Isotope 1 (239Pu), Isotope 2 (240Pu), Isotope 3 (69Ga) and Isotope 4 (71Ga). This core (which is designated as “material 1”) is surrounded by a spherical shell of polyethylene (designated as “material 2”), containing two isotopes, designated as Isotope 5 (C) and Isotope 6 (1H), respectively. The dimensions and material composition of the polyethylene-reflected plutonium (PERP) metal sphere considered in this work are presented in TableA1 in the Appendix. The quantity of interest in this work, which will be called the “response,” is the leakage of neutrons out of the PERP sphere, which has been measured experimentally [11].
The numerical modeling of the neutron flux distribution within the PERP benchmark, as well as the computation of the PERP leakage response has been performed using the multigroup discrete ordinates particle transport code PARTISN [22] together with neutron sources computed using the code SOURCES4C [23]. The neutron flux distribution within the PERP benchmark, as well as the leakage of neutrons out of the PERP sphere has been modeled using the standard multigroup form of the Boltzmann neutron transport equation subject to the boundary condition of no incoming flux, with an internal spontaneous fission source, which can be written in the following form:
(1)
, (2)
where
is the radius of the PERP sphere. Note that many works, use the “
” as the “dummy” summation index in Equation (1); the index h (instead of
) is preferred in this work in order to avoid, as much as possible, the appearance of “superscripted superscripts.” In this work, therefore, the superscript-indices “g” and “h” will refer exclusively to “energy groups.”
The source,
, which appears on the right-side of Equation (1) is defined as follows:
, (3)
where
denotes the total number of spontaneous-fission isotopes. The PERP benchmark has
spontaneous-fission isotopes, namely “isotope 1” (239Pu) and “isotope 2” (240Pu). The spontaneous fission neutron spectrum of 239Pu and 240Pu, respectively, is each approximated by a Watts fission spectrum, characterized by: 1) the evaluated parameters
and
; 2) the spontaneous emission,
, of an average neutron of an isotope k; 3) the decay constant,
, for actinide nuclide k; 4) the fraction,
, of decays that are spontaneous fission (the “spontaneous-fission branching fraction”); 5) the index
refers to “isotope 1” (239Pu) while
refers to “isotope 2” (240Pu). The symbols used in Equations (1) through (3) have their usual meanings; for convenient referencing, they are described in the Appendix and are summarized in the Nomenclature.
The mathematical expression of the PERP benchmark’s leakage response, denoted as
, is provided below:
. (4)
The PARTISN [22] computations of the neutron flux used the MENDF71X [24] 618-group cross section data collapsed to
energy groups, as well as a P3 Legendre expansion of the scattering cross section and a fine-mesh spacing of 0.005 cm (comprising 759 meshes for the plutonium sphere of radius of 3.794 cm, and 762 meshes for the polyethylene shell of thickness of 3.81 cm). The first- and second-order response sensitivities were computed using an angular quadrature of S256. The 3rd- and 4th-order sensitivities of the leakage response with respect to the total cross sections were computed using an angular quadrature of S32. The group boundaries of the
energy groups are provided in TableA2 in the Appendix. The scattering and fission terms in Equation (1) contain implicitly a factor
, to conform to the convention used in PARTISN [22].
The vector
, which appears in the arguments of the various quantities in Equations (1) and (4), is defined as follows:
(5)
The components of the TP-dimensional vector
are the imprecisely known (i.e., uncertain) model and response parameters, and are described in the Appendix. In Equation (5) and throughout this work, the dagger will be used to denote “transposition.” The nominal values of the parameters in Equation (5), as well as of all other quantities in this work, will be denoted using the superscript “zero,” e.g.,
.
For the mathematical derivations to follow in this work, it will be convenient to use the matrix-form of Equations (1) and (2), which is as follows:
(6)
(7)
where
(8)
with components defined below:
(9)
The notation
, which appears in Equation (9), denotes the Kronecker delta-functional, which is defined as usual, i.e.,
, if
and
, if
.
3. Computation of First-Order Sensitivities
Basically, there are three methods for computing deterministically (as opposed to computing “statistically”) the response sensitivities to model and response parameters, as follows:
1) The so-called “brute-force re-computations” method, which uses finite-difference formulas to approximate the derivative that expresses the response sensitivity to the parameter under consideration; this method will be presented in Subsection 3.1;
2) The Forward Sensitivity Analysis Methodology (FSAM), which will be applied in Subsection 3.2;
3) The 1st-Order Comprehensive Adjoint Sensitivity Analysis Methodology (CASAM) conceived by Cacuci [21], which will be applied in Subsection 3.3.
Subsection 3.4 will present a comparative discussion of the computational resources and times (CPU) which are required by the three above-mentioned deterministic methods.
3.1. Re-Computations with Finite-Difference Approximation
The first-order sensitivities of the leakage response,
, can be approximately computed by re-computations using the well-known finite-difference formula presented below:
, (10)
where
,
and
denotes a “judiciously-chosen” variation in the parameter
around its nominal value
. The values
and
are obtained by re-solving Equations (1) and (2) repeatedly, using the changed parameter values
. As is well known, the value of the variation
must be chosen by “trial and error” for each parameter
, and varies from parameter to parameter; when
is too large or too small, the result produced by Equation (10) will be far off from the exact value of the derivative
. It is important to note that finite difference formulas introduce their intrinsic “methodological errors,” such as the error
indicated in Equation (10), which are in addition to and independent of the errors that might be incurred in the computation of
. In other words, even if the computation of
were perfect (error-free), the finite-difference formulas nevertheless introduce their own, intrinsic, numerical errors into the computation of the sensitivity
.
3.2. Forward Sensitivity Analysis Methodology (FSAM)
If one could solve the neutron transport Equations (1) and (2) in closed form, the respective closed form of
would be an explicit function of the parameters
. However, since the neutron transport Equations (1) and (2) cannot be solved in closed form, it follows that
is therefore an implicit function of
. Consequently, as Equation (4) indicates, the PERP benchmark’s leakage response,
, is a function of the vector
of model parameters implicitly through the group-flux
.
The Forward Sensitivity Analysis Methodology (FSAM) is developed [18] [19] in the vector-space of the model parameters
. In this vector-space, the first-order partial sensitivity of
to a generic model parameter,
, can in principle be obtained by taking the first-order partial G-derivative of Equation (4) with respect to a generic model/respond parameter
, evaluated at the nominal parameter values
, which yields:
(11)
In turn, the derivative
is the solution of the equations obtained by taking the first-order G-derivatives of Equations (1) and (2) with respect to
, evaluated at the nominal parameter values
, which yields, by definition, the following equations:
(12)
(13)
Carrying out the differentiations with respect to
in Equations (12) and (13), setting
in the resulting equations and subsequently cancelling everywhere the scalar quantity
yields the following equations for the function
:
(14)
, (15)
where
(16)
(17)
The system of Equations (14) and (15) is called the 1st-Order Forward Sensitivity System (1st-OFSS), the solutions of which are required in Equation (11) to compute, in the end, the response sensitivities using the forward sensitivity analysis method. Note that a “place-holder,” denoted as “[]”, has been explicitly used on the left-side of Equation (14) to indicate that the operator
acts (linearly) on the function that appears in this place-holder. Place-holders “[]” have also been used on the right-side of Equation (16) and on the left-side of Equation (17) to indicate that the operator
acts on the function that appears in the respective place-holder. Since there are a total of TP parameters
, it is evident that the computations of all of the sensitivities
require TP large-scale computations to solve the 1st-OFSS, cf. Equations (14) and (15), followed by TP small-scale computations for performing the integration represented by Equation (11).
3.3. First-Order Comprehensive Adjoint Sensitivity Analysis Methodology (1st-CASAM)
The aim of the First-Order Comprehensive Adjoint Sensitivity Analysis Methodology (1st-CASAM) is to find an alternative way for expressing the contribution of the flux variation (the so-called “indirect-effect term” contribution) to the total response sensitivity, so as to avoid the need for having to compute the derivatives
of the state functions with respect to the model’s parameters, as is the case when using the FSAM. In contradistinction to the FSAM, which is set in the vector-space of the parameters
, the 1st-CASAM is set in the combined space of the parameters and the state-functions, denoted as
, and does not a priori consider that the state functions
are implicit functions of the parameters
. In its full generality, the 1st-CASAM also considers that the phase-space domain’s boundaries and internal interfaces are also subject to uncertainties (i.e., are imperfectly well known). For the purpose of this work, however, the boundaries of the phase-space domain (which consist of the boundaries of the spatial domain, i.e., the internal and external radii of the PERP sphere) and the end-points of the energy groups are considered to be free of errors (i.e., are perfectly well known) so that the sensitivities of the leakage response to these phase-space domain boundaries will not be considered. In this case, the 1st-CASAM reduces to the adjoint sensitivity analysis methodology originally conceived by Cacuci [18] [19]. When the response sensitivities with respect to the boundaries of the phase-space domain are not considered, the G-differential, denoted as
, of the leakage response defined in Equation (4) for a variation
around the nominal values
is obtained, by definition, as follows:
(18)
In general, the total G-variation of the response depends comprises two contributions, one arising directly from the parameter variations
(this contribution is called the “direct-effect term”) and another contribution, stemming from the variations
in the state functions (this contribution is called the “indirect-effect term”). In the particular case of the leakage response considered in this work, the variation
does not depend directly on the parameter variations
but depends only on variations
in the state functions, as indicated in Equation (18). Therefore,
coincides with the “indirect-effect term.”
The variations
are the solutions of the first-order G-differentials of the model Equations (1) and (2), which are determined by applying the definition of the G-differential to these equations, to obtain:
(19)
(20)
Carrying out the differentiations with respect to
in Equations (19) and (20), and setting
in the resulting equations yields the following system of equations for the variations
in terms of the parameter variations
:
(21)
(22)
where
(23)
(24)
By analogy to Equations (6) and (7), Equations (21) and (22) can be written in following matrix-vector form:
(25)
(26)
where
(27)
The aim of the 1st-CASAM—to construct an alternative expression for the “indirect-effect term”
which would not depend on
—can be achieved by implementing the following sequence of steps, which are all to be carried out at the nominal parameter values
(although this will not be explicitly indicated in the sequence in order to keep the notation as simple as possible):
1) Consider that the square-integrable functions
and
are elements of a Hilbert space denoted as
, in which the inner product between two elements
and
is denoted as
and is defined as follows:
. (28)
2) Form the inner product of Equation (25) with a yet undefined function
to obtain the following relation:
(29)
3) Using the inner product defined in Equation (28) and the definition of the adjoint operator in
, recast the left-side of Equation (29) into the following equivalent form:
(30)
where
(31)
denotes the bilinear concomitant evaluated on the PERP sphere’s surface
and where
denotes the operator adjoint to
, having components
, where the symbol
indicates “formal adjoint operator.”
4) Require the first term on the right-side of Equation (30) to represent the functional defined in Equation (18) to obtain the following relation:
. (32)
5) Use the boundary condition given in Equation (22) to eliminate the corresponding boundary terms in the bilinear concomitant
in Equation (31) and eliminate the appearance of the remaining boundary terms in Equation (31) by imposing the following (adjoint) boundary condition:
(33)
In component form, Equations (32) and (33) are as follows:
(34)
(35)
It is important to note that the relations presented in Equations (28) through (35) hold generally, including at the nominal values
. In order to simplify the notation, the superscript “zero” denoting nominal values has been omitted in the foregoing derivations and will occasionally be omitted henceforth, as well. This simplification should not cause any loss of clarity since it will become clear from the context which quantities are to be evaluated/computed using the nominal values for the model parameters.
6) Use Equations (29) through (33) in Equation (18) to obtain the following expression for the “indirect-effect term”:
(36)
7) Replacing in Equation (36) the expression of
from Equation (23) and identifying the expressions that multiply the arbitrary parameter variations
yields the expression of each partial sensitivity
, for all
,
, as follows:
(37)
(38)
(39)
(40)
(41)
(42)
(43)
The expressions of the sensitivities provided in Equations (37) through (43) are to be evaluated at the nominal parameter values
(which has not been indicted explicitly, in order to simplify the respective notations). All of these sensitivities have been computed numerically in [5] - [10]. Evidently, the computations of these sensitivities are inexpensive, involving only integrations using quadrature formulas, once the (1st-level adjoint) function
is available.
8) Equations (32) and (33) are called the First-Level Adjoint Sensitivity System (1st-LASS); the solution
of the 1st-LASS is called the 1st-level adjoint function. The system of equations is called “first-level” as opposed to “first-order” because it does not contain any derivatives (of first- or higher-order) but its solution is used for computing the first-order sensitivities. This terminology will be also used in the sequel, when deriving the expressions for the 2nd- and 3rd-order sensitivities. The 1st-LASS is independent of parameter variations, so it needs to be solved just once to obtain
. Thus, using the 1st-CASAM, the computation of the TP partial sensitivities
,
, using Equations (37) through requires just a single large-scale computation in order to determine
, followed by TP inexpensive computations to perform each integration (quadrature) involving the 1st-level adjoint function
.
3.4. Comparison of Computational Requirements
The computer used for the PERP computations is a DELL desktop computer (AMD FX-8350) with an 8-core processor. A forward computation of the flux distribution
within the PERP benchmark and of the leakage response takes ca. 2 minutes CPU-time when the forward transport equation is solved using an angular expansion of order ISN = 256 (S256).
The 1st-level adjoint function
used to compute the first-order sensitivities given by Equations (37) through (43) has been computed in [5] by solving the 1st-LASS using an angular expansion of order ISN = 256 (S256). The CPU-time for a typical adjoint computation of
using S256 is ca. 85 seconds, which is comparable to the CPU-time needed for solving the forward transport equation to compute the flux distribution
. Furthermore, the typical CPU-time needed to perform the integration (quadrature) over the forward and adjoint functions, to compute the respective sensitivity (using S256) is ca. 0.0012 seconds. The CPU requirements needed for computing the 7477 non-zero sensitivities using forward computations in conjunction with the 2-point finite difference scheme presented in Section 3.1 and using the FSAM presented in Section 3.2, respectively, are compared in Table 1 with the CPU-requirements needed to compute the same sensitivities using the formulas obtained
Table 1. CPU-time needed for computing
.
in Equations (37) through (43) in Section 3.3, which were obtained by having applied the 1st-CASAM. The “95 seconds CPU-time” needed by the 1st-CASAM comprises 85 seconds for the one adjoint computation plus 10 seconds for computing all of the 7477 1st-order sensitivities.
The results presented in Table 1 highlights the evident superiority of the 1st-CASAM over the finite-difference method and/or the Forward Sensitivity Analysis Methodology (FSAM) for computing the sensitivities of one response (i.e., the PERP leakage) to the 7477 PERP parameters that have non-zero nominal values.
4. Computation of
The finite-difference formulas that can be used to compute approximately the second-order response sensitivities with respect to the model parameters will be discussed in Subsection 4.1. The Forward Sensitivity Analysis Methodology will be presented in Subsection 4.2. The application of the 2nd-CASAM will be presented in Subsection 4.3, while Subsection 4.4 will compare the CPU-times which are required by these three deterministic methods.
4.1. Re-computations with Finite-Difference Approximation
The 2nd-order unmixed sensitivities,
, of the leakage response,
, can be approximately computed by re-computations using the well-known finite-difference formula presented below:
, (44)
where
,
,
and
denotes a “judiciously-chosen” variation in the parameter
around its nominal value
. The 2nd-order mixed sensitivities,
, can be calculated by using the following finite-difference formula:
(45)
where
and
denote the variations in the parameters
and
, respectively. The values of the quantities
,
,
, and
are obtained by re-solving Equations (1) and (2) repeatedly, using the changed parameter values
and
. As also discussed in Subsection 3.1, the values of
and
, respectively, must be chosen “judiciously” by “trial and error” for each of the parameters
and
; otherwise, the result produced by Equation (45) will be far off from the exact value of the derivative
. These simple finite difference formulas introduce their intrinsic “methodological errors” of order
and/or
, as indicated in Equations (44) and (45), which are in addition to,and independent of, the errors that might be incurred in the computation of
. In other words, even if the computation of
were perfect (error-free), the finite-difference formulas nevertheless introduce their own, intrinsic, numerical errors into the computation of
.
4.2. Forward Sensitivity Analysis Methodology
The second-order partial sensitivity of
to two generic model parameters,
and
is obtained by differentiating the expression provided in Equation (11) with respect to (the second parameter)
, to obtain the following expression:
(46)
The second-order derivative
is the solution of the second-order G-derivative of Equations (1) and (2) with respect to
and
, namely:
(47)
(48)
where
(49)
It is important to note that, as indicated in Equation (49), the computation of the 2nd-order flux-derivatives
requires knowledge of the 1st-order flux derivatives
, which appear in the definition of the right-side (“source”) for Equation (47) and which must therefore by computed prior to commencing the computations for obtaining
. Thus, the computation of the
distinct 2nd-order sensitivities
requires TP large-scale computations for solving Equations (14) and (15) to determine the fluxes
which are needed to compute the right-side of Equation (47), followed by at least
large-scale computations to solve Equations (47) and (48) to determine the quantities
. Subsequently,
small-scale computations are needed for performing the integrations represented by Equation (46). To summarize: obtaining the numerical values of the 2nd-order sensitivities
using the FSAM requires a total of
large-scale computations followed by
small-scale computations.
4.3. Second-Order Adjoint Sensitivity Analysis Methodology (2nd-CASAM)
The numerical results for the complete 2nd-order sensitivity analysis of the PERP benchmark’s leakage response with respect to all
nuclear parameters
, have been reported in [5] - [10]. Since this work ultimately aims at applying the 4th-Order Comprehensive Sensitivity Analysis Methodology (4th-CASAM) to obtain the closed form expressions of the 4th-order sensitivities of the PERP leakage response with respect to the group-averaged total microscopic cross sections, the proliferation of indices, superscripts and subscripts is unavoidable. Nevertheless, “subscripted-subscripts” can be avoided by using subscripts of the form
, where the index j1 will replace the index j (which was used in the Section 3) to index the 1st-order sensitivities, and where the index j2 will be used (in addition to j1) to index the 2nd-order sensitivities. Furthermore, anticipating the notation to be used in subsequent Subsections, the index j3 will be used (in addition to j1 and j2) to index the 3rd-order sensitivities; the index j4 will be used (in addition to j1, j2 and j3) to index the 4th-order sensitivities. Recall that even when only the components
,
,
,
, of the group-averaged total microscopic cross sections are considered, the numbers of sensitivities of the PERP leakage response with respect to these parameters are as follows: 1) 180 first-order sensitivities; 2) 32,400 second-order sensitivities, of which 16,290 are distinct; and 3) 5,832,000 third-order sensitivities, of which 988,260 are distinct; 4) 1,049,760,000 fourth-order sensitivities, of which 45,212,895 are distinct.
In contradistinction to the FSAM, the 2nd-CASAM does not use Equation (11) as the starting point for computing 2nd-order response sensitivities but instead uses the expressions of the sensitivities in terms of the 1st-level adjoint function
, as produced by the 1st-CASAM, namely Equations (37) through (43), as individual starting points for deriving the expressions of the corresponding 2nd-order sensitivities. This procedure has been illustrated in [5] - [10] which has derived and computed all of the 2nd-order sensitivities of the PERP leakage response to the nuclear data. In turn, the 3rd-CASAM uses the expressions of the 2nd-order response sensitivities derived within the 2nd-CASAM. The 4th-CASAM will use the expressions of the 3rd-order response sensitivities derived within the 3rd-CASAM, and so on.
In particular, the 2nd-order sensitivities involving only the total microscopic cross sections, are obtained by G-differentiating the expression provided in Equation (40) for the 1st-order sensitivities of the leakage response with respect to the group-averaged total microscopic cross sections, which yields the following result:
(50)
Carrying out the differentiations with respect to
in Equation (50) and subsequently setting
in the resulting equations yields the following relation:
(51)
Taking into account the facts that: 1) the parameter
represents the group-averaged total microscopic cross sections
, with
,
,
; and 2)
, it follows that the last term on the left-side of Equation (51) is identically zero.
In Equation (50), the variations
are the solutions of Equations (21) and (22) while the variations
are the solutions of the G-differentiated 1st-LASS, namely:
(52)
(53)
where
(54)
In matrix-vector form, which will be used in the sequel, Equations (52) and (53) are expressed as follows:
(55)
(56)
where
(57)
The 2nd-order sensitivities expressed by Equation (51) could be computed, in principle, if the functions
and
were available. However, determining the functions
would require solving Equations (21) and (22), while determining the functions
would require solving Equations (52) and (53), which would altogether amount to twice as many large-scale computations as there are parameter variations. To avoid the need for performing so many large-scale computations, the right-side of Equation (50) will be recast in terms of the solutions of a 2nd-Level Adjoint Sensitivity System (2nd-LASS) so as to eliminate the appearance of the functions
and
. The requisite 2nd-LASS will be constructed by following the general principles introduced by Cacuci [1], which comprise the following sequence of steps, all of which are to be carried out at the nominal parameter values
:
1) Consider a Hilbert space, denoted as
, comprising block-vector elements
having the structure:
, where
;
2) Define the inner product in
, denoted as
, of two arbitrary elements in
, denoted as
and
, with
, and
, as follows:
(58)
3) For a 2 × 2 block-matrix linear operator
in the Hilbert space
, use the inner product defined in Equation (58) to define the formal adjoint operator, denoted as
, of
, through the following relationship:
, (59)
where
denotes the corresponding bilinear concomitant evaluated on the domain’s boundary.
4) Apply the definition provided in Equation (58) to form the inner product of Equations (25) and (55) with a yet undefined function
, to obtain the following relation, evaluated at
:
(60)
5) Use the relation shown in Equation (59) to recast the left side of Equation (60) into the following equivalent form:
(61)
where
denotes the corresponding bilinear concomitant evaluated on the PERP sphere’s outer boundary
, at
.
6) Require the first term on the right-side of Equation (61) to represent the same functional as the right-side of Equation (51). This requirement will be satisfied by requiring that the following relations be satisfied by the components of the function
for
:
(62)
(63)
where, for each
,
is a
diagonal matrix having non-zero elements of the form
on its diagonal, i.e.,
(64)
7) Use in Equation (61) the boundary conditions shown in Equations (22) and (53). Furthermore, set to zero the remaining terms in the bilinear concomitant
in Equation (61) by requiring that the components of the function
satisfy the following boundary conditions:
(65)
(66)
8) The above boundary conditions complete the well-posed definition of the 2nd-level adjoint function
as the solution of Equations (62) through (66), which are called “the Second-Level Adjoint Sensitivity System (2nd-LASS)”. The reason for calling this system “Second-Level” (as opposed to “Second-Order”) stems from the fact that this system does not involve any “second-order” differential or derivatives of the dependent variables (i.e., state functions) even though the solution of the 2nd-LASS is used for computing, efficiently and exactly, the second-order sensitivities of the response with respect to the model parameters.
9) Use Equations (60) through (66) in Equation (51) to obtain the following alternative expression for the differential
in terms of the
2nd-level adjoint function
:
(67)
10) It is important to note that the differential expression provided in Equation (67) comprises all of the 2nd-order partial sensitivities that involve the group-averaged microscopic total cross sections. The 2nd-order partial sensitivities
,
,
, which involve the 180 total cross sections (
) and the other parameters (
), are obtained by replacing in Equation (67) the expressions of
and
by their definitions provided in Equations (23) and (54), respectively, and subsequently identifying the expressions that multiply the corresponding parameter variations.
11) In particular, identifying in Equation (67) the quantities that multiply only the variations in the total microscopic cross sections provides the following expression for the 2nd-order response sensitivities that involve only the group-averaged total microscopic cross sections:
(68)
4.4. Comparison of Computational Requirements
The numerical results for the 2nd-order sensitivities of the PERP benchmark’s leakage response to all 7477 nuclear data parameters that characterize the computational model of the PERP benchmark have been presented in [5] - [10]. The 2nd-order sensitivities were all computed using the PARTISN code with a S256 angular quadrature (ISN = 256), using a DELL desktop computer (AMD FX-8350) with an 8-core processor. The CPU-time for a typical adjoint computation was ca. 160 seconds; 0.046 seconds CPU-time was needed for computing a single 2nd-order sensitivity, including reading the adjoint functions and the integration over the adjoint functions, for ISN = 256. Table 2 presents the comparison of the CPU-times required by the finite-difference, FSAM, and 2nd-CASAM, respectively,
Table 2. CPU-time needed for computing
.
for computing the 2nd-order sensitivities of the leakage response only with respect to the 180 total group-averaged microscopic cross sections.
The number of 16,470 computations required by the FSAM comprises 180 large-scale computations for obtaining the first-order derivatives of the flux with respect to the total microscopic cross sections plus 180(180 + 1)/2 large-scale computations for computing the mixed second-order derivatives of the flux with respect to the total microscopic cross sections. The total CPU time needed for computing all of the 2nd-order sensitivities using the 2nd-CASAM was ca. 929 hours, comprising 735 hours used for the 14843 PARTISN computations (S256 angular quadrature; ISN = 256) and 194 hours used for performing the integrations needed to compute the respective unmixed and mixed second-order sensitivities. It is evident from the comparison of the CPU-times presented in Table 2 that the 2nd-CASAM is the only practical methodology for computing 2nd-order sensitivities for large-scale systems involving many parameters (as illustrated by using the PERP benchmark as a paradigm).
5. Computation of Third-Order Sensitivities
Subsection 5.1 presents the finite-difference formulas that can be used to compute approximately the third-order response sensitivities with respect to the model parameters. The Forward Sensitivity Analysis Methodology will be discussed in Subsection 5.2. The 3rd-CASAM will be discussed in Subsection 5.3, while Subsection 5.4 will present a comparative discussion of the computational resources and times (CPU) which are required by these three deterministic methods.
5.1. Re-Computations with Finite-Difference Approximation
The 3rd-order unmixed sensitivities,
, of the leakage response,
, can be approximately computed by re-computations using the well-known finite-difference formula presented below:
, (69)
where
,
,
,
and
denotes a “judiciously-chosen” variation in the parameter
around its nominal value
. The 3rd-order mixed sensitivities,
, can be calculated by using the following finite-difference formula:
(70)
where
,
, etc. The values of the quantities on the rights-sides of the expressions shown in Equations (69) and (70) are obtained by re-solving Equations (1) and (2) repeatedly, using the changed parameter values
,
and
. As has also been previously discussed, the values of
,
and
, respectively, must be chosen “judiciously” by “trial and error” for each of the parameters
,
and
. The finite difference formulas introduce their intrinsic “methodological errors” of order
which are in addition to, and independent of, the errors that might be incurred in the computation of
.
5.2. Forward Sensitivity Analysis Methodology
The third-order partial sensitivity of
to three generic model parameters,
, has the following expression:
(71)
In turn, the third-order derivative
is the solution of the third-order G-derivative of Equations (1) and (2) with respect to
or, equivalently, the solution of the first G-derivative of the 2nd-OFSS comprising Equations (47) and (48), which have the following form:
(72)
(73)
where
(74)
Evidently, the computations of all of the distinctive third-order sensitivities
require
large-scale computations to solve Equations (72) and (73), followed by
small-scale computations for performing the integration represented by Equation (71).
5.3. Third-Order Adjoint Sensitivity Analysis Methodology (3rd-CASAM)
In contradistinction to the FSAM, the 3rd-CASAM does not use Equation (46) as the starting point for computing 3rd-order response sensitivities but instead uses the expression provided by the 2nd-CASAM of the sensitivities in terms of the 1st-and 2nd-level adjoint functions
and
. Thus, the total G-differential of the expression given in Equation (68) provides the 3rd-order sensitivities of the leakage response involving the group-averaged total microscopic cross sections, as follows:
(75)
where: 1) the functions
are the solutions of Equations (25) and (26); 2) the functions
are the solutions of Equations (55) and (56); 3) the functions
and
are the solutions of the G-differentiated 2nd-LASS defined by Equations (62) through (66), namely:
(76)
(77)
(78)
(79)
where
(80)
(81)
Thus, in order to compute the value of the differential shown in Equation (75), it would be first necessary to solve the following system of matrix-equations, subject to the boundary conditions shown in Equations (26), (56), (78) and (79):
(82)
It is evident that solving Equation (82) amounts to impractically many large-scale computations, which can be avoided by recasting the right-side of Equation (75) in terms of the solutions of a 3rd-Level Adjoint Sensitivity System (3rd-LASS). Following the general principles introduced by Cacuci [12], the construction of the 3rd-LASS is similar to the construction of the 2nd-LASS and comprises the following sequence of operations, all of which are to be carried out at the nominal parameter values
:
1) Consider a Hilbert space, denoted as
, comprising elements denoted generically as
, which have a “four-component block-vector” structure of the form
, with each of the four vector-components having the following structure:
.
2) Define the inner product in
, denoted as
, of two arbitrary elements in
, denoted as
and
, with
, and
, as follows:
(83)
3) Apply the definition provided in Equation (83) to form the inner product of Equation (82) with a yet undefined function
, to obtain the following relation, evaluated at
:
(84)
4) Use the customary definition of the adjoint operator in
, endowed with the inner product defined in Equation (83) to recast the left side of Equation (84) into the following equivalent form:
(85)
where
denotes the corresponding bilinear concomitant evaluated on the PERP sphere’s outer boundary
, at
.
5) Require the first term on the right-side of Equation (85) to represent the same functional as the right-side of Equation (75). This requirement will be satisfied by requiring that the following relations be satisfied by the components of the function
:
(86)
6) Use in Equation (86) the boundary conditions shown in Equations (26), (56), (78) and (79). Furthermore, set to zero the remaining terms in the bilinear concomitant
in Equation (85) by requiring the components of the function
to satisfy the following boundary conditions:
(87)
7) The boundary conditions shown in Equation (87) complete the well-posed definition of the 3rd-level adjoint function
as the solution of Equations (86) and (87), which are called “the Third-Level Adjoint Sensitivity System (3rd-LASS)”. The reason for calling this system “Third-Level” (as opposed to “Third-Order”) stems from the fact that this system does not involve any 2nd- and/or 3rd-order differentials or derivatives of the dependent variables (i.e., state functions) even though the solution of the 3rd-LASS is used for computing, efficiently and exactly, the 3rd-order sensitivities of the response with respect to the model parameters.
8) Use Equations (84) through (87) in Equation (75) to obtain the following alternative expression for the differential
in terms of the 3rd-level adjoint function
:
(88)
9) It is important to note that the differential expression provided in Equation (88) comprises all of the 3rd-order partial sensitivities that involve the group-averaged microscopic total cross sections, i.e., the 3rd-order partial sensitivities
,
;
,
, describes a total of
3rd-order response sensitivities with respect to the microscopic total cross sections (indices
and
) and with respect to the other parameters (
).
10) In particular, identifying in Equation (88) the quantities that multiply only the variations in the total microscopic cross sections will reduce the expressions provided in Equations (80) and (81) as follows:
(89)
(90)
11) Inserting the results from Equations (89) and (90) into Equation (88) and identifying the specific quantity that multiplies the specific variation
provides the following expression for the 3rd-order response sensitivities which involve only the group-averaged total microscopic cross sections:
(91)
In component form, Equation (91) can be written as follows:
(92)
5.4. Comparison of Computational Requirements
As has already been discussed, the number of sensitivities of the PERP leakage response which involve solely the group-averaged total microscopic cross sections are as follows: 1) 180 first-order sensitivities; 2) 32,400 second-order sensitivities, of which 16,290 are distinct; and 3) 5,832,000 third-order sensitivities, of which 988,260 are distinct; 4) 1,049,760,000 fourth-order sensitivities, of which 45,212,895 are distinct. Numerical results for these sensitivities have been obtained by using the code PARTISN with a S32 angular quadrature (ISN = 32). The computer used for these computations is a DELL computer with an 8-core processor (AMD FX-8350).
The CPU-time for a typical adjoint computation using ISN = 32 is ca. 26 seconds, while the CPU-time computing the integrals over the various adjoint functions which appear in the definition of the respective sensitivity, cf. Equation (92), is ca. 0.002 seconds.
The CPU-time for computing the 1st-, 2nd- and 3rd-order sensitivities of the leakage response with respect to the 180 microscopic total cross sections are as follows:
1) The total CPU-time required for computing the 1st-order sensitivities is ca. 30 Seconds (1 adjoint PARTISN computation, plus 180 integrations over the adjoint functions);
2) The total CPU-time required for computing twice (for verification purposes) the 2nd-order sensitivities is ca. 3 hours (2 h 55 min for 180 forward-like + 180 adjoint-like PARTISN computations for determining the 2nd-level adjoint functions, plus 5 minutes for computing the 32,400 integrations over the adjoint functions);
3) The total CPU-time required for computing twice (for verification purposes) the 3rd-order sensitivities is around 338 hours (2 h 55 min for computing 2nd-level adjoint functions, 332 hours for computing the 3rd-level adjoint functions + 3 h 24 min for computing the 180 × 180 × 180 integrals over these functions to obtain the 3rd-order sensitivities).
Table 3 presents the comparison of the CPU-times for all of the distinct third-order sensitivities
required by applying the 3rd-CASAM, versus using the FSAM procedure using Equation (71) and/or the FD-approximations shown in Equations (69) and (70).
Table 3. Comparison of CPU-times for computing
.
Based on Equations (69) and (70), the number of forward computations needed to obtain all of the distinct third-order sensitivities by the FD-approximation method is 7,905,360 [= 180 × 4 forward PARTISN computations for the 180 unmixed 3rd-order sensitivities + (988,260 − 180) × 8 forward PARTISN computations for the 988,080 mixed 3rd-order sensitivities].
Based on Equations (72) and (73), the number of forward computations needed to obtain all of the distinct third-order sensitivities
by the FSAM method is
.
Based on Equation (86), a total number of 33,301 adjoint computations is needed to obtain all of the distinct third-order sensitivities
by the 3rd-CASAM method, comprising the following large-scale computations:
1) 1 adjoint PARTISN computations to obtain
;
2) 180 adjoint-like PARTISN computations to obtain
;
3) 180 forward-like PARTISN computations to obtain
;
4) 16,290 adjoint-like PARTISN computations to obtain
;
5) 16,290 forward-like PARTISN computations to obtain
;
6) 180 forward-like PARTISN computations to obtain
;
7) 180 adjoint-like PARTISN computations to obtain
.
The computation of each of the adjoint functions
and
, respectively, requires
PARTISN computations, respectively, since the source terms for the equations satisfied by these functions depend on both indices j1 and j2. However, the computation of each of the adjoint functions
and
, respectively, requires only 180 PARTISN computations (per function), because the source terms for the equations satisfied by these functions only depend on the index j2, as shown in Equation .
The results presented in Table 3 evidently indicate that the 3rd-CASAM is the only methodology capable of computing 3rd-order sensitivities, without introducing methodological errors.
6. Concluding Remarks
This work has presented the derivation of the exact mathematical expressions of the following sensitivities of the PERP leakage response with respect to the group-averaged total microscopic cross sections: 1) 180 first-order sensitivities; 2) 32,400 second-order sensitivities, of which 16,290 are distinct; and 3) 5,832,000 third-order sensitivities, of which 988,260 are distinct.
Using a DELL computer with an 8-core processor (AMD FX-8350), the total CPU-time required for computing the 1st-order sensitivities of the PERP leakage response with respect to all of the PERP benchmark’s parameters by applying the 1st-CASAM is 95 seconds. By comparison, the forward sensitivity analysis methodology (FSAM) would require 694 hours CPU-time, while a 2-point finite-difference (FD) approximate scheme would require 1,388 hours CPU-time.
Using the same DELL computer (AMD FX-8350), the computations of the 2nd-order sensitivities of the PERP leakage response with respect to the PERP benchmark’s total microscopic cross sections by applying the 2nd-CASAM required 19 hours CPU-time. By comparison, the FSAM would require 764 hours CPU-time, while the FD-scheme would require 3006 hours CPU-time.
Finally, using the AMD FX-8350 DELL computer, the computations of the 3rd-order sensitivities of the PERP leakage response with respect to the PERP benchmark’s total microscopic cross sections by applying the 3rd-CASAM required 175 hours CPU-time. By comparison, the FSAM would require 12,559 hours CPU-time, while the FD-scheme would require 98,817 hours CPU-time. These results make it abundantly evident that the CASAM is the only practical method for computing sensitivities exactly for large-scale problems involving many parameters.
The formulas derived in this work are valid not only for the PERP benchmark but can also be used for computing the 3rd-order sensitivities of the leakage response of any nuclear system involving fissionable material and internal or external neutron sources. Subsequent works [16] [17] will use the adjoint-based mathematical expressions obtained in this work to further derive the expressions for the 4th-order sensitivities, and to compute exactly and efficiently the numerical values of the 1,049,760,000 fourth-order sensitivities, of which 45,212,895 are distinct.
Appendix
The dimensions and material composition of the polyethylene-reflected plutonium (PERP) metal sphere considered in this work are presented in TableA1.
The quantities appearing in Equations (1) through (3) are defined as follows:
1) The quantity
is the customary “group-flux” for group
, and is the unknown state-function which is obtained by solving Equations (1) and (2). The group boundaries of the G=30 energy groups are provided in TableA2.
2) The source
depends on the vector of model parameters
, defined as follows:
Table A1. Dimensions and material composition of the PERP benchmark.
Table A2. Group boundaries,
, of the
energy groups used in the PARTISN forward and adjoint neutron transport computations.
(93)
3) As indicated in TableA1, the PERP benchmark comprises 2 materials: “material 1” comprises 4 isotopes, numbered 1 through 4, while “material 2” comprises 2 isotopes, numbered 5 and 6. In principle, PARTISN allows the same isotope to appear in different materials, in which case the atomic number density
of an isotope i in a material m would be computed by using the formula
, where
denotes the mass density of material m,
,
denotes the weight fraction of isotope i in material m;
denotes the atomic weight of isotope i, and
denotes Avogadro’s number. However, the two materials in the PERP benchmark contain only isotopes that are distinct from each other, so the subscript m will not be needed if the formula for the atomic number density
of an isotope i,
, is interpreted as follows:
(94)
The atomic number densities
will be considered to be components of the vector
, defined below:
(95)
4) The scattering transfer cross section from energy group
into energy group
is denoted as
and is computed in terms of the l-th order Legendre coefficient
using the following 3rd-order expansion in Legendre functions:
, (96)
where ISCT = 3 denotes the order of the expansion in Legendre polynomials. The microscopic scattering cross sections
for isotope i, and from energy group
into energy group g, are tabulated parameters. The zeroth-order (i.e.,
) scattering cross sections must be considered separately from the higher order (i.e.,
) scattering cross sections, since the former contribute to the total cross sections (as noted below), while the latter do not. Aiming at reducing the proliferation of superscripts and subscripts when defining response sensitivities with respect to the microscopic scattering cross sections
, these cross sections will be considered to be components of a vector
defined below:
(97)
5) The total cross section for energy group
is denoted as
and is computed using the following expression: