Evaluation and Correction of Ground-Based Microwave Radiometer Observations Based on NCEP-FNL Data ()
1. Introduction
Ground-based microwave radiometers are commonly used for atmospheric observations [1] and can be operated continuously with a typical temporal resolution of 1 s. They can be used to monitor the temperature and humidity profiles of the atmospheric boundary layer [2] - [9], and unique liquid water content profiles [10] [11] [12] [13] and to detect lightning [14]. The number of ground-based microwave radiometers in use in China for both research and quasi-operational observations has increased rapidly in recent years [15] - [20] and long time data have been obtained. However, due to changes in the observation position during the monitoring period (changing the environment of the instrument), the deposition of atmospheric pollutants on the radome (resulting in lower radome transmittance) and the half-yearly calibration with liquid nitrogen in accordance with the technical requirements of the system (resulting in a discontinuous calibration coefficient), these long time observational data show segmented features referred to as the “jumping problem”.
The output from a microwave radiometer is the brightness temperature, which is defined as the electromagnetic energy received by the radiometer at a certain reference frequency. Either inversion processing or data assimilation must be performed to convert the brightness temperature data into information on the atmospheric temperature, humidity and liquid water content profiles based on the theoretical radiative transfer model [21] [22]. The brightness temperature observed by the microwave radiometer is inaccurate as a result of the hardware and calibration techniques used and can be solved from the point of view of the hardware. However, corrections to take account of the hardware used and calibration techniques cannot be applied to historical observational data from microwave radiometers and therefore inversion cannot be applied to the temperature and humidity profile. For these historical data, there is no possibility of improving the quality of the hardware to improve data accuracy. This paper discusses whether a data processing method can be used to correct historical observational data. The brightness temperatures observed using a ground-based microwave radiometer and the brightness temperatures simulated using a radiative transfer model must be consistent and reconcilable with each other.
Consistency analysis based on a comparison of the observed brightness temperatures with the forward calculated brightness temperatures has been successfully used in the quality control of observations from satellite-borne microwave radiometers. For example, Lu et al. [23] found that the frequencies at some of the microwave channels onboard the FY-3 satellite varied after launch based on a comparison of the observed brightness temperatures with the brightness temperatures calculated using the European Centre for Medium-Range Weather Forecasts model output as the input to the radiative transfer model. They therefore suggested a correction scheme to improve the application of the FY-3 data. Goldberg et al. [24] found that measurements from the AMSU instrument onboard the NOAA 15 and NOAA 16 satellites varied with the scan angle based on a comparison between the observed and simulated brightness temperatures. Weng et al. [25] showed that there was a clear asymmetry in the measured radiance along the scan measured by the AMSU instrument. This was most obvious in the window channels and was probably caused by either the misalignment of the polarizer or errors in the antenna pointing angle. Weng et al. [26] concluded that the antenna properties (e.g. the main beam efficiency and the spillover contributions from the side lobes) must be known before computing the brightness temperatures from the antenna temperatures measured by the Advanced Technology Microwave Sounder onboard the Suomi National Polar-orbiting Partnership satellite.
Systematic deviations between the observed brightness temperature (TBM) and the corresponding forward computed brightness temperature (TBC) also exist in ground-based microwave remote sensing [21], where the difference between the antenna temperature and the brightness temperature in the direction of the beam center is about 2 K for a 6˚ beam width [27]. Meunier et al. [28] studied the effects of the characteristics of the radiometer (e.g. the antenna beam width and the receiver bandwidth) on simulated radiometer measurements based on theoretical simulations in which the beam width calculation is performed using a Gaussian quadrature and neglecting the effects of the side lobes. Tipping calibration is considered to be an important technique for the absolute calibration of ground-based microwave radiometers [27] [29] [30], but this is time consuming and is often not performed as often as would be useful. Wang Z. et al. [31] proposed verifying the working status of ground-based microwave radiometers in Nanjing and Wuhan by comparing TBM and TBC on a clear day. Li Qing et al. [32] tried to correct the systematic deviation to improve the consistency between the TBM values observed with a 22-channel radiometer in Beijing and the calculated TBC series for January 1, 2010 to December 31, 2011 when the radiometer was suspected to be malfunctioning. A liquid nitrogen calibration was performed on December 22, 2010. The results clearly show that the consistency between TBM and TBC can be improved for most of the 22 channels, but for some channels, especially channels 7 (28 GHz) and 8 (30 GHz), the improvement in consistency between TBM and TBC is negligible. Further study of this issue is required.
We used the analysis method for the quality control of bright temperature data from a satellite-borne microwave radiometer as a reference. We used NCEP-FNL [33] dataset as a reference because it has a high accuracy and good representativeness and time-space continuity. These data were used to obtain the brightness temperature TBC through the radiation transfer model for forward calculation [21] [34] [35]. We then identified the “jumping” problem in TBM by analyzing the deviation and correlation between the TBM data and the forward calculated TBC data under clear sky conditions and propose a correction scheme for TBM. The verification was performed using the observational TBM dataset for the period January 1, 2010 to December 31, 2011.
2. Theoretical Analysis and Estimation
According to Westwater et al. [21], when the atmosphere is approximated as parallel planar and the scattering can be ignored, the brightness temperature for the thermal radiance vertically downward to the ground is expressed by the radiative transfer equation
(1)
where
(2)
is the transmittance of the atmosphere from height z to the antenna (z = 0),
is the transmittance of the whole atmosphere,
is the cosmic brightness temperature, which was assumed here to be 2.9 K [21],
is the temperature profile and
is the absorption coefficient due to the presence of oxygen and water vapor in the atmosphere under a clear sky.
depends mainly on the pressure, temperature, humidity and wave frequency [36] [37]. The forward calculations according to Equation (1) are based on the radiative transfer model of Westwater et al. [21], including vertical discretization and humidity transformation; the absorption coefficient for atmospheric oxygen and water vapor follows Liebe et al. [37]. Data from either radiosondes or the NCEP-FNL Operational Model Global Tropospheric Analyses [33] can be used as the input temperature and humidity profiles in the forward model. The simulation scheme performed well in an earlier series of studies on the quality control and application of ground-based microwave radiometer data [31] [32] [35] [38] [39].
The power obtained by an antenna looking vertically upwards (the antenna temperature) is expressed as [40]:
(3)
where
and
are the zenith and azimuth angles of the incident radiance toward the antenna,
,
is the radiation pattern of the antenna,
is the brightness temperature incident on the antenna from the direction
, of which
is from zenith and is equal to TB(0) defined by Equation (1).
In most situations for a parabolic antenna,
is approximated to 1 in the main beam and to 0 elsewhere, so
and Equation (1) can be used directly to simulate the observations from the antenna.
In real situations, the antenna side lobes are weak, but rarely 0 (Figure 1(a)). In addition, pollutants deposited on the radiometer radome result in a small but significant loss, which leads to emissions visible via the antenna main lobe that
Figure 1. Schematic diagrams showing (a) the equivalence of the antenna radiation pattern; (b) the incident radiance and (c) the influence of the radome.
can correlated with the ambient temperature. Therefore, in order to predict the contamination of the atmospheric radiance measurement from the surroundings with an easy-to-understand formula, we assume that: the values of both
and
in the upper hemisphere are isotropic in the azimuth direction;
in the upward-looking main beam is identical to TB(0) and is representative of atmospheric radiance; and
in the lower hemisphere is equivalent to TS and is representative of the radiance from the surroundings (Figure 1(b)). Equation (3) then becomes
(4)
where γ1, γ2 and γ3 are parameters determined by the radiation pattern of the antenna and
is defined according to the integral mean value theorem.
Because the antenna reflector is covered by a metal cover containing a foam dielectric radome (Figure 1(c)), the second term in Equation (4) can be approximated using the contributions from both TB(0) and TS as the proportion β and hence Equation (4) becomes
(5)
where
and β is the proportional parameter and depends on the performance of both the antenna and the radome. A properly maintained or new radome can be taken as a perfect microwave window, but deposits on the radiometer radome, especially in areas with high levels of pollution, will increase the opacity of the radome and the value of β will decrease.
According to Equation (5), the observations of atmospheric radiance are influenced by the surroundings and must be corrected. Because the contribution from TS can be mistaken as an increment in TB, the correction to TB to take account of the surrounding environment according to Equation (5) is
(6)
The effect of the surrounding environment on the antenna is complex, but, according to Westwater et al. [21], TS mainly depends on the temperature of the surroundings:
(7)
where Tg and ε are the surrounding temperature and emissivity, respectively.
3. Verification of the Correction for the Surroundings
To obtain δTB, the amount of correction required to the value of TBM measured by the radiometer, it is assumed that the surrounding temperature is dominant and the emissivity is combined with
in Equation (6) to give
(8)
where c is a coefficient for the correction to the surroundings.
The correction for a systematic deviation caused by the difference between the atmospheric profiles over the radiometer and the atmospheric profiles used as the input in the forward calculation for TBC based on Equation (1) is expressed as
where a and b are coefficients and TBO is the result obtained from the correction [32]. The combination of the correction for systematic deviations and the correction for the surroundings leads to a bivariate linear regression model
(9)
Considering that the forward calculated result (TBC), based on a radiative transfer equation such as Equation (1), is mostly used as a reference in data assimilation and profile inversion, let the residual sum of square Q be expressed as
(10)
i.e.,
(11)
to obtain the optimum estimation for the coefficients a, b and c in Equation (9) from a sample of data.
The data sample used by Li Q. et al. [32] is used here for verification. The data sample is a radiometer with 35 channels, of which 22 are used for observations of the operational brightness temperature. The central frequencies for channels 1 - 8 are 22 - 30 GHz in the K band and the central frequencies for channels 9 - 22 are 51 - 59 GHz in the V band (Table 1). The radiometer has its own thermometer for measuring the surface air temperature, which is taken as Tg in the calculations. The observations were collected at 0800 and 2000 Beijing Time from January 1, 2010 to December 31, 2011. A total of 603 observations were made under clear skies. Clear sky conditions are defined as a relative humidity of
Table 1. Bias (K) and standard deviation (std, K) of the difference between the measured and calculated brightness temperatures and their correlation coefficient before and after correction.
<85% in the troposphere [34]. Only the data for clear sky days were used in the following statistical analysis to avoid the uncertain influence of clouds on the estimation of the coefficients. However, the results are applicable to all weather conditions because the coefficients account for both the systematic deviations and contamination from the surroundings. Additional corrections may be necessary for the effects of clouds.
1) Verification with time series and correlation analysis
Figure 2 shows the time series of TBM in the sample and the corresponding simulated values of TBC for four typical channels at 22.234, 28.000, 53.336 and 55.500 GHz. The gap between TBM and TBC includes the error in the radiative transmission mode and the space-time difference between radiometer data and the lattice data. This type of deviation is fairly limited. There are two jumps in the time series, one associated with the liquid nitrogen calibration at the 294th
position on the abscissa series index in Figure 2 and another at the 520th position in the abscissa series index in Figure 2 as a result of the transfer of the instrument from Shunyi (40˚07'N, 116˚36'E, 34.0 m a.s.l.) to Shangdianzi (40˚39'N, 117˚07'E, 293.3 m a.s.l.). The value of TBM after liquid nitrogen calibration differs considerably from that before calibration for channels 1 and 7, whereas the value of TBM for channel 13 showed a clear decrease after the instrument had been moved. The whole sample was therefore sliced into three sub-samples for the correction of TBM.
Based on Equation (11), the coefficients a, b and c were derived from each of the three sub-samples for each of the 22 channels (data not shown) and Equation (9) was applied for correction. Table 1 gives the statistics for the difference between the measured and calculated brightness temperatures and the correlation coefficients before and after correction. The bias before correction was decreased to 0 after correction and the standard deviations all decreased significantly, especially for the channels in the K band. The correlation coefficients between the calculated and measured brightness temperatures after correction were greater than those before correction for all 22 channels, particularly for channels 7 and 8 (as indicated by the bold font in Table 1). The correlation between TBM and TBC was almost negligible, whereas the correlation between TBO and TBC increased to about 0.9, mainly due to the correction for the surrounding environment. The improvement in consistency is also shown by the time series for TBO and TBC shown in Figure 3 for the same four typical channels, illustrating that this method can be used to improve historical datasets.
2) Verification with temperature and humidity profile retrievals
To verify the corrections to the brightness temperature data, we used the least-squares method to retrieve atmospheric temperature and moisture profiles from TBO and TBM, respectively, and then compared the statistics of the errors in the retrieved data.
If vector
is the temperature and the water vapor density profiles at L height levels
(12)
and vector
is the brightness temperatures at K microwave frequencies
(13)
then the regression equation is
(14)
where C is the regression coefficient matrix, and can be obtained through regression analysis by using an a regression sample (of sample size N) of both
and
based on the least-squares method to give
where
is the temperature and water vapor density provided by the NCEP-FNL data and
is TBC plus a Gaussian random number according to n(0, σ) to simulate the error in the brightness temperature computations, where σ is the standard deviation given for each channel in Table 1.
During the retrieval test with independent samples, TBO and TBM were used to replace
in Equation (14) and
obtained from Equation (14), respectively. The first 541 of the 603 samples were used as the regression samples and the last 63 samples were used as the test samples.
The 63 retrievals from TBO and TBM were compared with the NCEP-FNL data and the error statistics are shown in Figure 4(a) for temperature and in Figure 4(b) for the concentration of water vapor. Figure 4 shows that the bias from TBO is close to zero and the root-mean-square error (RMSE) is <2˚C for temperature and 1.2 g/m3 for humidity up to 5 km height. The bias from TBO is better than that from TBM. This implies that the brightness temperature after correction (TBO) gives better retrievals than the brightness temperature without correction (TBM).
The radiometer output profiles (LV2) were also compared with the NCEP-FNL data and the bias and RMSE are shown in Figure 4. The bias and RMSE for LV2 are similar to those obtained from and, in some instances, even poorer than those obtained from TBM.
4. Conclusions and Discussion
This work aimed to better preserve the historical data obtained by ground-based microwave radiometers and to improve their value in future applications. We took data from the NCEP-FNL dataset as a reference and then used the radiation transfer model for forward calculation to obtain the brightness temperature. However, we found that long time series of observational data from ground-based microwave radiometers may contain segmented features (the so-called “jumping problem”). Eliminating this “jumping problem” in the brightness temperature observation data will improve both the time continuity of the brightness temperature observational data and the consistency of the system with the forward modeled data based on the NCEP-FNL dataset, allowing the observational data to be used for inversion and assimilation at a later date. Our main conclusions are as follows.
(a) (b)
Figure 4. Comparison of error statistics for (a) temperature and (b) concentration of water vapor. Solid lines show the bias referring to the retrievals from the NCEP-FNL data; dotted lines show the root-mean-square error; green lines show the error statistics for LV2; blue lines show the error statistics for the retrievals from TBM; and red lines show the error statistics of the retrievals from TBO.
1) The temperature variation around the antenna must be taken into account in the corrections, especially in the K band because the spillover contributions from the side lobes and polluted radome cannot be neglected. Although frequent liquid nitrogen and tipping calibrations of the radiometer system help to alleviate the interference from the surrounding environment in the brightness temperature measurements, it is usually still necessary to correct the observations for this type of interference.
2) Our verification of the two years of observed data shows that our correction scheme is efficient. The consistency between the observations of the atmospheric brightness temperature and the ground-based microwave radiometer and forward calculations was greatly improved and the standard deviation of the difference was significantly decreased in all the channels in both the K (20 - 30 GHz) and V (50 - 60 GHz) bands, especially for channels close to 28 - 30 GHz.
3) We verified that the brightness temperature data after correction result in better retrievals of the atmospheric temperature and humidity than the brightness temperature data without correction.
Although our comprehensive correction procedure has significantly improved the accuracy of the calculations, this does not mean that the liquid nitrogen and tipping calibrations of the instrument systems are no longer necessary. In areas with high levels of pollution, correct calibration and maintenance of the radiometer can mitigate the degradation in the accuracy of the radiometer and regular cleaning and replacement of the radome are recommended to ensure the optimum accuracy of the observations. If the correlation and offset between the atmospheric brightness temperature observations and the ground-based microwave radiometer and forward calculations are far from the expected values, the radiometer should be suspected of not performing within its specification and should be returned to the factory.
Acknowledgements
The work is jointly supported by the National Natural Science Foundation of China (41675028, 41675029, 41275043, 41005005), The National Basic Research Program (973) of China (2013CB430102), The Project of State Key Laboratory of Severe Weather of Chinese Academy of Meteorological Sciences (2016LASW-B12), and Open Research Funding Program of KLGIS (KLGIS2015A01), Urban Meteorological Research Foundation IUMKY&UMRF201101 and Program for Postgraduates Research Innovation of Jiangsu Higher Education Institutions (KYLX16_0948). CMA/Institute of Urban Meteorological Research in Beijing provided the observed data twice a day (0800 and 2000BT) during the period from 1 January 2010 to 31 December 2011. Drs. Li Ju, Liu Hongyan, Ruan Shunxian, Cao Xiaoyan and Mr. Shen Yonghai of this institute help a lot during data processing. NCEP FNL data is obtained from website http://rda.ucar.edu/datasets/ds083.2/ (DOI: 10.5065/D6M043C6).