An assessment of Bayesian bias estimator for numerical weather prediction

J. Son, D. Hou, Z. Toth

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

Various statistical methods are used to process operational Numerical Weather Prediction (NWP) products with the aim of reducing forecast errors and they often require sufficiently large training data sets. Generating such a hindcast data set for this purpose can be costly and a well designed algorithm should be able to reduce the required size of these data sets.

This issue is investigated with the relatively simple case of bias correction, by comparing a Bayesian algorithm of bias estimation with the conventionally used empirical method. As available forecast data sets are not large enough for a comprehensive test, synthetically generated time series representing the analysis (truth) and forecast are used to increase the sample size. Since these synthetic time series retained the statistical characteristics of the observations and operational NWP model output, the results of this study can be extended to real observation and forecasts and this is confirmed by a preliminary test with real data.

By using the climatological mean and standard deviation of the meteorological variable in consideration and the statistical relationship between the forecast and the analysis, the Bayesian bias estimator outperforms the empirical approach in terms of the accuracy of the estimated bias, and it can reduce the required size of the training sample by a factor of 3. This advantage of the Bayesian approach is due to the fact that it is less liable to the sampling error in consecutive sampling. These results suggest that a carefully designed statistical procedure may reduce the need for the costly generation of large hindcast datasets.

Original languageEnglish
Pages (from-to)1013-1022
Number of pages10
JournalNonlinear Processes in Geophysics
Volume15
Issue number6
Publication statusPublished - Nov 3 2008

Fingerprint

weather
estimators
forecasting
Time series
Sampling
prediction
predictions
Statistical methods
education
sampling
time series
standard deviation
forecast
deviation
output
products
test
analysis
method

ASJC Scopus subject areas

  • Geochemistry and Petrology
  • Geophysics
  • Statistical and Nonlinear Physics

Cite this

An assessment of Bayesian bias estimator for numerical weather prediction. / Son, J.; Hou, D.; Toth, Z.

In: Nonlinear Processes in Geophysics, Vol. 15, No. 6, 03.11.2008, p. 1013-1022.

Research output: Contribution to journalArticle

@article{da10b2727c714f809c891588a43ba815,
title = "An assessment of Bayesian bias estimator for numerical weather prediction",
abstract = "Various statistical methods are used to process operational Numerical Weather Prediction (NWP) products with the aim of reducing forecast errors and they often require sufficiently large training data sets. Generating such a hindcast data set for this purpose can be costly and a well designed algorithm should be able to reduce the required size of these data sets. This issue is investigated with the relatively simple case of bias correction, by comparing a Bayesian algorithm of bias estimation with the conventionally used empirical method. As available forecast data sets are not large enough for a comprehensive test, synthetically generated time series representing the analysis (truth) and forecast are used to increase the sample size. Since these synthetic time series retained the statistical characteristics of the observations and operational NWP model output, the results of this study can be extended to real observation and forecasts and this is confirmed by a preliminary test with real data. By using the climatological mean and standard deviation of the meteorological variable in consideration and the statistical relationship between the forecast and the analysis, the Bayesian bias estimator outperforms the empirical approach in terms of the accuracy of the estimated bias, and it can reduce the required size of the training sample by a factor of 3. This advantage of the Bayesian approach is due to the fact that it is less liable to the sampling error in consecutive sampling. These results suggest that a carefully designed statistical procedure may reduce the need for the costly generation of large hindcast datasets.",
author = "J. Son and D. Hou and Z. Toth",
year = "2008",
month = "11",
day = "3",
language = "English",
volume = "15",
pages = "1013--1022",
journal = "Nonlinear Processes in Geophysics",
issn = "1023-5809",
publisher = "European Geosciences Union",
number = "6",

}

TY - JOUR

T1 - An assessment of Bayesian bias estimator for numerical weather prediction

AU - Son, J.

AU - Hou, D.

AU - Toth, Z.

PY - 2008/11/3

Y1 - 2008/11/3

N2 - Various statistical methods are used to process operational Numerical Weather Prediction (NWP) products with the aim of reducing forecast errors and they often require sufficiently large training data sets. Generating such a hindcast data set for this purpose can be costly and a well designed algorithm should be able to reduce the required size of these data sets. This issue is investigated with the relatively simple case of bias correction, by comparing a Bayesian algorithm of bias estimation with the conventionally used empirical method. As available forecast data sets are not large enough for a comprehensive test, synthetically generated time series representing the analysis (truth) and forecast are used to increase the sample size. Since these synthetic time series retained the statistical characteristics of the observations and operational NWP model output, the results of this study can be extended to real observation and forecasts and this is confirmed by a preliminary test with real data. By using the climatological mean and standard deviation of the meteorological variable in consideration and the statistical relationship between the forecast and the analysis, the Bayesian bias estimator outperforms the empirical approach in terms of the accuracy of the estimated bias, and it can reduce the required size of the training sample by a factor of 3. This advantage of the Bayesian approach is due to the fact that it is less liable to the sampling error in consecutive sampling. These results suggest that a carefully designed statistical procedure may reduce the need for the costly generation of large hindcast datasets.

AB - Various statistical methods are used to process operational Numerical Weather Prediction (NWP) products with the aim of reducing forecast errors and they often require sufficiently large training data sets. Generating such a hindcast data set for this purpose can be costly and a well designed algorithm should be able to reduce the required size of these data sets. This issue is investigated with the relatively simple case of bias correction, by comparing a Bayesian algorithm of bias estimation with the conventionally used empirical method. As available forecast data sets are not large enough for a comprehensive test, synthetically generated time series representing the analysis (truth) and forecast are used to increase the sample size. Since these synthetic time series retained the statistical characteristics of the observations and operational NWP model output, the results of this study can be extended to real observation and forecasts and this is confirmed by a preliminary test with real data. By using the climatological mean and standard deviation of the meteorological variable in consideration and the statistical relationship between the forecast and the analysis, the Bayesian bias estimator outperforms the empirical approach in terms of the accuracy of the estimated bias, and it can reduce the required size of the training sample by a factor of 3. This advantage of the Bayesian approach is due to the fact that it is less liable to the sampling error in consecutive sampling. These results suggest that a carefully designed statistical procedure may reduce the need for the costly generation of large hindcast datasets.

UR - http://www.scopus.com/inward/record.url?scp=59649123865&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=59649123865&partnerID=8YFLogxK

M3 - Article

AN - SCOPUS:59649123865

VL - 15

SP - 1013

EP - 1022

JO - Nonlinear Processes in Geophysics

JF - Nonlinear Processes in Geophysics

SN - 1023-5809

IS - 6

ER -