Numerical Optimization Problems of Sine-Wave Fitting Algorithms in the Presence of Roundoff Errors

Balazs Renczes, I. Kollár, Antonio Moschitta, Paolo Carbone

Research output: Contribution to journalArticle

6 Citations (Scopus)

Abstract

In this paper, the effect of roundoff errors on sine-wave fitting algorithms is investigated. It is shown that the standard calculation of sine-wave parameters may result in unexpectedly large errors, even with floating-point number representation. The three- and four-parameter least squares, the maximum likelihood, and the quantile-based estimator (QBE) methods are investigated. It is pointed out that imprecise phase storage and summation affect almost every sine-wave fitting algorithm. Furthermore, the necessary solution for sometimes ill-conditioned systems and the imprecisely evaluated distribution of the observation noise, as additional error sources, are also shown to influence a part of the fitting methods. Besides error descriptions, compensation techniques are also suggested in order to mitigate the effect of error sources. The enhancement of precision and robustness due to these suggestions is demonstrated, while keeping the given limited precision number representation platform. The QBE is shown to overcome roundoff error problems when its applicability conditions are fulfilled. In addition, its performance in comparison with that of the least squares estimator is highlighted. Finally, it is pointed out that the investigated methods show similar sensitivity to the inaccurate knowledge of the frequency of the sine wave.

Original languageEnglish
JournalIEEE Transactions on Instrumentation and Measurement
DOIs
Publication statusAccepted/In press - Jun 1 2016

Fingerprint

sine waves
optimization
quantiles
estimators
floating
Maximum likelihood
suggestion
platforms
augmentation
sensitivity

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Instrumentation

Cite this

Numerical Optimization Problems of Sine-Wave Fitting Algorithms in the Presence of Roundoff Errors. / Renczes, Balazs; Kollár, I.; Moschitta, Antonio; Carbone, Paolo.

In: IEEE Transactions on Instrumentation and Measurement, 01.06.2016.

Research output: Contribution to journalArticle

@article{ae3805e2b1654d3ca65999e8a451b7de,
title = "Numerical Optimization Problems of Sine-Wave Fitting Algorithms in the Presence of Roundoff Errors",
abstract = "In this paper, the effect of roundoff errors on sine-wave fitting algorithms is investigated. It is shown that the standard calculation of sine-wave parameters may result in unexpectedly large errors, even with floating-point number representation. The three- and four-parameter least squares, the maximum likelihood, and the quantile-based estimator (QBE) methods are investigated. It is pointed out that imprecise phase storage and summation affect almost every sine-wave fitting algorithm. Furthermore, the necessary solution for sometimes ill-conditioned systems and the imprecisely evaluated distribution of the observation noise, as additional error sources, are also shown to influence a part of the fitting methods. Besides error descriptions, compensation techniques are also suggested in order to mitigate the effect of error sources. The enhancement of precision and robustness due to these suggestions is demonstrated, while keeping the given limited precision number representation platform. The QBE is shown to overcome roundoff error problems when its applicability conditions are fulfilled. In addition, its performance in comparison with that of the least squares estimator is highlighted. Finally, it is pointed out that the investigated methods show similar sensitivity to the inaccurate knowledge of the frequency of the sine wave.",
author = "Balazs Renczes and I. Koll{\'a}r and Antonio Moschitta and Paolo Carbone",
year = "2016",
month = "6",
day = "1",
doi = "10.1109/TIM.2016.2562218",
language = "English",
journal = "IEEE Transactions on Instrumentation and Measurement",
issn = "0018-9456",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - JOUR

T1 - Numerical Optimization Problems of Sine-Wave Fitting Algorithms in the Presence of Roundoff Errors

AU - Renczes, Balazs

AU - Kollár, I.

AU - Moschitta, Antonio

AU - Carbone, Paolo

PY - 2016/6/1

Y1 - 2016/6/1

N2 - In this paper, the effect of roundoff errors on sine-wave fitting algorithms is investigated. It is shown that the standard calculation of sine-wave parameters may result in unexpectedly large errors, even with floating-point number representation. The three- and four-parameter least squares, the maximum likelihood, and the quantile-based estimator (QBE) methods are investigated. It is pointed out that imprecise phase storage and summation affect almost every sine-wave fitting algorithm. Furthermore, the necessary solution for sometimes ill-conditioned systems and the imprecisely evaluated distribution of the observation noise, as additional error sources, are also shown to influence a part of the fitting methods. Besides error descriptions, compensation techniques are also suggested in order to mitigate the effect of error sources. The enhancement of precision and robustness due to these suggestions is demonstrated, while keeping the given limited precision number representation platform. The QBE is shown to overcome roundoff error problems when its applicability conditions are fulfilled. In addition, its performance in comparison with that of the least squares estimator is highlighted. Finally, it is pointed out that the investigated methods show similar sensitivity to the inaccurate knowledge of the frequency of the sine wave.

AB - In this paper, the effect of roundoff errors on sine-wave fitting algorithms is investigated. It is shown that the standard calculation of sine-wave parameters may result in unexpectedly large errors, even with floating-point number representation. The three- and four-parameter least squares, the maximum likelihood, and the quantile-based estimator (QBE) methods are investigated. It is pointed out that imprecise phase storage and summation affect almost every sine-wave fitting algorithm. Furthermore, the necessary solution for sometimes ill-conditioned systems and the imprecisely evaluated distribution of the observation noise, as additional error sources, are also shown to influence a part of the fitting methods. Besides error descriptions, compensation techniques are also suggested in order to mitigate the effect of error sources. The enhancement of precision and robustness due to these suggestions is demonstrated, while keeping the given limited precision number representation platform. The QBE is shown to overcome roundoff error problems when its applicability conditions are fulfilled. In addition, its performance in comparison with that of the least squares estimator is highlighted. Finally, it is pointed out that the investigated methods show similar sensitivity to the inaccurate knowledge of the frequency of the sine wave.

UR - http://www.scopus.com/inward/record.url?scp=84971578045&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84971578045&partnerID=8YFLogxK

U2 - 10.1109/TIM.2016.2562218

DO - 10.1109/TIM.2016.2562218

M3 - Article

AN - SCOPUS:84971578045

JO - IEEE Transactions on Instrumentation and Measurement

JF - IEEE Transactions on Instrumentation and Measurement

SN - 0018-9456

ER -