Round off errors in the evaluation of the cost function in sine wave based adc testing

Balázs Renczes, I. Kollár

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

In this paper sine fitting algorithms are investigated for the purpose of ADC testing. The aim is to decide whether the minimum of the cost function (CF) has been reached. For this, two different types of algorithms, the conventional Levenberg-Marquardt and the genetic-type Differential Evolution methods are investigated in order to compare their optima. It is shown that due to roundoff errors the bottom of the cost function is fairly uneven for conventional number representations for the Maximum Likelihood method, hence the minimum can only be determined with decreased precision. Finally, a band is calculated in which solutions can be considered equivalent, since their CF difference is smaller than roundoff errors. Keywords - Sine wave fit, Cost Function Evaluation, Maximum Likelihood, ADC testing 1.

Original languageEnglish
Title of host publication20th IMEKO TC4 Symposium on Measurements of Electrical Quantities: Research on Electrical and Electronic Measurement for the Economic Upturn, Together with 18th TC4 International Workshop on ADC and DCA Modeling and Testing, IWADC 2014
PublisherIMEKO-International Measurement Federation Secretariat
Pages248-252
Number of pages5
ISBN (Print)9789299007327
Publication statusPublished - 2014
Event20th IMEKO TC4 Symposium on Measurements of Electrical Quantities: Research on Electrical and Electronic Measurement for the Economic Upturn, Together with 18th TC4 International Workshop on ADC and DCA Modeling and Testing, IWADC 2014 - Benevento, Italy
Duration: Sep 15 2014Sep 17 2014

Other

Other20th IMEKO TC4 Symposium on Measurements of Electrical Quantities: Research on Electrical and Electronic Measurement for the Economic Upturn, Together with 18th TC4 International Workshop on ADC and DCA Modeling and Testing, IWADC 2014
CountryItaly
CityBenevento
Period9/15/149/17/14

Fingerprint

Rounding error
sine waves
Cost functions
Cost Function
costs
Testing
evaluation
Evaluation
Maximum likelihood
Function evaluation
Levenberg-Marquardt
Maximum Likelihood Method
Differential Evolution
Maximum Likelihood

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Modelling and Simulation
  • Instrumentation

Cite this

Renczes, B., & Kollár, I. (2014). Round off errors in the evaluation of the cost function in sine wave based adc testing. In 20th IMEKO TC4 Symposium on Measurements of Electrical Quantities: Research on Electrical and Electronic Measurement for the Economic Upturn, Together with 18th TC4 International Workshop on ADC and DCA Modeling and Testing, IWADC 2014 (pp. 248-252). IMEKO-International Measurement Federation Secretariat.

Round off errors in the evaluation of the cost function in sine wave based adc testing. / Renczes, Balázs; Kollár, I.

20th IMEKO TC4 Symposium on Measurements of Electrical Quantities: Research on Electrical and Electronic Measurement for the Economic Upturn, Together with 18th TC4 International Workshop on ADC and DCA Modeling and Testing, IWADC 2014. IMEKO-International Measurement Federation Secretariat, 2014. p. 248-252.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Renczes, B & Kollár, I 2014, Round off errors in the evaluation of the cost function in sine wave based adc testing. in 20th IMEKO TC4 Symposium on Measurements of Electrical Quantities: Research on Electrical and Electronic Measurement for the Economic Upturn, Together with 18th TC4 International Workshop on ADC and DCA Modeling and Testing, IWADC 2014. IMEKO-International Measurement Federation Secretariat, pp. 248-252, 20th IMEKO TC4 Symposium on Measurements of Electrical Quantities: Research on Electrical and Electronic Measurement for the Economic Upturn, Together with 18th TC4 International Workshop on ADC and DCA Modeling and Testing, IWADC 2014, Benevento, Italy, 9/15/14.
Renczes B, Kollár I. Round off errors in the evaluation of the cost function in sine wave based adc testing. In 20th IMEKO TC4 Symposium on Measurements of Electrical Quantities: Research on Electrical and Electronic Measurement for the Economic Upturn, Together with 18th TC4 International Workshop on ADC and DCA Modeling and Testing, IWADC 2014. IMEKO-International Measurement Federation Secretariat. 2014. p. 248-252
Renczes, Balázs ; Kollár, I. / Round off errors in the evaluation of the cost function in sine wave based adc testing. 20th IMEKO TC4 Symposium on Measurements of Electrical Quantities: Research on Electrical and Electronic Measurement for the Economic Upturn, Together with 18th TC4 International Workshop on ADC and DCA Modeling and Testing, IWADC 2014. IMEKO-International Measurement Federation Secretariat, 2014. pp. 248-252
@inproceedings{823249e1af16463697a0a489a08283a9,
title = "Round off errors in the evaluation of the cost function in sine wave based adc testing",
abstract = "In this paper sine fitting algorithms are investigated for the purpose of ADC testing. The aim is to decide whether the minimum of the cost function (CF) has been reached. For this, two different types of algorithms, the conventional Levenberg-Marquardt and the genetic-type Differential Evolution methods are investigated in order to compare their optima. It is shown that due to roundoff errors the bottom of the cost function is fairly uneven for conventional number representations for the Maximum Likelihood method, hence the minimum can only be determined with decreased precision. Finally, a band is calculated in which solutions can be considered equivalent, since their CF difference is smaller than roundoff errors. Keywords - Sine wave fit, Cost Function Evaluation, Maximum Likelihood, ADC testing 1.",
author = "Bal{\'a}zs Renczes and I. Koll{\'a}r",
year = "2014",
language = "English",
isbn = "9789299007327",
pages = "248--252",
booktitle = "20th IMEKO TC4 Symposium on Measurements of Electrical Quantities: Research on Electrical and Electronic Measurement for the Economic Upturn, Together with 18th TC4 International Workshop on ADC and DCA Modeling and Testing, IWADC 2014",
publisher = "IMEKO-International Measurement Federation Secretariat",

}

TY - GEN

T1 - Round off errors in the evaluation of the cost function in sine wave based adc testing

AU - Renczes, Balázs

AU - Kollár, I.

PY - 2014

Y1 - 2014

N2 - In this paper sine fitting algorithms are investigated for the purpose of ADC testing. The aim is to decide whether the minimum of the cost function (CF) has been reached. For this, two different types of algorithms, the conventional Levenberg-Marquardt and the genetic-type Differential Evolution methods are investigated in order to compare their optima. It is shown that due to roundoff errors the bottom of the cost function is fairly uneven for conventional number representations for the Maximum Likelihood method, hence the minimum can only be determined with decreased precision. Finally, a band is calculated in which solutions can be considered equivalent, since their CF difference is smaller than roundoff errors. Keywords - Sine wave fit, Cost Function Evaluation, Maximum Likelihood, ADC testing 1.

AB - In this paper sine fitting algorithms are investigated for the purpose of ADC testing. The aim is to decide whether the minimum of the cost function (CF) has been reached. For this, two different types of algorithms, the conventional Levenberg-Marquardt and the genetic-type Differential Evolution methods are investigated in order to compare their optima. It is shown that due to roundoff errors the bottom of the cost function is fairly uneven for conventional number representations for the Maximum Likelihood method, hence the minimum can only be determined with decreased precision. Finally, a band is calculated in which solutions can be considered equivalent, since their CF difference is smaller than roundoff errors. Keywords - Sine wave fit, Cost Function Evaluation, Maximum Likelihood, ADC testing 1.

UR - http://www.scopus.com/inward/record.url?scp=84918779359&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84918779359&partnerID=8YFLogxK

M3 - Conference contribution

SN - 9789299007327

SP - 248

EP - 252

BT - 20th IMEKO TC4 Symposium on Measurements of Electrical Quantities: Research on Electrical and Electronic Measurement for the Economic Upturn, Together with 18th TC4 International Workshop on ADC and DCA Modeling and Testing, IWADC 2014

PB - IMEKO-International Measurement Federation Secretariat

ER -