Round off errors in the evaluation of the cost function in sine wave based adc testing

Balázs Renczes, István Kollár

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

In this paper sine fitting algorithms are investigated for the purpose of ADC testing. The aim is to decide whether the minimum of the cost function (CF) has been reached. For this, two different types of algorithms, the conventional Levenberg-Marquardt and the genetic-type Differential Evolution methods are investigated in order to compare their optima. It is shown that due to roundoff errors the bottom of the cost function is fairly uneven for conventional number representations for the Maximum Likelihood method, hence the minimum can only be determined with decreased precision. Finally, a band is calculated in which solutions can be considered equivalent, since their CF difference is smaller than roundoff errors. Keywords - Sine wave fit, Cost Function Evaluation, Maximum Likelihood, ADC testing 1.

Original languageEnglish
Title of host publication20th IMEKO TC4 Symposium on Measurements of Electrical Quantities
Subtitle of host publicationResearch on Electrical and Electronic Measurement for the Economic Upturn, Together with 18th TC4 International Workshop on ADC and DCA Modeling and Testing, IWADC 2014
PublisherIMEKO-International Measurement Federation Secretariat
Pages248-252
Number of pages5
ISBN (Electronic)9789299007327
Publication statusPublished - Jan 1 2014
Event20th IMEKO TC4 Symposium on Measurements of Electrical Quantities: Research on Electrical and Electronic Measurement for the Economic Upturn, Together with 18th TC4 International Workshop on ADC and DCA Modeling and Testing, IWADC 2014 - Benevento, Italy
Duration: Sep 15 2014Sep 17 2014

Publication series

Name20th IMEKO TC4 Symposium on Measurements of Electrical Quantities: Research on Electrical and Electronic Measurement for the Economic Upturn, Together with 18th TC4 International Workshop on ADC and DCA Modeling and Testing, IWADC 2014

Other

Other20th IMEKO TC4 Symposium on Measurements of Electrical Quantities: Research on Electrical and Electronic Measurement for the Economic Upturn, Together with 18th TC4 International Workshop on ADC and DCA Modeling and Testing, IWADC 2014
CountryItaly
CityBenevento
Period9/15/149/17/14

    Fingerprint

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Modelling and Simulation
  • Instrumentation

Cite this

Renczes, B., & Kollár, I. (2014). Round off errors in the evaluation of the cost function in sine wave based adc testing. In 20th IMEKO TC4 Symposium on Measurements of Electrical Quantities: Research on Electrical and Electronic Measurement for the Economic Upturn, Together with 18th TC4 International Workshop on ADC and DCA Modeling and Testing, IWADC 2014 (pp. 248-252). (20th IMEKO TC4 Symposium on Measurements of Electrical Quantities: Research on Electrical and Electronic Measurement for the Economic Upturn, Together with 18th TC4 International Workshop on ADC and DCA Modeling and Testing, IWADC 2014). IMEKO-International Measurement Federation Secretariat.