Limitations of the noise model of roundoff for the FFT

Vilmos Pálfi, István Kollár

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

The general assumptions made about roundoff noise are that its samples form a signal-independent white sequence, and they are uniformly distributed between ±q/2, where q equals the least significant bit (LSB). While these are often true, strange cases may appear, e.g. misleading peaks can occur in the spectrum. In this paper the roundoff error of the fixed-point and floating point fast Fourier transform is investigated. It reproduces the results of Welch (1969) with modern tools, revisits his simulations, and investigates the consequences of the violation of the above assumptions for almost pure sine waves. The maximum amplitude of spurious peaks is determined and the amount of the decrease in the dynamic range is given.

Original languageEnglish
Pages (from-to)179-185
Number of pages7
JournalPeriodica Polytechnica Electrical Engineering
Volume53
Issue number3-4
DOIs
Publication statusPublished - 2009

Keywords

  • FFT
  • Fixed-point
  • Floating-point
  • Roundoff error

ASJC Scopus subject areas

  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'Limitations of the noise model of roundoff for the FFT'. Together they form a unique fingerprint.

  • Cite this