On the averaged stochastic approximation for linear regression

László Györfi, Harro Walk

Research output: Contribution to journalArticle

12 Citations (Scopus)

Abstract

For a linear regression function the average of stochastic approximation with constant gain is considered. In case of ergodic observations almost sure convergence is proved, where the limit is biased with small bias for small gain. For independent and identically distributed observations and also under martingale and mixing assumptions, asymptotic normality with (n-1/2)-convergence order is obtained. In the martingale case the asymptotic covariance matrix is close to the optimum one if the gain is small.

Original languageEnglish
Pages (from-to)31-61
Number of pages31
JournalSIAM Journal on Control and Optimization
Volume34
Issue number1
DOIs
Publication statusPublished - Jan 1996

Keywords

  • Adaptive filtering
  • Almost sure convergence
  • Asymptotic normality
  • Averaged stochastic approximation
  • Constant gains
  • Ergodicity
  • Linear regression
  • Martingales
  • Mixing

ASJC Scopus subject areas

  • Control and Optimization
  • Applied Mathematics

Fingerprint Dive into the research topics of 'On the averaged stochastic approximation for linear regression'. Together they form a unique fingerprint.

  • Cite this