Fuzzy clustering for the identification of hinging hyperplanes based regression trees

Tamas Kenesei, Balazs Feil, J. Abonyi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This article deals with the identification of hinging hyperplane models. This type of non-linear black-box models is relatively new, and its identification is not thoroughly examined and discussed so far. They can be an alternative to artificial neural nets but there is a clear need for an effective identification method. This paper presents a new identification technique for that purpose based on a fuzzy clustering technique called Fuzzy c-Regression Clustering. To use this clustering procedure for the identification of hinging hyperplanes there is a need to handle restrictions about the relative location of the hyperplanes: they should intersect each other in the operating regime covered by the data points. The proposed method recursively identifies a hinging hyperplane model that contains two linear submodels by partitioning of the operating region of one local linear model resuling in a binary regression tree. Hence, this paper proposes a new algorithm for the identification of tree structured piecewise linear models, where the branches correspond to linear division of the operating regime based on the intersection of two local linear models. The effectiveness of the proposed model is demonstrated by a dynamic model identification example.

Original languageEnglish
Title of host publicationLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Pages179-186
Number of pages8
Volume4578 LNAI
Publication statusPublished - 2007
Event7th International Workshop on Fuzzy Logic and Applications, WILF 2007 - Camogli, Italy
Duration: Jul 7 2007Jul 10 2007

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume4578 LNAI
ISSN (Print)03029743
ISSN (Electronic)16113349

Other

Other7th International Workshop on Fuzzy Logic and Applications, WILF 2007
CountryItaly
CityCamogli
Period7/7/077/10/07

Fingerprint

Regression Tree
Fuzzy clustering
Fuzzy Clustering
Hyperplane
Cluster Analysis
Linear Models
Identification (control systems)
Linear Model
Clustering
Binary Regression
Neural Nets
Model Identification
Binary Tree
Black Box
Intersect
Piecewise Linear
Model
Partitioning
Division
Dynamic Model

Keywords

  • Clustering
  • Hinging hyperplane
  • NARX model
  • Neuro-fuzzy systems
  • Regression tree

ASJC Scopus subject areas

  • Computer Science(all)
  • Biochemistry, Genetics and Molecular Biology(all)
  • Theoretical Computer Science

Cite this

Kenesei, T., Feil, B., & Abonyi, J. (2007). Fuzzy clustering for the identification of hinging hyperplanes based regression trees. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (Vol. 4578 LNAI, pp. 179-186). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 4578 LNAI).

Fuzzy clustering for the identification of hinging hyperplanes based regression trees. / Kenesei, Tamas; Feil, Balazs; Abonyi, J.

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 4578 LNAI 2007. p. 179-186 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 4578 LNAI).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Kenesei, T, Feil, B & Abonyi, J 2007, Fuzzy clustering for the identification of hinging hyperplanes based regression trees. in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). vol. 4578 LNAI, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 4578 LNAI, pp. 179-186, 7th International Workshop on Fuzzy Logic and Applications, WILF 2007, Camogli, Italy, 7/7/07.
Kenesei T, Feil B, Abonyi J. Fuzzy clustering for the identification of hinging hyperplanes based regression trees. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 4578 LNAI. 2007. p. 179-186. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
Kenesei, Tamas ; Feil, Balazs ; Abonyi, J. / Fuzzy clustering for the identification of hinging hyperplanes based regression trees. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 4578 LNAI 2007. pp. 179-186 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{abb99fc3682644b78f3252483a8879b4,
title = "Fuzzy clustering for the identification of hinging hyperplanes based regression trees",
abstract = "This article deals with the identification of hinging hyperplane models. This type of non-linear black-box models is relatively new, and its identification is not thoroughly examined and discussed so far. They can be an alternative to artificial neural nets but there is a clear need for an effective identification method. This paper presents a new identification technique for that purpose based on a fuzzy clustering technique called Fuzzy c-Regression Clustering. To use this clustering procedure for the identification of hinging hyperplanes there is a need to handle restrictions about the relative location of the hyperplanes: they should intersect each other in the operating regime covered by the data points. The proposed method recursively identifies a hinging hyperplane model that contains two linear submodels by partitioning of the operating region of one local linear model resuling in a binary regression tree. Hence, this paper proposes a new algorithm for the identification of tree structured piecewise linear models, where the branches correspond to linear division of the operating regime based on the intersection of two local linear models. The effectiveness of the proposed model is demonstrated by a dynamic model identification example.",
keywords = "Clustering, Hinging hyperplane, NARX model, Neuro-fuzzy systems, Regression tree",
author = "Tamas Kenesei and Balazs Feil and J. Abonyi",
year = "2007",
language = "English",
isbn = "9783540733997",
volume = "4578 LNAI",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
pages = "179--186",
booktitle = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

}

TY - GEN

T1 - Fuzzy clustering for the identification of hinging hyperplanes based regression trees

AU - Kenesei, Tamas

AU - Feil, Balazs

AU - Abonyi, J.

PY - 2007

Y1 - 2007

N2 - This article deals with the identification of hinging hyperplane models. This type of non-linear black-box models is relatively new, and its identification is not thoroughly examined and discussed so far. They can be an alternative to artificial neural nets but there is a clear need for an effective identification method. This paper presents a new identification technique for that purpose based on a fuzzy clustering technique called Fuzzy c-Regression Clustering. To use this clustering procedure for the identification of hinging hyperplanes there is a need to handle restrictions about the relative location of the hyperplanes: they should intersect each other in the operating regime covered by the data points. The proposed method recursively identifies a hinging hyperplane model that contains two linear submodels by partitioning of the operating region of one local linear model resuling in a binary regression tree. Hence, this paper proposes a new algorithm for the identification of tree structured piecewise linear models, where the branches correspond to linear division of the operating regime based on the intersection of two local linear models. The effectiveness of the proposed model is demonstrated by a dynamic model identification example.

AB - This article deals with the identification of hinging hyperplane models. This type of non-linear black-box models is relatively new, and its identification is not thoroughly examined and discussed so far. They can be an alternative to artificial neural nets but there is a clear need for an effective identification method. This paper presents a new identification technique for that purpose based on a fuzzy clustering technique called Fuzzy c-Regression Clustering. To use this clustering procedure for the identification of hinging hyperplanes there is a need to handle restrictions about the relative location of the hyperplanes: they should intersect each other in the operating regime covered by the data points. The proposed method recursively identifies a hinging hyperplane model that contains two linear submodels by partitioning of the operating region of one local linear model resuling in a binary regression tree. Hence, this paper proposes a new algorithm for the identification of tree structured piecewise linear models, where the branches correspond to linear division of the operating regime based on the intersection of two local linear models. The effectiveness of the proposed model is demonstrated by a dynamic model identification example.

KW - Clustering

KW - Hinging hyperplane

KW - NARX model

KW - Neuro-fuzzy systems

KW - Regression tree

UR - http://www.scopus.com/inward/record.url?scp=37249061713&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=37249061713&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:37249061713

SN - 9783540733997

VL - 4578 LNAI

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 179

EP - 186

BT - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

ER -