A tensor algebraic framework for the intuitive exploration of sensory substitution spaces

Adam Csapo, P. Baranyi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

We refer to channels of communication that link the user to information systems as cognitive communication channels. One especially interesting research topic related to cognitive communication channels deals with a special application called sensory substitution, when information is conveyed through a channel other than the one that is normally used for the given application. Our goal is to develop engineering systems for the remote teleoperation of robots using sensory substitution to convey feedback information in meaningful ways. Such applications could help reduce the cognitive load for the user on the one hand, and help alleviate the effect of control instabilities and hidden parameters on the other. In this paper, we present a tensor algebraic approach for the compact representation of complete sensory substitution channels. Using HOSVD, we transform our representations into canonical, orthogonal forms. Through a combination of rank-reduction and error compensation techniques, we propose an iterative and hierarchical parameter space exploration method which may help users tune the generated sensory substituted signals in a more intuitive fashion. As an application example, we present a mapping between tactile percepts and auditory parameters in order to convey the tactile experience of a robot to a remote user through sound. In order to be able to apply a wide a wide range of mathematical analysis tools - such as principal component analysis and user performance-oriented adaptivity - we demonstrate that it is possible to convert our models into HOSVD-based canonical forms. The verification of the enhanced parameter space exploration method using rank reduction and error compensation in this application remains part of our future work.

Original languageEnglish
Title of host publicationSIISY 2010 - 8th IEEE International Symposium on Intelligent Systems and Informatics
Pages547-552
Number of pages6
DOIs
Publication statusPublished - 2010
Event8th IEEE International Symposium on Intelligent Systems and Informatics, SIISY 2010 - Subotica, Serbia
Duration: Sep 10 2010Sep 11 2010

Other

Other8th IEEE International Symposium on Intelligent Systems and Informatics, SIISY 2010
CountrySerbia
CitySubotica
Period9/10/109/11/10

Fingerprint

Tensors
Substitution reactions
Error compensation
Robots
Remote control
Systems engineering
Principal component analysis
Telecommunication links
Information systems
Acoustic waves
Feedback

ASJC Scopus subject areas

  • Artificial Intelligence
  • Information Systems

Cite this

Csapo, A., & Baranyi, P. (2010). A tensor algebraic framework for the intuitive exploration of sensory substitution spaces. In SIISY 2010 - 8th IEEE International Symposium on Intelligent Systems and Informatics (pp. 547-552). [5647127] https://doi.org/10.1109/SISY.2010.5647127

A tensor algebraic framework for the intuitive exploration of sensory substitution spaces. / Csapo, Adam; Baranyi, P.

SIISY 2010 - 8th IEEE International Symposium on Intelligent Systems and Informatics. 2010. p. 547-552 5647127.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Csapo, A & Baranyi, P 2010, A tensor algebraic framework for the intuitive exploration of sensory substitution spaces. in SIISY 2010 - 8th IEEE International Symposium on Intelligent Systems and Informatics., 5647127, pp. 547-552, 8th IEEE International Symposium on Intelligent Systems and Informatics, SIISY 2010, Subotica, Serbia, 9/10/10. https://doi.org/10.1109/SISY.2010.5647127
Csapo A, Baranyi P. A tensor algebraic framework for the intuitive exploration of sensory substitution spaces. In SIISY 2010 - 8th IEEE International Symposium on Intelligent Systems and Informatics. 2010. p. 547-552. 5647127 https://doi.org/10.1109/SISY.2010.5647127
Csapo, Adam ; Baranyi, P. / A tensor algebraic framework for the intuitive exploration of sensory substitution spaces. SIISY 2010 - 8th IEEE International Symposium on Intelligent Systems and Informatics. 2010. pp. 547-552
@inproceedings{54a2b19a057c44ee922d9b6f368f2366,
title = "A tensor algebraic framework for the intuitive exploration of sensory substitution spaces",
abstract = "We refer to channels of communication that link the user to information systems as cognitive communication channels. One especially interesting research topic related to cognitive communication channels deals with a special application called sensory substitution, when information is conveyed through a channel other than the one that is normally used for the given application. Our goal is to develop engineering systems for the remote teleoperation of robots using sensory substitution to convey feedback information in meaningful ways. Such applications could help reduce the cognitive load for the user on the one hand, and help alleviate the effect of control instabilities and hidden parameters on the other. In this paper, we present a tensor algebraic approach for the compact representation of complete sensory substitution channels. Using HOSVD, we transform our representations into canonical, orthogonal forms. Through a combination of rank-reduction and error compensation techniques, we propose an iterative and hierarchical parameter space exploration method which may help users tune the generated sensory substituted signals in a more intuitive fashion. As an application example, we present a mapping between tactile percepts and auditory parameters in order to convey the tactile experience of a robot to a remote user through sound. In order to be able to apply a wide a wide range of mathematical analysis tools - such as principal component analysis and user performance-oriented adaptivity - we demonstrate that it is possible to convert our models into HOSVD-based canonical forms. The verification of the enhanced parameter space exploration method using rank reduction and error compensation in this application remains part of our future work.",
author = "Adam Csapo and P. Baranyi",
year = "2010",
doi = "10.1109/SISY.2010.5647127",
language = "English",
isbn = "9781424473946",
pages = "547--552",
booktitle = "SIISY 2010 - 8th IEEE International Symposium on Intelligent Systems and Informatics",

}

TY - GEN

T1 - A tensor algebraic framework for the intuitive exploration of sensory substitution spaces

AU - Csapo, Adam

AU - Baranyi, P.

PY - 2010

Y1 - 2010

N2 - We refer to channels of communication that link the user to information systems as cognitive communication channels. One especially interesting research topic related to cognitive communication channels deals with a special application called sensory substitution, when information is conveyed through a channel other than the one that is normally used for the given application. Our goal is to develop engineering systems for the remote teleoperation of robots using sensory substitution to convey feedback information in meaningful ways. Such applications could help reduce the cognitive load for the user on the one hand, and help alleviate the effect of control instabilities and hidden parameters on the other. In this paper, we present a tensor algebraic approach for the compact representation of complete sensory substitution channels. Using HOSVD, we transform our representations into canonical, orthogonal forms. Through a combination of rank-reduction and error compensation techniques, we propose an iterative and hierarchical parameter space exploration method which may help users tune the generated sensory substituted signals in a more intuitive fashion. As an application example, we present a mapping between tactile percepts and auditory parameters in order to convey the tactile experience of a robot to a remote user through sound. In order to be able to apply a wide a wide range of mathematical analysis tools - such as principal component analysis and user performance-oriented adaptivity - we demonstrate that it is possible to convert our models into HOSVD-based canonical forms. The verification of the enhanced parameter space exploration method using rank reduction and error compensation in this application remains part of our future work.

AB - We refer to channels of communication that link the user to information systems as cognitive communication channels. One especially interesting research topic related to cognitive communication channels deals with a special application called sensory substitution, when information is conveyed through a channel other than the one that is normally used for the given application. Our goal is to develop engineering systems for the remote teleoperation of robots using sensory substitution to convey feedback information in meaningful ways. Such applications could help reduce the cognitive load for the user on the one hand, and help alleviate the effect of control instabilities and hidden parameters on the other. In this paper, we present a tensor algebraic approach for the compact representation of complete sensory substitution channels. Using HOSVD, we transform our representations into canonical, orthogonal forms. Through a combination of rank-reduction and error compensation techniques, we propose an iterative and hierarchical parameter space exploration method which may help users tune the generated sensory substituted signals in a more intuitive fashion. As an application example, we present a mapping between tactile percepts and auditory parameters in order to convey the tactile experience of a robot to a remote user through sound. In order to be able to apply a wide a wide range of mathematical analysis tools - such as principal component analysis and user performance-oriented adaptivity - we demonstrate that it is possible to convert our models into HOSVD-based canonical forms. The verification of the enhanced parameter space exploration method using rank reduction and error compensation in this application remains part of our future work.

UR - http://www.scopus.com/inward/record.url?scp=78650584181&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=78650584181&partnerID=8YFLogxK

U2 - 10.1109/SISY.2010.5647127

DO - 10.1109/SISY.2010.5647127

M3 - Conference contribution

SN - 9781424473946

SP - 547

EP - 552

BT - SIISY 2010 - 8th IEEE International Symposium on Intelligent Systems and Informatics

ER -