Towards a numerically tractable model for the auditory substitution of tactile percepts

Adam Csapo, P. Baranyi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

We refer to channels of communication that link the user to information systems as cognitive communication channels. One especially interesting research topic related to cognitive communication channels deals with a special application called sensory substitution, when information is conveyed through a channel other than the one that is normally used for the given application. Our goal is to develop engineering systems for the remote teleoperation of robots using sensory substitution to convey feedback information in meaningful ways. Such applications could help reduce the cognitive load for the user on the one hand, and help alleviate the effect of control instabilities and hidden parameters on the other. A large part of our research deals with how to provide information on tactile percepts-otherwise inaccessible to the remote user - through sound. In this paper, we present one possible mapping between tactile percepts and auditory parameters. Through a set of controlled experiments, we show that the parameters used are meaningful and the sounds can at some level be learned by users as a substitute for tactile perception. Analyzing the error statistics of the experiments, we argue that it would be worthwhile to create a system in which the sound parameters could be locally tuned to enhance performance on a user-per-user basis. To this end, we convert the analytical descriptions of our sounds into an higher-order singular value decomposition (HOSVD) based tensor product model form. In order to be able to apply a wide range of mathematical analysis tools - such as principal component analysis and user performance-oriented adaptivity - we demonstrate that it is possible to convert our models into such canonical forms.

Original languageEnglish
Title of host publicationProceedings - ISRCS 2010 - 3rd International Symposium on Resilient Control Systems
Pages23-28
Number of pages6
DOIs
Publication statusPublished - 2010
Event3rd International Symposium on Resilient Control Systems, ISRCS 2010 - Idaho Falls, ID, United States
Duration: Aug 10 2010Aug 12 2010

Other

Other3rd International Symposium on Resilient Control Systems, ISRCS 2010
CountryUnited States
CityIdaho Falls, ID
Period8/10/108/12/10

Fingerprint

Substitution reactions
Acoustic waves
Error statistics
Singular value decomposition
Remote control
Systems engineering
Principal component analysis
Telecommunication links
Tensors
Information systems
Experiments
Robots
Feedback

ASJC Scopus subject areas

  • Control and Systems Engineering

Cite this

Csapo, A., & Baranyi, P. (2010). Towards a numerically tractable model for the auditory substitution of tactile percepts. In Proceedings - ISRCS 2010 - 3rd International Symposium on Resilient Control Systems (pp. 23-28). [5603481] https://doi.org/10.1109/ISRCS.2010.5603481

Towards a numerically tractable model for the auditory substitution of tactile percepts. / Csapo, Adam; Baranyi, P.

Proceedings - ISRCS 2010 - 3rd International Symposium on Resilient Control Systems. 2010. p. 23-28 5603481.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Csapo, A & Baranyi, P 2010, Towards a numerically tractable model for the auditory substitution of tactile percepts. in Proceedings - ISRCS 2010 - 3rd International Symposium on Resilient Control Systems., 5603481, pp. 23-28, 3rd International Symposium on Resilient Control Systems, ISRCS 2010, Idaho Falls, ID, United States, 8/10/10. https://doi.org/10.1109/ISRCS.2010.5603481
Csapo A, Baranyi P. Towards a numerically tractable model for the auditory substitution of tactile percepts. In Proceedings - ISRCS 2010 - 3rd International Symposium on Resilient Control Systems. 2010. p. 23-28. 5603481 https://doi.org/10.1109/ISRCS.2010.5603481
Csapo, Adam ; Baranyi, P. / Towards a numerically tractable model for the auditory substitution of tactile percepts. Proceedings - ISRCS 2010 - 3rd International Symposium on Resilient Control Systems. 2010. pp. 23-28
@inproceedings{f41bb109939041b6905b877c75ac8552,
title = "Towards a numerically tractable model for the auditory substitution of tactile percepts",
abstract = "We refer to channels of communication that link the user to information systems as cognitive communication channels. One especially interesting research topic related to cognitive communication channels deals with a special application called sensory substitution, when information is conveyed through a channel other than the one that is normally used for the given application. Our goal is to develop engineering systems for the remote teleoperation of robots using sensory substitution to convey feedback information in meaningful ways. Such applications could help reduce the cognitive load for the user on the one hand, and help alleviate the effect of control instabilities and hidden parameters on the other. A large part of our research deals with how to provide information on tactile percepts-otherwise inaccessible to the remote user - through sound. In this paper, we present one possible mapping between tactile percepts and auditory parameters. Through a set of controlled experiments, we show that the parameters used are meaningful and the sounds can at some level be learned by users as a substitute for tactile perception. Analyzing the error statistics of the experiments, we argue that it would be worthwhile to create a system in which the sound parameters could be locally tuned to enhance performance on a user-per-user basis. To this end, we convert the analytical descriptions of our sounds into an higher-order singular value decomposition (HOSVD) based tensor product model form. In order to be able to apply a wide range of mathematical analysis tools - such as principal component analysis and user performance-oriented adaptivity - we demonstrate that it is possible to convert our models into such canonical forms.",
author = "Adam Csapo and P. Baranyi",
year = "2010",
doi = "10.1109/ISRCS.2010.5603481",
language = "English",
isbn = "9781424459544",
pages = "23--28",
booktitle = "Proceedings - ISRCS 2010 - 3rd International Symposium on Resilient Control Systems",

}

TY - GEN

T1 - Towards a numerically tractable model for the auditory substitution of tactile percepts

AU - Csapo, Adam

AU - Baranyi, P.

PY - 2010

Y1 - 2010

N2 - We refer to channels of communication that link the user to information systems as cognitive communication channels. One especially interesting research topic related to cognitive communication channels deals with a special application called sensory substitution, when information is conveyed through a channel other than the one that is normally used for the given application. Our goal is to develop engineering systems for the remote teleoperation of robots using sensory substitution to convey feedback information in meaningful ways. Such applications could help reduce the cognitive load for the user on the one hand, and help alleviate the effect of control instabilities and hidden parameters on the other. A large part of our research deals with how to provide information on tactile percepts-otherwise inaccessible to the remote user - through sound. In this paper, we present one possible mapping between tactile percepts and auditory parameters. Through a set of controlled experiments, we show that the parameters used are meaningful and the sounds can at some level be learned by users as a substitute for tactile perception. Analyzing the error statistics of the experiments, we argue that it would be worthwhile to create a system in which the sound parameters could be locally tuned to enhance performance on a user-per-user basis. To this end, we convert the analytical descriptions of our sounds into an higher-order singular value decomposition (HOSVD) based tensor product model form. In order to be able to apply a wide range of mathematical analysis tools - such as principal component analysis and user performance-oriented adaptivity - we demonstrate that it is possible to convert our models into such canonical forms.

AB - We refer to channels of communication that link the user to information systems as cognitive communication channels. One especially interesting research topic related to cognitive communication channels deals with a special application called sensory substitution, when information is conveyed through a channel other than the one that is normally used for the given application. Our goal is to develop engineering systems for the remote teleoperation of robots using sensory substitution to convey feedback information in meaningful ways. Such applications could help reduce the cognitive load for the user on the one hand, and help alleviate the effect of control instabilities and hidden parameters on the other. A large part of our research deals with how to provide information on tactile percepts-otherwise inaccessible to the remote user - through sound. In this paper, we present one possible mapping between tactile percepts and auditory parameters. Through a set of controlled experiments, we show that the parameters used are meaningful and the sounds can at some level be learned by users as a substitute for tactile perception. Analyzing the error statistics of the experiments, we argue that it would be worthwhile to create a system in which the sound parameters could be locally tuned to enhance performance on a user-per-user basis. To this end, we convert the analytical descriptions of our sounds into an higher-order singular value decomposition (HOSVD) based tensor product model form. In order to be able to apply a wide range of mathematical analysis tools - such as principal component analysis and user performance-oriented adaptivity - we demonstrate that it is possible to convert our models into such canonical forms.

UR - http://www.scopus.com/inward/record.url?scp=78349256691&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=78349256691&partnerID=8YFLogxK

U2 - 10.1109/ISRCS.2010.5603481

DO - 10.1109/ISRCS.2010.5603481

M3 - Conference contribution

SN - 9781424459544

SP - 23

EP - 28

BT - Proceedings - ISRCS 2010 - 3rd International Symposium on Resilient Control Systems

ER -