A cognitive robot supervision system

Gábor Sörös, Barna Reskó, Bjørn Solvang, P. Baranyi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

6 Citations (Scopus)

Abstract

This paper applies new cognitive infocommunication channels in human-machine interaction to develop a new paradigm of robot teaching and supervision. The robot is considered as an unskilled worker who is strong and capable for precise manufacturing. It has a special kind of intelligence but it is handicapped in a sense, which requires it to be supervised. If people can learn how to communicate to this "new worker" they can get a new, capable "colleague". The goal is that the boss is able to give the daily task to a robot in a similar way as he/she gives the jobs to the human workers, for example using CAD documentations, gestures and some verbal explanation. This paper presents an industrial robot supervision system inspired by research results of cognitive infocommunication. The operator can steer the remote manipulator by certain gestures using a motion capture suit as input device. Every gesture has its own meaning, which corresponds to a specific movement of the robot. The manipulator interprets and executes the instructions invoking its on-board artificial intelligence, while feedback through a 3D visualization unit closes the supervisory loop. The system was designed to be independent of the geographical distance between the user and the manipulated environment, allowing to establish control loops spanning through countries and continents. Successful results have been achieved between Norway, France and Hungary.

Original languageEnglish
Title of host publicationSAMI 2009 - 7th International Symposium on Applied Machine Intelligence and Informatics, Proceedings
Pages51-55
Number of pages5
DOIs
Publication statusPublished - 2009
Event7th International Symposium on Applied Machine Intelligence and Informatics, SAMI 2009 - Herl'any, Slovakia
Duration: Jan 30 2009Jan 31 2009

Other

Other7th International Symposium on Applied Machine Intelligence and Informatics, SAMI 2009
CountrySlovakia
CityHerl'any
Period1/30/091/31/09

Fingerprint

Robots
Manipulators
Industrial robots
Artificial intelligence
Computer aided design
Teaching
Visualization
Feedback

Keywords

  • Brain-in-the-loop control
  • Cognitive robot supervision
  • Motion-capture
  • Stereoscopic visualization

ASJC Scopus subject areas

  • Artificial Intelligence
  • Information Systems
  • Electrical and Electronic Engineering

Cite this

Sörös, G., Reskó, B., Solvang, B., & Baranyi, P. (2009). A cognitive robot supervision system. In SAMI 2009 - 7th International Symposium on Applied Machine Intelligence and Informatics, Proceedings (pp. 51-55). [4956637] https://doi.org/10.1109/SAMI.2009.4956637

A cognitive robot supervision system. / Sörös, Gábor; Reskó, Barna; Solvang, Bjørn; Baranyi, P.

SAMI 2009 - 7th International Symposium on Applied Machine Intelligence and Informatics, Proceedings. 2009. p. 51-55 4956637.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Sörös, G, Reskó, B, Solvang, B & Baranyi, P 2009, A cognitive robot supervision system. in SAMI 2009 - 7th International Symposium on Applied Machine Intelligence and Informatics, Proceedings., 4956637, pp. 51-55, 7th International Symposium on Applied Machine Intelligence and Informatics, SAMI 2009, Herl'any, Slovakia, 1/30/09. https://doi.org/10.1109/SAMI.2009.4956637
Sörös G, Reskó B, Solvang B, Baranyi P. A cognitive robot supervision system. In SAMI 2009 - 7th International Symposium on Applied Machine Intelligence and Informatics, Proceedings. 2009. p. 51-55. 4956637 https://doi.org/10.1109/SAMI.2009.4956637
Sörös, Gábor ; Reskó, Barna ; Solvang, Bjørn ; Baranyi, P. / A cognitive robot supervision system. SAMI 2009 - 7th International Symposium on Applied Machine Intelligence and Informatics, Proceedings. 2009. pp. 51-55
@inproceedings{34b42141070d419b838a4cbf2428389b,
title = "A cognitive robot supervision system",
abstract = "This paper applies new cognitive infocommunication channels in human-machine interaction to develop a new paradigm of robot teaching and supervision. The robot is considered as an unskilled worker who is strong and capable for precise manufacturing. It has a special kind of intelligence but it is handicapped in a sense, which requires it to be supervised. If people can learn how to communicate to this {"}new worker{"} they can get a new, capable {"}colleague{"}. The goal is that the boss is able to give the daily task to a robot in a similar way as he/she gives the jobs to the human workers, for example using CAD documentations, gestures and some verbal explanation. This paper presents an industrial robot supervision system inspired by research results of cognitive infocommunication. The operator can steer the remote manipulator by certain gestures using a motion capture suit as input device. Every gesture has its own meaning, which corresponds to a specific movement of the robot. The manipulator interprets and executes the instructions invoking its on-board artificial intelligence, while feedback through a 3D visualization unit closes the supervisory loop. The system was designed to be independent of the geographical distance between the user and the manipulated environment, allowing to establish control loops spanning through countries and continents. Successful results have been achieved between Norway, France and Hungary.",
keywords = "Brain-in-the-loop control, Cognitive robot supervision, Motion-capture, Stereoscopic visualization",
author = "G{\'a}bor S{\"o}r{\"o}s and Barna Resk{\'o} and Bj{\o}rn Solvang and P. Baranyi",
year = "2009",
doi = "10.1109/SAMI.2009.4956637",
language = "English",
isbn = "9781424438020",
pages = "51--55",
booktitle = "SAMI 2009 - 7th International Symposium on Applied Machine Intelligence and Informatics, Proceedings",

}

TY - GEN

T1 - A cognitive robot supervision system

AU - Sörös, Gábor

AU - Reskó, Barna

AU - Solvang, Bjørn

AU - Baranyi, P.

PY - 2009

Y1 - 2009

N2 - This paper applies new cognitive infocommunication channels in human-machine interaction to develop a new paradigm of robot teaching and supervision. The robot is considered as an unskilled worker who is strong and capable for precise manufacturing. It has a special kind of intelligence but it is handicapped in a sense, which requires it to be supervised. If people can learn how to communicate to this "new worker" they can get a new, capable "colleague". The goal is that the boss is able to give the daily task to a robot in a similar way as he/she gives the jobs to the human workers, for example using CAD documentations, gestures and some verbal explanation. This paper presents an industrial robot supervision system inspired by research results of cognitive infocommunication. The operator can steer the remote manipulator by certain gestures using a motion capture suit as input device. Every gesture has its own meaning, which corresponds to a specific movement of the robot. The manipulator interprets and executes the instructions invoking its on-board artificial intelligence, while feedback through a 3D visualization unit closes the supervisory loop. The system was designed to be independent of the geographical distance between the user and the manipulated environment, allowing to establish control loops spanning through countries and continents. Successful results have been achieved between Norway, France and Hungary.

AB - This paper applies new cognitive infocommunication channels in human-machine interaction to develop a new paradigm of robot teaching and supervision. The robot is considered as an unskilled worker who is strong and capable for precise manufacturing. It has a special kind of intelligence but it is handicapped in a sense, which requires it to be supervised. If people can learn how to communicate to this "new worker" they can get a new, capable "colleague". The goal is that the boss is able to give the daily task to a robot in a similar way as he/she gives the jobs to the human workers, for example using CAD documentations, gestures and some verbal explanation. This paper presents an industrial robot supervision system inspired by research results of cognitive infocommunication. The operator can steer the remote manipulator by certain gestures using a motion capture suit as input device. Every gesture has its own meaning, which corresponds to a specific movement of the robot. The manipulator interprets and executes the instructions invoking its on-board artificial intelligence, while feedback through a 3D visualization unit closes the supervisory loop. The system was designed to be independent of the geographical distance between the user and the manipulated environment, allowing to establish control loops spanning through countries and continents. Successful results have been achieved between Norway, France and Hungary.

KW - Brain-in-the-loop control

KW - Cognitive robot supervision

KW - Motion-capture

KW - Stereoscopic visualization

UR - http://www.scopus.com/inward/record.url?scp=69849095977&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=69849095977&partnerID=8YFLogxK

U2 - 10.1109/SAMI.2009.4956637

DO - 10.1109/SAMI.2009.4956637

M3 - Conference contribution

AN - SCOPUS:69849095977

SN - 9781424438020

SP - 51

EP - 55

BT - SAMI 2009 - 7th International Symposium on Applied Machine Intelligence and Informatics, Proceedings

ER -