Eye-tracking-based wizard-of-Oz usability evaluation of an emotional display agent integrated to a virtual environment

Károly Hercegfi, A. Komlódi, Máté Köles, Sarolta Tóvölgyi

Research output: Contribution to journalArticle

Abstract

This paper presents the results of the usability testing of an experimental component of the Virtual Collaboration Arena (VirCA) developed by the Cognitive Informatics Group of the Computer and Automation Research Institute of the Hungarian Academy of Sciences. This component is a semi-intelligent agent called the Emotional Display Object. We applied Wizard-of-Oz type high-fidelity early prototype evaluation technique to test the concept. The research focused on basic usability problems, and, in general, the perceptibility of the object as uncovered by eye-tracking and interview data; we analyzed and interpreted the results in correlation with the individual differences identified by a demographic questionnaire and psychological tests: the Myers-Briggs Type Indicator (MBTI), the Spatial-Visual Ability Paper Folding Test, and the Reading the Mind in the Eyes Test (RMET) - however, the main goal of this paper outreaches beyond the particular issues found and the development of an agent: it shows a case study on how complex concepts in Virtual Reality (VR) can be tested in very early stage of development.

Original languageEnglish
Pages (from-to)145-162
Number of pages18
JournalActa Polytechnica Hungarica
Volume16
Issue number2
DOIs
Publication statusPublished - Jan 1 2019

Fingerprint

Virtual reality
Display devices
Intelligent agents
Automation
Testing

Keywords

  • Concept testing
  • Early prototype
  • Eye-tracking
  • Human-robot interaction
  • Individual differences
  • Uncanny valley
  • Usability evaluation
  • Virtual agent
  • Virtual reality (VR)
  • Wizard-of-Oz

ASJC Scopus subject areas

  • Engineering(all)

Cite this

Eye-tracking-based wizard-of-Oz usability evaluation of an emotional display agent integrated to a virtual environment. / Hercegfi, Károly; Komlódi, A.; Köles, Máté; Tóvölgyi, Sarolta.

In: Acta Polytechnica Hungarica, Vol. 16, No. 2, 01.01.2019, p. 145-162.

Research output: Contribution to journalArticle

@article{8f0d4483ee5248dea660dab246f843fe,
title = "Eye-tracking-based wizard-of-Oz usability evaluation of an emotional display agent integrated to a virtual environment",
abstract = "This paper presents the results of the usability testing of an experimental component of the Virtual Collaboration Arena (VirCA) developed by the Cognitive Informatics Group of the Computer and Automation Research Institute of the Hungarian Academy of Sciences. This component is a semi-intelligent agent called the Emotional Display Object. We applied Wizard-of-Oz type high-fidelity early prototype evaluation technique to test the concept. The research focused on basic usability problems, and, in general, the perceptibility of the object as uncovered by eye-tracking and interview data; we analyzed and interpreted the results in correlation with the individual differences identified by a demographic questionnaire and psychological tests: the Myers-Briggs Type Indicator (MBTI), the Spatial-Visual Ability Paper Folding Test, and the Reading the Mind in the Eyes Test (RMET) - however, the main goal of this paper outreaches beyond the particular issues found and the development of an agent: it shows a case study on how complex concepts in Virtual Reality (VR) can be tested in very early stage of development.",
keywords = "Concept testing, Early prototype, Eye-tracking, Human-robot interaction, Individual differences, Uncanny valley, Usability evaluation, Virtual agent, Virtual reality (VR), Wizard-of-Oz",
author = "K{\'a}roly Hercegfi and A. Koml{\'o}di and M{\'a}t{\'e} K{\"o}les and Sarolta T{\'o}v{\"o}lgyi",
year = "2019",
month = "1",
day = "1",
doi = "10.12700/APH.16.2.2019.2.9",
language = "English",
volume = "16",
pages = "145--162",
journal = "Acta Polytechnica Hungarica",
issn = "1785-8860",
publisher = "Obuda University",
number = "2",

}

TY - JOUR

T1 - Eye-tracking-based wizard-of-Oz usability evaluation of an emotional display agent integrated to a virtual environment

AU - Hercegfi, Károly

AU - Komlódi, A.

AU - Köles, Máté

AU - Tóvölgyi, Sarolta

PY - 2019/1/1

Y1 - 2019/1/1

N2 - This paper presents the results of the usability testing of an experimental component of the Virtual Collaboration Arena (VirCA) developed by the Cognitive Informatics Group of the Computer and Automation Research Institute of the Hungarian Academy of Sciences. This component is a semi-intelligent agent called the Emotional Display Object. We applied Wizard-of-Oz type high-fidelity early prototype evaluation technique to test the concept. The research focused on basic usability problems, and, in general, the perceptibility of the object as uncovered by eye-tracking and interview data; we analyzed and interpreted the results in correlation with the individual differences identified by a demographic questionnaire and psychological tests: the Myers-Briggs Type Indicator (MBTI), the Spatial-Visual Ability Paper Folding Test, and the Reading the Mind in the Eyes Test (RMET) - however, the main goal of this paper outreaches beyond the particular issues found and the development of an agent: it shows a case study on how complex concepts in Virtual Reality (VR) can be tested in very early stage of development.

AB - This paper presents the results of the usability testing of an experimental component of the Virtual Collaboration Arena (VirCA) developed by the Cognitive Informatics Group of the Computer and Automation Research Institute of the Hungarian Academy of Sciences. This component is a semi-intelligent agent called the Emotional Display Object. We applied Wizard-of-Oz type high-fidelity early prototype evaluation technique to test the concept. The research focused on basic usability problems, and, in general, the perceptibility of the object as uncovered by eye-tracking and interview data; we analyzed and interpreted the results in correlation with the individual differences identified by a demographic questionnaire and psychological tests: the Myers-Briggs Type Indicator (MBTI), the Spatial-Visual Ability Paper Folding Test, and the Reading the Mind in the Eyes Test (RMET) - however, the main goal of this paper outreaches beyond the particular issues found and the development of an agent: it shows a case study on how complex concepts in Virtual Reality (VR) can be tested in very early stage of development.

KW - Concept testing

KW - Early prototype

KW - Eye-tracking

KW - Human-robot interaction

KW - Individual differences

KW - Uncanny valley

KW - Usability evaluation

KW - Virtual agent

KW - Virtual reality (VR)

KW - Wizard-of-Oz

UR - http://www.scopus.com/inward/record.url?scp=85069740749&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85069740749&partnerID=8YFLogxK

U2 - 10.12700/APH.16.2.2019.2.9

DO - 10.12700/APH.16.2.2019.2.9

M3 - Article

AN - SCOPUS:85069740749

VL - 16

SP - 145

EP - 162

JO - Acta Polytechnica Hungarica

JF - Acta Polytechnica Hungarica

SN - 1785-8860

IS - 2

ER -