Maintain and improve mental health by smart virtual reality serious games

András Sárkány, Zoltán Tősér, Anita L. Verő, András Lőrincz, Takumi Toyama, Ehsan N. Toosi, Daniel Sonntag

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Citations (Scopus)

Abstract

Serious games for mental health is seen as the groundwork for assistive technology to maintain and improve mental health. We present a technical system layout we partly implemented for demonstration purposes and highlight vision-based perception and manipulation capabilities. These include physical interactions employing artificial general intelligence in virtual reality applications. We employ hand gesture tracking, as well as an Oculus Rift integrated gaze and eye tracking system. The resulting serious games should eventually cover daily life activities, which we additionally monitor. The dynamic and contextual modelling of obstacles are central issues, and capabilities required for serious games include knowledge about the 3D world. Such knowledge include gaze and hand sensors interpretations for multimedia information extraction in causal relationships. Towards this goal, we envision to make use of virtual reality with a physics engine (rigid and soft body dynamics including collision detection) for the observed objects. We also exploit semantic networks to enable the machine to filter information and infer ongoing complex events including hidden BDI (beliefs, desires, intentions) variables. We see this combination of employed technology as the relevant groundwork for reaching human-level general intelligence and to enable real-world applications. Future applications and user groups we target on include dementia patients.

Original languageEnglish
Title of host publicationPervasive Computing Paradigms for Mental Health - 5th International Conference, MindCare 2015, Revised Selected Papers
EditorsDimitris Giakoumis, Guillaume Lopez, Aleksandar Matic, Silvia Serino, Pietro Cipresso
PublisherSpringer Verlag
Pages220-229
Number of pages10
ISBN (Print)9783319322698
DOIs
Publication statusPublished - 2016
Event5th International Conference on Pervasive Computing Paradigms for Mental Health, MindCare 2015 - Milan, Italy
Duration: Sep 24 2015Sep 25 2015

Publication series

NameCommunications in Computer and Information Science
Volume604
ISSN (Print)1865-0929

Other

Other5th International Conference on Pervasive Computing Paradigms for Mental Health, MindCare 2015
CountryItaly
CityMilan
Period9/24/159/25/15

ASJC Scopus subject areas

  • Computer Science(all)
  • Mathematics(all)

Fingerprint Dive into the research topics of 'Maintain and improve mental health by smart virtual reality serious games'. Together they form a unique fingerprint.

  • Cite this

    Sárkány, A., Tősér, Z., Verő, A. L., Lőrincz, A., Toyama, T., Toosi, E. N., & Sonntag, D. (2016). Maintain and improve mental health by smart virtual reality serious games. In D. Giakoumis, G. Lopez, A. Matic, S. Serino, & P. Cipresso (Eds.), Pervasive Computing Paradigms for Mental Health - 5th International Conference, MindCare 2015, Revised Selected Papers (pp. 220-229). (Communications in Computer and Information Science; Vol. 604). Springer Verlag. https://doi.org/10.1007/978-3-319-32270-4_22