X3S: A Multi-modal Approach to Monitor and Assess Stress through Human-computer Interaction

Filipe Gonçalves1, Davide Carneiro1, 2, José Pêgo3, 4 and Paulo Novais1

  1. Algoritmi Research Centre/Department of Informatics
    University of Minho, Braga, Portugal
    fgoncalves@algoritmi.uminho.pt, {dcarneiro,pjon}@di.uminho.pt
  2. CIICESI, ESTG, Polytechnic Institute of Porto
    Felgueiras, Portugal
  3. School of Health Sciences, Life and Health Sciences Research Institute (ICVS)
    University of Minho, Braga, Portugal
    jmpego@ecsaude.uminho.pt
  4. ICVS/3B’s - PT Government Associate Laboratory
    Braga / Guimarães, Portugal

Abstract

Stress evaluation is nowadays gaining an increasing importance in a time in which inter-individual competition continuously pushes us to be better. Indeed, in the workplace, in the academia or in many other contexts there is increasing pressure for better performance, which pushes us forward but also wears us out. This phenomenon has been studied from many different angles, including psychology, medicine or occupational dynamics. In a medical or biological context, stress is a physical, mental, or emotional factor that causes bodily or mental tension, which can cause or influence the course of many medical conditions including psychological conditions such as depression and anxiety. In these cases, individuals are under an increasing demand for performance, driving them to be under constant pressure, and consequently to present variations in their levels of stress. To mitigate this condition, this paper proposes to add a new dimension in human–computer interaction through the development of a distributed multi-modal framework approach entitled X3S, which aims to monitor and assess the psychological stress of computer users during high-end tasks, in a non-intrusive and non-invasive way, through the access of soft sensors activity (e.g. task performance and human behaviour). This approach presents as its main innovative key the capacity to validate each stress model trained for each individual through the analysis of cortisol and stress assessment survey data. Overall, this paper discusses how groups of medical students can be monitored through their interactions with the computer. Its main aim is to provide a stress marker that can be effectively used in large numbers of users and without inconvenience.

Key words

Human-computer Interaction, Behavioural & Performance Patterns, Machine Learning, Stress Monitoring & Assessment

Digital Object Identifier (DOI)

https://doi.org/10.2298/CSIS180115033G

Publication information

Volume 15, Issue 3 (October 2018)
Year of Publication: 2018
ISSN: 2406-1018 (Online)
Publisher: ComSIS Consortium

Full text

DownloadAvailable in PDF
Portable Document Format

How to cite

Gonçalves, F., Carneiro, D., Pêgo, J., Novais, P.: X3S: A Multi-modal Approach to Monitor and Assess Stress through Human-computer Interaction. Computer Science and Information Systems, Vol. 15, No. 3, 683–703. (2018), https://doi.org/10.2298/CSIS180115033G