Candidate:
Mariana de Oliveira Magalhães
Date, Time and Location:
July 8, 10:00, Sala de Atos (I-105) DEEC, FEUP
President of the Jury:
João Manuel Paiva Cardoso, PhD, Full Professor, Departamento de Engenharia Informática, Faculdade de Engenharia, Universidade do Porto.
Members:
Alfredo Manuel dos Santos Ferreira Júnior, PhD, Associate Professor, Departamento de Engenharia Informática, Instituto Superior Técnico da Universidade de Lisboa;
Maria Beatriz Alves de Sousa Santos, PhD, Associate Professor with habilitation, Departamento de Eletrónica, Telecomunicações e Informática, Universidade de Aveiro;
Mário Sérgio Carvalho Teixeira, PhD, Assistant Professor, Departamento de Economia, Sociologia e Gestão, Universidade de Trás-os-Montes e Alto Douro;
António Fernando Vasconcelos Cunha Castro Coelho, PhD, Associate Professor with habilitation, Departamento de Engenharia Informática, Faculdade de Engenharia, Universidade do Porto (Supervisor);
António Augusto de Sousa, PhD, Associate Professor, Departamento de Engenharia Informática, Faculdade de Engenharia, Universidade do Porto.
The thesis was co-supervised by Doutor Maximino Bessa, Associate Professor with Habilitation, Universidade de Trás-os-Montes e Alto Douro.
Abstract
This thesis aims to explore how multisensory experiences in virtual reality influence users’ emotional responses and the vividness of their mental imagery, focusing on the impact of the demographics of gender and age. This thesis is driven by the recent rapid development of virtual reality in tourism, characterized by increasingly immersive multisensory experiences. It addresses the knowledge gap related to the limited understanding of how multisensory stimuli impact users’ emotional responses and their mental imagery ability, considering the particular case of virtual tourism.
Two immersive virtual experiences were developed for this purpose. Multisensory combinations of visual, auditory, haptic, olfactory, and taste stimuli were strategically integrated at specific stages of the two experiments, after being previously validated in a focus group session. One of these virtual experiences included a scenario intended to elicit positive emotions in the user by resorting to a selection of pleasant multisensory stimuli, designated as the “positive IVE” (positive Immersive Virtual Environment). The other experience sought the contrary: to induce negative emotions in the user through a combination of unpleasant multisensory stimuli, which was labeled as the “negative IVE” (negative Immersive Virtual Environment). The basic combination of visual and auditory stimuli was consistently used during the entire experiment. Additional stimuli – taste, haptic, and smell – were introduced one by one, sequentially. Finally, all these stimuli were combined for a comprehensive experience. A between-subjects experimental design was developed to explore and compare the users’ emotional responses and vividness of visual imagery after each stimuli combination in the two virtual experiences, resorting to in-VR questionnaires for data collection. Key findings include the impact of different positive and negative multisensory stimuli combinations on the users’ emotional responses, and how they, in turn, influence mental imagery. This research further suggests an inverse relationship between the intensity of the user’s emotions and their mental imagery ability. Nevertheless, neither age nor gender was found to influence this relationship in either the positive or negative scenarios. Additionally, this investigation provides insights into the specific emotions triggered by the used multisensory stimuli combinations, addressing a need long identified by various researchers in the field. This thesis contributes to understanding multisensory stimuli in virtual reality, highlighting its potential for application in various fields. It provides insights for future research in creating user-centered virtual reality tourism applications and understanding individual differences.
Keywords: Multisensory Virtual Reality; Virtual Reality; Emotional Responses; Vividness of Mental Imagery; Virtual Tourism.