PhD Thesis Defence in Digital Media (PDMD) | ”The Ironic Machine[s]: Speech Emotion Recognition Methods for Affective Virtual Environment Generation”

Candidate:
Jorge Federico Forero Rodríguez

Date, Time and Location:
8 July 2026, at 14:30, Sala de Atos of the Faculdade de Engenharia da Universidade do Porto

President of the Jury:
João Carlos Pascoal Faria (PhD), Full Professor of the Department of Informatics Engineering of the Faculdade de Engenharia da Universidade do Porto.

Members:
Nuno António do Nascimento Correia (PhD), Associate Professor at University of Tallinn, Estonia;
Hugo Gonçalo Oliveira (PhD), Associate Professor of the Department of Informatics Engineering, Faculdade de Ciências e Tecnologia da Universidade de Coimbra;
Nuno Manuel Robalo Correia (PhD), Full Professor of the Department of Informatics, Faculdade de Ciência e Tecnologia da Universidade Nova de Lisboa;
Mónica Sofia Santos Mendes (PhD), Assistant Professor with Habilitation, Faculdade de Belas-Artes da Universidade de Lisboa (Supervisor);
Tiago Barbedo Assis (PhD), Assistant Professor of the Department of Design, Faculdade de Belas-Artes da Universidade do Porto;
António Fernando Vasconcelos Cunha Castro Coelho (PhD), Associate Professor with Habilitation of the Department of Informatics Engineering, Faculdade de Engenharia da Universidade do Porto.

The thesis was co supervised by Gilberto Bernardes de Almeida, Assistant Professor of the Department of Informatics Engineering of the Faculdade de Engenharia da Universidade do Porto.

Abstract:

The Ironic Machine[s] is a practice-based research project that explores the use of a bimodal speech emotion recognition system for the generation of affective virtual environments and creative
computational artifacts. Situated at the intersection of media art, affective computing, and natural language processing, the study investigates how rhetorical figures such as kind irony and sarcasm emerge through the divergence between semantic and acoustic emotional predictions, and how this interaction can inform the construction of Affective Virtual Environments. The primary contribution of this thesis is the formulation and empirical evaluation of a method for analyzing illocutionary irony using multimodal speech emotion recognition datasets. Building on sentiment analysis and speech emotion recognition techniques, the research introduces a statistical inference framework that integrates perceptual evaluation with hypothesis-driven analysis to identify prosodic features that significantly differentiate sincere and ironic speech. For posed American English samples, the results demonstrate that divergences between semantic and acoustic emotional predictions can be systematically quantified, supporting the hypothesis that prosodic irony can be understood as a measurable multimodal phenomenon. A secondary objective investigates whether these findings can be translated into a generative strategy for constructing Affective Virtual Environments. To this end, a three-level prompt engineering framework is proposed, mapping semantic and acoustic emotional predictions onto audiovisual features informed by statistical analyses of musical and visual datasets. Perceptual evaluation indicates that feature-based prompting shows a consistent advantage over high-level emotional labels, although the results do not reach conventional levels of statistical significance. The investigation is realized through a series of nine technological and artistic iterations, developed as autonomous yet interconnected works. These projects function as experimental platforms for exploring emotional ambiguity, disorientation, and the instability of meaning in computational environments within a techno-poetic narrative. Collectively, this work proposes both a methodological framework for the analysis of irony and a speculative approach to affective environment generation. It positions divergence between modalities as an operational principle in multimodal systems and demonstrates how practice-based research can serve as a rigorous mode of inquiry into the relationship between human emotion and machine-mediated representation.

Keywords: Speech Emotion Recognition, Prosodic Irony, Affective Virtual Environments, Multimodal Analysis, Practice-based Research, Media Art.

PhD Thesis Defence in Digital Media (PDMD) | ”The Musical Work as a Mutable Interface: Towards a Co-Creative Electroacoustic Practice”

Candidate:
Nádia de Sousa Varela de Carvalho

Date, Time and Location:
6 July 2026, at 14:30, Room Professor Vasco de Sá (L119) at DEMec, Faculdade de Engenharia da Universidade do Porto

President of the Jury:
António Fernando Vasconcelos Cunha Castro Coelho (PhD), Associate Professor with Habilitation, Department of Informatics Engineering, Faculdade de Engenharia da Universidade do Porto

Members:
Diemo Schwarz (PhD), Researcher of the Institute for Research and Coordination in Acoustics/Music (IRCAM), France;
Rui Luís Nogueira Penha (PhD), Coordinating Professor, Escola Superior de Música e Artes do Espetáculo do Instituto Politécnico do Porto;
Sofia Carmen Faria Maia Cavaco (PhD), Assistant Professor, Informatics Departament, Faculdade de Ciências e Tecnologia da Universidade Nova de Lisboa;
António Humberto Sá Pinto (PhD), Invited Assistant Professor, Departament of Informatics Engineering, Faculdade de Engenharia da Universidade do Porto and Affiliated Researcher at the Institute of Systems and Computer Engineering, Technology and Science (INESC TEC);
Gilberto Bernardes de Almeida (PhD), Assistant Professor, Department of Informatics Engineering, Faculdade de Engenharia da Universidade do Porto (Supervisor).

Abstract:

This thesis investigates the ontological and performative shift of the musical work. In this sense, we propose using intelligent computational mediation to reconfigure it from a static artefact into a mutable interface. Historically, the Western musical tradition has been framed by the work-concept (werktreue), which crystallizes the composition as an immutable object preserved by the rigidity of the score or the phonographic medium. However, contemporary digital and electroacoustic practices demand new paradigmas that account for the fluid boundaries between composition, performance, and technological agency. Acknowledging that, this research proposes a transition from the static score to the navigable topological manifold. Rather than utilizing fixed musical notation, these spaces treat the musical work as a dynamic environment. In this environment, identity is preserved through structural fluidity, leading to a paradigm change to a contextual navigation model. In a symbiotic dialogue of real-time structural discovery, the machine provides a restricted, high-dimensional map of the work’s universe, which the performer navigates using their gestural intuition.

The methodology follows a mixed approach between experimental and practice-based research. This methodology operates over a reflective-iterative cycle, integrating software development with musical performance. The study is divided into two main phases: symbolic (tonal) and sub-symbolic (timbre) representation and navigation. In the first phase, variational autoencoders (VAEs) are used to compress symbolic polyphony. A critical milestone was the empirical alignment found between unsupervised VAE latent spaces and theoretical Discrete Fourier Transform (DFT) phase spaces. This alignment confirms that black box latent space models naturally discover structural principles consistent with established music theory, such as the circle of fifths. The second phase employs Neural Audio Synthesis (RAVE) to map the timbre landscape of the tenor saxophone into high-dimensional latent spaces. To navigate these spaces, the research introduces a taxonomy of musical motions (parallel, oblique, and contrary). These motions propose to connect abstract data and musical intent, enabling gestural navigation that honours performer agency.

The practical applicability of this research is materialized in BroadcastJSB and Aethra. The former, a web-based topological instrument, uses a radio metaphor for real-time navigation within J.S. Bach’s chorales’ latent space. The latter consists of a co-creative interface for mixed music that synthesizes multidimensional complexity into a single axis of performative control. The primary contribution of this work lies in the formalization of the mutable work as a space of possibilities. We also demonstrate musical intelligibility within deep learning models and create open-access tools and data repositories for the computer music research and contemporary performance communities. In summary, the thesis argues that the future of musical practice lies in improving human intuition through intelligent mediation. By doing this, we position the mutable interface as a key place for collaboration and creative exploration in today’s digital world.

Phd Thesis Defence in Digital Media (PDMD) | ”Digital Innovation in Healthcare in a Low-Resource Setting: The case of Mozambique”

Candidate:
Pinto Francisco Impito

Date, Time and Location:
19 June 2026, at 14:00, Sala de Atos, Faculdade de Engenharia da Universidade do Porto

Chair of the Examination Committee:
Pedro Nuno Ferreira da Rosa da Cruz Diniz (PhD), Full Professor in the Department of Informatics Engineering, Faculdade de Engenharia da Universidade do Porto.

Members:
Felisbela Maria Carvalho Lopes (PhD), Full Professor in the Department of Communication Sciences, Instituto de Ciências Sociais da Universidade do Minho;
Ivone Marília Carinhas Ferreira (PhD), Assistant Professor in the Department of Communication Sciences at the Faculdade de Ciências Sociais e Humanas da Universidade Nova de Lisboa;
Carla Susana Moiteiro Ganito Afonso (PhD), Associate Professor at the Faculdade de Ciências Humanas da Universidade Católica Portuguesa;
José Manuel Pereira Azevedo (PhD), Full Professor in the Department of Communication and Information Sciences at the Faculdade de Letras da Universidade do Porto (Supervisor);
Ricardo José Pinheiro Fernandes Morais (PhD), Assistant Professor in the Department of Communication and Information Sciences at the Faculdade de Letras da Universidade do Porto.

The thesis was co-supervised by Dr Vasco Francisco Japissane Cumbe, a lecturer at the Faculdade de Medicina da Universidade Católica de Moçambique.

Abstract:

Introduction:
The increasing complexity of health systems, combined with rapid technological advances, has transformed the ways digital tools are produced, disseminated, and used in healthcare. At the same time, the unprecedented availability of mobile devices and audiovisual resources has expanded access to technologies but also introduced new challenges, such as usage limitations due to structural and infrastructural issues, as well as inequalities in access.
Objective:
This study aimed to evaluate the implementation of digital technologies in health communication in Mozambique, focusing on the use of videos, with particular attention to doctor–patient interaction and medical training. The study implemented and assessed digital resources based on interactive simulation, education, and modeling, proposing a Mozambican digital innovation model adapted to the local context.
Methodology:
The research was conducted through three studies: (1) Interactive Simulation Video (ISV) in Medical Training, (2) Augmented Education Video (AEV) in Pre-ART Counseling for HIV-positive patients, and (3) Modeling Video (MV) in Rehabilitation Strategies. Study 1 evaluated the usability, educational value, and interactive experience of the ISV with medical students (N = 93), using an exploratory sequential approach. Study 2 employed a quasi-experimental design with an intervention group (IG = 23) and a comparison group (CG = 23), involving HIV-positive patients, using the Mann–Whitney U test to compare dimensions related to counseling quality. Study 3 followed a longitudinal design, with pre- and post-intervention assessments, to evaluate the impact of the MV on caregivers’ execution of motor recovery exercises for patients with stroke.
Results:
The studies revealed (1) high levels of agreement regarding realism, clinical relevance, and pedagogical usefulness (ISV); (2) statistically significant differences between groups (IG, CG) concerning time spent on care, appropriateness of counseling format, and decision-making for ART adherence (AEV); and (3) meaningful improvements after the intervention in strengthening practical learning and confidence in performing motor recovery procedures (MV). Overall, the research demonstrated that the structured and adapted use of digital resources, as proposed in this thesis, has high potential to transform communication processes in resource-limited environments.
Conclusion:
The research highlights the importance of structured and adapted integration of digital media in resource-limited contexts. Future investigations should explore more robust experimental designs, with larger samples and longitudinal follow-up, as well as assess the impact of these interventions on real clinical practice and treatment adherence indicators. The consolidation of the Mozambican digital innovation model can advance sustainable health education policies and promote the digital transformation of medical training in Mozambique.

Keywords: Digital innovation; Video; Medical Education; doctor–patient interaction; Mozambique.

PhD Thesis Defence in Informatics Engineering (ProDEI): ”Generative Approaches for Case-Based Explanations in Medical Image Analysis”

Candidate:
Maria Helena Sampaio de Mendonça Montenegro e Almeida

Date Time and Location:
16 June 2026, 14:30, Sala de Atos, Faculdade de Engenharia da Universidade do Porto

President of the Jury:
Carlos Miguel Ferraz Baquero-Moreno (PhD), Full Professor at the Department of Informatics Engineering of the Faculdade de Engenharia da Universidade do Porto

Members:
Peter Johannes Schüffler (PhD), Professor at the Technical University of Munich, Germany;
Carlos Jorge Andrade Mariz Santiago (PhD), Research Assistant at the Robotics and Engineering Systems Laboratory (LARSyS) and Invited Assistant Professor of the Department of Electrical and Computer Engineering of the Instituto Superior Técnico da Universidade de Lisboa;
Jaime dos Santos Cardoso (PhD), Full Professor of the Department of Electrical and Computer Engineering of the Faculdade de Engenharia da Universidade do Porto (Supervisor);
Luís Filipe Pinto de Almeida Teixeira (PhD), Associate Professor of the Department of Informatics Engineering of the Faculdade de Engenharia da Universidade do Porto.

Abstract:

Artificial Intelligence models have been extensively applied to medical image analysis tasks over the past years, achieving outstanding results. However, the obscure reasoning of the models and the lack of supportive evidence causes both clinicians and patients to distrust their predictions, hindering their adoption in clinical practice. In recent years, the research community has focused on developing explanations capable of revealing a model’s reasoning. Among the various types of explanations, case-based explanations emerged as particularly intuitive for medical practitioners. While these types of explanations have been widely researched, they still possess limitations that compromise their real-world application. The main goal of this thesis is to overcome the limitations of medical case-based explanations, enabling their deployment in clinical practice.

To identify the main weaknesses of case-based explanations, we conduct a literature review on models that provide such explanations in healthcare. Through the analysis of existing works, we verify that the explanations raise privacy concerns by sharing sensitive images of patients, and lack the interactiveness required for clinicians to engage with the explanation. Furthermore, most works do not evaluate nor clinically validate the explanations through user studies with clinicians. Targeting these limitations, we propose deep generative models to obtain privacy-preserving, controllable and interactive explanations to explain the decisions of deep learning models.

To propose a privacy-preserving system for safely sharing case-based explanations, we start by reviewing the literature on image anonymisation techniques and identifying their vulnerabilities. In particular, we identify vulnerabilities by proposing two privacy attacks: a membership inference attack targeting deep generative models that generate synthetic images, and a superimposed image decomposition model to reverse the common anonymisation strategy of image averaging. After outlining the requirements that a privacy-preserving system for medical case-based explanations must fulfil, we propose privacy-preserving models capable of simultaneously anonymising medical images and generating counterfactual explanations. The proposed models rely on disentangled representation learning to separate identity and clinical traits, enabling their individual manipulation. Through this strategy, we can also separate and manipulate causal factors related with the clinical task to obtain controllable counterfactual explanations. To obtain interactive counterfactual explanations, we propose models to manipulate regions of medical images according to a segmentation mask, measuring their impact on a prediction. To evaluate the proposed models, we perform experiments on medical datasets like chest radiographs, verifying the models’ capacity to manipulate medical images for the purposes of generating explanations.

Finally, to show the wide applicability of the proposed models beyond their original purpose of generating case-based explanations, we apply them as decision-support systems in healthcare. More specifically, we adapt the models for predicting the aesthetic outcomes of breast cancer treatment, to facilitate the patients’ choice of treatment. Furthermore, we conduct a clinical study with breast surgeons from various health institutes to assess the predictions of the proposed models.

To conclude, through various contributions on explainable Artificial Intelligence and decision-support systems, this thesis contributes towards the safe use of trustworthy and privacy-preserving Artificial Intelligence models in healthcare.

Phd Thesis Defence in Digital Media (PDMD): ”The Fourier Qualia Space: Interaction, Ambiguity, and Hierarchy in Music Harmony”

Candidate: Samuel Filipe da Silva Pereira Oliveira

Date, Time and Location:
15 June 2026, at 14:30, in Sala de Atos of the Faculty of Engineering of the Universidade do Porto

President of the Jury:
António Fernando Vasconcelos Cunha Castro Coelho (PhD), Associate Professor with Habilitation, Department of Informatics Engineering at the Faculty of Engineering, Universidade do Porto.

Members:
Matt Chiu (PhD), Assistant Professor of Music Theory of the Baldwin Wallace University, United States of America;

Martin Alois Rohrmeier (PhD), Associate Professor of the Digital and Cognitive Musicology Lab at the EPFL – Swiss Federal Institute of Technology, Switzerland;

Isabel Maria Antunes Pires (PhD), Assistant Professor, Department of Musical Sciences at the Faculty of Social and Human Sciences, Universidade Nova de Lisboa;

Gilberto Bernardes de Almeida (PhD), Assistant Professor, Department of Informatics Engineering at the Faculty of Engineering, Universidade do Porto (Supervisor);

António Humberto Sá Pinto (PhD), Invited Assistant Professor, Department of Informatics Engineering at the Faculty of Engineering, Universidade do Porto.

The thesis was co-supervised by José António Oliveira Martins (PhD), Assistant Professor at the Faculty of Arts of the Universidade de Coimbra.

Abstract:

Music theory has long recognised harmonic qualities and developed tools for their analytical identification, yet existing frameworks provide no unified method for measuring their relative proportions, representing them within ambiguous passages, or comparing their deployment across distinct repertoires that currently demand separate methodologies. These limitations manifest differently across analytical traditions. Tonal analysis captures functional relationships effectively, yet falters when triads or diatonic collections appear without the progressions that would render them functional. Set theory provides rigorous measurement through interval vectors and set-class membership, yet fails to explain why two sonorities sound different whilst sharing identical interval vectors. What unites these shortcomings is a common conceptual gap: none of these frameworks treats ambiguity—passages where multiple harmonic qualities coexist—as a compositional resource.

To address these limitations, this thesis developed the Fourier Qualia Space, a geometrical framework that reconceptualises harmonic qualities as measurable qualia relationships within mathematically determined space. The discrete Fourier transform converts pitch-class sets into coefficients capturing specific harmonic qualities, which dimensional reduction then projects into a hexagonal space where proximity signals qualia resemblance and centrality denotes ambiguity. This geometric representation enables analysis at multiple scales, ranging from phrase-level examination of Schoenberg’s Op. 19/1, through hierarchical wavescape constructions for Bach, Debussy, and Webern, to diachronic corpus analysis spanning 1548–1968.

Applying this methodology across four centuries of Western music confirmed progressive dissolution of traditional tonal structures and provided novel quantitative evidence for how alternative organisational principles emerged: qualia sequences converged progressively towards Zipfian distributions characteristic of efficient communication systems. Among composers whose distributions most closely approximate this pattern, Debussy emerged as a paradigmatic case: statistical analysis of his harmonic practice identified three systematic roles governing qualia deployment, demonstrating that his music operates through identifiable organisational principles. Most significantly for the conceptual reframing proposed at the outset, qualia ambiguity functions not as analytical indeterminacy but as a compositional resource deployed strategically across the repertoires examined.

These findings carry broader implications. The identification of language-like patterns in Debussy’s deployment of harmonic qualia exemplifies what the Fourier Qualia Space makes possible: if one composer working without tonal syntax constraints nonetheless deployed harmonic qualities according to measurable principles, others may have done likewise—a hypothesis the framework can now test across stylistic boundaries that previously demanded entirely separate methodologies.

Keywords: Fourier Qualia Space; harmonic qualia; qualia ambiguity; discrete Fourier transform; Zipf’s law; harmonic syntax; computational musicology.

 

PhD Defense in Informatics Engineering (ProDEI): ”Modular and Multi-Stage Semantic Perception System for Robotics”

Candidate:
Bruno Georgevich Ferreira

Date, Time and Location:
27 February 2026, at 14:00, in Sala de Atos

President of the Jury:
Pedro Nuno Ferreira da Rosa da Cruz Diniz (PhD), Full Professor at the Faculdade de Engenharia da Universidade do Porto

Members:
João Alberto Fabro (PhD), Associate Professor at the Academic Department of Informatics (DAINF) of the Federal Technological University of Paraná, Brazil;
Rui Paulo Pinto da Rocha (PhD), Associate Professor at the Department of Electrical and Computer Engineering of the Faculdade de Ciências e Tecnologia da Universidade de Coimbra;
André Monteiro de Oliveira Restivo (PhD), Associate Professor at the Department of Informatics Engineering of the Faculdade de Engenharia da Universidade do Porto;
Armando Jorge Miranda de Sousa (PhD), Associate Professor at the Department of Electrical and Computer Engineering of the Faculdade de Engenharia da Universidade do Porto (Supervisor).

The thesis was co-supervised by Luís Paulo Gonçalves dos Reis (PhD), Associate Professor in the Department of Informatics Engineering of the Faculdade de Engenharia da Universidade do Porto.

Abstract:

The evolution of autonomous robotics benefits largely from the capacity to construct rich, navigable, and semantic representations of the environment, even more so if shared with humans. While the advent of open-vocabulary scene graphs powered by Vision-Language Models (VLMs) has revolutionized perception, these systems face critical hurdles: high rates of hallucinations (False Positives), a lack of topological spatial context, and operational fragility due to heavy reliance on cloud connectivity. This thesis proposes the Hybrid Inference Perception and Mapping System
(HIPaMS), framework adaptable to a target system, likely a robotic system that interacts with humans. The HIPaMS is a modular framework designed to bridge the gap between low-level perception and high-level agentic reasoning. A Proof of Concept (PoC) was designed to implement the HIPaMS. This PoC enhances the state-of-the-art ConceptGraphs semantic mapping process and introduces a refined interaction system through four main contributions. First, it introduces the Hybrid Adaptable Resource-Aware Inference Mechanism (HARAIM), which dynamically orchestrates internal models and settings based on runtime resource availability and optimization policies. This mechanism allows any optimization policy to adapt robotic system’s operation, possibly allowing zero downtime during network failures, graceful degradation and/or operational efficiency. Second, the semantic mapping pipeline is enhanced with rigorous False Positive filtering protocols, persona-based prompt engineering, and a broad collection of semantic information in an optimized manner during mapping. Third, a Room Semantic Segmentation Routine is proposed to provide topological information to the semantic map during interaction. This transforms unstructured, noisy detections into a hierarchically organized scene graph, anchoring objects within functional topological regions. Fourth, the robotic system now incorporates dynamic knowledge base via the Human-in-the-Loop (HITL) Agentic Retrieval-Augmented Generation (RAG)-based Interaction System (HARBIS). This interface uses short- and long-term memory to understand complex natural language queries. It enables the robot to learn continuously from user interactions, address gaps in perception and knowledge, maintain temporal consistency, and acknowledge its limitations by proactively asking for clarification. Extensive validation was conducted across 30 diverse environments, involving a total of 3300 interactive requests (depend on semantic map quality). The tested PoC processed 110 user requests per environment, categorized into: direct (30), indirect (30), graceful failure (30), follow-up (10) and time consistency (10). An ablation study was also performed to identify the impact of specific framework and PoC components. The results show that the PoC reduces False Positive detections by ≈86%, elevating mapping precision from a baseline of ≈ 0.28 to ≈ 0.68. Although strict filtering reduces raw recall, the integration of HITL learning increased the success rate for complex query resolution to ≈ 0.81, compared to baseline values of ≈ 0.48 and ≈ 0.55. Furthermore, the HIPaMS PoC reduced cloud inference costs by up to ≈ 84% in mapping and over ≈ 95% in interaction tasks while ensuring system stability. The presented framework pave the way for increased robotic autonomy and efficiency. The presented PoC demonstrates superior performance, particularly for human-centered scenarios.

Keywords: Semantic Mapping; Open-Vocabulary Perception; Hybrid Inference Architecture; Adaptable Framework; Human-in-the-Loop; Retrieval-Augmented Generation (RAG); Topological Segmentation; Robot@VirtualHome; Vision-Language Models; Agentic AI; Operational Robustness.

PhD Defense in Informatics Engineering (ProDEI): ”Low-Resource Machine Translation for Emakhuwa: Transfer Learning, Data Augmentation, and Lexical Resource Integration”

Candidate:
Felermino Dário Mário António Ali

Date, Time and Location:
20 February 2026, 14:00, Sala de Atos da Faculdade de Engenharia da Universidade do Porto

President of the Jury:
Pedro Nuno Ferreira da Rosa da Cruz Diniz (PhD), Full Professor, Faculdade de Engenharia da Universidade do Porto

Members:
Maarit Tuulikki Koponen (PhD), Professor at the School of Humanities of the Philosophical Faculty of the University of Eastern Finland (Finland);
Maria Luísa Torres Ribeiro Marques da Silva Coheur (PhD), Associate Professor, Departamento de Engenharia Informática, Instituto Superior Técnico da Universidade de Lisboa;
Sérgio Sobral Nunes (PhD), Associate Professor, Departamento de Engenharia Informática, Faculdade de Engenharia da Universidade do Porto;
Henrique Daniel de Avelar Lopes Cardoso (PhD), Associate Professor, Departamento de Engenharia Informática, Faculdade de Engenharia da Universidade do Porto (Supervisor).

The thesis was co-supervised by Rui Manuel Sousa Silva (PhD), Assistant Professor at Faculdade de Letras da Universidade do Porto.

Abstract:

“This research explores the underrepresentation of low-resource languages in the field of machine translation, with a specific focus on Emakhuwa, the most widely spoken local language in Mozambique. Despite having over 7 million native speakers, Emakhuwa remains underrepresented in both academia and technology due to a lack of digital resources and linguistic tools. To fill this gap, we have developed the first significant machine translation resources for the Portuguese–Emakhuwa language pair. Our contributions include the creation of a parallel corpus through the manual translation of journalistic texts, the digitisation of existing materials, and the translation of established machine translation evaluation benchmarks. We evaluated three central strategies to improve machine translation performance in this low-resource setting: (1) transfer learning using multilingual and Africa-centred models, (2) data augmentation through back-translation, and (3) integration of external linguistic resources such as loan glossaries and bilingual dictionaries. The results show that encoder-decoder models, particularly translation-optimised architectures such as NLLB and M2M-100, perform as well as or better than larger decoder-only models while maintaining computational efficiency. Back-translation offers modest improvements, and the integration of loanwords and dictionary resources, especially in the Portuguese-Emakhuwa direction, significantly improves translation quality, especially with the use of LLMs. This work lays the foundation for future research in NLP for underrepresented languages and demonstrates practical paths for the development of machine translation systems in resource-limited contexts.”

PhD Defense in Digital Media (PDMD): ”Cultivando a empatia digital: o potencial da produção de narrativas áudio”

Candidate:
Ivone Manuela Neiva Santos

Date, Time and Location:
29 January 2026, 14:30, Sala de Atos da Faculdade de Engenharia da Universidade do Porto

President of the Jury:
António Fernando Vasconcelos Cunha Castro Coelho (PhD), Associate Professor with Habilitation from Faculdade de Engenharia, Universidade do Porto

Members:
Marisa Rodrigues Pinto Torres da Silva (PhD), Full Professor, Faculdade de Ciências Sociais e Humanas, Universidade Nova de Lisboa;
Maria Madalena da Costa Oliveira (PhD), Associate Professor, Instituto de Ciências Sociais, Universidade do Minho;
Maria José Lisboa Brites de Azeredo (PhD), Associate Professor with Habilitation, Faculdade de Comunicação, Arquitetura, Artes e Tecnologias da Informação, Universidade Lusófona;
Ana Isabel Crispim Mendes Reis (PhD), Associate Professor, Department of Communication and Information Sciences, Faculdade de Letras, Universidade do Porto (Supervisor);
Ricardo José Pinheiro Fernandes Morais (PhD), Assistant Professor, Department of Communication and Information Sciences, Faculdade de Letras, Universidade do Porto.

The thesis was co-supervised by José Manuel Pereira Azevedo (PhD), Full Professor, Department of Communication and Information Sciences, Faculdade de Letras, Universidade do Porto.

Abstract:

Empathy, which is defined as the ability to understand and share the emotional state of others, is considered to be fundamental to both personal well-being and social cohesion. Its presence has been linked to pro-social behaviour, while its absence has been associated with a greater predisposition to aggressive behaviour. Empathy is a multidimensional construct integrating affective and cognitive components, and educational interventions appear to positively influence its development. While cognitive empathy is generally considered to be more sensitive to education, the affective component appears to benefit from emotional activities. Empathy is now considered a vital skill for the ‘digital citizen’, but research suggests that empathy displayed online is lower than empathy displayed offline. Tendencies such as inattention, desensitisation and disinhibition, which are stimulated by the internet, seem to make empathy more difficult to achieve. The fact that empathic capacity primarily develops towards the end of adolescence highlights the importance of exploring strategies to foster it throughout education, particularly in an era where digital technology is becoming increasingly prevalent in all areas of social life. This scenario highlights the need to deepen our understanding of digital empathy and consider strategies for promoting it in education. This is reflected in the objectives that guided this thesis. The research underlying this thesis includes a review of the literature on empathy and the methodologies employed to study and encourage it. It features a critical analysis of the role of screens in young people’s daily lives, as well as of the different approaches to the relationship between empathy and digital technology. Given that sound is a privileged vehicle for emotional connection with characteristics that make it resilient to digital environments, the review also explores the literature on the potential of auditory stimuli and audio narratives to promote empathy. Supported by this review, the empirical research comprises two studies: a descriptive study and a quasi-experimental study. These studies involved three educational institutions at different levels and students in the adolescent age group (10–24 years). A total of 279 students participated in the descriptive study and 228 in the quasi-experimental study, of whom 76 were in the experimental group. The descriptive study measured and compared participants’ empathy and digital empathy using a questionnaire based on self-report scales previously used in empathy research with this age group. The quasi-experimental study assessed the impact of an educational programme designed to explore the potential of sound and narrative. Based on the experience-based learning model, the programme combined technical and socio-emotional learning through Media Education. It is organised into two modules. The first module consists of a set of group dynamics exploring the theme of empathy and its relationship with digital environments and auditory stimuli. The second module considers the process of producing audio narratives with emotional content. The intervention’s impact was assessed both quantitatively, via pre- and post-test surveys, and qualitatively, through analysis of the narratives and other texts produced by participants throughout the programme. Overall, the results of the descriptive study indicate that digital empathy is lower than general empathy, with the affective component being lower than the cognitive component on both scales. The results also show that girls have higher levels of both empathy and digital empathy. Age appears to be a differentiating factor in empathy levels, but not in digital empathy. Results suggest that digital empathy does not increase significantly during adolescence, unlike general empathy. These results therefore support the need for educational interventions to stimulate empathy from early adolescence onwards addressing its multidimensionality and various contexts. The quantitative impact of participation in the educational programme evaluated in the quasi-experimental study was not significant. Nevertheless, a qualitative analysis of the data suggests that participation in the programme provided an opportunity to experiment with different empathic practices. The programme can therefore be considered a tool that facilitates the reconciliation of technical learning with the development of empathy. This tool can be applied to different stages of adolescence, levels of education, and school contexts. The findings of this research reiterate the concerns expressed in existing literature about the impact of digital environments on empathy development among young people. The 0findings suggest that programmes based on producing audio narratives with emotional content could promote empathy in educational contexts, addressing the constraints imposed by digital environments. Based on these findings, this research has produced a manual to disseminate the tested educational model and a validated instrument to measure empathy and digital empathy in Portuguese. To our knowledge, this is the first questionnaire of its kind to enhance sound stimuli.

Keywords: digital empathy; audio production; narrative; education.

PhD Defense in Digital Media (PDMD): ”Hibridismo Urbano-Digital e Bem-Estar Social: Estratégias para Fortalecer a Conexão Social nas Cidades”

Candidate:
Acilon Himercírio Baptista Cavalcante

Date, Time and Location:
26 January 2026, 14:30, Room Professor Joaquim Sarmento (G129), Department of Civil and Georesources Engineering, Faculdade de Engenharia da Universidade do Porto

President of the Jury:
António Fernando Vasconcelos Cunha Castro Coelho (PhD), Associate Professor with Habilitation, Faculdade de Engenharia da Universidade do Porto

Members:
Isabel Alexandra Reis Gonçalves Ferreira (PhD), Researcher at the Centre for Social Studies, Universidade de Coimbra;
Ivone Marília Carinhas Ferreira (PhD), Assistant Professor, Department of Communication Sciences, Faculdade de Ciências Sociais e Humanas, Universidade Nova de Lisboa;
Ana Isabel Barreto Furtado Franco de Albuquerque Veloso (PhD), Full Professor, Department of Communication and Art, Universidade de Aveiro;
José Manuel Pereira Azevedo (PhD), Full Professor, Department of Communication and Information Sciences, Faculdade de Letras, Universidade do Porto (Supervisor);
Maria Van Zeller de Macedo de Oliveira e Sousa (PhD), Invited Assitant Professor, Department of Informatics Engineering, Faculdade de Engenharia, Universidade do Porto and Researcher at the Instituto de Engenharia de Sistemas e Computadores, Tecnologia e Ciência (INESC TEC).

Abstract:

This thesis investigates the promotion of social well-being in cities through the concept of urban-digital hybridity, which considers social and spatial interactions—whether physical and/or digital—as inseparable in the urban context. Based on an integrative literature review, a set of indicators was identified and categorised to more comprehensively assess the effectiveness of public policies aimed at improving quality of life in technology-mediated urban environments.
The review of indicators combined traditional methodologies—such as those used in the World Happiness Report, published by the United Nations—with metrics related to physical and mental health, community participation, perception of safety, and cultural vitality, while also incorporating emerging variables derived from the use of digital media. The research methodology adapted the mapping and critical analysis of these indicators to Marichela Sepe’s Cartography of Happiness, applying it to contexts of urban-digital hybridity and combining it with empirical digital placemaking experiments.
Case studies and digital placemaking experiences were conducted in the cities of Porto and Póvoa de Varzim, involving local communities, religious institutions, and schools, exploring technological mediation as a catalyst for social bonds and the activation of public spaces. Heatmaps of interactions, together with qualitative field data, allowed the identification of correlations between patterns of urban activation, city morphology, and landscape.
As its main outcome, the research proposes three core metrics for assessing social well-being in hybrid cities: Sense of Belonging, Sense of Place, and Sense of Community, analysed in their urban, digital, and hybrid dimensions.
The thesis’ main contribution is an integrated model for assessing urban social well-being, combining physical and digital metrics to provide an operational framework for urban planning and public policy design, aiming to foster more inclusive, participatory, and well-being-oriented cities.

PhD Defense in Informatics Engineering (ProDEI): ”Novel Computational Methodologies for Detailed Analysis of Human Motion from Image Sequences”

Candidate:
João Ferreira de Carvalho Castro Nunes

Date, Time and Location:
12th December 2025, at 14:00, in Sala de Atos of the Faculdade de Engenharia da Universidade do Porto

President of the Jury:
Pedro Nuno Ferreira da Rosa da Cruz Diniz, Full Professor at the Department of Informatics Engineering of the Faculdade de Engenharia da Universidade do Porto

Members:
Carlos Miguel Fernandes Quental (PhD), Assistant Professor at the Department of Mechanical Engineering, Instituto Superior Técnico, Universidade de Lisboa;
Hugo Pedro Martins Carriço Proença (PhD), Full Professor at the Department of Computer Science, Universidade da Beira Interior;
João Manuel Ribeiro da Silva Tavares (PhD), Full Professor at the Department of Mechanical Engineering, Faculdade de Engenharia, Universidade do Porto (Supervisor);
Luís Paulo Gonçalves dos Reis (PhD), Associate Professor with Habilitation at the Department of Informatics Engineering, Faculdade de Engenharia, Universidade do Porto.

The thesis was co-supervised by Pedro Miguel do Vale Moreira (PhD), Full Professor at the Instituto Politécnico de Viana do Castelo.

Abstract:

Human gait analysis provides critical information on biomechanical function, clinical assessment, and biometric recognition, but achieving accurate and reproducible motion understanding under real-world variability remains a major challenge. Traditional motion capture techniques are dependent on expensive infrastructure and controlled environments, which limit scalability and realworld validity. This thesis addresses these limitations by developing computational methodologies that exploit both RGB and depth information to enable robust, efficient, and fully automatic gait analysis using consumer-grade sensors. The research followed a structured trajectory that encompasses dataset creation, representation design, and methodological innovation. First, an extensive review and comparative analysis of existing vision- and depth-based gait datasets identified gaps in modality diversity, annotation quality, and accessibility. To address these issues, the Gait Recognition Image and Depth Dataset (GRIDDS) was designed, acquired, and publicly released. GRIDDS provides synchronized RGB, depth, silhouette, and 3D skeletal data from 35 participants recorded under controlled conditions, establishing one of the first standardized multi-modal benchmarks for gait analysis and recognition. Building on this foundation, two novel computational gait representations were introduced that fuse two-dimensional appearance cues with three-dimensional skeletal structure to increase robustness to viewpoint, clothing, and carried-object variations. These Gait Skeleton Image (GSI) variants (joint-based and line-based) were integrated within deep learning frameworks and evaluated through extensive experiments, demonstrating competitive and, under certain circumstances, superior performance compared with established appearance-based methods across multiple datasets and covariate conditions. Finally, new methods for gait silhouette interpolation were introduced, combining deterministic geometric reasoning (BRIEF) and bidirectional deep learning (BiSINet) to reconstruct missing frames and enhance temporal coherence. The proposed interpolation techniques significantly improved downstream recognition accuracy and demonstrated strong generalization across datasets and frame-rate conditions. Collectively, the contributions of this work, which span multi-modal data acquisition, robust gait representation learning, and temporal reconstruction, advance the scientific and technological frontiers of human gait analysis, promoting reproducibility, accessibility, and applicability in both clinical and computer vision domains.