PhD Defence in Digital Media: “Integration of models for linked data in cultural heritage and contributions to the FAIR principles”

Candidate:
Inês Dias Koch

Date, Time and Location
1st of July 2025, 14:30, Sala de Atos da Faculdade de Engenharia da Universidade do Porto

Title:
“Integration of models for linked data in cultural heritage and contributions to the FAIR principles”

President of the Jury:
João Carlos Pascoal Faria (PhD), Full Professor, Department of Informatics Engineering, Faculdade de Engenharia da Universidade do Porto.

Members:
Maja Žumer (PhD), Full Professor, Department of Library and Information Science of the University of Ljubljana, Slovenia;

María Poveda Villalón (PhD), Associate Professor, Departament of Artificial Intelligence of the Technical University of Madrid, Spain;

José Luís Brinquete Borbinha (PhD), Full Professor, Department of Computer Science and Engineering, Instituto Superior Técnico da Universidade de Lisboa;

Pedro Manuel Rangel Santos Henriques (PhD), Full Professor, Department of Informatics, Escola de Engenharia da Universidade do Minho;

Carla Alexandra Teixeira Lopes (PhD), Associate Professor, Department of Informatics Engineering, Faculdade de Engenharia da Universidade do Porto (Supervisor);

Mariana Curado Malta (PhD), Assistant Professor, Department of Informatics Engineering, Faculdade de Engenharia da Universidade do Porto.

The thesis was co-supervised by Maria Cristina de Carvalho Alves Ribeiro (PhD), Retired Associate Professor in the Department of Informatics Engineering, Faculdade de Engenharia da Universidade do Porto.

Abstract:

The various areas of Cultural Heritage, such as archives, museums, and libraries, have invested in tech-
nological development and innovation to make their resources available to users more efficiently and completely. To this end, the description of these resources is essential so that they are explained in
terms of their context and content, as well as to facilitate their intelligibility and accessibility. In this
sense, each area has begun to develop its own models and standards for describing the cultural objects
it deals with. This has made these standards sector-specific and only able to fulfil the information needs
within the area of knowledge they were developed, exploring only the information described within their
domain. As a result, linking resources from different information sources is challenging.
With the need to make the standards and models more interoperable, linked data models emerged in
Cultural Heritage. These models make it possible to link the various concepts from the different heritage
areas efficiently and effectively, considering the Semantic Web’s characteristics.
In Portugal, the Portuguese National Archives felt the need to develop a linked data model to describe
their cultural objects, which led to the creation of the EPISA Project, the project from which this research
emerged. Thus, this work aims to develop a linked data model to describe archival records, as well as to
connect them with other heritage domains, integrating them with existing linked data models, promoting
the access and reuse of data from heritage institutions based on the specialised description associated
with the cultural objects of these institutions. Additionally, it aims to link existing data models to data from other sources available on the Web, such as Wikidata and DBpedia.
We carry out a study that includes existing data models in Cultural Heritage, such as CIDOC CRM
in museums, RiC-CM in archives, and LRMoo in libraries, along with models that have emerged within
Web projects, such as DBpedia and Wikidata. By describing archival objects, as well as creating and
exploring relationships between other data models, this study identifies common characteristics and
principles, as well as the distinctive aspects of each area. Furthermore, it identifies the possibility of linking elements of the various models, ensuring that the models can be adapted to applications without losing the richness of the conceptualisation carried out in each of the domains.
In a context in which the Web promotes the explicitness of data semantics through the Semantic
Web and provides tools to represent it, it is necessary, on the one hand, to create links between models from different communities and, on the other, to adjust the complexity of each model to each application according to its specific requirements. The FAIR Principles (Findable, Accessible, Interoperable, Reusable) were therefore used as one of the sources for the requirements that data and metadata must fulfil to have a modular structure. We bring together a collection of use cases linked to archives users, including profiles ranging fromcollection managers to heritage promoters and informal users. In addition, we compile and evaluate a set of data modelling experiences using different models.
This work resulted in ArchOnto, a modular ontology that describes archive records. It was developed
considering existing archive standards and validated by experts in the field, specifically archivists from the Portuguese National Archives. ArchOnto is based on CIDOC CRM, combined with four other
specific ontologies also developed in this work.
The development of ArchOnto led to the creation of a prototype platform designed to explore and
manipulate archive records. Additionally, it offers the potential to apply this ontology to other domains, specifically to the representation of cinematographic records.

Keywords: Cultural Heritage; Linked Open Data; Data Integration; Semantic Web; FAIR Principles; Digital Humanities.

PhD Defence in Informatics Engineering: ”Towards Continuous Certification of Software Systems for Aerospace”

Candidate:
José Eduardo Ferreira Ribeiro

Date, Time and Location:
30th of June 2025, 14:30, Sala de Atos, Faculdade de Engenharia da Universidade do Porto

Title:
”Towards Continuous Certification of Software Systems for Aerospace”

President of the Jury:
Rui Filipe Lima Maranhão de Abreu (PhD), Full Professor, Department of Informatics Engineering, Faculdade de Engenharia da Universidade do Porto.

Members:
Miguel Mira da Silva (PhD), Full Professor, Department of Computer Science and Engineering, Instituto Superior Técnico da Universidade de Lisboa;

João Miguel Lobo Fernandes (PhD), Full Professor, Departament of Informatics, Escola de Engenharia da Universidade do Minho;

João Carlos Pascoal Faria (PhD), Full Professor, Department of Informatics Engineering, Faculdade de Engenharia da Universidade do Porto;

João Gabriel Monteiro de Carvalho e Silva (PhD), Full Professor, Department of Informatics Engineering, Faculdade de Ciências e Tecnologia da Universidade de Coimbra (Co-Supervisor).

The thesis was supervised by Ademar Manuel Teixeira de Aguiar (PhD), Associate Professor of the Department of Informatics Engineering, Faculdade de Engenharia da Universidade do Porto.

Abstract:

Since the publication of the Agile Manifesto in 2001, Agile methods have evolved to become the dominant approach in software development across diverse domains. However, their adoption in safety-critical systems development, such as aerospace, remains limited for reasons usually attributed to the stringent regulatory safety requirements imposed by domain-specific standards. This dissertation explores the applicability of Agile methods within the context of safety-critical aerospace software development, specifically under the guidelines of the DO-178C standard, and concludes that, contrary to common belief, Agile methods can be effectively used also in this context. The DO-178C standard, titled Software Considerations in Airborne Systems and Equipment Certification, is the principal certification guideline for aviation software for agencies such as Federal Aviation Administration (FAA) and European Union Aviation Safety Agency (EASA).

A key observation from discussions with professionals across different organizations and industries with strong safety requirements, including space, aerospace, railway, automotive, energy, and defence, is the widespread perception that traditional methods like the Waterfall model are indispensable, if not mandatory, for compliance and successful certification. This perception derives from the rigorous safety-related evidence required for certification. In aerospace software development, the minimal adoption of Agile methods and practices is attributed to the demands of DO-178C, regarded as a restrictive standard. However, contrary to this belief, DO-178C does not mandate any specific development method but instead provides guidelines and objectives to achieve the necessary safety-related evidence. This flexibility opens the possibility for Agile methods to be adapted to meet certification requirements while offering their well-documented advantages of incremental delivery and adaptability to changing requirements.

This research examines whether Agile methods, particularly the Scrum framework, can be effectively integrated into the development of safety-critical aerospace software systems while maintaining full compliance with DO-178C. The study introduces Scrum4DO178C, a novel Agile-friendly process tailored to address the specific challenges of aerospace software development, including its extensive verification and validation (V&V) efforts. Through a comprehensive review of literature, industry practices and data, as well as real-world insights from an industrial case study involving a critical aerospace project (Software Level A – Catastrophic), the research evaluates the feasibility and benefits of this approach. The case study demonstrates that Scrum4DO178C improves project performance, enhances responsiveness to changing requirements and reduces V&V efforts, in comparison with Waterfall, while fully complying with DO-178C.

The findings challenge the prevailing notion that Agile is inherently incompatible with safety-critical domains and suggest that when adapted thoughtfully, Agile methods can complement the rigorous standards requirements like DO-178C. By bridging the gap between Agile methods, practices and safety-critical development, this work advocates for a paradigm shift in developing safety-critical software, promoting a more adaptive, customer-centric approach. Specifically, this research highlights Agile’s capacity to accelerate knowledge acquisition through shorter delivery cycles and feedback loops, improve traceability, and manage late-stage requirement changes more efficiently, also in the aerospace domain.
Building on this foundational work, ongoing efforts are underway to enhance the Scrum4DO178C process through automation, enabling the automatic generation and reuse of outputs required for DO-178C compliance. Additionally, future research will extend these concepts to other aerospace standards and safety-critical domains, ensuring their applicability and compliance across diverse regulatory frameworks. Supported by collaborative initiatives with universities (e.g Master’s thesis projects at the Faculty of Engineering, University of Porto (FEUP) and the Informatics Engineering Departament of the University of Coimbra (UC)) and industry partners, this research aims to reshape industry perceptions of Agile’s role in safety-critical systems, fostering innovation and adaptability in these complex environments.

Keywords: Agile; Aerospace; DO-178C; FAA; Safety-critical; Software development.

PhD Defence in Informatics Engineering: ”An Optimization Strategy for Resource Allocation in Cyber Physical Production Systems”

Candidate:

Eliseu Moura Pereira

Date, Time and Location:

17th of June 2025, 10:00, Sala de Atos, Faculdade de Engenharia da Universidade do Porto

President of the Jury:

Carlos Miguel Ferraz Baquero-Moreno, Full Professor, Department of Informatics Engineering, Faculdade de Engenharia da Universidade do Porto.

Members:

Pedro Nicolau Faria da Fonseca (PhD), Assistant Professor, Department of Electronics, Telecommunications and Computer Science, Universidade de Aveiro;

Paulo Jorge Pinto Leitão (PhD), Principal Coordinating Professor, Department of Electrical Engineering, Instituto Politécnico de Bragança;

André Monteiro de Oliveira Restivo (PhD), Associate Professor, Department of Informatics Engineering, Faculdade de Engenharia da Universidade do Porto;

Gil Manuel Magalhães de Andrade Gonçalves (PhD), Associate Professor with Habilitation, Department of Informatics Engineering, Faculdade de Engenharia da Universidade do Porto (Supervisor).

The thesis was co-supervised by João Pedro Correia dos Reis (PhD), Assistant Researcher, Department of Electrical and Computer Engineering, Faculdade de Engenharia da Universidade do Porto.

Abstract:

Cyber-Physical Production Systems (CPPSs) integrate computation, communication, and control technologies, delivering the flexibility needed for dynamic shop floor reconfiguration and efficient manufacturing. A factory with higher shop floor flexibility has the advantage of higher product customization or changeover, when compared to traditional industries. They manifest this advantage mainly when the industry introduces a new product or because the shop floor produces highly variable products needing constant reconfiguration. Several manufacturers adopt such production philosophy, like in the automotive industry, where a high variability of car models and specifications requires different setups/configurations of the shop floor to manufacture them. In sequential production lines, like car assembly lines, reconfigurable CPPSs play an essential role because processing one product can affect the entire production performance, requiring a shop floor reconfiguration to optimize their execution. A significant challenge in CPPSs arises when reacting to changing conditions, such as new products or requirements, reconfiguration is needed. Current systems rely on manual intervention, leading to significant delays, especially in large industries where reprogramming hundreds of machines can take days or weeks. This thesis addresses this issue by proposing a platform that automatically optimizes software assignment to resources, speeding up development, deployment, and reconfiguration, enabling CPPSs to adapt to external disturbances quickly.

With the purpose of accelerating the development, reconfiguration, and execution of software in CPPSs, this thesis aims to optimize Function Blocks (FBs) assignment to the devices existent in an IEC 61499-based Cyber-Physical System (CPS), reducing the total execution time (reconfiguration time plus FB pipeline execution time). With this main goal, the thesis resulted in the development of 3 tools: 1) the Dynamic Intelligent Architecture for Software and Modular Reconfiguration (DINASORE), that enables the development, execution and manual reconfiguration of IEC 61499-based CPSs, 2) the Task Resources Estimator and Allocation Optimizer (TREAO),  that simulates and optimizes the tasks/FBs assignment to the CPS machines, recommending suitable software layouts for the CPS characteristics, and 3) the Task Assignment Optimization and Synchronization Engine (T-Sync), which integrates the previous two tools in a solution and optimizes in run-time the FBs assignment to the devices existent in an IEC 61499-based CPS.

Integrating these tools in T-Sync resulted in a differentiating solution because it 1) allows online FB assignment to optimize the CPS execution continuously and 2) improves the transparency and interoperability between FBs across IEC 61499-based devices. With this solution, the performance (total execution time) running FBs in reconfigurable CPSs improved by 30% in a simulated environment and 61% in a CPS. In addition to T-Sync improving total execution time, DINASORE enhances reconfiguration efficiency and flexibility, while TREAO streamlines CPS development by optimizing task and FB assignments to available resources. Besides the mentioned ones, during this thesis, other algorithms were implemented and tested for task assignment optimization, and other tools were developed to increase the interoperability and portability in CPSs. The future work envisions the automatic generation of FB pipelines from structured requirements, with formal specifications like UML diagrams, consequently integrating TREAO, manufacturing process simulators, and T-Sync to iteratively validate, optimize, simulate factory layouts, and deploy CPS software with enhanced flexibility and adaptability.

Keywords: Cyber-Physical Production Systems; IEC 61499; Machine Learning; Task Assignment.

PhD Defence in Informatics Engineering: ”Intelligent Ticket Management Assistant for Helpdesk Operations”

Candidate:

Leonardo da Silva Ferreira

Date, Time and Location:

13th of June 2025, 9:30, Sala de Atos, Faculdade de Engenharia da Universidade do Porto

President of the Jury:

Pedro Nuno Ferreira da Rosa da Cruz Diniz, PhD, Full Professor, Department of Informatics Engineering, Faculdade de Engenharia da Universidade do Porto

Members:

Pedro Manuel Henriques da Cunha Abreu, PhD, Associate Professor with habilitation, Department of Informatics Engineering, Faculdade de Ciência e Tecnologia da Universidade de Coimbra;

Paulo Jorge Freitas de Oliveira Novais, PhD, Full Professor, Department of Computer Science, Escola de Engenharia da Universidade do Minho;

Carlos Manuel Milheiro de Oliveira Pinto Soares, PhD, Associate Professor, Department of Informatics Engineering, Faculdade de Engenharia da Universidade do Porto;

Ana Paula Cunha da Rocha, PhD, Associate Professor, Department of Informatics Engineering, Faculdade de Engenharia da Universidade do Porto;

Daniel Augusto Gama de Castro Silva, PhD, Assistant Professor, Department of Informatics Engineering, Faculdade de Engenharia da Universidade do Porto (Supervisor).

The thesis was co-supervised by Professor Mikel Uriarte Itzazelaia, Associate Professor at the Escuela de Ingeniería de Bilbao, Universidad del País Vasco.

Abstract:

With the dynamic evolution of the internet, particularly in domains such as multimedia services, cloud computing, internet of things, virtualization, and artificial intelligence, companies have witnessed significant expansion in their market and services. However, this growth has also exposed numerous vulnerabilities that threaten the confidentiality, integrity, and availability of organizational and personal data. As information technology analysts work to address security system alerts, artificial intelligence has introduced new avenues for breaching security, ranging from simple, low-cost methods to highly sophisticated attacks. Low-cost approaches include phishing and password spraying, which exploit human error and weak password practices. In contrast, more complex threats include advanced persistent attacks and zero-day exploits, which require significant expertise and resources, often disrupting critical systems. Many organizations rely on cybersecurity helpdesk centers, internal or outsourced, to manage incidents. However, these centers often struggle to respond effectively due to data overload and a lack of qualified operators.

This dissertation addresses the shortage of skilled operators and the high volume of incidents in helpdesk operations by developing a ticket management assistant to support human operators in resolving incidents. The framework integrates a context-aware recommender system that identifies the fastest analyst-procedure pair for each incident and continually improves with each treatment followed. To ensure data privacy, this recommender system is trained using artificial data generated by a custom synthetic data generator. Furthermore, this thesis explores the possibility of enhancing this assistant with automated machine learning functionalities to predict incoming tickets. This feature could help managers anticipate workloads and proactively adjust the composition of the security teams.

The development of this framework is supported by the collaboration with a cybersecurity company, S21sec, which provides anonymized historical incident treatment data structures and taxonomies. However, synthetic data generation techniques are essential due to the absence of granular information on incident resolution and related parameters in the shared data set, which also requires privacy. The implemented generator builds artificial datasets that can mimic distributions similar to those observed in the real dataset while emulating real-world behaviours, including ticket prioritization, scheduling, and treatment.

The artificial data generator is evaluated for its efficiency in replicating real-world datasets using similarity measures such as Hellinger distance and Kullback-Leibler divergence. Furthermore, several ticket scheduling scenarios are explored, varying operators’ numbers and distribution across three work shifts. The results demonstrate that this framework can replicate ticket distributions and treatment durations observed in real datasets. Additionally, it allows for the simulation of real-world helpdesk operations, providing a solid foundation for exploring diverse operational contexts without compromising privacy. The analysis of the ticket scheduling consistently shows that scenarios characterized by a high shift imbalance and fewer operators lead to longer wait times and more tickets scheduled for later treatment.

The recommender system is assessed from two perspectives: scalability and impact on ticket treatment. The first phase uses various test datasets with different sizes and numbers of operators, analyzed with metrics such as the average recommendation time and memory usage. In contrast, the impact on ticket treatment is examined by considering improvements in ticket waiting times before being allocated to an operator and the response time required for their resolution, using different recommendation acceptance degrees. The results indicate that the number of operators the recommender system utilizes has a slightly larger impact on its scalability than the number of test tickets. Both features show a similar linear growth pattern regarding the referred metrics, but the number of operators has a larger slope. Integrating this recommender system into the ticket treatment reduced the average response time by 37.9\% to 45.1\% and the average wait time by 62.2\% to 63.2\%, assuming operators always accept the recommendations. With varying recommendation acceptance rates, the average wait time remains constant, while the response time improvement ranges from 0.4\% to 11.7\%.

The potential application of automated machine learning for predictive analysis is explored through a case study, comparing the system’s recommended team dimensionality decisions with expected outcomes. The case study evaluates the system based on prediction accuracy and its ability to suggest team size adjustments. Among the tested dataset distributions, models trained in three years of data outperformed those trained on four years, showing a better mean average error using real data on ticket frequency throughout the year. Regarding team dimensionality recommendations, including hiring or dismissing operators, the tool-based on automated machine learning frequently proposed decisions closely aligned with those that could have been proposed in the same period.

Collectively, these results show that the proposed framework can optimize ticket treatment workflows in real-world applications, leading to more efficient use of resources and reduced operational delays. Furthermore, its ability to simulate real-world operations without compromising privacy allows security operations centers to test several scenarios and refine their strategies.

Keywords: Helpdesk; Ticket; Cybersecurity; Synthetic Data; Recommendation Systems.

PhD Defence in Informatics Engineering: “Inmplode: A Framework to Interpret Multiple Related Rule-Based Models”

Candidate:

Pedro Rodrigo Caetano Strecht Ribeiro

Date, Time and Location:

13th of June 2025, 15:00, Sala de Atos, Faculdade de Engenharia, Universidade do Porto 

President of the Jury:

Rui Filipe Lima Maranhão de Abreu, PhD, Full Professor, Department of Informatics Engineering, Faculdade de Engenharia, Universidade do Porto 

Members:

Johannes Fürnkranz, PhD, Full Professor, Department of Computer Science of the Institute for Application-Oriented Knowledge Processing at the Johannes Kepler University Linz, Austria;

José María Alonso Moral, PhD, Full Professor, Department of Electronics and Computing, Escuela Técnica Superior de Ingeniería de la Universidad de Santiago de Compostela, Spain;

José Luís Cabral de Moura Borges, PhD, Associate Professor, Department of Industrial Engineering and Management, Faculdade de Engenharia, Universidade do Porto;

João Pedro Carvalho Leal Mendes Moreira, PhD, Associate Professor, Department of Informatics Engineering, Faculdade de Engenharia, Universidade do Porto (Supervisor).

The thesis was co-supervised by Carlos Manuel Milheiro de Oliveira Pinto Soares, PhD, Associate Professor, Department of Informatics Engineering, Faculdade de Engenharia, Universidade do Porto. 

Abstract:

This thesis investigates the challenges and opportunities presented by the increasing trend of using multiple specialized models, referred to as operational models, to address complex data analysis problems. While such an approach can enhance predictive performance for specific sub-problems, it often leads to fragmented knowledge and difficulties understanding overarching organizational phenomena. This research focuses on synthesizing the knowledge embedded within a collection of decision tree models chosen for their inherent interpretability and suitability for knowledge extraction. For example, a company with chain stores or a university with diverse programs, each using dedicated prediction models (sales or dropout, respectively). While these localized models are important, a global perspective is valuable organization-wide. However, managing many operational models, especially for cross-program/store analysis, can be overwhelming.

A methodology framed within a comprehensive framework is introduced to merge sets of operational models into consensus models. These consensus models are directed towards higher level decision-makers, enhancing the interpretability of knowledge generated by the operational models. The framework, named Inmplode, addresses common challenges in model merging and presents a highly customizable process. This process features a generic workflow and adaptable components, detailing alternative approaches for each subproblem encountered in the merging process.

The framework was applied to four public datasets from diverse business areas and a case study in education using data from the University of Porto. Different model merging approaches were explored in each case, illustrating various process instantiations. The model merging process revealed that the resulting consensus models are frequently incomplete, meaning they cannot cover the entire decision space, which can undermine their intended purpose. To address the issue of incompleteness, two novel methodologies are explored: one relies on the generation of synthetic datasets followed by decision tree training. At the same time, the other uses a specialized algorithm designed to construct a decision tree directly from aggregated (i.e., symbolic) data.

The effectiveness of these methodologies in generating complete consensus models from incomplete rule sets is evaluated across the five datasets. Empirical results demonstrate the feasibility of overcoming the incompleteness issue, contributing to knowledge synthesis and decision tree modeling. However, tradeoffs were identified between completeness and interpretability, predictive performance, and the fidelity of consensus models.

Overall, this research addresses a critical gap in the literature by providing a comprehensive framework for synthesizing knowledge from multiple decision tree models, focusing on overcoming the challenge of incompleteness. The conclusions have implications for organizations seeking to use specialized models while maintaining a holistic understanding of the analyzed phenomenon.

Keywords: interpretability; rule-based models; model merging framework; decision trees; completeness.

PhD Defense in Digital Media “Interaction methods for digital musical instruments: Application in personal devices”

Candidate:
Alexandre Resende Clément

Date, Time and Location:
5th of June 2025, 14:30, Sala de Atos, Faculdade de Engenharia, Universidade do Porto

President of the Jury:
António Fernando Vasconcelos Cunha Castro Coelho, PhD, Associate Professor with Habilitation, Department of Informatics Engineering, Faculdade de Engenharia, Universidade do Porto

Members:
Marcelo Mortensen Wanderley, PhD, Full Professor, Department of Music Research, Schulich School of Music, McGill University, Canadá;
Damián Keller, PhD, Associate Professor, Centro de Educação, Letras e Artes da Universidade Federal do Acre, Brasil;
Sofia Carmen Faria Maia Cavaco, PhD, Assistant Professor, Informatics Department, Faculdade de Ciências e Tecnologia, Universidade NOVA de Lisboa;
Rui Pedro Amaral Rodrigues, PhD, Associate Professor, Department of Informatics Engineering, Faculdade de Engenharia, Universidade do Porto;
Gilberto Bernardes de Almeida, PhD, Department of Informatics Engineering, Faculdade de Engenharia, Universidade do Porto (Supervisor).

Abstract:

“This thesis explores the potential of mobile handheld devices as tools for digital musical instrument interaction and participatory performance. Guided by the principles of ubiquitous music and intuitive interaction, the research investigates how mobile handheld devices can address challenges and unlock opportunities in contemporary music-making through participatory frameworks, gesture mappings, and multimodal feedback. Three experiments form the foundation of this study. The first describes and evaluates a system that enables large-scale audience participation in multimedia performances. It highlights the ability of mobile handheld devices to engage users and foster collaboration but reveals challenges in designing intuitive interactions for untrained participants. The second experiment examines how users instinctively map gestures to core musical parameters, such as pitch, duration, and amplitude, identifying natural trends – and the influence of musical training and experience on interaction strategies. The third focuses on evaluating the impact of multimodal feedback, combining auditory, visual, and haptic modalities, in note pitch tuning tasks.
The findings underscore the importance of designing standardised interaction guidelines and integrating multimodal feedback to make digital musical instruments more accessible and intuitive. Experiment 1 showed that the lack of a unified interaction model limited intuitive engagement, highlighting the need for standards that balance individual creativity with group intent. Experiment 2 found clear user preferences for gesture mappings of onset, pitch, and duration, shaped by cultural familiarity, and supporting context-aware design. Experiment 3 showed that while multimodal feedback had little immediate effect on accuracy, it improved user confidence and may aid long-term learning. This research advances the understanding of how mobile handheld devices can support participatory and creative music-making, contributing to the development of inclusive, user-friendly, and versatile musical tools.”

PhD Defense in Informatics Engineering “A Live Environment for Continuous Software Inspection and Refactoring”

Candidate:
Sara Filipa Couto Fernandes

Date, Time and Location:
May the 5th, at 14:00, in Sala de Atos of the Faculdade de Engenharia of Universidade do Porto

President of the Jury:
Rui Filipe Lima Maranhão de Abreu, PhD, Full Professor, Department of Informatics Engineering, Faculdade de Engenharia, Universidade do Porto

Members:
Fabio Palomba, PhD, Assistant Professor of Software Engineering (SeSa) Lab, Department of Computer Science, University of Salerno, Itália;
António Manuel Ferreira Rito da Silva, PhD, Associate Professor, Department of Informatics Engineering, Instituto Superior Técnico, Universidade de Lisboa;
João Carlos Pascoal Faria, PhD, Full Professor, Department of Informatics Engineering, Faculdade de Engenharia, Universidade do Porto;
Ademar Manuel Teixeira de Aguiar, PhD, Associate Professor, Department of Informatics Engineering, Faculdade de Engenharia, Universidade do Porto (Supervisor).

This thesis was co-supervised by André Monteiro de Oliveira Restivo, PhD, Associate Professor at the Department of Informatics Engineering of the Faculdade de Engenharia of Universidade do Porto.

Abstract:

“Writing software is hard; reviewing, changing, or adapting old software is even more challenging. A bad design can quickly lead to rotting software, with each modification heading to a rigid and fragile codebase. Evolution may become extremely costly if we do not refactor code at the right time. Often, developers choose to refactor too late when most symptoms are already impossible to ignore. They check their source code, looking for code smells and the most appropriate refactorings, trying to bring sanity into their design. They then realize they need help from specialized, overly complex, and hard to use tools. If only they tended to refactor their code sooner, they might have gained more peace of mind earlier. In this process of writing and evolving code, changing hats from coding to refactoring should be done often, if not constantly. We argued that a live refactoring environment, which presents refactorings in real-time, would help developers be continually aware of possible refactoring opportunities, making it easier to apply them earlier and faster when the codebase is still under control. We developed such a live environment by considering and evaluating in real-time several code-quality metrics, detecting smells, providing feedback, and presenting possible refactoring candidates unobtrusively and elegantly to the developers — all without leaving the comfort of their development environment. By enhancing an existing IDE with live refactoring capabilities, we showed that we can help developers understand, adapt, and maintain their systems in a more controlled and prompt fashion, allowing them to produce better code faster. The following contributions resulted from this work: (i) an extensive analysis of the state-of-theart on the main topics of our project, (ii) a live refactoring environment capable of continuously inspecting code to detect, suggest, and apply refactorings, (iii) an empirical validation using different approaches that helped us gathering data that allowed to confirm our hypothesis, and (iv) a set of scientific publications validating all the work done. While our work presents significant contributions, there are areas for further exploration. We could enhance specific aspects of our Live Refactoring Environment, including broader refactoring support or reducing processing time for complex code. Moreover, future work could also involve predicting the impact of refactorings on quality metrics and enhancing usability, including tests with color-blind users.”

PhD Defense in Digital Media: ”Artificial Intelligence and Infodemic: a study on fact-checked Health Communication and synthetic media”

Candidate:
Haline Costa Maia

Date, Time and Place:
February 24th 2025, 10:30, Sala de Atos DEEC (I -105), Faculty of Engineering, University of Porto.

President of the Jury:
António Fernando Vasconcelos Cunha Castro Coelho, PhD, Associate Professor with Habilitation, Department of Informatics Engineering, Faculdade de Engenharia, Universidade do Porto.

Members:
Christopher Mathieu, PhD, Associate Professor, Department of Sociology, Faculty of Social Sciences, Lund University;
Stefania Milan, PhD, Professor of Critical Data Studies, Department of Media Studies, Faculty of Humanities, University of Amsterdam;
António Maria Salvado Coxito Granado, PhD, Associate Professor with Habilitation, Department of Communication Sciences, Faculdade de Ciências Sociais e Humanas, Universidade Nova de Lisboa;
Ioli Ribeiro Campos, PhD, Assistant Professor, Faculdade de Ciências Humanas, Universidade Católica Portuguesa;
Helena Laura Dias de Lima, PhD, Associate Professor, Department of Communication and Information Sciences, Faculdade de Letras, Universidade do Porto (Supervisor);
Alexandre Miguel Barbosa Valle de Carvalho, PhD, Assistant Professor, Department of Informatics Engineering, Faculdade de Engenharia, Universidade do Porto.

The thesis was co supervised by Prof. Sérgio Sobral Nunes, Associate Professor at the Department of Informatics Engineering, Faculdade de Engenharia, Universidade do Porto.

Abstract:

The proliferation of health misinformation, especially during critical times such as pandemics, has underscored the need for effective mechanisms to verify and disseminate accurate health news. This research, guided by Value Sensitive Design (VSD), investigates the integration of Artificial Intelligence (AI) in health fact-checking, aiming to enhance the speed and reliability of information dissemination while ensuring ethical compliance. The study addresses these key research questions: How can AI facilitate the rapid dissemination of authenticated health information? What benefits does AI integration bring to health fact-checking processes? How can AI promote ethically responsible practices in the dissemination of counter-information? Through systematic reviews, case studies, and empirical research, including co-design workshops and surveys, the research evaluates existing AI applications. It develops guidelines for incorporating AI in journalism and public health information systems. This dissertation follows a structured approach centered around the three distinct phases of VSD. During the Conceptual Investigations phase, systematic reviews and meta-analyses were conducted on publications from 2020 to 2022, using the PRISMA process to analyze 57 studies. During the Technical Investigations phase, case studies and semi-structured interviews were conducted with stakeholders. In the Empirical Investigations, technological probes using AI for the dissemination phase of health fact-checking were tested through co-design workshops, focus groups, and surveys. The data collected in the Technical and Empirical phases were analyzed using thematic and exploratory methods. Findings indicate that while AI significantly enhances the efficiency of fact-checking processes, challenges related to equality, governance, and stakeholder trust remain prevalent. The study also explores the socio-technical dynamics of AI applications in fact-checking, emphasizing the importance of value-driven design to mitigate ethical risks and promote inclusivity. The implications of this research are far-reaching, offering guidelines for developing AI-driven tools that are not only technologically effective but also culturally sensitive and ethically sound. By fostering a better understanding of AI’s role in managing health misinformation, this work contributes to the broader discussion on technology governance and the ethical dimensions of digital media in public health contexts.

Keywords:  AI Ethics; Infodemic; Generative Media; Fact-Checking; Health Misinformation; Media Literacy; Journalism Innovation.

PhD Defense in Digital Media: ”Interfacing peer-produced knowledge: a framework for shadow libraries based on pervasive games”

Candidate:
Pedro Miguel Sá Couto Condeço Ribeiro

Date, Time and Place:
February 19th 2025, at 9:30, Sala de Atos (L202A), Department of Industrial Engineering and Management of the Faculty of Engineering of University of Porto

President of the Jury:
António Fernando Vasconcelos Cunha Castro Coelho, PhD, Associate Professor with Habilitation, Department of Informatics Engineering, Faculdade de Engenharia, Universidade do Porto.

Members:
Rodrigo Hernández Ramírez, PhD, Senior Lecturer in Design da Sydney School of Architecture, Design and Planning da The University of Sydney, Austrália;
Luísa Maria Lopes Ribas, PhD, Assistant Professor, Design and Communication Department, Faculdade de Belas Artes, Universidade de Lisboa;
Teresa Isabel Lopes Romão, PhD, Associate Professor, Department of Informatics, Faculdade de Ciências e Tecnologia, Universidade Nova de Lisboa;
Catarina Franco Lélis da Cruz, PhD, Assistant Professor, Department of Communication and Art, Universidade de Aveiro;
José Miguel Santos Araújo Carvalhais Fonseca, PhD, Full Professor, Department of Design, Faculdade de Belas Artes, Universidade do Porto (Supervisor);
Rui Pedro Amaral Rodrigues, PhD, Associate Professor, Departament of Informatics Engineering, Faculdade de Engenharia, Universidade do Porto.

The thesis was co supervised by Pedro Cardoso, PhD, Assistant Professor, Department of Design, Faculdade de Belas Artes, Universidade do Porto.

Abstract:
Shadow libraries are media repositories whose primary goal is to enable access to resources that were previously restricted or inaccessible through other means. These informal publishing streams have the additional capacity to interface knowledge that does not fit or does not aim to fit within formal distribution models.
As a case study, we researched Portuguese-student shadow libraries (PSSLs) as spaces significant beyond their distributive capacity. Through physical, digital and hybrid interfaces, PSSLs challenge contemporary access to published research, enabling community members to produce and distribute informal knowledge and actively questioning the stability of peers’ roles, dependencies, and interdependencies.
This research started by investigating PSSLs community members’ current needs and requirements. Subsequently, we analysed how prominent shadow libraries align with these needs and how available platforms have the necessary affordances to respond to them. Informed by present constraints, we established a set of software requirements to support the creation and transformation of multiple shadow libraries, enable the collection of plural voices and interventions, and ensure these spaces accommodate a diverse range of resources.
In the second moment of our research, we studied shadow libraries from a new lens. We explored potential library discourses using mechanics from pervasive games as a tool with particular traits and potential. In the context of this research, these are particularly relevant due to their capacity to extend experiences beyond fixed timeframes, leading to users’ sustained and continuous involvement; extend the relationship between users and their environment, exploring the boundaries between physical and digital spaces; extend the possible interfaces for interaction introducing new hypotheses for interaction and user engagement; extend the dynamics between users and their community by integrating external variables and reshaping social interactions; extend users’ engagement at a more personal and meaningful level.
Through a practice-based research methodology, we led community members to reconsider shadow library’s distribution and production dynamics, as well as community interactions. Contributions from these explorations establish a holistic set of design strategies that challenge dominant shadow library practices and highlight the importance of protecting projects’ motivations, community requirements, dependencies, and informal principles. Collectively, the strategies and dependencies identified establish a framework for expanding shadow libraries in response to communities’ evolving needs, ultimately shaping access, distribution, production, and publication of knowledge, and peer synergies.

Keywords:
Shadow Libraries; Peer-produced knowledge; Design; Pervasive Games; Game mechanics; Publishing.

PhD Defense in Informatics Engineering: ”Enhanced multiview experiences through remote content selection and dynamic quality adaptation”

Candidate
Tiago André Queiroz Soares da Costa

Date, Time and Location:
September 16, 14:30, Sala de Atos da Faculdade de Engenharia da Universidade do Porto

President of the Jury:
Doutor Carlos Miguel Ferraz Baquero-Moreno, Professor Catedrático da Faculdade de Engenharia da Universidade do Porto

Members:
Klara Nahrstedt, PhD, Full Professor, Department of Computer Science, University of Illinois at Urbana-Champaign, United States of America;
Pedro António Amado de Assunção, PhD, Coordinator Professor, Departamento de Engenharia Eletrotécnica, Escola Superior de Tecnologia e Gestão do Instituto Politécnico de Leiria;
Luís António Pereira de Meneses Corte-Real, PhD, Associate Professor, Departamento de Engenharia Eletrotécnica e de Computadores, Faculdade de Engenharia da Universidade do Porto;
Maria Teresa Magalhães da Silva Pinto de Andrade, PhD, Assistant Professor, Departamento de Engenharia Eletrotécnica e de Computadores, Faculdade de Engenharia da Universidade do Porto (Supervisor).

Abstract:
This thesis proposes a novel approach to immersive, multiview media distribution that uses Deep Learning models and user-centric data to predict user interest in the near future while multimediacontent is being presented. The main objective of this thesis is to give the user a truly ubiquitousmultimedia immersive experience without the need for expensive equipment, while also allowing him or her to see the scene being presented on the screen from almost any angle, as if they were actually there when the scene was shot. A methodological approach was envisioned based on the literature review and the identification of gaps in immersive streaming scenarios, which resulted in the conceptualization of a brand new architecture that was coined Smooth Multiview (SmoothMV). This architecture is capable of analysing user behaviour data in real-time and preemptively preparing content delivery accordingly based on viewing interests demonstrated by users while visualising a particular scene. Users effortlessly provide behaviour data without equiring intrusive equipment, which is then processed using the novel concept of the Hot&Cold matrix, which this thesis describes. With the use of this concept, the screen is divided into nine separate regions, each of which is connected to a neighbouring view that the SmoothMV architecture can prepare and choose to present. Separate queues designated for playback and buffering of upcoming content segments are introduced to provide minimal delay without compromising the user experience, since content adaptation is closely linked to user inputs. The number of views that are available and the approach employed for analysing behaviour while viewing content and selecting which view should be processed in the following moment affect how these queues are managed. This thesis developed from a purely reactive approach to a sophisticated, twofold Deep Learning architecture that can accurately identify the view that best fits the interests of the user with a high degree of accuracy. The development of a new dataset was needed in order to achieve this level of performance, as the data provided by existing datasets was not suitable for the scenario that was proposed. After a series of 128 experiments were conducted to collect visual attention data from 45 participants while viewing multi-perspective content, the Data2MV dataset was created and made available to the public. This thesis’ fundamental concepts and practical outputs are considered to be of significant importance to the body of knowledge currently available in the field of research, while also offering relevant tools for the general enhancement of current content distribution architectures.

Keywords: Multimedia, Streaming, Multiview, Focus-of-Attention, Deep Learning