DEI Talks | “Developing high-risk AI systems for mental health applications” by Prof. Lars Bongo (UiT The Arctic University of Norway)

The talk entitled “Developing high-risk AI systems for mental health applications” will be given on 21 May at 2.30 pm in room I-105, moderated by Prof. António Coelho (DEI).

About the talk:

“In the TRUSTING project, we are developing a speech-based tool to predict relapse in psychosis. The tool is being designed for six languages and will be evaluated in a clinical trial. While large language models offer promising opportunities for cognitive testing, their use in high-risk AI systems raises significant challenges. These include ensuring safety, trustworthiness, and compliance with emerging AI regulations. In this talk, I will present the key challenges we encounter in data collection, infrastructure development, and cognitive test design, and reflect on the added complexity of developing high-risk AI systems across multiple languages. Finally, I will present our design principles and lessons learned.”

About the Speaker:

Dr. Lars Ailo Bongo is currently a Professor in health technology at the Department of Computer Science, UiT The Arctic University of Norway. His main research interest is to build and experimentally evaluate infrastructure systems that support the methods under development by our bioinformatics and health science collaborators. He is the principal investigator in the Health Data Lab. Bongo is also active in building a culture for entrepreneurship at UiT, He is the co-founder of Medsensio AS, innovation coordinator in SFI Visual Intelligence, and the co-founder of the Digital Technology Innovation Lab at UiT. Bongo has an adjunct Professor position at Sámi University of Applied Sciences, where he recently co-founded the Sámi AI Lab that aims to use AI to improve the Sámi society for the better.

DEI Talks | “Hybrid neural systems: neuromorphic computing for real-time control of brain activity” by Paulo Aguiar (i3S-U.Porto)

The talk, entitled “Hybrid neural systems: neuromorphic computing for real-time control of brain activity“, will be given on 15 June at 2:00 pm in room I-105. Henrique Lopes Cardoso (DEI) will chair the session.

Abstract:

The brain is a powerful model for fast, adaptive and energy-efficient information processing. Translating these principles into computing systems is a major challenge with direct relevance for the next generation of intelligent neural interfaces. In this talk I will present work from my research group where we developed a hybrid neural system combining biological neurons with neuromorphic hardware, where artificial spiking neurons process ongoing brain activity in real time. By converting biological signals into spike-based representations, we trained spiking neural networks (SNNs) to identify short-lived electrophysiological patterns and deployed them on neuromorphic hardware. This system was integrated with open-source electrophysiology tools to create a closed-loop pipeline capable of detecting ongoing brain states and triggering targeted stimulation with low latency. Using this approach, we show that hybrid systems linking artificial and biological neurons can support real-time interaction with living neural circuits. These results provide a proof-of-concept for accessible neuromorphic neural interfaces and open new possibilities for adaptive, low-power and biologically inspired computing technologies.

About the Speaker:

Paulo Aguiar graduated in Physics (U. Lisbon, PT), and completed his PhD in Computational Neuroscience at the Institute for Adaptive and Neural Computation (U. Edinburgh, UK). Since 2016, he leads the Neuroengineering and Computational Neuroscience Lab (i3S-UPorto, PT). His group uses a bottom-up approach, focusing on understanding how neural circuits process and store information. The team combines expertise in neurobiology, advanced analytical methods and computational models, to reveal and repair neural function. He has already been the (co)PI/Task Leader in 20+ national and international research projects obtained through competitive calls.

23rd Information Science Conference: Innovation and Societal Transformation at FLUP

On 19 May, the 23rd edition of Jornadas de Ciência da Informação will take place, under the theme “Information Science: Innovation and Societal Transformation”, in the Nobre Amphitheatre of the Faculty of Arts and Humanities of the University of Porto (FLUP), between 09:00 and 17:00.

This year’s edition offers a reflection centred on the role of Information Science in innovation and the transformation of society, through a varied programme that includes presentations, panel discussions and opportunities for scientific and professional exchange.

This is an annual event, organised as part of the Information Science program, which has established itself as a prime forum for reflection, sharing and debate on current and relevant topics in this field of knowledge. Throughout its editions, the Conference has promoted dialogue on the trends, challenges and opportunities shaping the evolution of Information Science, bringing together students, lecturers, researchers and professionals.

Participation is free of charge, although registration is mandatory and must be completed using the following form: https://shorturl.at/rdEXV

The detailed programme for the event is available at: https://www.linkedin.com/in/jornadascienciainformacao/

DEI Talks | “nanoML: Pushing the Limits of Edge AI with Weightless Neural Networks” by Prof. Lizy John (UT Austin)

The talk entitled “nanoML: Pushing the Limits of Edge AI with Weightless Neural Networks”, will be given by Prof. Lizy Kurian John (University of Texas at Austin) on 6 May at 2.30 pm in room I-105. The session will be moderated by Prof. Pedro Diniz (DEI).

About the Talk:

“Mainstream artificial neural network models, such as Deep Neural Networks (DNNs) are computation-heavy and energy-hungry. Weightless Neural Networks (WNNs) are natively built with RAM-based neurons and represent an entirely distinct type of neural network computing compared to DNNs. WNNs are extremely low-latency, low-energy, and suitable for efficient, accurate, edge inference. The WNN approach derives an implicit inspiration from the decoding process observed in the dendritic trees of biological neurons, making neurons based on Random Access Memories (RAMs) and/or Lookup Tables (LUTs) ready-to-deploy neuromorphic digital circuits. WNNs are a natural fit for edge AI due to the low area, energy and latency properties offered by them. This talk will describe the state of the art of Weightless Neural Networks, and their applications for edge inferencing.”

About the Speaker:

“Lizy Kurian John is Truchard Foundation Chair in Engineering at the University of Texas at Austin. Her research interests include workload characterization, performance evaluation, and high performance architectures for emerging workloads. She is recipient of many awards including Joe J. King Professional Engineering Achievement Award (2023), and The Pennsylvania State University Outstanding Engineering Alumnus Award (2011). She has authored 3 books and has edited 4 books including a book on Computer Performance Evaluation and Benchmarking. She holds 18 US patents and is an IEEE Fellow (Class of 2009), ACM Fellow, AAAS Fellow and Fellow of the National Academy of Inventors (NAI).”

Acknowledgement: Lizy K. John is currently a Fulbright Specialist. Her research is supported in part by the Unites States National Science Foundation (NSF) Grants #2326894, #2425655, Semiconductor Research Corporation (SRC) Task 3148.001, and NVIDIA Applied Research Accelerator Program Grant.

DEI Talks | “When AI meets Performance Engineering: Challenges and Opportunities” by Prof. Lizy John (UT Austin)

The talk entitled “When AI meets Performance Engineering: Challenges and Opportunities”, will be given by Prof. Lizy Kurian John (University of Texas at Austin) on 29 April, at 2.30 pm, in room L119 (DEMec). The session will be moderated by Prof. Pedro Diniz (DEI).

About the Talk:

“Artificial Intelligence/Machine Learning (AI/ML) has transformed hardware design, software systems, and system architectures. Emerging hardware for AI accelerators have become heterogeneous and complex, that traditional modeling methodologies, benchmarks, and metrics for prior systems may not work for assessing AI models and AI hardware. The single-most commonly used operation in AI is matrix multiplication. Hardware accelerators like GPUs have created Tensor Cores to support matrix multiplication. Google TPUs support matrix multiplication by the hardware systolic arrays. However, matrix multiplication cannot be a reliable benchmark for benchmarking, due to its high sensitivity to optimizations. The MLPerf consortium creates ML benchmarks, however those benchmarks are prohibitively difficult to manage for many small companies and academic researchers. What are good benchmarks for AI/ML? How can you evaluate AI hardware in pre-silicon and post-silicon stages? Complete system simulation was a popular mode of pre-silicon evaluation but prohibitively expensive. This talk will describe some of the opportunities and challenges when AI meets Performance Engineering.”

About the Speaker:

“Lizy Kurian John is Truchard Foundation Chair in Engineering at the University of Texas at Austin. Her research interests include workload characterization, performance evaluation, and high performance architectures for emerging workloads. She is recipient of many awards including Joe J. King Professional Engineering Achievement Award (2023), and The Pennsylvania State University Outstanding Engineering Alumnus Award (2011). She has authored 3 books and has edited 4 books including a book on Computer Performance Evaluation and Benchmarking. She holds 18 US patents and is an IEEE Fellow (Class of 2009), ACM Fellow, AAAS Fellow and Fellow of the National Academy of Inventors (NAI).”

Acknowledgement: Lizy K. John is currently a Fulbright Specialist. Her research is supported in part by the Unites States National Science Foundation (NSF) Grants #2326894, #2425655, Semiconductor Research Corporation (SRC) Task 3148.001, and NVIDIA Applied Research Accelerator Program Grant.

DEI contributes to SPE 2026 with 50 activities in the field of Informatics Engineering

The Department of Informatics Engineering (DEI) had a strong and highly participative presence at SPE 2026 – Semana Profissão Engenharia, which took place from March 24 to 26 at the Faculty of Engineering of the University of Porto (FEUP).

Over the three days of SPE, DEI delivered a total of 50 activities, each lasting 30 minutes, involving a large number of students, faculty members, and visitors. Forty of these activities were integrated into two tracks exclusively dedicated to Informatics, allowing for direct and in‑depth contact with different areas of Informatics Engineering. The remaining ten activities were part of two “Future Society” tracks, developed in collaboration with the Department of Electrical and Computer Engineering (DEEC) and other research institutes, promoting an interdisciplinary approach to emerging technological challenges.

DEI’s activities were offered in a variety of formats, including mini‑workshops, demonstrations of projects developed within curricular units, and presentations delivered by student groups and research teams. In the mini‑workshops, participants had the opportunity to engage in hands‑on activities such as Python programming and programming with micro:bits, in an interactive and accessible environment.

Several DEI curricular units were represented in this edition, showcasing the work developed across different study cycles. From the 2nd year of the Bachelor’s Degree in Informatics and Computing Engineering (L.EIC), the curricular units Computational Logic (LC) and Software Technologies Development Laboratories (LDTS) took part. From the 3rd year of L.EIC, the units Web Application Bases Laboratories (LBAW), Artificial Intelligence (AI), and Computer Graphics (CG) were represented. From the 1st year of the Master’s Degree in Informatics and Computing Engineering (M.EIC), the curricular unit Information Management Systems (SGI) participated.

The program also included demonstrations of DEI’s participation in the Bosch Future Mobility Challenge(BFMC), an international competition in the field of autonomous driving, highlighting the department’s involvement in projects with a strong practical, technological, and industry‑focused component.

In parallel, several student groups contributed with their own presentations, namely ACM FEUP, ARMIS.LAB, xSTF, NCGM, and IEEE UP Student Branch, reinforcing the central role of students in promoting the degree programs and research areas in Informatics.

In total, DEI’s participation involved more than 60 students, whose contribution was essential to the success of the activities and to interaction with secondary school students attending the event.

The organization of DEI’s participation was coordinated by DEI faculty members Carla Gonçalves, José Campos, Ricardo Cruz, and Thiago Silva, ensuring a well‑structured, diverse, and representative presence of the department throughout the event.

With this participation, DEI reinforced its commitment to the dissemination of Informatics Engineering, engagement with society, and the promotion of education, research, and innovation among future engineers.

DEI Talks | “Life Post Moore’s Law: The New Design Frontier” by Prof. Mark Horowitz (Stanford University)

The talk “Life Post Moore’s Law: The New Design Frontier” will be given by Prof. Mark Horowitz (Stanford University) on March 27th, at 14:00, in room I-105. The session will be chaired by Prof. Pedro Diniz (DEI).

About the Talk:

“For over 50 years, information technology has relied upon Moore’s Law: providing, for the same cost, 2x the number of logic transistors that were possible a few years prior. For much of that time, the smaller devices also provided dramatic energy and performance improvement through Dennard Scaling, but that scaling ended over a decade ago. While technology scaling continues, per transistor cost is no longer scaling in the advanced nodes. In this post Moore’s Law reality, further price/performance improvement follows only from improving the efficiency of applications using innovative hardware and software techniques.

Unfortunately, this need for innovative system solutions runs smack into the enormous complexity of designing and debugging contemporary VLSI based hardware/software platforms; a task so large it has caused the industry to consolidate, moving it away from innovation. The result is a set of platforms aim at different computing markets. To overcome this challenge, we need to develop a new design approach and tools to enable small groups of application experts to selectively extend the performance of those successful platforms.

Like the ASIC revolution in the 1980s, the goal of this approach is to enable a new set of designers, then board level logic designers, now application experts, to leverage the power of customized silicon solutions. Like then, these tools won’t initially be useful for current chip designers, but over time will underly all designs. In the 1980s to provide access to logic designers, the key technologies were logic synthesis, simulation, and placement/routing of their designs to gate arrays and std cells. Today, the key is to realize you are creating an “app” for an existing platform, and not creating the system solution from scratch (which is both too expensive and error prone), and to leverage the fact that modern “chips” are made of many chiplets. The new approach must provide a design window familiar to application developers, with similar descriptive, performance tuning, and debug capabilities. These new tools will be tied to highly capable platforms that are used as the foundation, like the appStore model for mobile phones. This talk will try to convince you this might be possible, and where innovative design/tools are needed.”

About the Speaker:

“Professor Horowitz initially focused on designing high-performance digital systems by combining work in computer-aided design tools, circuit design, and system architecture. During this time, he built a number of early RISC microprocessors, and contributed to the design of early distributed shared memory multiprocessors. In 1990, Dr. Horowitz took leave from Stanford to help start Rambus Inc., a company designing high-bandwidth memory interface technology. After returning in 1991, his research group pioneered many innovations in high-speed link design, and many of today’s high speed link designs are designed by his former students or colleagues from Rambus.

In the 2000s he started a long collaboration with Prof. Levoy on computational photography, which included work that led to the Lytro camera, whose photographs could be refocused after they were captured. Dr. Horowitz’s current research interests are quite broad and span using EE and CS analysis methods to problems in neuro and molecular biology to creating new agile design methodologies for analog and digital VLSI circuits. He remains interested in learning new things, and building interdisciplinary teams.”

YACC – the only Portuguese team to qualify for the final stage of the Bosch Future Mobility Challenge 2026

The YACC team – Yet Another Careless Car has qualified for the final stage of the Bosch Future Mobility Challenge 2026, standing out as the only Portuguese team amongst the 22 selected for this decisive stage of the competition.

The 2026 edition proved to be particularly demanding, and was described by the organisers themselves as the most competitive ever. Of the 141 teams that applied, only 78 were admitted to the competition, 57 completed the qualifying round and just 22 secured a place in the final stage, which underscores the high standard achieved by the team from the Department of Informatics and Computing Engineering (DEI) at the Faculty of Engineering of the University of Porto (FEUP).

The YACC team comprises students from the Bachelor’s Degree in Informatics and Computing Engineering (L.EIC) – Joana Azevedo Louro, Luís Miguel Costa Gonçalves, Luís Miguel Rosa Santos, Luís Wolffrom Barbosa and Leonor Silva Bidarra, under the mentorship of Bruno Lima, a lecturer at DEI. The initiative also involves Ricardo Cruz, a DEI lecturer as well, who has been developing work in the field of autonomous vehicles and who mentored the first team to reach this stage of the competition, “BeepLearning”, in 2022.

YACC’s qualification marks the third time that a team comprising members of FEUP’s DEI has reached the final stage of this competition (following “BeepLearning” in 2022 and “BadSeeds” in 2024), consolidating the institution’s presence in a highly demanding international technical and scientific context.

The final stage, which includes the Testing Days, Semi-Finals and Finals, will take place between 16 and 20 May in Cluj-Napoca, Romania, where the teams will demonstrate the performance of their solutions in a competitive environment.

The Bosch Future Mobility Challenge is an international technical competition organised by the Bosch Engineering Center Cluj-Napoca, which challenges student teams to develop autonomous driving and connectivity algorithms for 1/10-scale vehicles. These vehicles operate in an environment simulating a miniature smart city, being tested in scenarios such as lane keeping, navigating junctions, interpreting road signs and interacting with other road users.

Further information on the team’s journey can be followed via their Instagram page, where it will also be possible to support the team in the race for the Audience Award, which is awarded based on audience interaction.

We wish YACC every success in this final phase, as well as a truly enriching experience, both technically and personally.

DEI Talks | “Accelerating ML for Science Applications” by Prof. Seda Ogrenci (Northwestern University)

The talk “Accelerating ML for Science Applications” will be presented by Prof. Seda Ogrenci (McCormick School of Engineering, Northwestern University) on March the 12th, at 11:00, in room I-105. The session will be moderated by Tiago Carvalho (DEI).

About the Talk:

“Emerging open-source tools and methodologies targeting reconfigurable fabrics hold significant promise for lowering barriers to research, education, and innovation. There are exciting developments in diverse domains where such benefits are demonstrated. This talk will review active domains with needs and applications for real-time ultra low latency ML hardware and how open-source tools need to evolve to provide a multitude of features to enable design of hardware efficient and adaptive ML. As part of this discussion, examples of research directions in adaptive and resilient ML hardware synthesis flows developed in Dr. Ogrenci’s lab will presented.”

About the Speaker:

Seda Ogrenci is a Professor in the Department of Electrical and Computer Engineering (ECE), and in the Department of Computer Science (CS). She is the Director of the Computer Engineering Division of ECE. She has received her PhD degree in Computer Science from the University of California-Los Angeles. She is the co-author of over 140 peer reviewed publications and twelve patents on the subjects of Electronic Design Automation, Reconfigurable Computing, Thermal-Aware High Performance Computing, Computer Architecture, and Instrumentation for Real-Time ML for Experimental Sciences. She is the author of the book: Heat Management in Integrated Circuits: On-chip and system-level monitoring and cooling (Materials, Circuits and Devices). Seda Ogrenci serves on the editorial boards of the IEEE Transactions on Computer Aided Design and ACM Transactions of Reconfigurable Technology and Systems.

PhD Defense in Informatics Engineering (ProDEI): ”Modular and Multi-Stage Semantic Perception System for Robotics”

Candidate:
Bruno Georgevich Ferreira

Date, Time and Location:
27 February 2026, at 14:00, in Sala de Atos

President of the Jury:
Pedro Nuno Ferreira da Rosa da Cruz Diniz (PhD), Full Professor at the Faculdade de Engenharia da Universidade do Porto

Members:
João Alberto Fabro (PhD), Associate Professor at the Academic Department of Informatics (DAINF) of the Federal Technological University of Paraná, Brazil;
Rui Paulo Pinto da Rocha (PhD), Associate Professor at the Department of Electrical and Computer Engineering of the Faculdade de Ciências e Tecnologia da Universidade de Coimbra;
André Monteiro de Oliveira Restivo (PhD), Associate Professor at the Department of Informatics Engineering of the Faculdade de Engenharia da Universidade do Porto;
Armando Jorge Miranda de Sousa (PhD), Associate Professor at the Department of Electrical and Computer Engineering of the Faculdade de Engenharia da Universidade do Porto (Supervisor).

The thesis was co-supervised by Luís Paulo Gonçalves dos Reis (PhD), Associate Professor in the Department of Informatics Engineering of the Faculdade de Engenharia da Universidade do Porto.

Abstract:

The evolution of autonomous robotics benefits largely from the capacity to construct rich, navigable, and semantic representations of the environment, even more so if shared with humans. While the advent of open-vocabulary scene graphs powered by Vision-Language Models (VLMs) has revolutionized perception, these systems face critical hurdles: high rates of hallucinations (False Positives), a lack of topological spatial context, and operational fragility due to heavy reliance on cloud connectivity. This thesis proposes the Hybrid Inference Perception and Mapping System
(HIPaMS), framework adaptable to a target system, likely a robotic system that interacts with humans. The HIPaMS is a modular framework designed to bridge the gap between low-level perception and high-level agentic reasoning. A Proof of Concept (PoC) was designed to implement the HIPaMS. This PoC enhances the state-of-the-art ConceptGraphs semantic mapping process and introduces a refined interaction system through four main contributions. First, it introduces the Hybrid Adaptable Resource-Aware Inference Mechanism (HARAIM), which dynamically orchestrates internal models and settings based on runtime resource availability and optimization policies. This mechanism allows any optimization policy to adapt robotic system’s operation, possibly allowing zero downtime during network failures, graceful degradation and/or operational efficiency. Second, the semantic mapping pipeline is enhanced with rigorous False Positive filtering protocols, persona-based prompt engineering, and a broad collection of semantic information in an optimized manner during mapping. Third, a Room Semantic Segmentation Routine is proposed to provide topological information to the semantic map during interaction. This transforms unstructured, noisy detections into a hierarchically organized scene graph, anchoring objects within functional topological regions. Fourth, the robotic system now incorporates dynamic knowledge base via the Human-in-the-Loop (HITL) Agentic Retrieval-Augmented Generation (RAG)-based Interaction System (HARBIS). This interface uses short- and long-term memory to understand complex natural language queries. It enables the robot to learn continuously from user interactions, address gaps in perception and knowledge, maintain temporal consistency, and acknowledge its limitations by proactively asking for clarification. Extensive validation was conducted across 30 diverse environments, involving a total of 3300 interactive requests (depend on semantic map quality). The tested PoC processed 110 user requests per environment, categorized into: direct (30), indirect (30), graceful failure (30), follow-up (10) and time consistency (10). An ablation study was also performed to identify the impact of specific framework and PoC components. The results show that the PoC reduces False Positive detections by ≈86%, elevating mapping precision from a baseline of ≈ 0.28 to ≈ 0.68. Although strict filtering reduces raw recall, the integration of HITL learning increased the success rate for complex query resolution to ≈ 0.81, compared to baseline values of ≈ 0.48 and ≈ 0.55. Furthermore, the HIPaMS PoC reduced cloud inference costs by up to ≈ 84% in mapping and over ≈ 95% in interaction tasks while ensuring system stability. The presented framework pave the way for increased robotic autonomy and efficiency. The presented PoC demonstrates superior performance, particularly for human-centered scenarios.

Keywords: Semantic Mapping; Open-Vocabulary Perception; Hybrid Inference Architecture; Adaptable Framework; Human-in-the-Loop; Retrieval-Augmented Generation (RAG); Topological Segmentation; Robot@VirtualHome; Vision-Language Models; Agentic AI; Operational Robustness.