Explainable & Trustworthy AI
AI-algoritmen zijn complex en zeer geavanceerd. Het is voor de eindgebruiker soms moeilijk om de beslissingen of de suggesties die door het systeem gemaakt worden, te begrijpen en te interpreteren. Deze opleiding bekijkt de verschillende aspecten die te maken hebben met vertrouwen.
Praktische info:
Inschrijven?
- Inschrijvingen: tot 21 apr. 2026
- Voorwaarden: Voortgezette opleiding in computerwetenschappen of een equivalente programmeerervaring met Python of een gelijkaardige programmeertaal
- Prijs: €1.450
Leertraject
AI-algoritmen zijn complex en zeer geavanceerd. Het is voor de eindgebruiker soms moeilijk om de beslissingen of de suggesties die door het systeem gemaakt werden, te begrijpen en te interpreteren.
Artificiële Intelligentie (AI) heeft een lange weg afgelegd sinds enkele decennia geleden voor het eerst werd toegepast. AI en machine learning zijn ondertussen heel populair en de technieken worden met succes toegepast op een breed scala aan problemen, zowel in de academische wereld, de industrie als de publieke sector. Naarmate dit domein de laatste jaren meer en meer ingeburgerd raakte, ontstonden er ook nieuwe uitdagingen omdat de werking en uitkomsten niet altijd door mensen gevolgd kunnen worden.
De opleiding ‘Explainable AI’ bekijkt de verschillende aspecten van AI die te maken hebben met vertrouwen:
- Vertrouwen winnen door bijvoorbeeld de kenmerken van AI-output uit te leggen.
- Door een AI-techniek uit te leggen zal het begrip toenemen, waardoor kan worden onderzocht of de techniek kan worden overgedragen naar een ander domein of probleem.
- Een gebruiker informeren over de werking van een AI-model zodat het niet verkeerd begrepen wordt.
- Het vertrouwen van gebruikers kan worden vastgesteld door gebruik te maken van AI-modellen die verklaarbaar, stabiel maar ook robuust zijn.
- Bij het uitleggen van AI-modellen spelen vraagstukken rond privacy een rol. Privégegevens mogen niet door de modellen worden onthuld.
- Het is belangrijk dat handelingen en acties kunnen worden uitgelegd. Hoe zijn we tot specifieke resultaten gekomen en hoe kunnen we deze veranderen?
- mensen met verschillende achtergronden komen met AI in aanraking, het is belangrijk dat ze allemaal begrijpen waarom het systeem zich zo gedraagt en dat een uitleg gegeven wordt, die is afgestemd op hun behoeften.
Elke module binnen deze cursus richt zich op een ander onderwerp binnen het domein van verklaarbare en betrouwbare AI, variërend van white-box-modellen over hybride technieken tot aspecten van privacy. Deze cursus wordt georganiseerd in 10 verschillende modules.
Programma
Introduction, 22 April 2026
In this first module, we give a short recap of the basics, followed by the explanation of some general terms that are used in the domain of explainable and trustworthy Artificial Intelligence. This introduction will end with the definition of the challenges within this domain.
- Recap the basics: AI, ML and statistics
- Different types of ML: white-box & black-box
- Interpretability vs Explainability
- Human Uncertainty vs Model Uncertainty
- Challenges
Teacher: prof. dr. Sofie Van Hoecke, Department of Electronics and Information Systems, Ghent University & prof. dr. Femke Ongenae, Department of Information Technology, Ghent University
White box models, 29 April 2026
In this module, focus is given to white box models. While black box models offer higher accuracy, white box models are easier to explain and to interpret, unfortunately this leads to a lesser predictive capacity. In the area of white box models, several different approaches will be highlighted:
- Linear Regression
- Decision Trees and Rule Sets
- Generalized Additive Models (GAMs)
Teacher: prof. dr. Yvan Saeys, Department of Mathematics, Computer Science and Statistics, Ghent University
Interpretability & Explainability, 6 May 2026
Machine learning systems build models that learn to automate complex tasks by learning from examples. How to get insights into how these models work depends on the type of algorithm used. Getting insights into how our models work can be done by looking at how the model works in general (interpretability), versus how a specific prediction of the model was computed (explainability). Additional hypothetical “What if” questions can be asked to allow for counterfactual reasoning, adding to the toolkit of explainability methods.
- Interpretability versus explainability
- Counterfactuals
- Model distillation
- Dependency plots
- Saliency maps
Teacher: prof. dr. Yvan Saeys, Department of Mathematics, Computer Science and Statistics, Ghent University
Supply Chains & Operations, 13 May 2026
Since most AI systems are still black boxes, transparency in the AI supply chain is a foundational property of trustworthy AI. Knowing where a model comes from, what data it was trained on, an how it was tested is key to building confidence in the model itself.
We introduce the concept of an AI Bill of Materials (AI BoM), inspired by software supply chain practices, to document model lineage, training data provenance, and environment details.
By making these elements verifiable, AI BoMs enable explainability, accountability, and compliance with emerging regulations such as the EU AI Act. Open source AI models play an important role in creating more transparency, and confidential computing helps safeguard sensitive data during training and inference.
Attendees will gain practical insights into techniques that strengthen trust in AI systems without compromising innovation.
Teacher: dr. Merlijn Sebrechts, Department of Information Technology, Ghent University
Hybrid AI, 20 May 2026
The oldest forms of machine learning entail rule engines that were hand programmed. Newer forms entail algorithms searching for connections themselves. The first are great in explaining how they reach their conclusions. The latter sometimes give superior predictions, being a lot less brittle, but lack that explainability. To get the best of both worlds, these approaches are sometimes combined. Moreover, allowing an expert to guide a machine learning system can sometimes lead to yet again superior predictions. This module explains how.
- Data-driven vs expert-based approaches
- Finding synergies in data-driven and expert-based approaches
- Combining expert knowledge and machine learning
Teacher: prof. dr. Sofie Van Hoecke, Department of Electronics and Information Systems, Ghent University & prof. dr. Femke Ongenae, Department of Information Technology, Ghent University
Robustness, 27 May 2026
The output of a machine learning system depends on the data used as input. Often the needed amount and structure of that data is overlooked. However, machine learning systems can be combined to generate additional data or to finetune each other. Nevertheless, malicious additions to your training data can corrupt your system and even a well-trained system can be deceived. This module explains these issues and what you can do about them.
- Data quality & quantity
- Adversarial learning
- Poisoning attacks & defenses
- Learning theory
Teacher: dr. Jonathan Peck, Department of Applied Mathematics, Computer Science & Statistics, Ghent University
Uncertainty, 3 June 2026
The notion of uncertainty is of major importance in machine learning and constitutes a key element of modern machine learning methodology. In recent years, it has gained attention due to the increasing relevance of machine learning for practical applications, many of which are coming with safety requirements. In this regard, new problems and challenges have been identified by machine learning scholars, many of which call for novel methodological developments. Indeed, while uncertainty has a long tradition in statistics, and many useful concepts for representing and quantifying uncertainty have been developed on the basis of probability theory, recent research has gone beyond traditional approaches and also leverages more general formalisms and uncertainty calculi.
- Aleatoric and epistemic uncertainty
- First-order uncertainty representations
- Second-order uncertainty representations
Teacher: prof. dr. Willem Waegeman, Department of Data Analysis and Mathematical Modelling, Ghent University
Bias & Fairness, 10 June 2026
When training machine learning systems, the training data can be biased, leading to unwanted outcomes, i.e. an HR system trained on old hospital personnel data now stating that women might be unlikely good candidates for doctor positions. This module will explain these issues, how to avoid them, how to measure bias and what the limitations of avoiding it are.
- Various notions of fairness & impossibility theorem
- Different types of bias & methods to debias
- Ethical guidelines
- Learning fair models
- Uncovering model bias
Teacher: prof. dr. Tijl De Bie, Department of Electronics and Information Systems, Ghent University
Privacy, 17 June 2026
Sometimes the quality of machine learning system outputs and privacy are at odds and need to be balanced. However, there are techniques that allow the training of machine learning systems on privacy sensitive data, without exposing the data itself. Those techniques and relevant regulation on these practices are explained in this module.
- Pseudonimization
- K-anonymity
- Differential privacy
- Regulation
Teacher: prof. dr. Tijl De Bie, Department of Electronics and Information Systems, Ghent University
Use cases, 24 June 2026
During this module, some specific use cases in the domain of Explainable and Trustworthy AI will be discussed.
Gerelateerde opleidingen