Summary

I am a PhD student co-supervised by Mickael Randour at the Université de Mons (UMONS) in the Mathematics department of the Faculty of Science, and Joost-Pieter Katoen at the RWTH Aachen University in the Computer Science department.
Before starting my PhD thesis in September 2018, I obtained my Master's degree in Computer Science at UMONS

My research interests are about

  • Formal verification and strategy synthesis in stochastic systems
  • Partially observable probabilistic systems (like POMDPs)
  • Reinforcement learning for verification and safety in reinforcement learning

I am also interested in the combination of formal methods and machine learning in general.

Projects and Tools

SSP Solver [link] - SSP Solver is a tool that synthesises strategies for different stochastic shortest path problems in Markov Decision Processes (e.g., minimisation of the expected cost to a set of target states in the MDP, or maximisation of the probability to reach this target set with a cost bounded, ...).
Statechart Visualizer [link] - In UML, statecharts form a visual modelling language for representing the executable behaviour of complex reactive event-based systems. Following the description of a system, the tool allows to generate a pretty visual representation of this statechart. Moreover, this program allows to add visual constraints of some states (e.g., the state A has to be right to the state B, etc.).

Publications

  • Life is Random, Time is Not: Markov Decision Processes with Window Objectives: Thomas Brihaye, Florent Delgrange, Youssouf Oualhadj, Mickael Randour , 2019 (preprint on arXiv) .

Teaching

Formal methods for system design

Teaching assistant
September 2018 - Today
CS and Maths: 4th and 5th year

Teaching assistant in charge of

  • Exercice sessions
  • Formal verification project

Hands on AI

Teaching assistant
October 2018 - November 2018
CS and Engineers: 4th and 5th year

University certificate in artificial intelligence for students and non university person.
Supervising reinforcement learning practical sessions.

Computer programming and Algorithms II

Student teaching assistant
January 2018 - June 2018
CS and Maths: 1st year
Supervising practical sessions (Java 8)

Computer programming and Algorithms I

Student teaching assistant
September 2018 - January 2018
CS, Maths and Physics: 1st and 2nd year
Supervising practical sessions (Python 3)

Attended events

  • 2019: Theory and Algorithms in Graph and Stochastic Games (UMONS), Mardi des Chercheurs (UMONS).
  • 2018: HIGHLIGHTS of Logic, Games and Automata (Technical University of Berlin), MOVEP (ENS Cachan), MoRe at FLoC 2018 (University of Oxford), Logic and learning at FoPPS 2018 (University of Oxford), Logic and learning (The Alan Turing Institute, London).