Smile-IT is a strategic basic research project in which artificial intelligence is applied to communication and power system networks. The project focuses on multi-agent reinforcement learning and a robust interaction software framework to model such networks and its actors. EnergyVille is responsible for the smart grid applications.
Status
Period
EnergyVille is building a strong international reputation in the field of demand response in a smart grids context, both at an experimental and an algorithmic level. Near-optimal control of flexibility however, relies on the availability of an accurate model describing the dynamics of the cluster. Defining and calibrating an accurate model often requires dedicated expert knowledge. This strongly reduces the practicality of such an approach, certainly given that the model and its parameters need repeated updates. Whilst this is less a bottle neck for large consumers, this can be a show-stopper for managing flexibility related to small consumers. To this end EnergyVille leverages on recent developments in machine learning and reinforcement learning to obtain general-purpose self-learning control algorithms tailored to energy applications for small to large groups of consumers harbouring flexibility.
Multi-agent reinforcement learning (MARL) is a promising technique for automatically managing complex and highly-distributed networked systems. Reinforcement learning possesses the inherit ability to cope with uncertainty and allows agents to automatically learn how to properly behave in face of unexpected situations. The introduction of multi-agent concepts supports effective inter-agent collaborations, allowing them to jointly achieve their, possibly competing, goals. Additionally, human operators will still be needed to effectively control and guide the automated agents in line with the high-level business goals and processes of the managed system. Intuitive and novel programming abstractions are needed to facilitate the straight-forward configuration of such multi-agent systems.
The overall project’s goals is to develop a MARL framework, and to apply it to different application domains (telecom, smart grids, traffic, …). EnergyVille’s contribution focuses on the application to smart grids. Specific research questions include dealing with uncertainty, learning over large periods of time, self-healing and robustness.
Smile-IT is an IWT-SBO project: a project funded by the Flemish Agency for Innovation through Science and Technology, promoting Strategic Basic Research. It runs for 4 years with a total subsidy of 2,5M€.
