Journals
Resources
About Us
Open Access

Reinforcement Learning Algorithm for Mixed Mean Field Control Games

Year:    2023

Author:    Andrea Angiuli, Nils Detering, Jean-Pierre Fouque, Mathieu Laurière, Jimin Lin

Journal of Machine Learning, Vol. 2 (2023), Iss. 2 : pp. 108–137

Abstract

We present a new combined mean field control game (MFCG) problem which can be interpreted as a competitive game between collaborating groups and its solution as a Nash equilibrium between groups. Players coordinate their strategies within each group. An example is a modification of the classical trader’s problem. Groups of traders maximize their wealth. They face cost for their transactions, for their own terminal positions, and for the average holding within their group. The asset price is impacted by the trades of all agents. We propose a three-timescale reinforcement learning algorithm to approximate the solution of such MFCG problems. We test the algorithm on benchmark linear-quadratic specifications for which we provide analytic solutions.

Journal Article Details

Publisher Name:    Global Science Press

Language:    English

DOI:    https://doi.org/10.4208/jml.220915

Journal of Machine Learning, Vol. 2 (2023), Iss. 2 : pp. 108–137

Published online:    2023-01

AMS Subject Headings:   

Copyright:    COPYRIGHT: © Global Science Press

Pages:    30

Keywords:    Mean Field Control Games Reinforcement Learning Q-Learning Optimal Liquidation.

Author Details

Andrea Angiuli

Nils Detering

Jean-Pierre Fouque

Mathieu Laurière

Jimin Lin

  1. Markov decision processes under model uncertainty

    Neufeld, Ariel | Sester, Julian | Šikić, Mario

    Mathematical Finance, Vol. 33 (2023), Iss. 3 P.618

    https://doi.org/10.1111/mafi.12381 [Citations: 4]
  2. How can the tragedy of the commons be prevented?: Introducing Linear Quadratic Mixed Mean Field Games

    Dayanıklı, Gökçe | Laurière, Mathieu

    2024 IEEE 63rd Conference on Decision and Control (CDC), (2024), P.6792

    https://doi.org/10.1109/CDC56724.2024.10886681 [Citations: 0]
  3. Developing Game AI for Classic Games Using Reinforcement Learning

    Gupta, Shivam | Nancy, Nancy | Saw, Priyanshu Kumar | Raj, Atul | Kumar, Amit | Agrawal, Kushagra

    2024 IEEE 1st International Conference on Green Industrial Electronics and Sustainable Technologies (GIEST), (2024), P.1

    https://doi.org/10.1109/GIEST62955.2024.10960023 [Citations: 0]