Abstract
In this study, the Pareto optimal strategy problem was investigated for multi-player mean-field stochastic systems governed by Itô differential equations using the reinforcement learning (RL) method. A partially model-free solution for Pareto-optimal control was derived. First, by applying the convexity of cost functions, the Pareto optimal control problem was solved using a weighted-sum optimal control problem. Subsequently, using on-policy RL, we present a novel policy iteration (PI) algorithm based on the ℌ-representation technique. In particular, by alternating between the policy evaluation and policy update steps, the Pareto optimal control policy is obtained when no further improvement occurs in system performance, which eliminates directly solving complicated cross-coupled generalized algebraic Riccati equations (GAREs). Practical numerical examples are presented to demonstrate the effectiveness of the proposed algorithm.
| Original language | English |
|---|---|
| Article number | 140202 |
| Journal | Science China Information Sciences |
| Volume | 67 |
| Issue number | 4 |
| DOIs | |
| Publication status | Published - Apr 2024 |
Bibliographical note
Publisher Copyright:© Science China Press 2024.
Keywords
- Pareto optimal control
- mean-field stochastic systems
- policy iteration scheme
- ℌ-representation
Fingerprint
Dive into the research topics of 'Online Pareto optimal control of mean-field stochastic multi-player systems using policy iteration'. Together they form a unique fingerprint.Cite this
- APA
- Author
- BIBTEX
- Harvard
- Standard
- RIS
- Vancouver