Decentralized Partially Observable Markov Decision Process

Work in process.

Mean-Field Game for Autonomous Vehicles Navigation

Mean-Field Game is developed to study the decision-making strategy in multi-agent systems with very large populations by building a connection between stochastic modeling and distributed control. In the context of autonomous vehicle navigation, each vehicle acts as an agent and makes decisions regarding velocity control and route choice [ref] according to current population density distribution. The actions of all vehicles jointly trigger the evolution of density dynamics. This process repeats until converges to the mean-field equilibrium. We proposed various approaches to address the practical challenges, such as fine-granularity [ref], scalability and computational efficiency [ref1, ref2].



Most of these research works were done in collaboration with Xu Chen.