Particle Filtering for Dynamic Agent Modelling in Simplified Poker
- Nolan Bard
- Michael Bowling, University of Alberta
Agent modelling is a challenging problem in many modern artificial intelligence applications. The agent modelling task is especially difficult when handling stochastic choices, deliberately hidden information, dynamic agents, and the need for fast learning. State estimation techniques, such as Kalman filtering and particle filtering, have addressed many of these challenges, but have received little attention in the agent modelling literature. This paper looks at the use of particle filtering for modelling a dynamic opponent in Kuhn poker, a simplified version of Texas Hold'em poker. We demonstrate effective modelling both against static opponents as well as dynamic opponents, when the dynamics are known. We then examine an application of Rao-Blackwellized particle filtering for doing dual estimation, inferring both the opponent's state as well as a model of its dynamics. Finally, we examine the robustness of the approach to incorrect beliefs about the opponent and compare it to previous work on opponent modelling in Kuhn poker.
Citation
N. Bard, M. Bowling. "Particle Filtering for Dynamic Agent Modelling in Simplified Poker". National Conference on Artificial Intelligence (AAAI), April 2007.| Keywords: | machine learning |
| Category: | In Conference |
| Related Publication(s): | Using State Estimation for Dynamic Agent Modelling |
BibTeX
@incollection{Bard+Bowling:AAAI07,
author = {Nolan Bard and Michael Bowling},
title = {Particle Filtering for Dynamic Agent Modelling in Simplified Poker},
booktitle = {National Conference on Artificial Intelligence (AAAI)},
year = 2007,
}Last Updated: January 25, 2010Submitted by Nolan Bard
