Not Logged In

Solving Heads-Up Limit Texas Hold'em

Full Text: 097.pdf PDF

Cepheus is the first computer program to essentially solve a game of imperfect information that is played competitively by humans. The game it plays is heads-up limit Texas hold'em poker, a game with over 10^14 information sets, and a challenge problem for artificial intelligence for over 10 years. Cepheus was trained using a new variant of Counterfactual Regret Minimization (CFR), called CFR+, using 4800 CPUs running for 68 days. In this paper we describe in detail the engineering details required to make this computation a reality. We also prove the theoretical soundness of CFR+ and its component algorithm, regret-matching+. We further give a hint towards understanding the success of CFR+ by proving a tracking regret bound for this new regret matching algorithm. We present results showing the role of the algorithmic components and the engineering choices to the success of CFR+.

Citation

O. Tammelin, N. Burch, M. Johanson, M. Bowling. "Solving Heads-Up Limit Texas Hold'em". International Joint Conference on Artificial Intelligence (IJCAI), (ed: Qiang Yang, Michael J. Wooldridge), pp 645-652, July 2015.

Keywords:  
Category: In Conference
Web Links: IJCAI

BibTeX

@incollection{Tammelin+al:IJCAI15,
  author = {Oskari Tammelin and Neil Burch and Michael Johanson and Michael
    Bowling},
  title = {Solving Heads-Up Limit Texas Hold'em},
  Editor = {Qiang Yang, Michael J. Wooldridge},
  Pages = {645-652},
  booktitle = {International Joint Conference on Artificial Intelligence
    (IJCAI)},
  year = 2015,
}

Last Updated: October 29, 2020
Submitted by Sabina P

University of Alberta Logo AICML Logo