Here are some recommended readings. More will be added later.

Recommended Textbooks

Game Theory. The best textbook I know of on game theory is:

Martin J. Osborne and Ariel Rubinstein. A Course in Game Theory. MIT Press, 1994. It is available electronically (within UVa): Electronic Version, but I recommend getting it on paper for easier reading.

Artificial Intelligence. The definitive book on AI is:

Stuart Russell and Peter Norvig. Artificial Intelligence: A Modern Approach (Third Edition). Prentice Hall, 2010. [Amazon] (The UVa library does not appear to have this, but I have put in a request. I have one copy whoever asks first can borrow.)

I also recommend Tim Jones’ Artificial Intelligence: A Systems Approach (Jones and Bartlett, 2008).

Machine Learning. This book focuses on Bayesian networks and other kinds of graphical models (including Hidden Markov Models):

Daphne Koller and Nir Friedman. Probabilistic Graphical Models: Principles and Techniques. MIT Press, 2009. [Amazon] [UVa Library]

A good, broad overview of machine learning is:

Ethem Alpaydin, Introduction to Machine Learning (Second Edition). MIT Press, 2010. [Amazon]

Computer Poker

New Survey Paper!: Jonathan Rubin, Ian Watson. Computer Poker: A review. Artificial Intelligence, 2011. [Proof PDF] [Final Version PDF (UVa only)]

Aaron Davidson. Opponent Modeling in Poker: Learning and Acting in a Hostile and Uncertain Environment. University of Alberta MSc Thesis, 2002. [PDF] This MSc Thesis describes Poki. Some of the content expands on an earlier ICAI paper: Aaron Davidson, Darse Billings, Jonathan Schaeffer, and Duane Szafron. Improved Opponent Modeling in Poker. Proceedings of the 2000 International Conference on Artificial Intelligence, 2000. [PDF].

Darse Billings, Neil Burch, Aaron Davidson, Robert Holte, Jonathan Schaeffer, Terence Schauenberg, and Duane Szafron. Approximating Game-Theoretic Optimal Strategies for Full-scale Poker. 2003 International Joint Conference on Artificial Intelligence. [PDF]

Darse Billings. Algorithms and Assessment in Computer Poker. University of Alberta PhD Thesis, 2006. [PDF] (See Readings for Jan 25 for individual chapters.)

Martin Zinkevich and Michael Bowling and Nolan Bard and Morgan Kan and Darse Billings. Optimal Unbiased Estimators for Evaluating Agent Performance. In Proceedings of the Twenty-First National Conference on Artificial Intelligence (AAAI). [PDF]

Martin Zinkevich, Michael Johanson, Michael Bowling, Carmelo Piccione. Regret Minimization in Games with Incomplete Information. Advances in Neural Information Processing Systems. [PDF]

Andrew Gilpin and Tuomas Sandholm. 2007. Lossless Abstraction of Imperfect Information Games. Journal of the ACM, 2009. [PDF] (Provides an optimal solution to Rhode Island Hold’em, three-card game. (Earlier version: Andrew Gilpin and Tuomas Sandholm. Finding Equilibria in Large Sequential Games of Imperfect Information. ACM Conference on Electronic Commerce, 2008.)

Michael Johanson, Martin Zinkevich, and Michael Bowling. Computing Robust Counter-Strategies. Advances in Neural Information Processing Systems 20 (NIPS). 2008. [PDF]

Andrew Gilpin, Tuomas Sandholm, and Troels Bjerre Sørensen. 2008. A Heads-Up No-Limit Texas Hold’em Poker Player: Discretized Betting Models and Automatically Generated Equilibrium-Finding Programs. International Joint Conference on Autonomous Agents and Multiagent Systems (AAMAS’08). [PDF]

Daphne Koller and Avi Pfeffer. Generating and Solving Imperfect Information Games. IJCAI 1995. [PDF]

Books on Poker

My favorite books on (human) poker strategy are Dan Harrington’s Harrington on Hold ‘Em series: Volume 1: Strategic Play, Volume 2: Endgame, and Volume 3: Workbook.

Bill Chen and Jerrod Ankeman’s The Mathematics of Poker is a game theory-focused analysis of many simple poker variants and situations. It is targeted to sophisticated poker players without much mathematics, so only uses simple probability and algebra, but this is enough for explaining many situations.

A great book that is a comprehensive history of poker is James McManus’ Cowboy’s Full: The Story of Poker. It includes a chapter on AI poker (focusing on Daphne Koller).

Another worthwhile book is Michael Craig’s The Professor, the Banker, and the Suicide King: Inside the Richest Poker Game of All Time about how Andy Beal trained himself to beat all the best Vegas players at head’s up (2 player) Texas Hold’Em.