The challenge of poker

被引:148
作者
Billings, D [1 ]
Davidson, A [1 ]
Schaeffer, J [1 ]
Szafron, D [1 ]
机构
[1] Univ Alberta, Dept Comp Sci, Edmonton, AB T6G 2H1, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
computer poker; imperfect information; opponent modeling; simulations; neural networks;
D O I
10.1016/S0004-3702(01)00130-8
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Poker is an interesting test-bed for artificial intelligence research. It is a Game of imperfect information, where multiple competing agents must deal with probabilistic knowledge, risk assessment, and possible deception, not unlike decisions made in the real world. Opponent modeling is another difficult problem in decision-making applications, and it is essential to achieving high performance in poker. This paper describes the design considerations and architecture of the poker-program Poki. In addition to methods for hand evaluation and betting strategy, Poki uses learning techniques to construct statistical models of each opponent, and dynamically adapts to exploit observed patterns and tendencies. The result is a program capable of playing reasonably strong poker, but there remains considerable research to be done to play at a world-class level. (C) 2001 Elsevier Science B.V. All rights reserved.
引用
收藏
页码:201 / 240
页数:40
相关论文
共 40 条
[31]  
SKLANSKY D, 1994, HOLD EM POKER ADV PL
[32]  
SKLANSKY D, 1992, THEORY POKER
[33]  
Smith S.F., 1983, P 8 INT JOINT C ART, V83, P422
[34]  
TAKUSAGAWA K, 2000, THESIS STANFORD U
[35]   Programming backgammon using self-teaching neural nets [J].
Tesauro, G .
ARTIFICIAL INTELLIGENCE, 2002, 134 (1-2) :181-199
[36]   TEMPORAL DIFFERENCE LEARNING AND TD-GAMMON [J].
TESAURO, G .
COMMUNICATIONS OF THE ACM, 1995, 38 (03) :58-68
[37]  
von Neumann J, 1947, THEORY GAMES EC BEHA, V2
[38]   GENERALIZATION LEARNING TECHNIQUES FOR AUTOMATING LEARNING OF HEURISTICS [J].
WATERMAN, DA .
ARTIFICIAL INTELLIGENCE, 1970, 1 (1-2) :121-170
[39]   COMPUTATION OF OPTIMAL POKER STRATEGIES [J].
ZADEH, N .
OPERATIONS RESEARCH, 1977, 25 (04) :541-562
[40]  
ZADEH N, 1974, WINNING POKER SYSTEM