Evolving an expert checkers playing program without using human expertise

被引:102
作者
Chellapilla, K [1 ]
Fogel, DB [1 ]
机构
[1] Nat Select Inc, La Jolla, CA 92037 USA
关键词
checkers; coevolution; evolutionary computation;
D O I
10.1109/4235.942536
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
An evolutionary algorithm has taught itself how to play the game of checkers without using features that would normally require human expertise. Using only the raw positions of pieces on the board and the piece differential, the evolutionary program optimized artificial neural networks to evaluate alternative positions in the game. Over the course of several hundred generations, the program taught itself to play at a level that is competitive with human experts (one level below human masters). This was verified by playing the best evolved neural network against 165 human players on an Internet gaming zone. The neural network's performance earned a rating that was better than 99.61% of all registered players at the website. Control experiments between the best evolved neural network and a program that relies on material advantage indicate the superiority of the neural network both at equal levels of look ahead and CPU time. The results suggest that the principles of Darwinian evolution may be usefully applied to solving problems that have not yet been solved by human expertise.
引用
收藏
页码:422 / 428
页数:7
相关论文
共 15 条
  • [1] RANDOM EVALUATIONS IN CHESS
    BEAL, D
    SMITH, MC
    [J]. ICCA JOURNAL, 1994, 17 (01): : 3 - 9
  • [2] Evolution, neural networks, games, and intelligence
    Chellapilla, K
    Fogel, DB
    [J]. PROCEEDINGS OF THE IEEE, 1999, 87 (09) : 1471 - 1496
  • [3] Co-evolving checkers playing programs using only win, lose, or draw
    Chellapilla, K
    Fogel, DB
    [J]. APPLICATIONS AND SCIENCE OF COMPUTATIONAL INTELLIGENCE II, 1999, 3722 : 303 - 312
  • [4] Evolving neural networks to play checkers without relying on expert knowledge
    Chellapilla, K
    Fogel, DB
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 1999, 10 (06): : 1382 - 1391
  • [5] FOGEL DB, 1993, P IEEE INT C NEUR NE, P875
  • [6] FOGEL DB, 2001, IN PRESS NEUROCOMPUT
  • [7] Kaindl H., 1990, COMPUTERS CHESS COGN, P133, DOI [10.1007/978-1-4613-9080-0, DOI 10.1007/978-1-4613-9080-0]
  • [8] STEPS TOWARD ARTIFICIAL INTELLIGENCE
    MINSKY, M
    [J]. PROCEEDINGS OF THE INSTITUTE OF RADIO ENGINEERS, 1961, 49 (01): : 8 - +
  • [9] CELL SIGNALING PATHWAY INVOLVED IN PACAP-INDUCED AR4-2J CELL-PROLIFERATION
    MORISSET, J
    DOUZIECH, N
    RYDZEWSKA, G
    BUSCAIL, L
    RIVARD, N
    [J]. CELLULAR SIGNALLING, 1995, 7 (03) : 195 - 205
  • [10] Co-evolution in the successful learning of backgammon strategy
    Pollack, JB
    Blair, AD
    [J]. MACHINE LEARNING, 1998, 32 (03) : 225 - 240