Strategy Acquisition for Games Based on Simplified Reinforcement Learning Using a Strategy Network
| Autor: | Masafumi Hagiwara, Masaaki Kanakubo |
|---|---|
| Rok vydání: | 2005 |
| Předmět: |
Learning classifier system
Error-driven learning Artificial neural network Computer science business.industry ComputingMilieux_PERSONALCOMPUTING Machine learning computer.software_genre Human-Computer Interaction Artificial Intelligence Reinforcement learning Computer Vision and Pattern Recognition Artificial intelligence business computer |
| Zdroj: | Journal of Advanced Computational Intelligence and Intelligent Informatics. 9:203-210 |
| ISSN: | 1883-8014 1343-0130 |
| DOI: | 10.20965/jaciii.2005.p0203 |
| Popis: | We propose a simplified form of reinforcement learning (RL) for game strategy acquisition using a strategy network. RL has been applied to a number of games, such as backgammon, checkers, etc. However, the application of RL to Othello or Shogi, which have very large state spaces, is more difficult because these games take a very long time to learning. The proposed strategy network is composed of N lines from N nodes on the game board with a single evaluation node as a 2-layer perceptron. These nodes denote all possible states of every square on the game board and can easily represent the evaluation function. Moreover, these nodes can also denote imaginary states, such as pieces that may exist in the next step, or denote every positional relation of two arbitrary pieces or other various board phases. After several thousands of games had been played, the strategy network quickly acquired a better evaluation function than that using a normalized Gaussian network. The computer player employing the strategy network beat a heuristic-based player that evaluates the values of pieces or places on the game board. The proposed strategy network was able to acquire good weightings of various features of game states. In addition, the player employing the strategy network for a 4×4 Othello task after co-evolutionary training acquired a winning strategy. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|