Path Searching of Robot Manipulator Using Reinforcement Learning-Reduction of Searched Configuration Space Using SOM and Multistage Learning

Autor:	Kenji Hiraoka, Seiji Aoyagi
Rok vydání:	2010
Předmět:	Reduction (complexity) General Computer Science Computer science business.industry Path (graph theory) Robot manipulator Reinforcement learning Computer vision Path search Configuration space Artificial intelligence Electrical and Electronic Engineering business
Zdroj:	Journal of Robotics and Mechatronics. 22:532-541
ISSN:	1883-8049 0915-3942
DOI:	10.20965/jrm.2010.p0532
Popis:	Reinforcement learning is applicable to a robot manipulator required to search for a path adaptable to an unknown environment. Searching for an optimal path in configuration space (C-space), i.e., joint angle space, however, takes much convergence time and memory resources. We propose two ways to overcome this problem. One is restructuring C-space by using Self-Organizing Maps (SOM). Another is doing reinforcement learning at multistage, stage 1 of which searches a path in C-space without considering obstacles, so does stage 2 with considering them near path 1, reducing searched space and convergence time. We propose further reducing searched space by adjusting the path in stage 2 to that in stage 1 through dynamic programming (DP) matching.
Databáze:	OpenAIRE
Externí odkaz:	https://explore.openaire.eu/search/publication?articleId=doi_________::5ed5ee7ff868805ccfd0f5d50d537f3c https://doi.org/10.20965/jrm.2010.p0532 Zobrazit plný text záznamu