Proximal Policy Optimization for Radiation Source Search

Autor: Philippe Proctor, Christof Teuscher, Adam Hecht, Marek Osiński
Jazyk: angličtina
Rok vydání: 2021
Předmět:
Zdroj: Journal of Nuclear Engineering, Vol 2, Iss 4, Pp 368-397 (2021)
Druh dokumentu: article
ISSN: 2673-4362
DOI: 10.3390/jne2040029
Popis: Rapid search and localization for nuclear sources can be an important aspect in preventing human harm from illicit material in dirty bombs or from contamination. In the case of a single mobile radiation detector, there are numerous challenges to overcome such as weak source intensity, multiple sources, background radiation, and the presence of obstructions, i.e., a non-convex environment. In this work, we investigate the sequential decision making capability of deep reinforcement learning in the nuclear source search context. A novel neural network architecture (RAD-A2C) based on the advantage actor critic (A2C) framework and a particle filter gated recurrent unit for localization is proposed. Performance is studied in a randomized 20×20 m convex and non-convex simulation environment across a range of signal-to-noise ratio (SNR)s for a single detector and single source. RAD-A2C performance is compared to both an information-driven controller that uses a bootstrap particle filter and to a gradient search (GS) algorithm. We find that the RAD-A2C has comparable performance to the information-driven controller across SNR in a convex environment. The RAD-A2C far outperforms the GS algorithm in the non-convex environment with greater than 95% median completion rate for up to seven obstructions.
Databáze: Directory of Open Access Journals