Faster and more diverse de novo molecular optimization with double-loop reinforcement learning using augmented SMILES.

Autor: Bjerrum EJ; Odyssey Therapeutics, Cambridge, MA, USA. esben@odysseytx.com., Margreitter C; Odyssey Therapeutics, Cambridge, MA, USA., Blaschke T; Odyssey Therapeutics, Cambridge, MA, USA., Kolarova S; Odyssey Therapeutics, Cambridge, MA, USA., de Castro RL; Odyssey Therapeutics, Cambridge, MA, USA.; Department of Physics and Department of Chemistry, King's College, London, UK.
Jazyk: angličtina
Zdroj: Journal of computer-aided molecular design [J Comput Aided Mol Des] 2023 Aug; Vol. 37 (8), pp. 373-394. Date of Electronic Publication: 2023 Jun 17.
DOI: 10.1007/s10822-023-00512-6
Abstrakt: Using generative deep learning models and reinforcement learning together can effectively generate new molecules with desired properties. By employing a multi-objective scoring function, thousands of high-scoring molecules can be generated, making this approach useful for drug discovery and material science. However, the application of these methods can be hindered by computationally expensive or time-consuming scoring procedures, particularly when a large number of function calls are required as feedback in the reinforcement learning optimization. Here, we propose the use of double-loop reinforcement learning with simplified molecular line entry system (SMILES) augmentation to improve the efficiency and speed of the optimization. By adding an inner loop that augments the generated SMILES strings to non-canonical SMILES for use in additional reinforcement learning rounds, we can both reuse the scoring calculations on the molecular level, thereby speeding up the learning process, as well as offer additional protection against mode collapse. We find that employing between 5 and 10 augmentation repetitions is optimal for the scoring functions tested and is further associated with an increased diversity in the generated compounds, improved reproducibility of the sampling runs and the generation of molecules of higher similarity to known ligands.
(© 2023. The Author(s), under exclusive licence to Springer Nature Switzerland AG.)
Databáze: MEDLINE
Externí odkaz:
Nepřihlášeným uživatelům se plný text nezobrazuje