Multi-objective Reinforced Evolution in Mobile Neural Architecture Search

Autor: Xu Ruijun, Bo Zhang, Xiangxiang Chu
Rok vydání: 2020
Předmět:
Zdroj: Computer Vision – ECCV 2020 Workshops ISBN: 9783030668228
ECCV Workshops (4)
DOI: 10.1007/978-3-030-66823-5_6
Popis: Fabricating neural models for a wide range of mobile devices is a challenging task due to highly constrained resources. Recent trends favor neural architecture search involving evolutionary algorithms (EA) and reinforcement learning (RL), however, they are separately used. In this paper, we present a novel multi-objective algorithm called MoreMNAS (Multi-Objective Reinforced Evolution in Mobile Neural Architecture Search) by leveraging good virtues from both sides. Particularly, we devise a variant of multi-objective genetic algorithm NSGA-II, where mutations are performed either by reinforcement learning or a natural mutating process. It maintains a delicate balance between exploration and exploitation. Not only does it prevent the search degradation, but it also makes use of the learned knowledge. Our experiments conducted in Super-resolution domain (SR) deliver rivaling models compared with some state-of-the-art methods at fewer FLOPS (Evaluation code can be found at https://github.com/xiaomi-automl/MoreMNAS).
Databáze: OpenAIRE