Efficient On-Chip Training of Optical Neural Networks Using Genetic Algorithm
| Autor: | Xudong Jiang, Yi Zhang, Hui Zhang, Hong Cai, Patricia Yang Liu, Leong Chuan Kwek, Jayne Thompson, Ai Qun Liu, Mile Gu, Guo-Qiang Lo, Muhammad Faeyz Karim, Yuzhi Shi, Xianshu Luo, Bin Dong |
|---|---|
| Přispěvatelé: | School of Electrical and Electronic Engineering, School of Physical and Mathematical Sciences |
| Rok vydání: | 2021 |
| Předmět: |
Computer science
Optical computing 02 engineering and technology 01 natural sciences 010309 optics Engineering On-chip Training 0103 physical sciences Genetic algorithm Electrical and Electronic Engineering Flexibility (engineering) Silicon photonics Artificial neural network business.industry Deep learning Control reconfiguration 021001 nanoscience & nanotechnology Atomic and Molecular Physics and Optics Electronic Optical and Magnetic Materials Computer architecture Software deployment Optical Neural Networks Artificial intelligence 0210 nano-technology business Biotechnology |
| Zdroj: | ACS Photonics. 8:1662-1672 |
| ISSN: | 2330-4022 |
| DOI: | 10.1021/acsphotonics.1c00035 |
| Popis: | Recent advances in silicon photonic chips have made huge progress in optical computing owing to their flexibility in the reconfiguration of various tasks. Its deployment of neural networks serves as an alternative for mitigating the rapidly increased demand for computing resources in electronic platforms. However, it remains a formidable challenge to train the online programmable optical neural networks efficiently, being restricted by the difficulty in obtaining gradient information on a physical device when executing a gradient descent algorithm. Here, we experimentally demonstrate an efficient, physics-agnostic, and closed-loop protocol for training optical neural networks on chip. A gradient-free algorithm, that is, the genetic algorithm, is adopted. The protocol is on-chip implementable, physical agnostic (no need to rely on characterization and offline modeling), and gradient-free. The protocol works for various types of chip structures and is especially helpful to those that cannot be analytically decomposed and characterized. We confirm its viability using several practical tasks, including the crossbar switch and the Iris classification. Finally, by comparing our physics-agonistic and gradient-free method to the off-chip and gradient-based training methods, we demonstrate the robustness of our system to perturbations such as imperfect phase implementation and photodetection noise. Optical processors with gradient-free genetic algorithms have broad application potentials in pattern recognition, reinforcement learning, quantum computing, and realistic applications (such as facial recognition, natural language processing, and autonomous vehicles). Ministry of Education (MOE) National Research Foundation (NRF) Accepted version This work was supported by the Singapore Ministry of Education (MOE) Tier 3 grant (MOE2017-T3-1-001), the Singapore National Research Foundation (NRF) National Natural Science Foundation of China (NSFC) joint grant (NRF2017NRF-NSFC002-014), the Singapore National Research Foundation under the Competitive Research Program (NRF-CRP13-2014-01), the NRF Fellowship reference no. NRF-NRFF2016-02. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|