Spectrum-Informed Multistage Neural Networks: Multiscale Function Approximators of Machine Precision
| Autor: | Ng, Jakin, Wang, Yongji, Lai, Ching-Yao |
|---|---|
| Rok vydání: | 2024 |
| Předmět: | |
| Druh dokumentu: | Working Paper |
| Popis: | Deep learning frameworks have become powerful tools for approaching scientific problems such as turbulent flow, which has wide-ranging applications. In practice, however, existing scientific machine learning approaches have difficulty fitting complex, multi-scale dynamical systems to very high precision, as required in scientific contexts. We propose using the novel multistage neural network approach with a spectrum-informed initialization to learn the residue from the previous stage, utilizing the spectral biases associated with neural networks to capture high frequency features in the residue, and successfully tackle the spectral bias of neural networks. This approach allows the neural network to fit target functions to double floating-point machine precision $O(10^{-16})$. Comment: 8 pages, 3 figures, ICML 2024 workshop (AI for Science: Scaling in AI for Scientific Discovery) |
| Databáze: | arXiv |
| Externí odkaz: |
|