Deep backward schemes for high-dimensional nonlinear PDEs
Autor: | Côme Huré, Huyên Pham, Xavier Warin |
---|---|
Přispěvatelé: | Laboratoire de Probabilités, Statistiques et Modélisations (LPSM (UMR_8001)), Université Paris Diderot - Paris 7 (UPD7)-Sorbonne Université (SU)-Centre National de la Recherche Scientifique (CNRS), Université Paris Diderot - Paris 7 (UPD7), Laboratoire de Finance des Marchés d'Energie (FiME Lab), EDF R&D (EDF R&D), EDF (EDF)-EDF (EDF)-CREST-Université Paris Dauphine-PSL, Université Paris sciences et lettres (PSL)-Université Paris sciences et lettres (PSL), EDF (EDF), FiME, Laboratoire de Finance des Marchés de l'Energie, and the 'Finance and Sustainable Development' EDF - CACIB Chair. |
Rok vydání: | 2019 |
Předmět: |
FOS: Computer and information sciences
Machine Learning (stat.ML) 010103 numerical & computational mathematics [INFO.INFO-NE]Computer Science [cs]/Neural and Evolutionary Computing [cs.NE] 01 natural sciences Stochastic differential equation [STAT.ML]Statistics [stat]/Machine Learning [stat.ML] Statistics - Machine Learning Deep neural networks FOS: Mathematics Applied mathematics Optimal stopping Mathematics - Numerical Analysis Neural and Evolutionary Computing (cs.NE) 0101 mathematics nonlinear PDEs in high dimension Mathematics - Optimization and Control Mathematics Algebra and Number Theory Partial differential equation Artificial neural network business.industry Applied Mathematics Deep learning Probability (math.PR) Computer Science - Neural and Evolutionary Computing Numerical Analysis (math.NA) optimal stopping problem 010101 applied mathematics Maxima and minima [MATH.MATH-PR]Mathematics [math]/Probability [math.PR] Computational Mathematics Nonlinear system Optimization and Control (math.OC) Variational inequality backward stochastic differential equations Artificial intelligence [MATH.MATH-OC]Mathematics [math]/Optimization and Control [math.OC] business Mathematics - Probability [MATH.MATH-NA]Mathematics [math]/Numerical Analysis [math.NA] |
DOI: | 10.48550/arxiv.1902.01599 |
Popis: | We propose new machine learning schemes for solving high dimensional nonlinear partial differential equations (PDEs). Relying on the classical backward stochastic differential equation (BSDE) representation of PDEs, our algorithms estimate simultaneously the solution and its gradient by deep neural networks. These approximations are performed at each time step from the minimization of loss functions defined recursively by backward induction. The methodology is extended to variational inequalities arising in optimal stopping problems. We analyze the convergence of the deep learning schemes and provide error estimates in terms of the universal approximation of neural networks. Numerical results show that our algorithms give very good results till dimension 50 (and certainly above), for both PDEs and variational inequalities problems. For the PDEs resolution, our results are very similar to those obtained by the recent method in \cite{weinan2017deep} when the latter converges to the right solution or does not diverge. Numerical tests indicate that the proposed methods are not stuck in poor local minimaas it can be the case with the algorithm designed in \cite{weinan2017deep}, and no divergence is experienced. The only limitation seems to be due to the inability of the considered deep neural networks to represent a solution with a too complex structure in high dimension. Comment: 34 pages |
Databáze: | OpenAIRE |
Externí odkaz: |