Convergence analysis of deep Ritz method with over-parameterization.

Abstract

The deep Ritz method (DRM) has recently been shown to be a simple and effective method for solving PDEs. However, the numerical analysis of DRM is still incomplete, especially why over-parameterized DRM works remains unknown. This paper presents the first convergence analysis of the over-parameterized DRM for second-order elliptic equations with Robin boundary conditions. We demonstrate that the convergence rate can be controlled by the weight norm, regardless of the number of parameters in the network. To this end, we establish novel approximation results in Sobolev spaces with norm constraints, which have independent significance.