Skip to content Skip to navigation
University of Warwick
  • Study
  • |
  • Research
  • |
  • Business
  • |
  • Alumni
  • |
  • News
  • |
  • About

University of Warwick
Publications service & WRAP

Highlight your research

  • WRAP
    • Home
    • Search WRAP
    • Browse by Warwick Author
    • Browse WRAP by Year
    • Browse WRAP by Subject
    • Browse WRAP by Department
    • Browse WRAP by Funder
    • Browse Theses by Department
  • Publications Service
    • Home
    • Search Publications Service
    • Browse by Warwick Author
    • Browse Publications service by Year
    • Browse Publications service by Subject
    • Browse Publications service by Department
    • Browse Publications service by Funder
  • Help & Advice
University of Warwick

The Library

  • Login
  • Admin

Optimally weighted loss functions for solving PDEs with neural networks

Tools
- Tools
+ Tools

van der Meer, Remco, Oosterlee, Cornelis W. and Borovykh, Anastasia (2022) Optimally weighted loss functions for solving PDEs with neural networks. Journal of Computational and Applied Mathematics, 405 . 113887. doi:10.1016/j.cam.2021.113887

[img] PDF
WRAP-Optimally-weighted-loss-functions-solving-PDEs-Neural-Networks-2021.pdf - Accepted Version
Embargoed item. Restricted access to Repository staff only until 2 December 2022. Contact author directly, specifying your specific needs. - Requires a PDF viewer.
Available under License Creative Commons Attribution Non-commercial No Derivatives 4.0.

Download (1334Kb)
Official URL: https://doi.org/10.1016/j.cam.2021.113887

Request Changes to record.

Abstract

Recent works have shown that deep neural networks can be employed to solve partial differential equations, giving rise to the framework of physics informed neural networks (Raissi et al., 2007). We introduce a generalization for these methods that manifests as a scaling parameter which balances the relative importance of the different constraints imposed by partial differential equations. A mathematical motivation of these generalized methods is provided, which shows that for linear and well-posed partial differential equations, the functional form is convex. We then derive a choice for the scaling parameter that is optimal with respect to a measure of relative error. Because this optimal choice relies on having full knowledge of analytical solutions, we also propose a heuristic method to approximate this optimal choice. The proposed methods are compared numerically to the original methods on a variety of model partial differential equations, with the number of data points being updated adaptively. For several problems, including high-dimensional PDEs the proposed methods are shown to significantly enhance accuracy.

Item Type: Journal Article
Subjects: Q Science > QA Mathematics
Divisions: Faculty of Social Sciences > Warwick Business School
Library of Congress Subject Headings (LCSH): Neural networks (Computer science), Differential equations, Partial, Mathematical optimization
Journal or Publication Title: Journal of Computational and Applied Mathematics
Publisher: Elseivier Science BV
ISSN: 0377-0427
Official Date: 15 May 2022
Dates:
DateEvent
15 May 2022Published
2 December 2021Available
12 October 2021Accepted
Volume: 405
Article Number: 113887
DOI: 10.1016/j.cam.2021.113887
Status: Peer Reviewed
Publication Status: Published
Access rights to Published version: Restricted or Subscription Access

Request changes or add full text files to a record

Repository staff actions (login required)

View Item View Item
twitter

Email us: wrap@warwick.ac.uk
Contact Details
About Us