Numerical MethodsFinite ElementPDE SolversDifferentiable Programming

Numerical Methods & PDE Solvers

The full chain from discretisation theory to production solvers: FEM, FVM and spectral methods, industrial solvers such as OpenFOAM and PETSc, differentiable physics programming, and recent numerical-methods research.

Updated Nov 3, 2026 43 resources
Introduction

Why this collection

Every upper-layer method in physics AI — PINNs, neural operators, surrogates — ultimately has to deal with numerical methods. Some treat it as a black box to be replaced, some embed it in the training loop, and others displace it with a differentiable version. Without discretisation literacy you cannot judge whether an AI result is trustworthy.

Industrial deployment also cannot avoid production solvers. OpenFOAM, PETSc and SU2 carry real engineering cases, and their parallel strategies, memory models and convergence criteria directly decide whether your AI pipeline can run at all.

This collection links three layers:

  • Discretisation and classical numerics — textbooks and tools for FEM, FVM and spectral methods, i.e. how an equation becomes a matrix;
  • Production-grade solvers — open-source solvers and their ecosystems, deployable as-is;
  • Differentiable physics and programming — frameworks that put solvers on the gradient path, currently the hottest direction.

Suggested order: discretisation → production solvers → differentiable physics. Skipping the first layer and jumping straight to the third raises debugging cost by an order of magnitude.

Engineering Practice & Industrial Workflows 1 resources

OpenFOAM Industrial Multiphysics Pipeline: From Meshing to Data Supply

General CFD / Industrial Simulation / Data Generation
A review of the industrial multiphysics pipeline around the three OpenFOAM distribution lines: conjugate heat transfer coupling, what version 14 and v2606 actually changed, the real state of GPU offloading, and where electromagnetic capability actually sits in the mainline code.
New GPL-3.0 (all three distribution lines publish under GPL v3) OpenFOAMFinite VolumeIndustrial Simulation

Discretisation & Classical Numerics 15 resources

Backward log orthogonal functions and their approximation theory

ScientificML
Introduces backward logarithmic orthogonal functions constructed via terminal-endpoint logarithmic mapping of generalized Laguerre polynomials, designed for backward spectral approximation of problems with weak endpoint singularities.
See LICENSE file spectral methodsorthogonal functionsapproximation theory

FEniCS / FFCx

Finite Element Framework / Multiphysics
Open-source FEM-based multiphysics framework; describes variational problems in UFL and auto-generates efficient C++ discretization code - a standard academic tool for solids and coupled physics, also a high-fidelity reference for surrogates.
New LGPL-3.0 FEMFinite ElementMultiphysics
💬 Editor note: The FEniCS / FFCx finite element platform, programmed through variational forms — ideal for rapid validation during research prototyping.

Physics Simulation & ML Integration Roadmap

Learning Roadmap / Systematic Overview
Systematic path from classical PDE numerics to data-driven physics AI - FEM, FVM, surrogates, PINN and their evolution.
CC BY 4.0 RoadmapPDENumerical Method
💬 Editor note: The overall roadmap: it threads the evolution from finite element and finite volume through surrogates to PINNs — the best entry point for the whole stack.

Finite Element from Scratch in Python

Finite Element / From Scratch
Build a 2D linear-elastic FEM solver from NumPy/SciPy - no FEniCS/Abaqus - to deeply understand every matrix derivation and assembly step.
GPL-3.0 FEMFinite ElementPython
💬 Editor note: Derives and assembles a 2D elastic FEM matrix from scratch in NumPy, with no framework at all — read this to genuinely understand discretisation.

Dedalus Spectral PDE Solver Framework

General SciML / Framework Tutorial
Python framework that builds spectral-method solvers symbolically (Burns et al. 2020), widely used in fluid dynamics, plasma, star and planet research.
New GPL-3.0 Spectral MethodSymbolicPython
💬 Editor note: The Dedalus spectral framework pairs symbolic computation with MPI parallelism — a practical reference for the spectral-methods direction.

CFD Python: 12 Steps to Navier-Stokes

Fluid / CFD / Beginner Tutorial
Lorena Barba classic "12 Steps to Navier-Stokes" - twelve Jupyter notebooks building solvers from 1-D linear convection to 2-D NS and channel flow.
New See LICENSE file CFDFinite DifferenceBeginner
💬 Editor note: Twelve steps into Navier–Stokes: little code, but every step carries physical meaning — a high-value path to CFD intuition.

FEniCS/dolfinx v0.11.0.post0 Released

Scientific Computing/Finite Element
FEniCS/dolfinx releases a patch version that fixes a Mathjax rendering issue in the built documentation. This release is functionally identical to v0.11.0, so users do not need to upgrade.
GNU Lesser General Public License v3.0 FEniCSdolfinxFinite Element

Clawpack Finite-Volume Solvers for Hyperbolic PDEs

Fluid / CFD / Framework Tutorial
LeVeque team finite-volume package - Godunov-type schemes for hyperbolic conservation laws, standard tool for shocks, tsunami, reservoir, and seismic waves.
New BSD-3-Clause Finite VolumeHyperbolic PDEShock Wave

FEniCS Automated Finite Element Platform

Solid / Structure / Framework Tutorial
FEM platform where you write variational forms in near-math UFL syntax and discretization/solving is automated - the standard learning route with its official tutorial book.
New LGPL-3.0 Finite ElementFEMVariational Form

Production-Grade Solvers 4 resources

OpenFOAM

General-Purpose CFD Solver
Open-source CFD solver as a physics-AI data backbone: principles, case structure, getting started, alternatives, cost accounting and failure boundaries.
New GPL v3 CFDOpen SourceSolver
💬 Editor note: One of the de facto industrial-grade open CFD solvers, and the workhorse for industrial cases and engineering workflows.

PETSc

Numerical Solver Library / HPC
High-performance scientific library from Argonne for large linear/nonlinear systems and parallel infrastructure - the underlying solver engine of top-tier CFD and multiphysics simulation, BSD-2-Clause friendly for commercial use.
New BSD-2-Clause SolverLinear AlgebraSparse Matrix
💬 Editor note: PETSc provides parallel linear algebra and solver suites — an unavoidable low-level library for large sparse problems.

PyVista

Visualization / Post-Processing
Python 3D visualization and mesh-processing framework wrapping VTK; a concise API for field data, mesh rendering and animation. The de-facto standard for simulation post-processing, ML dataset construction and QA, used as the output layer by FEniCSx / PyMAPDL.
New MIT VisualizationVTKMesh

SU2

Aerodynamics / Design Optimization Solver
Open-source CFD and discrete-adjoint solver with built-in aerodynamic shape optimization; PDE-constrained gradients at a cost independent of design-variable count, a high-fidelity reference for surrogates.
New GNU Lesser General Public License v2.1 CFDAdjointShape Optimization
💬 Editor note: SU2 ships adjoint methods and is common in aerodynamic optimisation, complementing the surrogate-model direction.

Differentiable Physics & Programming 15 resources

Frax

Robot Kinematics and Dynamics Library / JAX Autodiff Control Framework
A pure-Python, JAX-based robot kinematics and dynamics library from Stanford ASL that delivers Pinocchio-class speed with autodifferentiation and MJX-compatible parallelism for high-performance IK and inverse-dynamics control.
New MIT License Robot DynamicsKinematicsAutomatic Differentiation

Physics-Based Deep Learning (Online Book)

Textbook / Systematic Course
A free online textbook from TU Munich covering physics + deep learning: differentiable physics, PINNs, neural operators and turbulence modeling, with runnable code.
CC BY-NC-SA 4.0 TextbookDifferentiable PhysicsPINN

SuperMimic

Humanoid Whole-Body Control / Differentiable World Model Training Framework
An open-source humanoid whole-body control framework from UC Berkeley that amortizes learning across all motions with one differentiable world model, surpassing a 128-GPU, 7-day baseline in 3 hours on a single GPU and winning the CoRL 2026 Best Paper Award.
New Apache License 2.0 Physics SimulationHumanoid RobotMotion Imitation

JAX-Fluids

Differentiable CFD Solver
Fully auto-differentiable CFD solver built on JAX for CPU/GPU/TPU, focused on end-to-end differentiable fluid simulation that couples seamlessly with neural networks.
New GNU General Public License v3.0 JAXDifferentiable CFDDifferentiable Physics

MuJoCo

General-Purpose Physics Engine / Contact Dynamics Solver and Robotics Simulation Backend
An open-source physics engine maintained by Google DeepMind, pairing generalised coordinates with soft convex contact dynamics for robotics, biomechanics and reinforcement learning, with MJCF, MJX, MuJoCo Warp and the 4.0 release.
New Apache-2.0 for source code; CC BY 4.0 for documentation, images and videos in the doc directory Physics EngineContact DynamicsRobot Simulation

NVIDIA Warp

Differentiable GPU Simulation Framework
NVIDIA's open-source Python framework that JIT-compiles plain Python functions into CPU/CUDA kernels with automatic differentiable adjoints, letting gradients flow through entire physics simulations - the compute substrate under Isaac Lab and Newton.
New Apache License 2.0 Differentiable SimulationGPUJIT Compilation
💬 Editor note: NVIDIA Warp provides a GPU-native differentiable simulation kernel and is the mainstream choice for GPU-accelerated differentiable physics today.

PDEArena

PDE Benchmark / Differentiable Solver
Microsoft Research's open-source PDE benchmark suite with differentiable solvers and spatiotemporal dynamics data for evaluating long-horizon rollout stability.
MIT PDEBenchmarkDifferentiable Solver
💬 Editor note: PDEArena benchmarks differentiable solvers, letting you compare accuracy and speed across JAX-CFD, PhiFlow and similar frameworks.

JAX-CFD

Differentiable Fluid Solver
Google Research's differentiable incompressible-flow solver in JAX; the whole time-stepping loop is differentiable and JIT-compilable on GPU/TPU. A PNAS 2021 learned-interpolation result reached ~80x/40x speedups at equal accuracy, but the project is now unmaintained - treat it as a research prototype and reference.
New Apache-2.0 JAXDifferentiable PhysicsCFD
💬 Editor note: JAX-CFD is the reference fully differentiable CFD framework, turning aerodynamic design into an end-to-end optimisation problem.

NeuralPDE.jl Scientific Machine Learning Solvers in Julia

General SciML / Framework Tutorial
Julia SciML ecosystem library unifying PINN/DeepONet/NeuralOperator solvers with seamless DifferentialEquations.jl interoperability and GPU/autodiff out of the box.
New MIT JuliaPINNSciML

DeepXDE v1.15.0

PDE Solving
DeepXDE v1.15.0 released with L-LAAF activation function support for JAX backend and Apple MPS GPU acceleration for PyTorch backend, improving deep learning-based PDE solving performance.
LGPL-2.1 PDEDeep LearningScientific Computing

Taichi Lang

Physics Simulation DSL
A Python-embedded parallel programming language for high-performance numerical computing, with LLVM JIT compilation of per-element kernels, sparse data structures and automatic differentiation, widely used for differentiable physics prototyping.
New Apache License 2.0 Physical SimulationDifferentiable ProgrammingDSL
💬 Editor note: Taichi combines a DSL with MPM support, earning it a place in differentiable physics simulation with a low engineering barrier.

JAX

Differentiable Numerical Computing Framework
Google's open-source NumPy-style numerical computing library built on XLA with autodiff and functional transformations (grad/jit/vmap/pmap) - the substrate behind differentiable solvers and neural operators.
New Apache License 2.0 Automatic DifferentiationXLANumerical Computing

Pinocchio

Rigid-Body Dynamics Algorithm Library / Robot Kinematics and Dynamics Engine
A rigid-body dynamics library from Inria and LAAS-CNRS implementing Featherstone's algorithms with analytical derivatives, BSD-2-Clause licensed and used as the dynamics backbone of Crocoddyl, TSID, HPP, Aligator, Jiminy and many robotics frameworks.
New BSD 2-Clause License Rigid Body DynamicsKinematicsRobot Control

DeepXDE

PINN Starter Framework
A beginner-friendly PINN library with thorough Chinese docs and TensorFlow/PyTorch/JAX/PaddlePaddle backends - a common starting point for scientific machine learning and PDE solving.
New GNU Lesser General Public License v2.1 PINNBeginnerChinese Docs

Recent Numerics Papers 8 resources

The Scott-Vogelius Element is Inf-Sup Stable on Freudenthal Meshes for k ≥ 4

Structural
This paper rigorously establishes inf-sup stability of the Scott-Vogelius finite element on three-dimensional Freudenthal meshes for polynomial degree k ≥ 4, completing the theoretical framework for this classical divergence-free mixed element used in Stokes flow computations.
See LICENSE file finite element methodsStokes probleminf-sup stability
💬 Editor note: An inf-sup analysis of Scott–Vogelius elements on Freudenthal grids, giving the theoretical stability boundary for spectral element methods.

A Parallel Solver for Vortex-Induced Vibrations at Zero Mass Ratio

CFD
The paper presents a parallel monolithic finite element strategy for simulating two- and three-dimensional vortex-induced vibrations of a rigid, massless cylinder mounted on translational springs.
See LICENSE file vortex-induced vibrationscylinder flowparallel solver
💬 Editor note: A parallel solver for zero-mass-ratio vortex-induced vibration, involving strong coupling and partitioning strategies — high practical reference value.