Fourier Neural Operator (FNO)

Category: 解析 | Integrated 2026-04-06
Fourier Neural Operator FNO: kernel integral operator κ(x-y) heatmap in physical space and spectral multiplier R_k in Fourier space with k_max truncation
FNO の核心:左は物理空間における並進不変カーネル κ(x-y) の積分演算子、右はフーリエ空間でのスペクトル乗算 R_k(k_max までが学習対象)

Overview

🧑‍🎓

先生! 今日はフーリエニューラル演算子(FNO)の話なんですよね? どんなものなんですか?


Theory and Physics

🎓

An architecture that efficiently learns PDE solution operators through convolution in Fourier space. Its characteristic is resolution-independent generalization performance.



Governing Equations


🎓

Expressing this mathematically, it looks like this.


$$v_{l+1}(x) = \sigma\left(W_l v_l(x) + \mathcal{F}^{-1}(R_l \cdot \mathcal{F}(v_l))(x)\right)$$

🧑‍🎓

Hmm, just the equation alone doesn't really click... What does it represent?


🎓

Fourier layer kernel integral:



$$\mathcal{K}(v)(x) = \int_{\mathbb{R}^d} \kappa(x, y) v(y) dy$$
🧑‍🎓

Wow, the discussion about Fourier layer kernels is super interesting! Tell me more.


Theoretical Foundation

🧑‍🎓

I've heard of "theoretical foundation," but I might not fully understand it...


🎓

The Fourier Neural Operator (FNO) is an important method aiming to fuse data-driven approaches and physics-based modeling. While computational cost is a major bottleneck in conventional CAE analysis, introducing the Fourier Neural Operator (FNO) can significantly improve the trade-off between computational efficiency and prediction accuracy. The mathematical foundation of this method is based on function approximation theory and statistical learning theory, with rigorous analysis of generalization guarantees and convergence being key theoretical research topics. Particularly, dealing with the "curse of dimensionality" when the input dimension is high is crucial for practical application, and approaches like dimensionality reduction and leveraging sparsity are important.


🧑‍🎓

I see... Fourier Neural Operators seem simple at first glance, but they're actually very profound.


Details of Mathematical Formulation

🧑‍🎓

Next is "Details of Mathematical Formulation"! What kind of content is this?


🎓

Shows the basic mathematical framework for applying machine learning models to CAE.



Loss Function Composition

🧑‍🎓

What exactly does "loss function composition" mean?


🎓

In AI×CAE, the loss function is composed as a weighted sum of a data-driven term and a physics constraint term:



$$ \mathcal{L} = \lambda_d \mathcal{L}_{\text{data}} + \lambda_p \mathcal{L}_{\text{physics}} + \lambda_r \mathcal{L}_{\text{reg}} $$


🎓

Here, $\mathcal{L}_{\text{data}}$ is the squared error with observed data, $\mathcal{L}_{\text{physics}}$ is the residual of the governing equation, and $\mathcal{L}_{\text{reg}}$ is a regularization term. Adjusting the weight parameters $\lambda$ greatly affects learning stability and accuracy.




Generalization Performance and Extrapolation Problem

🧑‍🎓

Please tell me about "Generalization Performance and the Extrapolation Problem"!


🎓

The biggest challenge for surrogate models is prediction accuracy outside the range of training data (extrapolation region). Incorporating physical laws can improve extrapolation performance, but complete guarantees are difficult.




Curse of Dimensionality

🧑‍🎓

Please tell me about the "Curse of Dimensionality"!


🎓

When the dimension of the input parameter space is high, the required number of samples increases exponentially. Efficient sample placement through Active Learning or Latin Hypercube Sampling (LHS) is extremely important.



$$ N_{\text{samples}} \propto d^{\alpha}, \quad \alpha \geq 1 $$

Assumptions and Applicability Limits

🧑‍🎓

Is this equation not universal? When can't it be used?


🎓
  • The training data sufficiently represents the physics of the analysis target.
  • The relationship between input parameters and output is smooth (domain decomposition is needed if discontinuities exist).
  • Reducing computational cost is the main objective; conventional solvers should be used in conjunction for final verification requiring high accuracy.
  • If the quality of training data (mesh-converged, V&V completed) is insufficient, model reliability decreases.

🧑‍🎓

Ah, I see! So that's how the mechanism of training data representing the analysis target works.


Dimensionless Parameters and Dominant Scales

🧑‍🎓

Professor, please tell me about "Dimensionless Parameters and Dominant Scales"!


🎓

Understanding the dimensionless parameters governing the physical phenomenon being analyzed forms the basis for appropriate model selection and parameter setting.


🎓
  • Péclet Number Pe: Relative importance of convection and diffusion. Pe >> 1 indicates convection-dominated (stabilization methods required).
  • Reynolds Number Re: Ratio of inertial forces to viscous forces. Fundamental parameter for fluid problems.
  • Biot Number Bi: Ratio of internal conduction to surface convection. Lumped capacitance method applicable when Bi < 0.1.
  • Courant Number CFL: Indicator of numerical stability. For explicit methods, CFL ≤ 1 is required.

🧑‍🎓

Ah, I see! So that's how the mechanism of the analysis target's physical phenomenon works.



Verification via Dimensional Analysis

🧑‍🎓

Please tell me about "Verification via Dimensional Analysis"!


🎓

For order-of-magnitude estimation of analysis results, dimensional analysis based on Buckingham's Π theorem is effective. Using characteristic length $L$, characteristic velocity $U$, and characteristic time $T = L/U$, the order of each physical quantity is estimated beforehand to confirm the validity of the analysis results.


🧑‍🎓

I see. So if the analysis target's physical phenomenon is understood, then it's basically okay to start?


Classification of Boundary Conditions and Mathematical Characteristics

🧑‍🎓

I've heard that if you get the boundary conditions wrong, everything fails...


TypeMathematical ExpressionPhysical MeaningExample
Dirichlet Condition$u = u_0$ on $\Gamma_D$Specification of variable valueFixed wall, specified temperature
Neumann Condition$\partial u/\partial n = g$ on $\Gamma_N$Specification of gradient (flux)Heat flux, force
Robin Condition$\alpha u + \beta \partial u/\partial n = h$Linear combination of variable and gradientConvective heat transfer
Periodic Boundary Condition$u(x) = u(x+L)$Spatial periodicityUnit cell analysis
🎓

Choosing appropriate boundary conditions is directly linked to solution uniqueness and physical validity. Insufficient boundary conditions lead to ill-posed problems, while excessive ones cause contradictions.




🎓

Yeah, you're doing great! Actually trying things out is the best way to learn. If you don't understand something, feel free to ask anytime.


Coffee Break Casual Talk

Why FNO Uses "Fourier Transform" – Efficiently Capturing Non-local Interactions

The core of the Fourier Neural Operator (FNO) proposed by Li et al. 2021 (ICLR 2021 Outstanding Paper) is the idea of performing convolution in Fourier space. While standard CNNs can only capture local features, Fourier transformation allows handling all spatial frequency components at once, enabling efficient learning of phenomena where "distant points influence each other," like fluid vortices or waves. Moreover, by truncating high-frequency components, computational cost can be reduced to O(N log N). This "simultaneous achievement of physical intuition and computational efficiency" is the appeal of FNO.

Physical Meaning of Each Term
  • Time Variation Term of Conserved Quantity: Represents the rate of change over time of the target physical quantity. Becomes zero for steady-state problems. 【Image】When filling a bathtub with hot water, the water level rises over time—this "rate of change per time" is the time variation term. The state where the valve is closed and the water level is constant is "steady," and the time variation term is zero.
  • Flux Term (Flow Term): Describes spatial transport/diffusion of physical quantity. Broadly classified into convection and diffusion. 【Image】Convection is like "a river's current carrying a boat," where things are carried by the flow. Diffusion is like "ink naturally spreading in still water," where things move due to concentration differences. The competition between these two transport mechanisms governs many physical phenomena.
  • Source Term (Generation/Annihilation Term): Represents local generation or annihilation of physical quantity due to external forces/reactions. 【Image】Turning on a heater in a room "generates" thermal energy at that location. Fuel consumption in a chemical reaction "annihilates" mass. A term representing physical quantities injected into the system from outside.
Assumptions and Applicability Limits
  • The continuum assumption holds for the spatial scale.
  • Constitutive laws of materials/fluids (stress-strain relationship, Newtonian fluid law, etc.) are within the applicable range.
  • Boundary conditions are physically valid and mathematically well-defined.
Dimensional Analysis and Unit Systems
VariableSI UnitNotes / Conversion Memo
Characteristic Length $L$mMust match the unit system of the CAD model.
Characteristic Time $t$sFor transient analysis, time step should consider CFL condition and physical time constant.

Numerical Methods and Implementation

🎓

Explains numerical methods and algorithms for implementing the Fourier Neural Operator (FNO).



Discretization and Calculation Procedure

🧑‍🎓

How do you actually solve this equation on a computer?


🎓

As data preprocessing, normalization/standardization of input features is crucial. Since CAE data have vastly different scales for each physical quantity, appropriate selection of Min-Max normalization or Z-score normalization is necessary. In selecting learning algorithms, appropriate methods should be chosen based on data volume, dimensionality, and degree of nonlinearity.



Implementation Considerations

🧑‍🎓

What is the most important thing to be careful about when using the Fourier Neural Operator (FNO) in practice?


🎓

Implementation using the Python ecosystem (scikit-learn, PyTorch, TensorFlow) is common. Keys to implementation are learning acceleration via GPU parallelization, automatic hyperparameter tuning, and preventing overfitting through cross-validation. Using the HDF5 format is recommended for efficient I/O processing of large-scale CAE data.



Verification Methods

🧑‍🎓

Professor, please tell me about "Verification Methods"!


🎓

It's important to use k-fold cross-validation, Leave-One-Out method, and holdout method appropriately for the purpose, and to evaluate prediction performance comprehensively using coefficient of determination R², RMSE, MAE, and maximum error.


🧑‍🎓

Now I understand what my senior meant when they said, "At least do cross-validation properly."


Code Quality and Reproducibility

🧑‍🎓

What is the most important thing to be careful about when using the Fourier Neural Operator (FNO) in practice?


🎓

Ensure code quality and experiment reproducibility by introducing version control (Git), automated testing (pytest), and CI/CD pipelines. Strictly enforce dependency version pinning (requirements.txt) to facilitate reconstruction of the computational environment. Fixing random seeds to ensure result reproducibility is also an important implementation practice.


🧑‍🎓

Ah, I see! So that's how version control works.


Implementation Algorithm Details

🧑‍🎓

I want to know more about what's happening behind the scenes of the calculation!



Neural Network Architecture

🧑‍🎓

Next is the discussion about neural network architecture. What kind of content is it?


🎓

Major architectures used in CAE applications:


この記事の評価
ご回答ありがとうございます!
参考に
なった
もっと
詳しく
誤りを
報告
参考になった
0
もっと詳しく
0
誤りを報告
0
Written by NovaSolver Contributors
Anonymous Engineers & AI — サイトマップ
ArchitectureInputOutputApplication Scenario