Kolmogorov Arnold networks (KAN) for aerodynamic prediction: a comparison with MLPs and GNNs

• ArXiv number: 2606.27126

Kolmogorov Arnold networks (KAN) have recently been introduced as a (deep) neural network architecture whose trainable parameters adapt the activation functions, instead of the coefficients of the affine transformations at the core of traditional architectures such as deep multilayer perceptrons (MLPs). This architecture builds on the Kolmogorov-Arnold theorem, which endows it with universal approximation properties. While the advent of KANs has been received with excitement, there is a current debate about the possible KAN supremacy over deep multilayer perceptrons (MLPs) for classic fields such as symbolic regression, generic-purpose machine learning, natural language processing or computer vision. Here we assess the performance of KANs --and its nuanced comparison against MLPs and graph neural networks (GNNs)-- in the realm of fluid dynamics surrogate modelling. To that aim, we consider the task of predicting the surface pressure distribution over subsonic and transonic airfoils, a canonical task in aerodynamics. Our results show that KAN models show good performance in predicting the whole pressure coefficients and is able to interpolate across Mach numbers and angles of attack, however its performance is comparable --marginally inferior-- to a suitably trained MLP, where best performance is achieved by a GNN at the expense or requiring lengthier training. While the optimal KAN model have typically much lower complexity than MLP and GNN --hence resulting in faster training--, we find that KANs suffer from training instabilities, and their performance is highly dependent on a proper hyperparameter optimisation.

Related research projects

CSxAI

Complexity science for understanding AI: from the dynamics of complex networks to collective effects of interacting neural networks

I.P.: Lucas Lacasa, Víctor M. Eguíluz

The CSxAI project engages researchers at IFISC in a (non-oriented research project) on the interdisciplinary challenge of applying tools and concepts of complexity science (dynamical systems, statistical physics, and network science) to …

NEHIL

Neuromorphic-Enhanced Heterogeneously-Integrated FMCW LiDAR

I.P.: Miguel C. Soriano

The NEHIL project, an EU-Korea partnership, is set to transform the landscape of digital technologies through groundbreaking neuromorphic architectures and advanced heterogeneous integration such as LiDAR systems. This collaborative initiative aims to …

MdM-IFISC-2

Maria de Maeztu 2023-2026

I.P.: Ernesto Estrada, Ingo Fischer, Emilio Hernández-García, Rosa Lopez, Claudio Mirasso, Jose Javier Ramasco, Raúl Toral, Roberta Zambrini

After 15 years of its existence, IFISC can point to a proven track record of impactful research. The previous 2018-2022 MdM award has significantly enhanced the institute's capabilities, as demonstrated by an …