Towards certification: A complete statistical validation pipeline for supervised learning in industry

• DOI: 10.1016/j.eswa.2025.127169

Machine and Deep Learning methods are gradually being integrated into industrial operations, although at different speeds for different types of industries. The aerospace and aeronautical industries have been recently pushing to develop a roadmap for concepts of design assurance and integration of neural network-related technologies in the aeronautical sector. Within such
a roadmap, there is currently no clear definition of what would constitute a certifiable validation protocol for an industrial surrogate model. This paper aims to bridge this gap and contribute to the paradigm of AI-based certification in the context of supervised learning, by proposing a practical and comprehensible validation pipeline of a surrogate model that integrates
concepts and methods from deep learning, mathematical optimization and statistical data science. This pipeline is represented as a directed graph of ten logical steps/nodes, incorporating both linear-sequential procedures and feedback loops to iteratively refine the surrogate model. Each of these logical steps solves specific machine learning problems by merging previously
scattered key statistical methods with some novel algorithmic solutions. We provide details and best practices for each of the steps and we illustrate the application of this pipeline in a realistic supervised problem arising in aerostructural design: predicting the likelihood of different stress-related failure modes during different flight maneuvers based on a (large) set of features
characterizing the aircraft internal loads and geometric parameters.

• Full paper

Related research projects

MdM-IFISC-2

Maria de Maeztu 2023-2026

P.I.: Ernesto Estrada, Ingo Fischer, Emilio Hernández-García, Rosa Lopez, Claudio Mirasso, Jose Javier Ramasco, Raúl Toral, Roberta Zambrini

After 15 years of its existence, IFISC can point to a proven track record of impactful research. The previous 2018-2022 MdM award has significantly enhanced the institute's capabilities, as demonstrated by an …

DYNDEEP

Dynamics of Temporal Networks: Memory and Deep Learning

P.I.: Lucas Lacasa

The interaction between elements of a complex system arising in physics, biology or sociology can be modelled as a mathematical graph. The precise architecture of this interaction backbone plays a fundamental role …

MISLAND

Modelling island ecological complexity in the context of global change

P.I.: Lucas Lacasa, Víctor M. Eguíluz

** This project (PID2020-114324GB-C22) is part of a coordinated project between IFISC and IMEDEA, both research centers from CSIC located in Mallorca. The project is funded by AEI and a PhD fellowship …