An improved estimator of Shannon entropy with applications to systems with memory

• DOI: doi.org/10.1016/j.chaos.2022.112797
• ArXiv number: 2205.11931

We investigate the memory properties of discrete sequences built upon a finite number of states. We find that the block entropy can reliably determine the memory for systems modeled as Markov chains of arbitrary finite order. Further, we provide an entropy estimator that remarkably gives accurate results when correlations are present. To illustrate our findings, we calculate the memory of daily precipitation series at different locations. Our results are in agreement with existing methods being at the same time valid in the undersampled regime and independent of model selection.

• Full paper

Related research projects

APASOS-UIB

A Physics approach to sociotechnical systems: from theory to data analysis.

P.I.: Maxi San Miguel, Raúl Toral

APASOS objective is to use mathematical and computational methods combined with data and physics thinking to model complex socio-technical systems. APASOS is organized into two workpackages (WP). WP 1 focuses on models …

PACSS

Physics approach to complexity in sociotechnical systems

P.I.: Sandro Meloni, Jose Javier Ramasco, Maxi San Miguel, Raúl Toral

This project, Physics approach to complexity in sociotechnical systems (PACSS), wants to contribute to the understanding of sociotechnical phenomena from the perspective provided by the application of the modern field of complex …

PACSS (UIB)

Physics approach to complexity in sociotechnical systems

P.I.: Raúl Toral

This project, Physics approach to complexity in sociotechnical systems (PACSS), wants to contribute to the understanding of sociotechnical phenomena from the perspective provided by the application of the modern field of complex …