Three perspectives on complexity: entropy, compression, subsymmetry

Nagaraj, Nithin and Balasubramanian, Karthi (2017) Three perspectives on complexity: entropy, compression, subsymmetry. In: EUROPEAN PHYSICAL JOURNAL-SPECIAL TOPICS, 226 (15, SI). pp. 3251-3272.

PDF Eur_Phy_Jou_226-15_3251_2017.pdf - Published Version Restricted to Registered users only Download (787kB) | Request a copy

Abstract

There is no single universally accepted definition of `Complexity'. There are several perspectives on complexity and what constitutes complex behaviour or complex systems, as opposed to regular, predictable behaviour and simple systems. In this paper, we explore the following perspectives on complexity: effort-to-describe (Shannon entropy H, Lempel-Ziv complexity LZ), effort-to-compress (ETC complexity) and degree-of-order (Subsymmetry or SubSym). While Shannon entropy and LZ are very popular and widely used, ETC is relatively a new complexity measure. In this paper, we also propose a novel normalized complexity measure SubSym based on the existing idea of counting the number of subsymmetries or palindromes within a sequence. We compare the performance of these complexity measures on the following tasks: (A) characterizing complexity of short binary sequences of lengths 4 to 16, (B) distinguishing periodic and chaotic time series from 1D logistic map and 2D H,non map, (C) analyzing the complexity of stochastic time series generated from 2-state Markov chains, and (D) distinguishing between tonic and irregular spiking patterns generated from the `Adaptive exponential integrate-and-fire' neuron model. Our study reveals that each perspective has its own advantages and uniqueness while also having an overlap with each other.

Item Type:	Journal Article
Publication:	EUROPEAN PHYSICAL JOURNAL-SPECIAL TOPICS
Publisher:	10.1140/epjst/e2016-60347-2
Additional Information:	Copy right for this article belongs to the SPRINGER HEIDELBERG, TIERGARTENSTRASSE 17, D-69121 HEIDELBERG, GERMANY
Department/Centre:	Others
Date Deposited:	02 Mar 2018 15:06
Last Modified:	02 Mar 2018 15:06
URI:	http://eprints.iisc.ac.in/id/eprint/58893

Actions (login required)

View Item