S$\Omega$I: Score-based O-INFORMATION Estimation

The analysis of scientific data and complex multivariate systems requires information quantities that capture relationships among multiple random variables. Recently, new information-theoretic measures have been developed to overcome the shortcomings of classical ones, such as mutual information, that are restricted to considering pairwise interactions. Among them, the concept of information synergy and redundancy is crucial for understanding the high-order dependencies between variables. One of the most prominent and versatile measures based on this concept is O-information, which provides a clear …

analysis concept cs.it cs.lg data information interactions math.it multiple multivariate random redundancy relationships synergy systems them variables