On Parallels Between Shannon’s and Kolmogorov’s Information Theories...
431 views · Published 2 February 2016 · 56:14 · Indexed 14 November 2026
Channel: Institut Henri Poincaré · 2016 · Science & Technology
On Parallels Between Shannon’s and Kolmogorov’s Information Theories (where the parallelism fails and why) By Andrei Romashchenko (LIRMM) Abstract: Two versions of information theory - the theory of Shannon's entropy and the theory of Kolmgorov complexity - have manifest similarities in the basic definitions as well as in deep technical theorems. The interplay between these two theories often lead to remarkable insights. In the talk we will show different examples of this interplay concerning information inequalities and conditional encoding theorems, and discuss the limits of this parallelism.
More from this channel
-
29:47
10 ans du Groupe Calcul : Histoire du Calcul - Introduction
-
52:14
Gauss, Jacobi, Seidel, Richardson, Krylov: the Invention of Iterative Methods
-
55:33
Les "invariants arithmétiques" de H. Poincaré
-
1:08:53
Henri Poincaré, a founding father of the modern theory of PDEs
-
57:13
Sympletic topology from Poincaré to Gromov
-
57:35
Structural Realism, Then and Now
-
46:26
Poincaré inequalities in probability and geometric analysis
-
1:02:05
On the contributions of Henri Poincaré to modern geophysics...