2000 character limit reached
Empirical entropy in context (0708.2084v1)
Published 15 Aug 2007 in cs.IT and math.IT
Abstract: We trace the history of empirical entropy, touching briefly on its relation to Markov processes, normal numbers, Shannon entropy, the Chomsky hierarchy, Kolmogorov complexity, Ziv-Lempel compression, de Bruijn sequences and stochastic complexity.