2000 character limit reached
On Rényi and Tsallis entropies and divergences for exponential families (1105.3259v1)
Published 17 May 2011 in cs.IT, cs.LG, and math.IT
Abstract: Many common probability distributions in statistics like the Gaussian, multinomial, Beta or Gamma distributions can be studied under the unified framework of exponential families. In this paper, we prove that both R\'enyi and Tsallis divergences of distributions belonging to the same exponential family admit a generic closed form expression. Furthermore, we show that R\'enyi and Tsallis entropies can also be calculated in closed-form for sub-families including the Gaussian or exponential distributions, among others.