2000 character limit reached
Structure and Randomness of Continuous-Time Discrete-Event Processes (1704.04707v1)
Published 16 Apr 2017 in cond-mat.stat-mech, cs.IT, math.IT, math.ST, nlin.CD, and stat.TH
Abstract: Loosely speaking, the Shannon entropy rate is used to gauge a stochastic process' intrinsic randomness; the statistical complexity gives the cost of predicting the process. We calculate, for the first time, the entropy rate and statistical complexity of stochastic processes generated by finite unifilar hidden semi-Markov models---memoryful, state-dependent versions of renewal processes. Calculating these quantities requires introducing novel mathematical objects ({\epsilon}-machines of hidden semi-Markov processes) and new information-theoretic methods to stochastic processes.