2000 character limit reached
Verifying Heaps' law using Google Books Ngram data (1612.09213v1)
Published 29 Dec 2016 in cs.CL and physics.soc-ph
Abstract: This article is devoted to the verification of the empirical Heaps law in European languages using Google Books Ngram corpus data. The connection between word distribution frequency and expected dependence of individual word number on text size is analysed in terms of a simple probability model of text generation. It is shown that the Heaps exponent varies significantly within characteristic time intervals of 60-100 years.