On the missing log in upper tail estimates

Abstract: In the late 1990s, Kim and Vu pioneered an inductive method for showing concentration of certain random variables X. Shortly afterwards, Janson and Ruci{\'n}ski developed an alternative inductive approach, which often gives comparable results for the upper tail Pr(X \ge (1+\eps) E[X]). In some cases, both methods yield upper tail estimates which are best possible up to a logarithmic factor in the exponent, but closing this narrow gap has remained a technical challenge. In this paper we present a BK-inequality based combinatorial sparsification idea that can recover this missing logarithmic term in the upper tail. As an illustration, we consider random subsets of the integers {1,...,n}, and prove sharp upper tail estimates for various objects of interest in additive combinatorics. Examples include the number of arithmetic progressions, Schur triples, additive quadruples, and (r,s)-sums.