Empirical Bayes to assess ecological diversity and similarity with overdispersion in multivariate counts

Abstract: The assessment of diversity and similarity is relevant in monitoring the status of ecosystems. The respective indicators are based on the taxonomic composition of biological communities of interest, currently estimated through the proportions computed from sampling multivariate counts. In this work we present a novel method able to work with only one sample to estimate the taxonomic composition when the data are affected by overdispersion. The presence of overdispersion in taxonomic counts may be the result of significant environmental factors which are often unobservable but influence communities. Following the empirical Bayes approach, we combine a Bayesian model with the marginal likelihood method to jointly estimate the taxonomic proportions and the level of overdispersion from one sample of multivariate counts. Our proposal is compared to the classical maximum likelihood method in an extensive simulation study with different realistic scenarios. An application to real data from aquatic biomonitoring is also presented. In both the simulation study and the real data application, we consider communities characterized by a large number of taxonomic categories, such as aquatic macroinvertebrates or bacteria which are often overdispersed. The applicative results demonstrate an overall superiority of the empirical Bayes method in almost all examined cases, for both assessments of diversity and similarity. We would recommend practitioners in biomonitoring to use the proposed approach in addition to the traditional procedures. The empirical Bayes estimation allows to better control the error propagation due to the presence of overdispersion in biological data, with a more efficient managerial decision making.