Parameter Redundancy and the Existence of Maximum Likelihood Estimates in Log-linear Models

Abstract: Log-linear models are typically fitted to contingency table data to describe and identify the relationship between different categorical variables. However, the data may include observed zero cell entries. The presence of zero cell entries can have an adverse effect on the estimability of parameters, due to parameter redundancy. We describe a general approach for determining whether a given log-linear model is parameter redundant for a pattern of observed zeros in the table, prior to fitting the model to the data. We derive the estimable parameters or functions of parameters and also explain how to reduce the unidentifiable model to an identifiable one. Parameter redundant models have a flat ridge in their likelihood function. We further explain when this ridge imposes some additional parameter constraints on the model, which can lead to obtaining unique maximum likelihood estimates for parameters that otherwise would not have been estimable. In contrast to other frameworks, the proposed novel approach informs on those constraints, elucidating the model that is actually being fitted.