Identification enhanced generalised linear model estimation with nonignorable missing outcomes (2204.10508v4)
Abstract: Missing data often result in undesirable bias and loss of efficiency. These issues become substantial when the response mechanism is nonignorable, meaning that the response model depends on unobserved variables. To manage nonignorable nonresponse, it is necessary to estimate the joint distribution of unobserved variables and response indicators. However, model misspecification and identification issues can prevent robust estimates, even with careful estimation of the target joint distribution. In this study, we modeled the distribution of the observed parts and derived sufficient conditions for model identifiability, assuming a logistic regression model as the response mechanism and generalized linear models as the main outcome model of interest. More importantly, the derived sufficient conditions do not require any instrumental variables, which are often assumed to guarantee model identifiability but cannot be practically determined beforehand. To analyze missing data in applications, we propose practical guidelines and sensitivity analysis to determine the response mechanism. Furthermore, we present the performance of the proposed estimators in numerical studies and apply the proposed method to two sets of real data: exit polls from the 19th South Korean election and public data collected from the Korean Survey of Household Finances and Living Conditions.
- Baraldi, A. N., and Enders, C. K. (2010), “An introduction to modern missing data analyses,” Journal of school psychology, 48(1), 5–37.
- Cui, X., Guo, J., and Yang, G. (2017), “On the identifiability and estimation of generalized linear models with parametric nonignorable missing data mechanism,” Computational Statistics & Data Analysis, 107, 64–80.
- Franks, A. M., Airoldib, E. M., and Rubin, D. B. (2020), “Nonstandard conditionally specified models fornonignorable missing data,” Proceedings of the National Academy of Sciences, 117(32), 19045–19053.
- Hazewinkel, A.-D., Bowden, J., Wade, K. H., Palmer, T., Wiles, N. J., and Tilling, K. (2022), “Sensitivity to missing not at random dropout in clinical trials: Use and interpretation of the trimmed means estimator,” Statistics in Medicine, 41(8), 1462–1481.
- Hicks, S. C., Townes, F. W., Teng, M., and Irizarry, R. A. (2018), “Missing data and technical variability in single-cell RNA-sequencing experiments,” Biostatistics, 19(4), 562–578.
- Ibrahim, J., Chen, M.-H., Lipsitz, S., and Herring, A. (2005), “Missing-Data Methods for Generalized Linear Models,” Journal of the American Statistical Association, 100, 332–347.
- Im, J., Cho, I.-H., and Kim, J.-K. (2018), “FHDI: An R Package for Fractional Hot Deck Imputation,” The R Journal, pp. 140–154.
- Im, J., and Kim, S. (2017), “Multiple imputation for nonignorable missing data,” Journal of the Korean Statistical Society, 46(4), 583–592.
- Kim, J. K. (2011), “Parametric fractional imputation for missing data analysis,” Biometrika, 98(1), 119–132.
- Kim, J. K., and Yu, C. L. (2011), “A semiparametric estimation of mean functionals with nonignorable missing data,” Journal of the American Statistical Association, 106(493), 157–165.
- Leurent, B., Gomes, M., Faria, R., Morris, S., Grieve, R., and Carpenter, J. R. (2018), “Sensitivity analysis for not-at-random missing data in trial-based cost-effectiveness analysis: a tutorial,” Pharmacoeconomics, 36(8), 889–901.
- Li, M., Ma, Y., and Zhao, J. (2021), “Efficient estimation in a partially specified nonignorable propensity score model,” Computational Statistics & Data Analysis, p. 107322.
- Liu, C. (2004), “Robit regression: a simple robust alternative to logistic and probit regression,” Applied Bayesian Modeling and Casual Inference from Incomplete-Data Perspectives, pp. 227–238.
- Miao, W., Ding, P., and Geng, Z. (2016), “Identifiability of normal and normal mixture models with nonignorable missing data,” Journal of the American Statistical Association, 111(516), 1673–1683.
- Miao, W., and Tchetgen Tchetgen, E. J. (2016), “On varieties of doubly robust estimators under missingness not at random with a shadow variable,” Biometrika, 103(2), 475–482.
- Morikawa, K., and Kim, J. K. (2021), “Semiparametric optimal estimation with nonignorable nonresponse data,” The Annals of Statistics, 49(5), 2991–3014.
- Parent, M. C. (2013), “Handling item-level missing data: Simpler is just as good,” The Counseling Psychologist, 41(4), 568–600.
- Peng, J., Hahn, J., and Huang, K.-W. (2023), “Handling missing values in information systems research: A review of methods and assumptions,” Information Systems Research, 34(1), 5–26.
- Potdar, K., Pardawala, T. S., and Pai, C. D. (2017), “A comparative study of categorical variable encoding techniques for neural network classifiers,” International journal of computer applications, 175(4), 7–9.
- Riddles, M. K., Kim, J. K., and Im, J. (2016), “A propensity-score-adjustment method for nonignorable nonresponse,” Journal of Survey Statistics and Methodology, 4(2), 215–245.
- Sauerbrei, W., Abrahamowicz, M., Altman, D. G., le Cessie, S., Carpenter, J., and initiative, S. (2014), “STRengthening analytical thinking for observational studies: the STRATOS initiative,” Statistics in medicine, 33(30), 5413–5432.
- Shao, J., and Wang, L. (2016), “Semiparametric inverse propensity weighting for nonignorable missing data,” Biometrika, 103(1), 175–187.
- Shetty, S., Ma, Y., and Zhao, J. (2021), “Avoid Estimating the Unknown Function in a Semiparametric Nonignorable Propensity Model,” arXiv preprint arXiv:2108.04966, .
- Wang, H., Lu, Z., and Liu, Y. (2021), “Score test for missing at random or not,” arXiv preprint arXiv:2105.12921, .
- Wang, S., Shao, J., and Kim, J. K. (2014), “An instrumental variable approach for identification and estimation with nonignorable nonresponse,” Statistica Sinica, 24, 1097–1116.
- Zhao, J., and Ma, Y. (2018), “Optimal pseudolikelihood estimation in the analysis of multivariate missing data with nonignorable nonresponse,” Biometrika, 105(2), 479–486.
- Zhao, J., and Shao, J. (2015), “Semiparametric pseudo-likelihoods in generalized linear models with nonignorable missing data,” Journal of the American Statistical Association, 110(512), 1577–1590.
- Zou, H. (2006), “The adaptive lasso and its oracle properties,” Journal of the American statistical association, 101(476), 1418–1429.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Collections
Sign up for free to add this paper to one or more collections.
