A Multidimensional Hierarchical Framework for Modeling Speed and Ability in Computer-based Multidimensional Tests (1807.04003v2)

Abstract: In psychological and educational computer-based multidimensional tests, latent speed, a rate of the amount of labor performed on the items with respect to time, may also be multidimensional. To capture the multidimensionality of latent speed, this study firstly proposed a multidimensional log-normal response time (RT) model to consider the potential multidimensional latent speed. Further, to simultaneously take into account the response accuracy (RA) and RTs in multidimensional tests, a multidimensional hierarchical modeling framework was proposed. The framework is an extension of the van der Linden (2007; doi:10.1007/s11336-006-1478-z) and allows a "plug-and-play approach" with alternative choices of multidimensional models for RA and RT. The model parameters within the framework were estimated using the Bayesian Markov chain Monte Carlo method. The 2012 Program for International Student Assessment computer-based mathematics data were analyzed first to illustrate the implications and applications of the proposed models. The results indicated that it is appropriate to simultaneously consider the multidimensionality of latent speed and latent ability for multidimensional tests. A brief simulation study was conducted to evaluate the parameter recovery of the proposed model and the consequences of ignoring the multidimensionality of latent speed.