Assess the suitability of ordinal response models for peer grading

Determine, through theoretical analysis and empirical evaluation on simulated and real datasets, the suitability of ordinal item response formulations for peer grading data, specifically comparing a partial credit model and alternatives such as the graded response model within the proposed peer grading framework.

Background

Many peer grading systems collect ordinal scores. The paper outlines how to extend the proposed framework to ordinal outcomes using a partial credit model and notes that graded response models are an alternative.

The authors explicitly state that which ordinal formulation is appropriate for peer grading remains to be established and defer this evaluation, calling for theoretical and numerical studies.