Academic Commons

Theses Doctoral

Posterior Predictive Model Checks in Cognitive Diagnostic Models

Park, Jung Yeon

Cognitive diagnostic models (CDMs; DiBello, Roussos, & Stout, 2007) have received increasing attention in educational measurement for the purpose of diagnosing strengths and weaknesses of examinees’ latent attributes. And yet, despite the current popularity of a number of diagnostic models, research seeking to assess model-data fit has been limited. The current study applied one of the Bayesian model checking methods, namely the posterior predictive model check method (PPMC; Rubin, 1984), to its investigation of model misfit. We employed the technique in order to assess the model-data misfit from various diagnostic models, using real data and conducting two simulation studies. An important issue when it comes to the application of PPMC is choice of discrepancy measure. This study examines the performance of three discrepancy measures utilized to assess different aspects of model misfit: observed total-scores distribution, association of item pairs, and correlation between attribute pairs as adequate measures of the diagnostic models.

Files

  • thumnail for Park_columbia_0054D_13006.pdf Park_columbia_0054D_13006.pdf binary/octet-stream 1.93 MB Download File

More About This Work

Academic Units
Measurement and Evaluation
Thesis Advisors
Johnson, Matthew S.
Degree
Ph.D., Columbia University
Published Here
October 15, 2015