Author(s)

Jinsong Chen^1*, Jimmy de la Torre²

¹Department of Psychology, Sun Yat-sen University, Guangzhou, China.
²Department of Educational Psychology, Rutgers, The State University of New Jersey, New Brunswick, USA.

Cognitive diagnosis models (CDMs) are psychometric models developed mainly to assess examinees’ specific strengths and weaknesses of a set of skills or attributes within a domain. Recently, several methodological developments have been added to the CDM literature, which include the development of general and reduced CDMs, various absolute and relative fit measures at both the test and item levels, and a general Q-matrix validation procedure. Building on these developments, this research proposes a systematic procedure to diagnostically model extant large-scale assessment data. The procedure can be divided into four phases: construction of initial attributes and Q-matrices, construction of final attributes and Q-matrix, evaluation of reduced CDMs, and crossvalidation of the selected model. Working with language experts, we use data from the PISA 2000 reading assessment to illustrate the procedure.

CDM, Q-Matrix, Large-Scale Assessment, Fit Measures, PISA

Chen, J. & Torre, J. (2014). A Procedure for Diagnostically Modeling Extant Large-Scale Assessment Data: The Case of the Programme for International Student Assessment in Reading. Psychology, 5, 1967-1978. doi: 10.4236/psych.2014.518200.