img
Applicability And Efficiency of a Polytomous IRT-Based Computerized Adaptive Test for Measuring Psychological Traits        
Yazarlar
Doç. Dr. Ahmet Salih ŞİMŞEK Doç. Dr. Ahmet Salih ŞİMŞEK
Kırşehir Ahi Evran Üniversitesi, Türkiye
Ezel Tavşancıl
Türkiye
Özet
Currently, research on computerized adaptive testing (CAT) focuses mainly on dichotomous items and cognitive traits (achievement, aptitude, etc.). However, polytomous IRT-based CAT is a promising research area for measuring psychological traits that has attracted much attention. The main purpose of this study is to test the practicality of the polytomous IRT-based CAT and its equivalence with the paper-pencil version. Data were collected from 1449 high school students (45% female) via the paper-pencil version. The data were used for IRT parameter estimates and CAT simulation studies. For the equivalence study, the research group consisted of 81 students (47% female) who participated in both the paper-pencil and live CAT applications. The paper-pencil version of the vocational interest inventory consists of 17 factors and 164 items. When the EAP estimation method and setting SE < .50 as the termination criterion, better performance was obtained compared with other CAT designs. The Item selection did not help to reduce test duration or increase measurement accuracy. As a result, it was found that an area of interest can be assessed with four items. The results of the live CAT application showed that the estimates of CAT were strongly positively correlated with its paper-pencil version. In addition, the live CAT application increased applicability compared to the fixed-length test version by reducing test length by 50% and time by 77%. This study shows that the polytomous IRT-based CAT is applicable and efficient for measuring psychological traits.
Anahtar Kelimeler
computerized adaptive test | efficiency | equivalence | measurement precision | polytomous item response model
Makale Türü Özgün Makale
Makale Alt Türü ESCI dergilerinde yayımlanan tam makale
Dergi Adı JOURNAL OF MEASUREMENT AND EVALUATION IN EDUCATION AND PSYCHOLOGY-EPOD
Dergi ISSN 1309-6575
Dergi Tarandığı Indeksler Core Collection - Emerging Science Citation Index (ESCI) - Psychology, Educational
Makale Dili İngilizce
Basım Tarihi 01-2022
Cilt No 13
Sayı 4
Sayfalar 328 / 344
Doi Numarası 10.21031/epod.1148313
Makale Linki http://dx.doi.org/10.21031/epod.1148313