이분식 영어 쓰기 평가 문항 난이도 및 변별도 분석: 고전검사이론과 문항반응이론을 활용하여

초록

This paper explored item difficulty, item discrimination, and item-fit information on the 30 dichotomously-scored attributes of a writing test, using classical testing theorem, Rasch simple logistic model, and 2-parameter logistic model. 251 pre-service English teachers participated in a 50-minute argumentative essay writing test. Their essays were rated by experts who referred to the empirically-based and binary-choice rubric. The findings show that ‘concreteness and appropriateness of the supporting ideas tied to topic sentence’ was the most difficult item. Attributes related to appropriate vocabulary and grammar use usually showed a high discrimination index. Finally, all attributes except for ‘the proper use of tense’ were within in-fit range. This study reminds that further studies which employ fine-grained psychometric analyses on the writing test items are warranted.

키워드