논증 기반의 언어평가 타당화 연구의 이해-고부담 의사결정의 맥락으로부터-

Understanding argument based validation research in language testing: from the high-stakes decision-making contexts

초록

The purpose of this paper is to discuss the applicability of the assessment use argument (AUA: Bachman & Palmer, 2010) to validation in the Test of Proficiency in Korean with foci of value implications and consequences. Ever since Messick (1989) articulated value implications and consequences in the conceptual model of test validity, the social dimensions of testing have been increasingly recognized (McNamara, 2012), and various approaches have been proposed to include the social dimensions into validation research. However, few empirical studies have investigated the social dimensions of testing nor do validation frameworks comprehensively provide procedures for evaluating value implications and consequences. Nevertheless, AUA addresses the limitations in the existing validation frameworks by specifying two claims of decisions for evaluating value and consequences. In this discussion paper, a description of the AUA and a review of empirical validation studies which used the AUA are provided, followed by discussions of the usefulness and applicability of the AUA to the TOPIK (Test of Proficiency in Korean) for evaluating issues of values and consequences. This paper also suggests that analyzing policy documents and media reportage as well as listening to multiple stakeholders’ voices be considered for further research in test validation.

키워드

고부담 언어시험; 타당도; 논증 기반 타당화 연구; 한국어능력시험; high-stakes language testing; validity; argument based approach to validation; TOPIK
제목
논증 기반의 언어평가 타당화 연구의 이해-고부담 의사결정의 맥락으로부터-
제목 (타언어)
Understanding argument based validation research in language testing: from the high-stakes decision-making contexts
저자
신동일; 박수현; 임관혁
DOI
10.17296/korbil.2019..74.309
발행일
2019-03
저널명
이중언어학
호
74
페이지
309 ~ 335