Investigating Learners’ Involvement in Process-Oriented Web Novel Assessment

초록

This study examined the following aspects when learners actively participated in process-oriented assessment as raters, test-takers, and rubric developers: the assessment area to receive the highest weight in the learner-generated rubric, the reliability between self-assessment and expert assessment, the achievement levels of students in different assessment areas, and learners' perceptions of the process-oriented assessment. 25 college students with upper-intermediate to advanced writing proficiency participated in a workshop on web novel writing, rater training, the creation of analytical scoring rubrics, and the process of self-assessment based on their own rubrics. Analysis of the scoring rubrics, comparison of self-assessment and expert assessment, and the results from open-ended survey questions revealed that learners identified creativity as the area with the highest point, and there was a very high reliability between self- and expert assessment. Students showed relatively low achievement levels in the area of setting, particularly in character development and background description. While students noted psychological comfort and motivation as key advantages of the process-oriented web novel assessment, they also highlighted reliability issues as the main disadvantage. The study concluded with the implication that process-oriented assessment should be tailored to the specific assessment environment.

키워드