한국어능력시험(TOPIK) 쓰기 평가의 채점 특성 연구

• 영문명: A Study on the Features of Writing Rater in TOPIK Writing Assessment
• 발행기관: 국제한국어교육학회
• 저자명: 안수현 김정숙
• 간행물 정보: 『한국어교육』28권 1호, 173~196쪽, 전체 24쪽
• 주제분류: 어문학 > 한국어와문학
• 파일형태: PDF
• 발행일자: 2017.03.31

영문 초록

Writing is a subjective and performative activity. Writing ability has multi-facets and compoundness. To understand the examinees’s writing ability accurately and provide effective writing scores, raters first ought to have the competency regarding assessment. Therefore, this study is significant as a fundamental research about rater’s characteristics on the TOPIK writing assessment. 150 scripts of the 47th TOPIK examinees were selected randomly, and were further rated independently by 20 raters. The many-facet Rasch model was used to generate individualized feedback reports on each rater’s relative severity and consistency with respect to particular categories of the rating scale. This study was analyzed using the FACETS ver 3.71.4 program. Overfit and misfit raters showed many difficulties for noticing the difference between assessment factors and interpreting the criteria. Writing raters appear to have much confusion when interpreting the assessment criteria, and especially, overfit and misfit teachers interpret the criteria arbitrarily. The main reason of overfit and misfit is the confusion about assessment factors and criteria in finding basis for scoring. Therefore, there needs to be more training and research is needed for raters based on this type of writing assessment characteristics. This study is recognized significantly in that it collectively examined writing assessment characteristics of writing raters, and visually confirmed the assessment error aspects of writing assessment. (NIIED, Korea University)

목차

1. 연구 목적 및 필요성

2. 이론적 배경

3. 연구 자료 및 분석 방법

4. 분석 결과

5. 결론 및 논의

참고문헌

키워드

한국어능력시험 쓰기 평가 채점자 채점자 엄격성 채점자 일관성 평가 요소 FACETS 프로그램 TOPIK writing assessment writing rater rater severity rater consistency writing criteria FACETS program