쓰기 평가에서 채점 특성에 대한 피드백이 채점에 미치는 영향 연구

• 영문명: The Effects of Individualized Feedback on Rating Behaviors in Korean Writing Assessment
• 발행기관: 이중언어학회
• 저자명: 강민석 심재경
• 간행물 정보: 『이중언어학』제61호, 1~29쪽, 전체 29쪽
• 주제분류: 인문학 > 언어학
• 파일형태: PDF
• 발행일자: 2015.12.31

영문 초록

The purpose of this study is to investigate the effect of individualized feedback to raters of Korean writing assessment on their severity, consistency, and bias. 20 scripts were rated independently by 22 Korean language teachers. The many-facet Rasch model was used to generate individualized feedback reports on each rater’s relative severity, overall consistency, and significant bias patterns with respect to particular categories of the rating scale. Reports were given and explicated to each rater at a feedback session. Raters were then asked to rate a further set of 20 scripts. A comparison of ratings before and after feedback revealed that individual feedback had positive effects on their ratings (again using the many-facet Rasch model). The range of raters’ severity was reduced after the feedback session, indicating a higher level of agreement between raters compared to the ratings before the feedback. The individualized feedback also had an influence on the rater consistency; raters who were classified as over-fitted or mis-fitted improved their consistency after receiving the feedback. In addition, rater bias in relation to particular categories was all removed.

목차

1. 서론

2. 쓰기 평가에서의 채점자

3. 연구 방법

4. 연구 결과

5. 결론

참고 문헌

키워드

채점자 훈련 채점자 다국면 라쉬 모형 쓰기 평가 rater training rater many-facet Rasch model writing assessment