학문 목적 한국어 쓰기 능력에 대한 분석적 평가의 일반화가능도 검증

• 영문명: Analysis of Error Sources and Estimation of Reliability in a Analytic Evaluation on Writing Ability for Academic Purpose Korean by Applying Generalizability Theory
• 발행기관: 국제한국어교육학회
• 저자명: 김성숙
• 간행물 정보: 『한국어교육』22권 3호, 29~48쪽, 전체 20쪽
• 주제분류: 어문학 > 한국어와문학
• 파일형태: PDF
• 발행일자: 2011.09.30

영문 초록

The primary aim of this study is: 1) to determine error sources and the effects of each error source in an analytic evaluation on APK(Academic Purpose Korean) writing ability; 2) to estimate the generalizability coefficient; and 3) to suggest optimal measuring conditions for an analytic evaluation on APK writing ability based on the generalizability theory. For the design of the G study(Generalizability Study), a three-facet crossed model(p x r x i) was used with two academic writing task(a test with 2 hour limit and a report with 1 week term), 9 raters, and 10 analytic scoring items. The D study(Decision Study) design was used in an identical manner as the G study. The result of the G study for estimating error sources in the analytic evaluation on APK writing ability indicates that error sources for raters have a more significant impact than error sources related to analytic scoring items associated with the score of the writing test. As for the generalizability coefficients in the D study, increasing the number of the raters had more significant impact than increasing the number of assessment items in the analytic evaluation on APK writing ability. However even the ratio in the error dispersion of the raters is not small, the ratio in the error dispersion of the items is 0. It means that these 10 analytic scoring items guided a coherent response from 9 raters. Therefore, it seems useful to train the raters with these 10 analytic scoring items.

목차

1. 학문 목적 쓰기 능력 평가 준거의 필요성

2. 일반화가능도 이론의 원리와 의의

3. 쓰기 샘플 채집 및 채점 수행

4. 수험자의 학문 목적 한국어 쓰기 능력 분포

5. 시험 답안과 보고서 평가의 오차원 분석

6. 시험 답안과 보고서 평가의 일반화가능도 비교

7. 결론

참고문헌

키워드

학문 목적 한국어 쓰기 능력 평가 일반화가능도 이론 오차원 일반화가능도 신뢰 계수 evaluation on writing ability for APK generalizability theory error sources generalizability coefficients