An Investigation into the Variability of a Writing Test Using Generalizability Theory

• 영문명: An Investigation into the Variability of a Writing Test Using Generalizability Theory
• 발행기관: 한국외국어교육학회
• 저자명: Taejoon Park(박태준)
• 간행물 정보: 『Foreign Languages Education』Vol.15 No.1, 45~67쪽, 전체 23쪽
• 주제분류: 사회과학 > 교육학
• 파일형태: PDF
• 발행일자: 2008.06.30

영문 초록

  Because performance assessment such as a composition test introduces a range of factors that may influence the chances of success for a candidate on the test, those in charge of monitoring quality control for performance assessment programs need to gather information that will help them determine whether all aspects of the programs are working as intended. In the present study, generalizability theory (Brennan, 1992) was employed to examine the relative effects of various sources of variability on students" performance on an essay writing test and also to investigate the reliability of the assigned scores. The results showed that due to the largest effect associated with the students" writing ability and negligible effects associated with facets of measurement such as scoring criteria and ratings, the generalizability coefficient estimated for the writing test was high, suggesting that the test is a reliable measure of what it purports to measure, the students" writing ability.

목차

Ⅰ. Introduction
Ⅱ. Literature Review
Ⅲ. Methods
Ⅳ. Results
Ⅴ. Conclusion
References
Appendix

키워드

language testing writing assessment 언어평가 작문평가