Distractor Analysis to Improve the Quality of Multiple-Choice Item Development

• 영문명: Distractor Analysis to Improve the Quality of Multiple-Choice Item Development
• 발행기관: 한국영어평가학회
• 저자명: 박정영(Jungyoung Park) Eric A. Wright
• 간행물 정보: 『English Language Assessment』Vol.18 No.2, 73~94쪽, 전체 22쪽
• 주제분류: 인문학 > 언어학
• 파일형태: PDF
• 발행일자: 2023.12.31

영문 초록

Generating effective distractors is critical to multiple-choice item development because distractors impact both psychometric properties and validity arguments. While the importance of distractors is recognized, studies on the extent distractors function as intended are limited. The purpose of this study is to demonstrate a distractor analysis. To do that, we examine the distractors of multiple-choice items developed to assess U.S. elementary preservice teachers’ metalinguistic knowledge in the four domains of phonology, morphology, syntax, and discourse. We analyze the functioning of the distractors using data from a pilot test of the measure (n=144), employing simple response option selection frequencies and the average scores associated with the selection of each option in the form of Rasch person ability estimates. The results show potential areas for item improvement and demonstrate the value of distractor analysis for making decisions about item revision. Through this analysis, we highlight the significance of distractor analysis in multiple-choice item development, suggesting that teachers with the appropriate content knowledge should be able to conduct such analyses for enhancing language teaching and assessment.

목차

Ⅰ. INTRODUCTION

Ⅱ. LITERATURE REVIEW

Ⅲ. RESEARCH METHOD

Ⅳ. RESULTS & DISCUSSION

Ⅴ. CONCLUSION

REFERENCES

키워드

distractor analysis multiple-choice items metalinguistic knowledge measurement elementary preservice teacher education