감성분석에 기반한 수능 영어영역 ‘심경·분위기 파악’ 문항의 타당도 분석 연구

• 영문명: A validity study on the item type of ‘identifying the emotional state or mood’ in the English section of CSAT based on sentiment analysis
• 발행기관: 한국영어교과교육학회
• 저자명: 신동광(Shin, Dongkwang)
• 간행물 정보: 『영어교과교육』영어교과교육 19권 4호, 159~179쪽, 전체 21쪽
• 주제분류: 사회과학 > 교육학
• 파일형태: PDF
• 발행일자: 2020.11.30

영문 초록

The present study attempts to validate the item type of ‘identifying the emotional state or mood’ in the English section of the CSAT by using sentiment analysis. To this end, the agreement rate between the analysis results based on two sentiment analysis tools, ‘Tone analyzer’ and ‘KH-Coder,’ and the correct answers of the 60 target items from the CSATs 1994-2020 was examined. The results of this study show that ‘Tone Analyzer’ has an agreement rate of about 67%, while the agreement rate of ‘KH-Coder’ is about 57%. That is, the result of ‘Tone Analyzer’ adapting a machine learning method is more accurate than that of ‘KH-Coder’, which is based on a sentiment dictionary method. Additionally, sentiment words, possible explicit cues to infer a correct answer, appeared in most of the 60 items. However, in the case of an item where any sentiment words were not directly presented, both sentiment analysis tools mostly failed to find the correct answer. This means that the target item type needs to be developed as an item requiring contextual information to infer in order to reinforce its construct validity. In conclusion, some pedagogical implications and suggestions for future studies are addressed.

목차

I. 서론

II. 이론적 배경 및 선행연구

III. 연구방법

IV. 연구 결과

V. 결론 및 제언

참고문헌

키워드

감성분석 심경·분위기 파악 대학수학능력시험 sentiment analysis identifying the emotional state or mood CSAT