ChatGPT의 영어 문법성 판단에 근거한 타당성 검증

• 영문명: Validating the efficacy of ChatGPT based on its judgement of English grammaticality
• 발행기관: 한국영어평가학회
• 저자명: 이명원(Myungwon Yi) 주헌우(Hunwoo Joo) 최희(Hee Choi) 최인철(Inn-Chull Choi)
• 간행물 정보: 『English Language Assessment』Vol.18 No.2, 213~241쪽, 전체 29쪽
• 주제분류: 인문학 > 언어학
• 파일형태: PDF
• 발행일자: 2023.12.31

영문 초록

The present study is aimed at validating the efficacy of ChatGPT based on its explanations of grammatical concepts. Given the fact that more and more English teachers refer to ChatGPT for the purpose of judging grammaticality, this study attempts to probe the potentials and challenges of ChatGPT for English education and assessment. ChatGPT’s explanations of 140 paired sentences from 11 grammatical categories including sentence types, verbs, verbals, passive voice, subjunctive mood, relatives, special structures, conjunctions, nouns-articles, adjectives-adverbs, and prepositions were collected and examined to identify the extent to which the information was valid. The results were then compared against such authoritative corpus resources as the Corpus of Contemporary American English (COCA) and Google Books Ngram Viewer (GBNV). The results revealed the average accuracy of the explanations provided by ChatGPT was approximately 73%. While some grammatical explanations of ChatGPT were accurate, 27% of explanations included misleading or even self-contradictory information. According to the survey, the majority of teachers think somewhat favorably of ChatGPT’s potential for teaching and testing, but they are aware of its inherent inaccurate information. Overall, the findings suggest that even ChatGPT’s state-of-the-art technology has yet to meet the adequacy of grammaticality for teaching and testing and that it be supplemented by authoritative English corpora.

목차

Ⅰ. 서론

Ⅱ. 이론적 배경

Ⅲ. 연구방법

Ⅳ. 결과 및 논의

Ⅴ. 결론 및 제언

참고문헌

키워드

ChatGPT grammaticality English language assessment COCA Google Books Ngram Viewer