Transformer-Based Language Models as Psycholinguistic Subjects: Focusing on Understanding Metaphor

• 영문명: Transformer-Based Language Models as Psycholinguistic Subjects: Focusing on Understanding Metaphor
• 발행기관: 현대문법학회
• 저자명: 정원일
• 간행물 정보: 『현대문법연구』제119호, 87~110쪽, 전체 24쪽
• 주제분류: 인문학 > 언어학
• 파일형태: PDF
• 발행일자: 2023.09.25

영문 초록

Metaphor is a fundamental aspect of human language and cognition, playing a crucial role in communication, comprehension, and creative expression. In light of the recent advancements demonstrated by prominent language models, a pivotal question arises: Can these expansive language models effectively discern metaphorical knowledge? The primary objective involves comparing the surprisal values estimated from neural network language models like autoregressive and bidirectional language models to the reaction times of human when exposed to both metaphorical and literal sentences. Our secondary objective involves assessing the AI's comprehension of metaphors by utilizing the sensicality ratings generated by sophisticated ChatGPT. To achieve this, we used psycholinguistic methods, and adopted the experimental materials from Lai, Currana, and Menna (2009). We found the surprisal values estimated from the autoregressive language model demonstrate metaphor processing that closely resembles that of native speakers. Furthermore, ChatGPT's processing of conventional metaphorical sentences closely resembles its approach to literal sentences, mirroring the convergence observed in native speakers' ERP response to conventional metaphorical sentences and their alignment with that of literal sentences.

목차

1. Introduction

2. Previous Studies

3. Methodology

4. Results

5. Discussion

6. Conclusion

References

키워드

metaphor transformer language models chatGPT surprisal value sensicality