How Language Models Process Subject and Object Control: On Promise as a Subject Control Verb

• 발행기관: 한국생성문법학회
• 저자명: Kangsan Noh
• 간행물 정보: 『생성문법연구』제34권 제4호, 289~302쪽, 전체 14쪽
• 주제분류: 인문학 > 언어학
• 파일형태: PDF
• 발행일자: 2024.11.30

국문 초록

This squib examines how neural language models process subject and object control. Processing these two types of control requires an understanding of the structural dependency between an overt determiner phrase (DP) and a non-overt argument (PRO). By using surprisal as a complexity metric, the study tests whether two representative encoder models - BERT and RoBERTa - can distinguish subject control from object control. The results showed that, while the models succeeded in processing object control, they failed to process subject control. The surprisal estimates, which are expected to be higher for unlikely or unacceptable sentences, were elevated for subject inputs even in subject control sentences. This contrast between subject and object control is attributed to the statistical rarity of subject control in the corpus data, particularly regarding the subject control verb promise. Thus, model parsing relies more on statistical patterns than genuine syntactic analysis.

목차

1. Introduction

2. Theoretical Background: Subject and Object Control

3. Design

4. Results

5. Discussion

6. Conclusion

References

키워드

subject control object control PRO language model surprisal