상세 보기
ConCSE: Unified Contrastive Learning and Augmentation for Code-Switched Embeddings
- Jeon, Jangyeong;
- Cho, Sangyeon;
- Ma, Minuk;
- Kim, Junyeong
WEB OF SCIENCE
0SCOPUS
0초록
This paper examines the Code-Switching (CS) phenomenon where two languages intertwine within a single utterance. There exists a noticeable need for research on the CS between English and Korean. We highlight that the current Equivalence Constraint (EC) theory for CS in other languages may only partially capture English-Korean CS complexities due to the intrinsic grammatical differences between the languages. We introduce a novel Koglish dataset tailored for English-Korean CS scenarios to mitigate such challenges. First, we constructed the Koglish-GLUE dataset to demonstrate the importance and need for CS datasets in various tasks. We found the differential outcomes of various foundation multilingual language models when trained on a monolingual versus a CS dataset. Motivated by this, we hypothesized that SimCSE, which has shown strengths in monolingual sentence embedding, would have limitations in CS scenarios. We construct a novel Koglish-NLI (Natural Language Inference) dataset using a CS augmentation-based approach to verify this. From this CS-augmented dataset Koglish-NLI, we propose a unified contrastive learning and augmentation method for code-switched embeddings, ConCSE, highlighting the semantics of CS sentences. Experimental results validate the proposed ConCSE with an average performance enhancement of 1.77% on the Koglish-STS(Semantic Textual Similarity) tasks. (Source code available at https://github.com/jjy961228/ConCSE). © The Author(s), under exclusive license to Springer Nature Switzerland AG 2025.
키워드
- 제목
- ConCSE: Unified Contrastive Learning and Augmentation for Code-Switched Embeddings
- 저자
- Jeon, Jangyeong; Cho, Sangyeon; Ma, Minuk; Kim, Junyeong
- 발행일
- 2025
- 유형
- Proceedings Paper
- 권
- 15320
- 페이지
- 29 ~ 44
- 언어
- ENG
- 출판사
- Springer Science and Business Media Deutschland GmbH
- 발행국가
- 미국
- 분량
- 16 페이지
- ISSN
- E 1611-3349
P 0302-9743