A Survey of Code-switching: Linguistic and Social Perspectives for Language Technologies
| Autor: | Barbara E. Bullock, A. Seza Doğruöz, Sunayana Sitaram, Almeida Jacqueline Toribio |
|---|---|
| Přispěvatelé: | Zong, Chengqing, Xia, Fei, Li, Wenjie, Navigli, Roberto |
| Rok vydání: | 2021 |
| Předmět: |
FOS: Computer and information sciences
Computer Science - Computation and Language Technology and Engineering Reflection (computer programming) Training set Computer science LT3 Perspective (graphical) Multilingualism Linguistics Code-switching Popularity Machine Learning Computational Linguistics Language model Computational linguistics Computation and Language (cs.CL) Natural Language Processing |
| Zdroj: | ACL/IJCNLP (1) 59TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS AND THE 11TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING, VOL 1 (ACL-IJCNLP 2021) |
| Popis: | The analysis of data in which multiple languages are represented has gained popularity among computational linguists in recent years. So far, much of this research focuses mainly on the improvement of computational methods and largely ignores linguistic and social aspects of C-S discussed across a wide range of languages within the long-established literature in linguistics. To fill this gap, we offer a survey of code-switching (C-S) covering the literature in linguistics with a reflection on the key issues in language technologies. From the linguistic perspective, we provide an overview of structural and functional patterns of C-S focusing on the literature from European and Indian contexts as highly multilingual areas. From the language technologies perspective, we discuss how massive language models fail to represent diverse C-S types due to lack of appropriate training data, lack of robust evaluation benchmarks for C-S (across multilingual situations and types of C-S) and lack of end-to- end systems that cover sociolinguistic aspects of C-S as well. Our survey will be a step to- wards an outcome of mutual benefit for computational scientists and linguists with a shared interest in multilingualism and C-S. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|