GPT Perdetry Test: Generating new meanings for new words
| Autor: | Pranav Goel, Sudha Rao, Nikolay Malkin, Nebojsa Jojic, Sameera Lanka |
|---|---|
| Rok vydání: | 2021 |
| Předmět: |
050101 languages & linguistics
Vocabulary Process (engineering) Computer science media_common.quotation_subject 05 social sciences 02 engineering and technology Linguistics Test (assessment) 0202 electrical engineering electronic engineering information engineering 020201 artificial intelligence & image processing 0501 psychology and cognitive sciences Language model Set (psychology) Large model Cryptographic nonce media_common Meaning (linguistics) |
| Zdroj: | NAACL-HLT |
| Popis: | Human innovation in language, such as inventing new words, is a challenge for pretrained language models. We assess the ability of one large model, GPT-3, to process new words and decide on their meaning. We create a set of nonce words and prompt GPT-3 to generate their dictionary definitions. We find GPT-3 produces plausible definitions that align with human judgments. Moreover, GPT-3’s definitions are sometimes preferred to those invented by humans, signaling its intriguing ability not just to adapt, but to add to the evolving vocabulary of the English language. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|