Zobrazeno 1 - 3
of 3
pro vyhledávání: '"Reif, Yuval"'
Natural language is composed of words, but modern LLMs process sub-words as input. A natural question raised by this discrepancy is whether LLMs encode words internally, and if so how. We present evidence that LLMs engage in an intrinsic detokenizati
Externí odkaz:
http://arxiv.org/abs/2410.05864
Autor:
Reif, Yuval, Schwartz, Roy
Large language models (LLMs) have shown remarkable adaptability to diverse tasks, by leveraging context prompts containing instructions, or minimal input-output examples. However, recent work revealed they also exhibit label bias -- an undesirable pr
Externí odkaz:
http://arxiv.org/abs/2405.02743
Autor:
Reif, Yuval, Schwartz, Roy
NLP models often rely on superficial cues known as dataset biases to achieve impressive performance, and can fail on examples where these biases do not hold. Recent work sought to develop robust, unbiased models by filtering biased examples from trai
Externí odkaz:
http://arxiv.org/abs/2305.18917