Zobrazeno 1 - 1
of 1
pro vyhledávání: '"Shou, Mengrou"'
Autor:
Wilf, Alex, Akter, Syeda Nahida, Mathur, Leena, Liang, Paul Pu, Mathew, Sheryl, Shou, Mengrou, Nyberg, Eric, Morency, Louis-Philippe
The self-supervised objective of masking-and-predicting has led to promising performance gains on a variety of downstream tasks. However, while most approaches randomly mask tokens, there is strong intuition that deciding what to mask can substantial
Externí odkaz:
http://arxiv.org/abs/2305.14577
