Zobrazeno 1 - 2
of 2
pro vyhledávání: '"Jiang, Lianghao"'
Autor:
Chen, Qihong, Li, Jiawei, Suh, Hyunjae, Jiang, Lianghao, Zhou, Zheng, Chen, Jingze, Gesi, Jiri, Ahmed, Iftekhar
To improve the performance on a target task, researchers have fine-tuned language models with an intermediate task before the target task of interest. However, previous works have focused on the pre-trained language models and downstream tasks in Nat
Externí odkaz:
http://arxiv.org/abs/2410.02915
We present a novel Parameter-Efficient Fine-Tuning (PEFT) method, dubbed as Adaptive Freezing of Low Rank Adaptation (AFLoRA). Specifically, for each pre-trained frozen weight tensor, we add a parallel path of trainable low-rank matrices, namely a do
Externí odkaz:
http://arxiv.org/abs/2403.13269