Výsledky vyhledávání - "Sahu, Sambit"

Report

RainbowPO: A Unified Framework for Combining Improvements in Preference Optimization

Autor: Zhao, Hanyang, Winata, Genta Indra, Das, Anirban, Zhang, Shi-Xiong, Yao, David D., Tang, Wenpin, Sahu, Sambit

Recently, numerous preference optimization algorithms have been introduced as extensions to the Direct Preference Optimization (DPO) family. While these methods have successfully aligned models with human preferences, there is a lack of understanding

Externí odkaz: http://arxiv.org/abs/2410.04203

Zobrazit plný text záznamu

Report

LLM Surgery: Efficient Knowledge Unlearning and Editing in Large Language Models

Autor: Veldanda, Akshaj Kumar, Zhang, Shi-Xiong, Das, Anirban, Chakraborty, Supriyo, Rawls, Stephen, Sahu, Sambit, Naphade, Milind

Large language models (LLMs) have revolutionized various domains, yet their utility comes with significant challenges related to outdated or problematic knowledge embedded during pretraining. This paper addresses the challenge of modifying LLMs to un

Externí odkaz: http://arxiv.org/abs/2409.13054

Zobrazit plný text záznamu

Report

Preference Tuning with Human Feedback on Language, Speech, and Vision Tasks: A Survey

Autor: Winata, Genta Indra, Zhao, Hanyang, Das, Anirban, Tang, Wenpin, Yao, David D., Zhang, Shi-Xiong, Sahu, Sambit

Preference tuning is a crucial process for aligning deep generative models with human preferences. This survey offers a thorough overview of recent advancements in preference tuning and the integration of human feedback. The paper is organized into t

Externí odkaz: http://arxiv.org/abs/2409.11564

Zobrazit plný text záznamu