Zobrazeno 1 - 10
of 17 481
pro vyhledávání: '"Weston, P"'
Autor:
Nguyen, Thao, Li, Jeffrey, Oh, Sewoong, Schmidt, Ludwig, Weston, Jason, Zettlemoyer, Luke, Li, Xian
We propose a new method, instruction back-and-forth translation, to construct high-quality synthetic data grounded in world knowledge for aligning large language models (LLMs). Given documents from a web corpus, we generate and curate synthetic instr
Externí odkaz:
http://arxiv.org/abs/2408.04614
Autor:
Wang, Tianlu, Kulikov, Ilia, Golovneva, Olga, Yu, Ping, Yuan, Weizhe, Dwivedi-Yu, Jane, Pang, Richard Yuanzhe, Fazel-Zarandi, Maryam, Weston, Jason, Li, Xian
Model-based evaluation is at the heart of successful model development -- as a reward model for training, and as a replacement for human evaluation. To train such evaluators, the standard approach is to collect a large amount of human preference judg
Externí odkaz:
http://arxiv.org/abs/2408.02666
Autor:
Wu, Tianhao, Yuan, Weizhe, Golovneva, Olga, Xu, Jing, Tian, Yuandong, Jiao, Jiantao, Weston, Jason, Sukhbaatar, Sainbayar
Large Language Models (LLMs) are rapidly surpassing human knowledge in many domains. While improving these models traditionally relies on costly human data, recent self-rewarding mechanisms (Yuan et al., 2024) have shown that LLMs can improve by judg
Externí odkaz:
http://arxiv.org/abs/2407.19594
Self-Supervised Learning (SSL) has become a prominent approach for acquiring visual representations across various tasks, yet its application in fine-grained visual recognition (FGVR) is challenged by the intricate task of distinguishing subtle diffe
Externí odkaz:
http://arxiv.org/abs/2407.14676
Autor:
Zhang, Yuhang, Zhang, Zhiyao, Quiñones-Grueiro, Marcos, Barbour, William, Weston, Clay, Biswas, Gautam, Work, Daniel
This article presents the first field deployment of a multi-agent reinforcement-learning (MARL) based variable speed limit (VSL) control system on the I-24 freeway near Nashville, Tennessee. We describe how we train MARL agents in a traffic simulator
Externí odkaz:
http://arxiv.org/abs/2407.08021
Large language models (LLMs) can spend extra compute during inference to generate intermediate thoughts, which helps to produce better final responses. Since Chain-of-Thought (Wei et al., 2022), many such System 2 techniques have been proposed such a
Externí odkaz:
http://arxiv.org/abs/2407.06023
Autor:
Yuan, Weizhe, Kulikov, Ilia, Yu, Ping, Cho, Kyunghyun, Sukhbaatar, Sainbayar, Weston, Jason, Xu, Jing
Aligned instruction following models can better fulfill user requests than their unaligned counterparts. However, it has been shown that there is a length bias in evaluation of such models, and that training algorithms tend to exploit this bias by le
Externí odkaz:
http://arxiv.org/abs/2406.17744
Autor:
Slussarenko, Sergei, Weston, Morgan M., Shalm, Lynden K., Verma, Varun B., Nam, Sae-Woo, Kocsis, Sacha, Ralph, Timothy C., Pryde, Geoff J.
Publikováno v:
Nature Communications 13, 1832 (2022)
Long-distance optical quantum channels are necessarily lossy, leading to errors in transmitted quantum information, entanglement degradation and, ultimately, poor protocol performance. Quantum states carrying information in the channel can be probabi
Externí odkaz:
http://arxiv.org/abs/2406.04661
Autor:
Paraschos, G. F., Wielgus, M., Benke, P., Mpisketzis, V., Rösch, F., Dasyra, K., Ros, E., Kadler, M., Ojha, R., Edwards, P. G., Hyland, L., Quick, J. F. H., Weston, S.
Publikováno v:
A&A 687, L6 (2024)
Radio galaxies harbouring jetted active galactic nuclei are a frequent target of very-long-baseline interferometry (VLBI) because they play an essential role in exploring how jets form and propagate. Hence, only few have not been detected with VLBI y
Externí odkaz:
http://arxiv.org/abs/2406.02660
The attention mechanism is a critical component of Large Language Models (LLMs) that allows tokens in a sequence to interact with each other, but is order-invariant. Incorporating position encoding (PE) makes it possible to address by position, such
Externí odkaz:
http://arxiv.org/abs/2405.18719