Zobrazeno 1 - 10
of 5 721
pro vyhledávání: '"Zheng, Lin"'
Formal theorem proving, a field at the intersection of mathematics and computer science, has seen renewed interest with advancements in large language models (LLMs). This paper introduces SubgoalXL, a novel approach that synergizes subgoal-based proo
Externí odkaz:
http://arxiv.org/abs/2408.11172
Autor:
Ye, Jiacheng, Gong, Shansan, Chen, Liheng, Zheng, Lin, Gao, Jiahui, Shi, Han, Wu, Chuan, Jiang, Xin, Li, Zhenguo, Bi, Wei, Kong, Lingpeng
Recently, diffusion models have garnered significant interest in the field of text processing due to their many potential advantages compared to conventional autoregressive models. In this work, we propose Diffusion-of-Thought (DoT), a novel approach
Externí odkaz:
http://arxiv.org/abs/2402.07754
Efficient attentions have greatly improved the computational efficiency of Transformers. However, most existing linear attention mechanisms suffer from an \emph{efficiency degradation} problem, leading to inefficiencies in causal language modeling an
Externí odkaz:
http://arxiv.org/abs/2312.11135
This work introduces self-infilling code generation, a general framework that incorporates infilling operations into auto-regressive decoding. Our approach capitalizes on the observation that recent infilling-capable code language models can self-inf
Externí odkaz:
http://arxiv.org/abs/2311.17972
Autoregressive~(AR) generation almost dominates sequence generation for its efficacy. Recently, non-autoregressive~(NAR) generation gains increasing popularity for its efficiency and growing efficacy. However, its efficiency is still bottlenecked by
Externí odkaz:
http://arxiv.org/abs/2310.09512
Autor:
Zheng, Hui, Chen, Zhong-Tao, Wang, Hai-Teng, Zhou, Jian-Yang, Zheng, Lin, Lin, Pei-Yang, Liu, Yun-Zhe
Understanding semantic content from brain activity during sleep represents a major goal in neuroscience. While studies in rodents have shown spontaneous neural reactivation of memories during sleep, capturing the semantic content of human sleep poses
Externí odkaz:
http://arxiv.org/abs/2309.16457
Publikováno v:
BMC Public Health, Vol 24, Iss 1, Pp 1-11 (2024)
Abstract Background Nonrestorative sleep (NRS) is related to numerous adverse outcomes. There is rare evidence of its associated factors, especially in Chinese adolescents. This study aimed to explore the factors associated with NRS in Chinese adoles
Externí odkaz:
https://doaj.org/article/58ceaec73b1f4270a30a557d2ea91017
This paper investigates the impact of data volume and the use of similar languages on transfer learning in a machine translation task. We find out that having more data generally leads to better performance, as it allows the model to learn more patte
Externí odkaz:
http://arxiv.org/abs/2306.00660
The label-free model evaluation aims to predict the model performance on various test sets without relying on ground truths. The main challenge of this task is the absence of labels in the test data, unlike in classical supervised model evaluation. T
Externí odkaz:
http://arxiv.org/abs/2304.09758
Autor:
Ma, Chang, Zhao, Haiteng, Zheng, Lin, Xin, Jiayi, Li, Qintong, Wu, Lijun, Deng, Zhihong, Lu, Yang, Liu, Qi, Kong, Lingpeng
Protein language models have excelled in a variety of tasks, ranging from structure prediction to protein engineering. However, proteins are highly diverse in functions and structures, and current state-of-the-art models including the latest version
Externí odkaz:
http://arxiv.org/abs/2302.12563