Výsledky vyhledávání - "CHENG, Shuang"

Report

Layerwise Recurrent Router for Mixture-of-Experts

Autor: Qiu, Zihan, Huang, Zeyu, Cheng, Shuang, Zhou, Yizhi, Wang, Zili, Titov, Ivan, Fu, Jie

The scaling of large language models (LLMs) has revolutionized their capabilities in various tasks, yet this growth must be matched with efficient computational strategies. The Mixture-of-Experts (MoE) architecture stands out for its ability to scale

Externí odkaz: http://arxiv.org/abs/2408.06793

Zobrazit plný text záznamu

Report

Dynamic Object Queries for Transformer-based Incremental Object Detection

Autor: Zhang, Jichuan, Li, Wei, Cheng, Shuang, Li, Ya-Li, Wang, Shengjin

Incremental object detection (IOD) aims to sequentially learn new classes, while maintaining the capability to locate and identify old ones. As the training data arrives with annotations only with new classes, IOD suffers from catastrophic forgetting

Externí odkaz: http://arxiv.org/abs/2407.21687

Zobrazit plný text záznamu

Report

Unlocking Continual Learning Abilities in Language Models

Autor: Du, Wenyu, Cheng, Shuang, Luo, Tongxu, Qiu, Zihan, Huang, Zeyu, Cheung, Ka Chun, Cheng, Reynold, Fu, Jie

Language models (LMs) exhibit impressive performance and generalization capabilities. However, LMs struggle with the persistent challenge of catastrophic forgetting, which undermines their long-term sustainability in continual learning (CL). Existing

Externí odkaz: http://arxiv.org/abs/2406.17245

Zobrazit plný text záznamu

Report

LaDA: Latent Dialogue Action For Zero-shot Cross-lingual Neural Network Language Modeling

Autor: Ma, Zhanyu, Ye, Jian, Cheng, Shuang

Cross-lingual adaptation has proven effective in spoken language understanding (SLU) systems with limited resources. Existing methods are frequently unsatisfactory for intent detection and slot filling, particularly for distant languages that differ

Externí odkaz: http://arxiv.org/abs/2308.02903

Zobrazit plný text záznamu

Akademický článek

Nucleated red blood cell distribution in critically ill patients with acute pancreatitis: a retrospective cohort study

Autor: Huan-qin Liu, Guan-qun Wang, Cheng-shuang Zhang, Xia Wang, Ji-kui Shi, Feng Qu, Hang Ruan

Publikováno v: BMC Gastroenterology, Vol 24, Iss 1, Pp 1-13 (2024)

Abstract Objectives This study examined the potential association between nucleated red blood cell (NRBC) levels and mortality in critically ill patients with acute pancreatitis (AP) in the intensive care unit, due to limited existing research on thi

Externí odkaz: https://doaj.org/article/143d065cd2e845f0a45ceebc86285f87