Zobrazeno 1 - 10
of 676
pro vyhledávání: '"Pedro, Moreno"'
While Transformers have revolutionized deep learning, their quadratic attention complexity hinders their ability to process infinitely long inputs. We propose Feedback Attention Memory (FAM), a novel Transformer architecture that leverages a feedback
Externí odkaz:
http://arxiv.org/abs/2404.09173
Autor:
Munkhdalai, Tsendsuren, Chen, Youzheng, Sim, Khe Chai, Biadsy, Fadi, Sainath, Tara, Mengibar, Pedro Moreno
Parameter efficient adaptation methods have become a key mechanism to train large pre-trained models for downstream tasks. However, their per-task parameter overhead is considered still high when the number of downstream tasks to adapt for is large.
Externí odkaz:
http://arxiv.org/abs/2403.19709
Autor:
Ngai, Hillary, Agrawal, Rohan, Gaur, Neeraj, Huang, Ronny, Haghani, Parisa, Mengibar, Pedro Moreno
Adapters are an efficient, composable alternative to full fine-tuning of pre-trained models and help scale the deployment of large ASR models to many tasks. In practice, a task ID is commonly prepended to the input during inference to route to single
Externí odkaz:
http://arxiv.org/abs/2310.13015
Autor:
Wang, Weiran, Wu, Zelin, Caseiro, Diamantino, Munkhdalai, Tsendsuren, Sim, Khe Chai, Rondon, Pat, Pundak, Golan, Song, Gan, Prabhavalkar, Rohit, Meng, Zhong, Zhao, Ding, Sainath, Tara, Mengibar, Pedro Moreno
Contextual biasing refers to the problem of biasing the automatic speech recognition (ASR) systems towards rare entities that are relevant to the specific user or application scenarios. We propose algorithms for contextual biasing based on the Knuth-
Externí odkaz:
http://arxiv.org/abs/2310.00178
Autor:
Wang, Weiran, Prabhavalkar, Rohit, Hwang, Dongseong, Li, Qiujia, Sim, Khe Chai, Li, Bo, Qin, James, Cai, Xingyu, Stooke, Adam, Meng, Zhong, Zheng, CJ, He, Yanzhang, Sainath, Tara, Mengibar, Pedro Moreno
In this work, we investigate two popular end-to-end automatic speech recognition (ASR) models, namely Connectionist Temporal Classification (CTC) and RNN-Transducer (RNN-T), for offline recognition of voice search queries, with up to 2B model paramet
Externí odkaz:
http://arxiv.org/abs/2309.12963
Autor:
Garg, Shefali, Huo, Zhouyuan, Sim, Khe Chai, Schwartz, Suzan, Chua, Mason, Aksënova, Alëna, Munkhdalai, Tsendsuren, King, Levi, Wright, Darryl, Mengesha, Zion, Hwang, Dongseong, Sainath, Tara, Beaufays, Françoise, Mengibar, Pedro Moreno
Automatic speech recognition (ASR) systems have been shown to have large quality disparities between the language varieties they are intended or expected to recognize. One way to mitigate this is to train or fine-tune models with more representative
Externí odkaz:
http://arxiv.org/abs/2309.09996
Autor:
Weronika E. Borek, Luis Nobre, S. Federico Pedicona, Amy E. Campbell, Josie A. Christopher, Nazrath Nawaz, David N. Perkins, Pedro Moreno-Cardoso, Janet Kelsall, Harriet R. Ferguson, Bela Patel, Paolo Gallipoli, Andrea Arruda, Alex J. Ambinder, Andrew Thompson, Andrew Williamson, Gabriel Ghiaur, Mark D. Minden, John G. Gribben, David J. Britton, Pedro R. Cutillas, Arran D. Dokal
Publikováno v:
EBioMedicine, Vol 108, Iss , Pp 105316- (2024)
Summary: Background: Acute myeloid leukaemia (AML) is a bone marrow malignancy with poor prognosis. One of several treatments for AML is midostaurin combined with intensive chemotherapy (MIC), currently approved for FLT3 mutation-positive (FLT3-MP) A
Externí odkaz:
https://doaj.org/article/c1ed1c39383540cb899802e9a5af0c25
Autor:
Wang, Gary, Rosenberg, Andrew, Ramabhadran, Bhuvana, Biadsy, Fadi, Huang, Yinghui, Emond, Jesse, Mengibar, Pedro Moreno
Automatic speech recognition (ASR) needs to be robust to speaker differences. Voice Conversion (VC) modifies speaker characteristics of input speech. This is an attractive feature for ASR data augmentation. In this paper, we demonstrate that voice co
Externí odkaz:
http://arxiv.org/abs/2209.06987
Autor:
Gema Morales-Olán, Pedro Moreno-Zarate, María Antonieta Ríos-Corripio, Aleida Selene Hernández-Cázares, Marlon Rojas-López, Silvia Luna-Suárez
Publikováno v:
Frontiers in Chemistry, Vol 12 (2024)
Chia (Salvia hispanica L.) flour seeds produce films with good barrier properties against water vapor and could be used as food packaging; however, their mechanical properties are poor, which limits their application. The incorporation of nanoparticl
Externí odkaz:
https://doaj.org/article/e2af5216fd8645b3af21e7cd3284efce
Publikováno v:
In Journal of South American Earth Sciences 15 July 2024 140