Zobrazeno 1 - 10
of 7 628
pro vyhledávání: '"A, Kingma"'
Training large neural networks typically requires sharing gradients between accelerators through specialized high-speed interconnects. Drawing from the signal processing principles of frequency decomposition and energy compaction, we demonstrate that
Externí odkaz:
http://arxiv.org/abs/2411.19870
Autor:
Zhang, Yushun, Chen, Congliang, Li, Ziniu, Ding, Tian, Wu, Chenwei, Kingma, Diederik P., Ye, Yinyu, Luo, Zhi-Quan, Sun, Ruoyu
We propose Adam-mini, an optimizer that achieves on par or better performance than AdamW with 50% less memory footprint. Adam-mini reduces memory by cutting down the learning rate resources in Adam (i.e., $1/\sqrt{v}$). By investigating the Hessian s
Externí odkaz:
http://arxiv.org/abs/2406.16793
Autor:
Xie, Sirui, Xiao, Zhisheng, Kingma, Diederik P, Hou, Tingbo, Wu, Ying Nian, Murphy, Kevin Patrick, Salimans, Tim, Poole, Ben, Gao, Ruiqi
While diffusion models can learn complex distributions, sampling requires a computationally expensive iterative process. Existing distillation methods enable efficient sampling, but have notable limitations, such as performance degradation with very
Externí odkaz:
http://arxiv.org/abs/2405.16852
Autor:
Sebastian Hendrix, Vincent Dartigue, Hailee Hall, Shrankhla Bawaria, Jenina Kingma, Bilkish Bajaj, Noam Zelcer, Daniel L. Kober
Publikováno v:
Nature Communications, Vol 15, Iss 1, Pp 1-17 (2024)
Abstract Site-one protease (S1P) conducts the first of two cleavage events in the Golgi to activate Sterol regulatory element binding proteins (SREBPs) and upregulate lipogenic transcription. S1P is also required for a wide array of additional signal
Externí odkaz:
https://doaj.org/article/37ed8873d23d4923aecc3d62781541c8
Autor:
Kingma, Diederik P., Gao, Ruiqi
To achieve the highest perceptual quality, state-of-the-art diffusion models are optimized with objectives that typically look very different from the maximum likelihood and the Evidence Lower Bound (ELBO) objectives. In this work, we reveal that dif
Externí odkaz:
http://arxiv.org/abs/2303.00848
Autor:
Sandra D.K. Kingma, Laura K.M. Steinbusch, Sietse M. Aukema, Margje Sinnema, Bianca Panis, Joost Nicolai, Estela Rubio-Gozalbo
Publikováno v:
Molecular Genetics and Metabolism Reports, Vol 41, Iss , Pp 101159- (2024)
D-glyceric aciduria (DGA) is caused by D-glycerate-2-kinase deficiency due to biallelic pathogenic variants in GLYCTK. It is associated with variable neurological symptoms. DGA is extremely rare, and genetic variants are only known in 7 previously de
Externí odkaz:
https://doaj.org/article/f30ddf4203474cf3b784e5b2eea70fee
Publikováno v:
Frontiers in Neurology, Vol 15 (2024)
BackgroundBenign Paroxysmal Positional Vertigo (BPPV) is the most common cause of vertigo. While various techniques and technologies have improved BPPV diagnostics and treatment, optimizing BPPV healthcare pathways requires a comprehensive understand
Externí odkaz:
https://doaj.org/article/b4e74b0807f142aebb7703a75e64e08c
Autor:
Bernice Scholten, Koen van der Sanden, Blaise Kelly, Bas Henzing, Anjoeka Pronk, W. Marty Blom, Lisa Klous, Boris R.M. Kingma
Publikováno v:
Environment International, Vol 192, Iss , Pp 109010- (2024)
Background: Climate change is expected to elevate exposure to several environmental health risk factors, including extreme environmental temperatures, air pollution and airborne allergenic pollen. Given their interconnected effects on respiratory and
Externí odkaz:
https://doaj.org/article/ff6b8c878a254f6488aeaa3dd903e4dd
Publikováno v:
Frontiers in Neurology, Vol 15 (2024)
ObjectiveTo investigate the effect of daily use of subconscious vibrotactile stimulation in bilateral vestibulopathy (BVP) patients, who judged the effect of vestibular rehabilitation as insufficient.MethodsBVP patients were asked to wear a subconsci
Externí odkaz:
https://doaj.org/article/47823f590484401cbc0efa37d75e52df
Autor:
Meng, Chenlin, Rombach, Robin, Gao, Ruiqi, Kingma, Diederik P., Ermon, Stefano, Ho, Jonathan, Salimans, Tim
Classifier-free guided diffusion models have recently been shown to be highly effective at high-resolution image generation, and they have been widely used in large-scale diffusion frameworks including DALLE-2, Stable Diffusion and Imagen. However, a
Externí odkaz:
http://arxiv.org/abs/2210.03142