Zobrazeno 1 - 10
of 6 253
pro vyhledávání: '"A. Aithal"'
Autor:
Vavre, Aditya, He, Ethan, Liu, Dennis, Yan, Zijie, Yang, June, Tajbakhsh, Nima, Aithal, Ashwath
Scaling large language models (LLMs) significantly improves performance but comes with prohibitive computational costs. Mixture-of-Experts (MoE) models offer an efficient alternative, increasing capacity without a proportional rise in compute require
Externí odkaz:
http://arxiv.org/abs/2412.09952
Mild cognitive impairment (MCI), often linked to early neurodegeneration, is characterized by subtle cognitive declines and disruptions in brain connectivity. The present study offers a detailed analysis of topological changes associated with MCI, fo
Externí odkaz:
http://arxiv.org/abs/2410.22681
Autor:
He, Ethan, Khattar, Abhinav, Prenger, Ryan, Korthikanti, Vijay, Yan, Zijie, Liu, Tong, Fan, Shiqing, Aithal, Ashwath, Shoeybi, Mohammad, Catanzaro, Bryan
Upcycling pre-trained dense language models into sparse mixture-of-experts (MoE) models is an efficient approach to increase the model capacity of already trained models. However, optimal techniques for upcycling at scale remain unclear. In this work
Externí odkaz:
http://arxiv.org/abs/2410.07524
Mild cognitive impairment (MCI) is characterized by subtle changes in cognitive functions, often associated with disruptions in brain connectivity. The present study introduces a novel fine-grained analysis to examine topological alterations in neuro
Externí odkaz:
http://arxiv.org/abs/2408.15647
Autor:
Aithal, A R, Chorwadwala, Anisa M H
In this article, we prove that there exists a unique perimeter minimizer among all piecewise smooth simple closed curves in $M_{\kappa}^2$ enclosing area $A > 0$ $(A \leq 2{\pi}$ if ${\kappa} = 1)$, and it is a circle in $M_{\kappa}^2$ of radius $AS_
Externí odkaz:
http://arxiv.org/abs/2408.13565
Autor:
Sreenivas, Sharath Turuvekere, Muralidharan, Saurav, Joshi, Raviraj, Chochowski, Marcin, Mahabaleshwarkar, Ameya Sunil, Shen, Gerald, Zeng, Jiaqi, Chen, Zijia, Suhara, Yoshi, Diao, Shizhe, Yu, Chenhan, Chen, Wei-Chun, Ross, Hayley, Olabiyi, Oluwatobi, Aithal, Ashwath, Kuchaiev, Oleksii, Korzekwa, Daniel, Molchanov, Pavlo, Patwary, Mostofa, Shoeybi, Mohammad, Kautz, Jan, Catanzaro, Bryan
We present a comprehensive report on compressing the Llama 3.1 8B and Mistral NeMo 12B models to 4B and 8B parameters, respectively, using pruning and distillation. We explore two distinct pruning strategies: (1) depth pruning and (2) joint hidden/at
Externí odkaz:
http://arxiv.org/abs/2408.11796
Multi-channel ECG-based cardiac disorders detection has an impact on cardiac care and treatment. Limitations of existing methods included variation in ECG waveforms due to the location of electrodes, high non-linearity in the signal, and amplitude me
Externí odkaz:
http://arxiv.org/abs/2408.01542
Recent advances in molecular and genetic research have identified a diverse range of brain tumor sub-types, shedding light on differences in their molecular mechanisms, heterogeneity, and origins. The present study performs whole-brain connectome ana
Externí odkaz:
http://arxiv.org/abs/2407.17938
Autor:
Adhikarla, Eashan, Zhang, Kai, VidalMata, Rosaura G., Aithal, Manjushree, Madhusudhana, Nikhil Ambha, Nicholson, John, Sun, Lichao, Davison, Brian D.
Despite recent strides made by AI in image processing, the issue of mixed exposure, pivotal in many real-world scenarios like surveillance and photography, remains inadequately addressed. Traditional image enhancement techniques and current transform
Externí odkaz:
http://arxiv.org/abs/2407.13170
Autor:
Devaguptapu, Chaitanya, Aithal, Sumukh, Ramasubramanian, Shrinivas, Yamada, Moyuru, Kaul, Manohar
Self-supervised learning (SSL) with vision transformers (ViTs) has proven effective for representation learning as demonstrated by the impressive performance on various downstream tasks. Despite these successes, existing ViT-based SSL architectures d
Externí odkaz:
http://arxiv.org/abs/2406.12944