Challenges in Guardrailing Large Language Models for Science

Autor: Pantha, Nishan, Ramasubramanian, Muthukumaran, Gurung, Iksha, Maskey, Manil, Ramachandran, Rahul

The rapid development in large language models (LLMs) has transformed the landscape of natural language processing and understanding (NLP/NLU), offering significant benefits across various domains. However, when applied to scientific research, these

Externí odkaz: http://arxiv.org/abs/2411.08181

MicroScopiQ: Accelerating Foundational Models through Outlier-Aware Microscaling Quantization

Autor: Ramachandran, Akshat, Kundu, Souvik, Krishna, Tushar

Quantization of foundational models (FMs) is significantly more challenging than traditional DNNs due to the emergence of large magnitude features called outliers. Existing outlier-aware algorithm/architecture co-design techniques either use mixed-pr

Externí odkaz: http://arxiv.org/abs/2411.05282

POD-Attention: Unlocking Full Prefill-Decode Overlap for Faster LLM Inference

Autor: Kamath, Aditya K, Prabhu, Ramya, Mohan, Jayashree, Peter, Simon, Ramjee, Ramachandran, Panwar, Ashish

Each request in LLM inference goes through two phases: compute-bound prefill and memory-bandwidth-bound decode. To improve GPU utilization, recent systems use hybrid batching that combines the prefill and decode phases of different requests into the

Externí odkaz: http://arxiv.org/abs/2410.18038

ZK-DPPS: A Zero-Knowledge Decentralised Data Sharing and Processing Middleware

Autor: Jabbari, Amir, Ramachandran, Gowri, Malik, Sidra, Jurdak, Raja

In the current digital landscape, supply chains have transformed into complex networks driven by the Internet of Things (IoT), necessitating enhanced data sharing and processing capabilities to ensure traceability and transparency. Leveraging Blockch

Externí odkaz: http://arxiv.org/abs/2410.15568

First constraints on general neutrino interactions based on KATRIN data

Autor: Aker, M., Batzler, D., Beglarian, A., Beisenkötter, J., Biassoni, M., Bieringer, B., Biondi, Y., Block, F., Bornschein, B., Bornschein, L., Böttcher, M., Carminati, M., Chatrabhuti, A., Chilingaryan, S., Daniel, B. A., Descher, M., Barrero, D. Díaz, Doe, P. J., Dragoun, O., Drexlin, G., Edzards, F., Eitel, K., Ellinger, E., Engel, R., Enomoto, S., Felden, A., Fengler, C., Fiorini, C., Formaggio, J. A., Forstner, C., Fränkle, F. M., Gagliardi, G., Gauda, K., Gavin, A. S., Gil, W., Glück, F., Grössle, R., Gutknecht, N., Hannen, V., Hasselmann, L., Helbing, K., Henke, H., Heyns, S., Hiller, R., Hillesheimer, D., Hinz, D., Höhn, T., Huber, A., Jansen, A., Khosonthongkee, K., Köhler, C., Köllenberger, L., Kopmann, A., Kovač, N., La Cascio, L., Lasserre, T., Lauer, J., Le, T. L., Lebeda, O., Lehnert, B., Li, G., Lokhov, A., Machatschek, M., Mark, M., Marsteller, A., McMichael, K., Melzer, C., Mertens, S., Mohanty, S., Mostafa, J., Müller, K., Nava, A., Neumann, H., Niemes, S., Onillon, A., Parno, D. S., Pavan, M., Pinsook, U., Poon, A. W. P., Poyato, J. M. L., Priester, F., Ráliš, J., Ramachandran, S., Robertson, R. G. H., Rodenbeck, C., Röllig, M., Sack, R., Saenz, A., Salomon, R., Schäfer, P., Schlösser, K., Schlösser, M., Schlüter, L., Schneidewind, S., Schrank, M., Schürmann, J., Schütz, A. K., Schwemmer, A., Schwenck, A., Seeyangnok, J., Šefčík, M., Siegmann, D., Simon, F., Songwadhana, J., Spanier, F., Spreng, D., Sreethawong, W., Steidl, M., Štorek, J., Stribl, X., Sturm, M., Suwonjandee, N., Jerome, N. Tan, Telle, H. H., Thorne, L. A., Thümmler, T., Titov, N., Tkachev, I., Urban, K., Valerius, K., Vénos, D., Weinheimer, C., Welte, S., Wendel, J., Wetter, M., Wiesinger, C., Wilkerson, J. F., Wolf, J., Wüstling, S., Wydra, J., Xu, W., Zadorozhny, S., Zeller, G.

The precision measurement of the tritium $\beta$-decay spectrum performed by the KATRIN experiment provides a unique way to search for general neutrino interactions (GNI). All theoretical allowed GNI terms involving neutrinos are incorporated into a

Externí odkaz: http://arxiv.org/abs/2410.13895