DEPT: Decoupled Embeddings for Pre-training Language Models

Autor: Iacob, Alex, Sani, Lorenzo, Kurmanji, Meghdad, Shen, William F., Qiu, Xinchi, Cai, Dongqi, Gao, Yan, Lane, Nicholas D.

Language model pre-training benefits from diverse data to enhance performance across domains and languages. However, training on such heterogeneous corpora requires extensive and costly efforts. Since these data sources vary lexically, syntactically,

Externí odkaz: http://arxiv.org/abs/2410.05021

Search for proton decay via $p\rightarrow{e^+\eta}$ and $p\rightarrow{\mu^+\eta}$ with a 0.37 Mton-year exposure of Super-Kamiokande

Autor: Collaboration, Super-Kamiokande, Taniuchi, N., Abe, K., Abe, S., Asaoka, Y., Bronner, C., Harada, M., Hayato, Y., Hiraide, K., Hosokawa, K., Ieki, K., Ikeda, M., Kameda, J., Kanemura, Y., Kaneshima, R., Kashiwagi, Y., Kataoka, Y., Miki, S., Mine, S., Miura, M., Moriyama, S., Nakahata, M., Nakayama, S., Noguchi, Y., Pronost, G., Okamoto, K., Sato, K., Sekiya, H., Shiba, H., Shimizu, K., Shiozawa, M., Sonoda, Y., Suzuki, Y., Takeda, A., Takemoto, Y., Takenaka, A., Tanaka, H., Watanabe, S., Yano, T., Kajita, T., Okumura, K., Tashiro, T., Tomiya, T., Wang, X., Yoshida, S., Megias, G. D., Fernandez, P., Labarga, L., Ospina, N., Zaldivar, B., Pointon, B. W., Kearns, E., Mirabito, J., Raaf, J. L., Wan, L., Wester, T., Bian, J., Griskevich, N. J., Kropp, W. R., Locke, S., Smy, M. B., Sobel, H. W., Takhistov, V., Yankelevich, A., Hill, J., Jang, M. C., Kim, J. Y., Lee, S. H., Lim, I. T., Moon, D. H., Park, R. G., Yang, B. S., Bodur, B., Scholberg, K., Walter, C. W., Beauchêne, A., Bernard, L., Coffani, A., Drapier, O., Hedri, S. El, Giampaolo, A., Mueller, Th. A., Santos, A. D., Paganini, P., Rogly, R., Nakamura, T., Jang, J. S., Machado, L. N., Learned, J. G., Choi, K., Iovine, N., Cao, S., Anthony, L. H. V., Martin, D., Prouse, N. W., Scott, M., Sztuc, A. A., Uchida, Y., Berardi, V., Calabria, N. F., Catanesi, M. G., Radicioni, E., Langella, A., De Rosa, G., Collazuol, G., Feltre, M., Iacob, F., Lamoureux, M., Mattiazzi, M., Ludovici, L., Gonin, M., Périssé, L., Quilain, B., Fujisawa, C., Horiuchi, S., Kobayashi, M., Liu, Y. M., Maekawa, Y., Nishimura, Y., Okazaki, R., Akutsu, R., Friend, M., Hasegawa, T., Ishida, T., Kobayashi, T., Jakkapu, M., Matsubara, T., Nakadaira, T., Nakamura, K., Oyama, Y., Yrey, A. Portocarrero, Sakashita, K., Sekiguchi, T., Tsukamoto, T., Bhuiyan, N., Boschi, T., Burton, G. T., Di Lodovico, F., Gao, J., Goldsack, A., Katori, T., Migenda, J., Ramsden, R. M., Taani, M., Xie, Z., Zsoldos, S., Kotsar, Y., Ozaki, H., Suzuki, A. T., Takagi, Y., Takeuchi, Y., Yamamoto, S., Zhong, H., Feng, J., Feng, L., Han, S., Hu, J. R., Hu, Z., Kawaue, M., Kikawa, T., Mori, M., Nakaya, T., Wendell, R. A., Yasutome, K., Jenkins, S. J., McCauley, N., Mehta, P., Tarrant, A., Wilking, M. J., Fukuda, Y., Itow, Y., Menjo, H., Ninomiya, K., Yoshioka, Y., Lagoda, J., Mandal, M., Mijakowski, P., Prabhu, Y. S., Zalipska, J., Jia, M., Jiang, J., Jung, C. K., Shi, W., Yanagisawa, C., Hino, Y., Ishino, H., Ito, S., Kitagawa, H., Koshio, Y., Ma, W., Nakanishi, F., Sakai, S., Tada, T., Tano, T., Ishizuka, T., Barr, G., Barrow, D., Cook, L., Samani, S., Wark, D., Holin, A., Nova, F., Jung, S., Yang, J. Y., Yoo, J., Fannon, J. E. P., Kneale, L., Malek, M., McElwee, J. M., Stone, O., Stowell, P., Thiesse, M. D., Thompson, L. F., Wilson, S. T., Okazawa, H., Lakshmi, S. M., Kim, S. B., Kwon, E., Lee, M. W., Seo, J. W., Yu, I., Ichikawa, A. K., Nakamura, K. D., Tairafune, S., Nishijima, K., Koshiba, M., Eguchi, A., Goto, S., Iwamoto, K., Mizuno, Y., Muro, T., Nakagiri, K., Nakajima, Y., Shima, S., Watanabe, E., Yokoyama, M., de Perio, P., Fujita, S., Jesús-Valls, C., Martens, K., Marti, Ll., Tsui, K. M., Vagins, M. R., Xia, J., Izumiyama, S., Kuze, M., Matsumoto, R., Terada, K., Asaka, R., Inomoto, M., Ishitsuka, M., Ito, H., Kinoshita, T., Ommura, Y., Shigeta, N., Shinoki, M., Suganuma, T., Yamauchi, K., Yoshida, T., Nakano, Y., Martin, J. F., Tanaka, H. A., Towstego, T., Gaur, R., Gousy-Leblanc, V., Hartz, M., Konaka, A., Li, X., Chen, S., Wu, Y., Xu, B. D., Zhang, A. Q., Zhang, B., Posiadala-Zezula, M., Boyd, S. B., Edwards, R., Hadley, D., Nicholson, M., O'Flaherty, M., Richards, B., Ali, A., Jamieson, B., Amanai, S., Minamino, A., Pintaudi, G., Sano, S., Sasaki, R., Shibayama, R., Shimamura, R., Suzuki, S., Wada, K.

A search for proton decay into $e^+/\mu^+$ and a $\eta$ meson has been performed using data from a 0.373 Mton$\cdot$year exposure (6050.3 live days) of Super-Kamiokande. Compared to previous searches this work introduces an improved model of the intr

Externí odkaz: http://arxiv.org/abs/2409.19633

Homological dimensions of complexes over coherent regular rings

Autor: Gillespie, James, Iacob, Alina

We show that Iacob-Iyengar's answer to a question of Avromov-Foxby extends from Noetherian to coherent rings. In particular, a coherent ring R is regular if and only if the injective (resp. projective) dimension of each complex X of R-modules agrees

Externí odkaz: http://arxiv.org/abs/2409.08393

Low-energy collisions between electrons and BeD$^+$

Autor: Niyonzima, S., Pop, N., Iacob, F., Larson, Å., Orel, A. E., Mezei, J. Zs, Chakrabarti, K., Laporta, V., Hassouni, K., Benredjem, D., Bultel, A., Tennyson, J., Reiter, D., Schneider, I. F.

Publikováno v: Plasma Sources Sci. Technol. 27 (2018) 025015 (10pp)

Multichannel quantum defect theory is applied in the treatment of the dissociative recombination and vibrational excitation processes for the BeD$^+$ ion in the twenty four vibrational levels of its ground electronic state ($\textrm{X}\,{^{1}\Sigma^{

Externí odkaz: http://arxiv.org/abs/2405.19792

Worldwide Federated Training of Language Models

Autor: Iacob, Alex, Sani, Lorenzo, Marino, Bill, Aleksandrov, Preslav, Shen, William F., Lane, Nicholas Donald

The reliance of language model training on massive amounts of computation and vast datasets scraped from potentially low-quality, copyrighted, or sensitive data has come into question practically, legally, and ethically. Federated learning provides a

Externí odkaz: http://arxiv.org/abs/2405.14446