Transformers Use Causal World Models in Maze-Solving Tasks

Autor: Spies, Alex F., Edwards, William, Ivanitskiy, Michael I., Skapars, Adrians, Räuker, Tilman, Inoue, Katsumi, Russo, Alessandra, Shanahan, Murray

Recent studies in interpretability have explored the inner workings of transformer models trained on tasks across various domains, often discovering that these networks naturally develop surprisingly structured representations. When such representati

Externí odkaz: http://arxiv.org/abs/2412.11867

The broader spectrum of in-context learning

Autor: Lampinen, Andrew Kyle, Chan, Stephanie C. Y., Singh, Aaditya K., Shanahan, Murray

The ability of language models to learn a task from a few examples in context has generated substantial interest. Here, we provide a perspective that situates this type of supervised few-shot learning within a much broader spectrum of meta-learned in

Externí odkaz: http://arxiv.org/abs/2412.03782

Small-scale Hamiltonian optimization of interpolating operators for Lagrangian lattice quantum field theory

Autor: Avkhadiev, Artur, Funcke, Lena, Jansen, Karl, Kühn, Stefan, Shanahan, Phiala E.

Lattice quantum field theory calculations may potentially combine the advantages of Hamiltonian formulations with the scalability and control of conventional Lagrangian frameworks. However, such hybrid approaches need to consider (1) the differences

Externí odkaz: http://arxiv.org/abs/2411.02185

Gas puff imaging of plasma turbulence in the magnetic island scrape-off layer of W7-X

Autor: Baek, S. G., Ballinger, S., Grulke, O., Killer, C., von Stechow, A., Terry, J. L., Scharmer, F., Shanahan, B.

The turbulence characteristics of the scrape-off-layer (SOL) plasma in the W7-X stellarator are investigated using a gas-puff-imaging (GPI) diagnostic, newly installed and operated during the OP 2.1 campaign. The SOL plasma on W7-X features a chain o

Externí odkaz: http://arxiv.org/abs/2410.16194

Measurement of the double-differential cross section of muon-neutrino charged-current interactions with low hadronic energy in the NOvA Near Detector

Autor: Acero, M. A., Acharya, B., Adamson, P., Aliaga, L., Anfimov, N., Antoshkin, A., Arrieta-Diaz, E., Asquith, L., Aurisano, A., Back, A., Balashov, N., Baldi, P., Bambah, B. A., Bannister, E., Barros, A., Bashar, S., Bat, A., Bays, K., Bernstein, R., Bezerra, T. J. C., Bhatnagar, V., Bhattarai, D., Bhuyan, B., Bian, J., Booth, A. C., Bowles, R., Brahma, B., Bromberg, C., Buchanan, N., Butkevich, A., Calvez, S., Carroll, T. J., Catano-Mur, E., Cesar, J. P., Chatla, A., Chirco, R., Choudhary, B. C., Christensen, A., Cicala, M. F., Coan, T. E., Cooleybeck, A., Cortes-Parra, C., Coveyou, D., Cremonesi, L., Davies, G. S., Derwent, P. F., Ding, P., Djurcic, Z., Dobbs, K., Dolce, M., Doyle, D., Tonguino, D. Dueñas, Dukes, E. C., Dye, A., Ehrlich, R., Ewart, E., Filip, P., Frank, M. J., Gallagher, H. R., Gao, F., Giri, A., Gomes, R. A., Goodman, M. C., Groh, M., Group, R., Habig, A., Hakl, F., Hartnell, J., Hatcher, R., He, M., Heller, K., Hewes, V, Himmel, A., Horoho, T., Ivaneev, Y., Ivanova, A., Jargowsky, B., Jarosz, J., Johnson, C., Judah, M., Kakorin, I., Kaplan, D. M., Kalitkina, A., Kirezli-Ozdemir, B., Kleykamp, J., Klimov, O., Koerner, L. W., Kolupaeva, L., Kralik, R., Kumar, A., Kus, V., Lackey, T., Lang, K., Lesmeister, J., Lister, A., Liu, J., Lock, J. A., Lokajicek, M., MacMahon, M., Magill, S., Mann, W. A., Manoharan, M. T., Plata, M. Manrique, Marshak, M. L., Martinez-Casales, M., Matveev, V., Mehta, B., Messier, M. D., Meyer, H., Miao, T., Miller, W. H., Mishra, S., Mishra, S. R., Mislivec, A., Mohanta, R., Moren, A., Morozova, A., Mu, W., Mualem, L., Muether, M., Mulder, K., Myers, D., Naples, D., Nath, A., Nelleri, S., Nelson, J. K., Nichol, R., Niner, E., Norman, A., Norrick, A., Nosek, T., Oh, H., Olshevskiy, A., Olson, T., Ozkaynak, M., Pal, A., Paley, J., Panda, L., Patterson, R. B., Pawloski, G., Petti, R., Porter, J. C. C., Prais, L. R., Rabelhofer, M., Rafique, A., Raj, V., Rajaoalisoa, M., Ramson, B., Rebel, B., Roy, P., Samoylov, O., Sanchez, M. C., Falero, S. Sanchez, Shanahan, P., Sharma, P., Sheshukov, A., Shivam, Shmakov, A., Shorrock, W., Shukla, S., Singha, D. K., Singh, I., Singh, P., Singh, V., Smith, E., Smolik, J., Snopok, P., Solomey, N., Sousa, A., Soustruznik, K., Strait, M., Suter, L., Sutton, A., Sutton, K., Swain, S., Sweeney, C., Sztuc, A., Talukdar, N., Oregui, B. Tapia, Tas, P., Thakore, T., Thomas, J., Tiras, E., Titus, M., Torun, Y., Tran, D., Trokan-Tenorio, J., Urheim, J., Vahle, P., Vallari, Z., Villamil, J. D., Vockerodt, K. J., Wallbank, M., Weber, C., Wetstein, M., Whittington, D., Wickremasinghe, D. A., Wieber, T., Wolcott, J., Wrobel, M., Wu, S., Wu, W., Xiao, Y., Yaeggy, B., Yahaya, A., Yankelevich, A., Yonehara, K., Yu, Y., Zadorozhnyy, S., Zalesak, J., Zwaska, R.

The NOvA collaboration reports cross-section measurements for $\nu_{\mu}$ charged-current interactions with low hadronic energy (maximum kinetic energy of 250 MeV for protons and 175 MeV for pions) in the NOvA Near Detector. The results are presented

Externí odkaz: http://arxiv.org/abs/2410.10222