Lessons from the Trenches on Reproducible Evaluation of Language Models

Autor: Biderman, Stella, Schoelkopf, Hailey, Sutawika, Lintang, Gao, Leo, Tow, Jonathan, Abbasi, Baber, Aji, Alham Fikri, Ammanamanchi, Pawan Sasanka, Black, Sidney, Clive, Jordan, DiPofi, Anthony, Etxaniz, Julen, Fattori, Benjamin, Forde, Jessica Zosa, Foster, Charles, Hsu, Jeffrey, Jaiswal, Mimansa, Lee, Wilson Y., Li, Haonan, Lovering, Charles, Muennighoff, Niklas, Pavlick, Ellie, Phang, Jason, Skowron, Aviya, Tan, Samson, Tang, Xiangru, Wang, Kevin A., Winata, Genta Indra, Yvon, François, Zou, Andy

Effective evaluation of language models remains an open challenge in NLP. Researchers and engineers face methodological issues such as the sensitivity of models to evaluation setup, difficulty of proper comparisons across methods, and the lack of rep

Externí odkaz: http://arxiv.org/abs/2405.14782

Terrestrial Very-Long-Baseline Atom Interferometry: Workshop Summary

Autor: Abend, Sven, Allard, Baptiste, Alonso, Iván, Antoniadis, John, Araujo, Henrique, Arduini, Gianluigi, Arnold, Aidan, Aßmann, Tobias, Augst, Nadja, Badurina, Leonardo, Balaz, Antun, Banks, Hannah, Barone, Michele, Barsanti, Michele, Bassi, Angelo, Battelier, Baptiste, Baynham, Charles, Quentin, Beaufils, Belic, Aleksandar, Beniwal, Ankit, Bernabeu, Jose, Bertinelli, Francesco, Bertoldi, Andrea, Biswas, Ikbal Ahamed, Blas, Diego, Boegel, Patrick, Bogojevic, Aleksandar, Böhm, Jonas, Böhringer, Samuel, Bongs, Kai, Bouyer, Philippe, Brand, Christian, Brimis, Apostolos, Buchmueller, Oliver, Cacciapuoti, Luigi, Calatroni, Sergio, Canuel, Benjamin, Caprini, Chiara, Caramete, Ana, Caramete, Laurentiu, Carlesso, Matteo, Carlton, John, Casariego, Mateo, Charmandaris, Vassilis, Chen, Yu-Ao, Chiofalo, Maria Luisa, Cimbri, Alessia, Coleman, Jonathon, Constantin, Florin Lucian, Contaldi, Carlo, Cui, Yanou, Da Ros, Elisa, Davies, Gavin, Rosendo, Esther del Pino, Deppner, Christian, Derevianko, Andrei, de Rham, Claudia, De Roeck, Albert, Derr, Daniel, Di Pumpo, Fabio, Djordjevic, Goran, Dobrich, Babette, Domokos, Peter, Dornan, Peter, Doser, Michael, Drougakis, Giannis, Dunningham, Jacob, Duspayev, Alisher, Easo, Sajan, Eby, Joshua, Efremov, Maxim, Ekelof, Tord, Elertas, Gedminas, Ellis, John, Evans, David, Fadeev, Pavel, Fanì, Mattia, Fassi, Farida, Fattori, Marco, Fayet, Pierre, Felea, Daniel, Feng, Jie, Friedrich, Alexander, Fuchs, Elina, Gaaloul, Naceur, Gao, Dongfeng, Gardner, Susan, Garraway, Barry, Gauguet, Alexandre, Gerlach, Sandra, Gersemann, Matthias, Gibson, Valerie, Giese, Enno, Giudice, Gian Francesco, Glasbrenner, Eric, Gündogan, Mustafa, Haehnelt, Martin G., Hakulinen, Timo, Hammerer, Klemens, Hanımeli, Ekim Taylan, Harte, Tiffany, Hawkins, Leonie, Hees, Aurelien, Heise, Jaret, Henderson, Victoria, Herrmann, Sven, Hird, Thomas, Hogan, Jason, Holst, Bodil, Holynski, Michael, Hussain, Kamran, Janson, Gregor, Jeglič, Peter, Jelezko, Fedor, Kagan, Michael, Kalliokoski, Matti, Kasevich, Mark, Kehagias, Alex, Kilian, Eva, Koley, Soumen, Konrad, Bernd, Kopp, Joachim, Kornakov, Georgy, Kovachy, Tim, Krutzik, Markus, Kumar, Mukesh, Kumar, Pradeep, Laemmerzahl, Claus, Landsberg, Greg, Langlois, Mehdi, Lanigan, Bryony, Lellouch, Samuel, Leone, Bruno, Lafitte, Christophe Le Poncin, Lewicki, Marek, Leykauf, Bastian, Lezeik, Ali, Lombriser, Lucas, López, Luis, Asamar, Elias López, Monjaraz, Cristian López, Luciano, Gaetano, Mohammed, Mohammed Mahmoud, Maleknejad, Azadeh, Markus, Krutzik, Marteau, Jacques, Massonnet, Didier, Mazumdar, Anupam, McCabe, Christopher, Meister, Matthias, Menu, Jonathan, Messineo, Giuseppe, Micalizio, Salvatore, Millington, Peter, Milosevic, Milan, Mitchell, Jeremiah, Montero, Mario, Morley, Gavin, Müller, Jürgen, Müstecaplıoğlu, Özgür, Ni, Wei-Tou, Noller, Johannes, Odžak, Senad, Oi, Daniel, Omar, Yasser, Pahl, Julia, Paling, Sean, Pandey, Saurabh, Pappas, George, Pareek, Vinay, Pasatembou, Elizabeth, Pelucchi, Emanuele, Santos, Franck Pereira dos, Piest, Baptist, Pikovski, Igor, Pilaftsis, Apostolos, Plunkett, Robert, Poggiani, Rosa, Prevedelli, Marco, Puputti, Julia, Veettil, Vishnupriya Puthiya, Quenby, John, Rafelski, Johann, Rajendran, Surjeet, Rasel, Ernst Maria, Sfar, Haifa Rejeb, Reynaud, Serge, Richaud, Andrea, Rodzinka, Tangui, Roura, Albert, Rudolph, Jan, Sabulsky, Dylan, Safronova, Marianna, Santamaria, Luigi, Schilling, Manuel, Schkolnik, Vladimir, Schleich, Wolfgang, Schlippert, Dennis, Schneider, Ulrich, Schreck, Florian, Schubert, Christian, Schwersenz, Nico, Semakin, Aleksei, Sergijenko, Olga, Shao, Lijing, Shipsey, Ian, Singh, Rajeev, Smerzi, Augusto, Sopuerta, Carlos F., Spallicci, Alessandro, Stefanescu, Petruta, Stergioulas, Nikolaos, Ströhle, Jannik, Struckmann, Christian, Tentindo, Silvia, Throssell, Henry, Tino, Guglielmo M., Tinsley, Jonathan, Mircea, Ovidiu Tintareanu, Tkalčec, Kimberly, Tolley, Andrew, Tornatore, Vincenza, Torres-Orjuela, Alejandro, Treutlein, Philipp, Trombettoni, Andrea, Tsai, Yu-Dai, Ufrecht, Christian, Ulmer, Stefan, Valuch, Daniel, Vaskonen, Ville, Aceves, Veronica Vazquez, Vitanov, Nikolay, Vogt, Christian, von Klitzing, Wolf, Vukics, András, Walser, Reinhold, Wang, Jin, Warburton, Niels, Webber-Date, Alexander, Wenzlawski, André, Werner, Michael, Williams, Jason, Windapssinger, Patrcik, Wolf, Peter, Wörner, Lisa, Xuereb, André, Yahia, Mohamed, Cruzeiro, Emmanuel Zambrini, Zarei, Moslem, Zhan, Mingsheng, Zhou, Lin, Zupan, Jure, Zupanič, Erik

This document presents a summary of the 2023 Terrestrial Very-Long-Baseline Atom Interferometry Workshop hosted by CERN. The workshop brought together experts from around the world to discuss the exciting developments in large-scale atom interferomet

Externí odkaz: http://arxiv.org/abs/2310.08183

Perfil Sociodemográfico de Idosos Com Câncer em Serviço Terciário do Sistema Único de Saúde

Autor: Ana Beatriz Bortolansa Pacagnella, Emmily Daiane Buarque De Santana, Manoella de Macedo Gome, André Fattori, Maria Elena Guariento

Publikováno v: Geriatrics, Gerontology and Aging, Vol 8, Pp 27-31 (2024)

Objetivos: Avaliar a relação entre status social e acesso ao tratamento antineoplásico em idosos com câncer. Métodos: Esse estudo avaliou algumas características sociodemográficas (idade, sexo, IDH-M, distância entre município de origem e Ca

Externí odkaz: https://doaj.org/article/487083cc7f794953b143ec32a0b4f530

Network Analysis: A Multivariate Statistical Approach for Health Science Research

Autor: Daniel Eduardo da Cunha Leme, Erika Valeska da Costa Alves, Vinícius do Carmo Oliveira Lemos, andré Fattori

Publikováno v: Geriatrics, Gerontology and Aging, Vol 14, Pp 43-51 (2024)

Network analysis is a graphical statistical technique that allows rapid visualization and interpretation of associations between multiple variables. There are still few theoretical studies on this method, especially in the areas of geriatrics and ger

Externí odkaz: https://doaj.org/article/58ae1ebd519b4b72a71d40847bbf8584

A simple and efficient Distributed Trigger Counting algorithm based on local thresholds

Autor: Seokhyun Kim, Giorgia Fattori, Yongsu Park

Publikováno v: ICT Express, Vol 10, Iss 4, Pp 895-901 (2024)

Consider a large-scale distributed system in which each computing device is observing triggers from an external source. Distributed Trigger Counting (DTC) algorithm is used to detect the state of the system when the aggregated number of the observed

Externí odkaz: https://doaj.org/article/b54e9bc344674c91a8b8173d7f4aa9ca