Movie Gen: A Cast of Media Foundation Models

Autor: Polyak, Adam, Zohar, Amit, Brown, Andrew, Tjandra, Andros, Sinha, Animesh, Lee, Ann, Vyas, Apoorv, Shi, Bowen, Ma, Chih-Yao, Chuang, Ching-Yao, Yan, David, Choudhary, Dhruv, Wang, Dingkang, Sethi, Geet, Pang, Guan, Ma, Haoyu, Misra, Ishan, Hou, Ji, Wang, Jialiang, Jagadeesh, Kiran, Li, Kunpeng, Zhang, Luxin, Singh, Mannat, Williamson, Mary, Le, Matt, Yu, Matthew, Singh, Mitesh Kumar, Zhang, Peizhao, Vajda, Peter, Duval, Quentin, Girdhar, Rohit, Sumbaly, Roshan, Rambhatla, Sai Saketh, Tsai, Sam, Azadi, Samaneh, Datta, Samyak, Chen, Sanyuan, Bell, Sean, Ramaswamy, Sharadh, Sheynin, Shelly, Bhattacharya, Siddharth, Motwani, Simran, Xu, Tao, Li, Tianhe, Hou, Tingbo, Hsu, Wei-Ning, Yin, Xi, Dai, Xiaoliang, Taigman, Yaniv, Luo, Yaqiao, Liu, Yen-Cheng, Wu, Yi-Chiao, Zhao, Yue, Kirstain, Yuval, He, Zecheng, He, Zijian, Pumarola, Albert, Thabet, Ali, Sanakoyeu, Artsiom, Mallya, Arun, Guo, Baishan, Araya, Boris, Kerr, Breena, Wood, Carleigh, Liu, Ce, Peng, Cen, Vengertsev, Dimitry, Schonfeld, Edgar, Blanchard, Elliot, Juefei-Xu, Felix, Nord, Fraylie, Liang, Jeff, Hoffman, John, Kohler, Jonas, Fire, Kaolin, Sivakumar, Karthik, Chen, Lawrence, Yu, Licheng, Gao, Luya, Georgopoulos, Markos, Moritz, Rashel, Sampson, Sara K., Li, Shikai, Parmeggiani, Simone, Fine, Steve, Fowler, Tara, Petrovic, Vladan, Du, Yuming

We present Movie Gen, a cast of foundation models that generates high-quality, 1080p HD videos with different aspect ratios and synchronized audio. We also show additional capabilities such as precise instruction-based video editing and generation of

Externí odkaz: http://arxiv.org/abs/2410.13720

What can we learn from nonequilibrium response of a strange metal?

Autor: Polyak, B. A., Khrapai, V. S., Tikhonov, E. S.

Publikováno v: JETP Letters, 2024

We critically address the recent experiment [Science 382, 907 (2023)] on nonequilibrium transport and noise in a strange metal YbRh2Si2 patterned into the nanowire shape. In the long device, resistivity, differential resistance and current noise data

Externí odkaz: http://arxiv.org/abs/2402.09946

Scaling Autoregressive Multi-Modal Models: Pretraining and Instruction Tuning

Autor: Yu, Lili, Shi, Bowen, Pasunuru, Ramakanth, Muller, Benjamin, Golovneva, Olga, Wang, Tianlu, Babu, Arun, Tang, Binh, Karrer, Brian, Sheynin, Shelly, Ross, Candace, Polyak, Adam, Howes, Russell, Sharma, Vasu, Xu, Puxin, Tamoyan, Hovhannes, Ashual, Oron, Singer, Uriel, Li, Shang-Wen, Zhang, Susan, James, Richard, Ghosh, Gargi, Taigman, Yaniv, Fazel-Zarandi, Maryam, Celikyilmaz, Asli, Zettlemoyer, Luke, Aghajanyan, Armen

We present CM3Leon (pronounced "Chameleon"), a retrieval-augmented, token-based, decoder-only multi-modal language model capable of generating and infilling both text and images. CM3Leon uses the CM3 multi-modal architecture but additionally shows th

Externí odkaz: http://arxiv.org/abs/2309.02591

Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generation

Autor: Kirstain, Yuval, Polyak, Adam, Singer, Uriel, Matiana, Shahbuland, Penna, Joe, Levy, Omer

The ability to collect a large dataset of human preferences from text-to-image users is usually limited to companies, making such datasets inaccessible to the public. To address this issue, we create a web app that enables text-to-image users to gene

Externí odkaz: http://arxiv.org/abs/2305.01569

Submerged bridge constructed at least 5600 years ago indicates early human arrival in Mallorca, Spain

Autor: Bogdan P. Onac, Victor J. Polyak, Jerry X. Mitrovica, Joaquín Ginés, Francesc Gràcia, Joan J. Fornós, Angel Ginés, Yemane Asmerom

Publikováno v: Communications Earth & Environment, Vol 5, Iss 1, Pp 1-6 (2024)

Abstract Reconstructing early human colonization of the Balearic Islands in the western Mediterranean is challenging due to limited archaeological evidence. Current understanding places human arrival ~4400 years ago. Here, U-series data from phreatic

Externí odkaz: https://doaj.org/article/882089c2d1224cf288bd80fc8171bb76