GazeGen: Gaze-Driven User Interaction for Visual Content Generation

Autor: Hsieh, He-Yen, Li, Ziyun, Zhang, Sai Qian, Ting, Wei-Te Mark, Chang, Kao-Den, De Salvo, Barbara, Liu, Chiao, Kung, H. T.

We present GazeGen, a user interaction system that generates visual content (images and videos) for locations indicated by the user's eye gaze. GazeGen allows intuitive manipulation of visual content by targeting regions of interest with gaze. Using

Externí odkaz: http://arxiv.org/abs/2411.04335

Movie Gen: A Cast of Media Foundation Models

Autor: Polyak, Adam, Zohar, Amit, Brown, Andrew, Tjandra, Andros, Sinha, Animesh, Lee, Ann, Vyas, Apoorv, Shi, Bowen, Ma, Chih-Yao, Chuang, Ching-Yao, Yan, David, Choudhary, Dhruv, Wang, Dingkang, Sethi, Geet, Pang, Guan, Ma, Haoyu, Misra, Ishan, Hou, Ji, Wang, Jialiang, Jagadeesh, Kiran, Li, Kunpeng, Zhang, Luxin, Singh, Mannat, Williamson, Mary, Le, Matt, Yu, Matthew, Singh, Mitesh Kumar, Zhang, Peizhao, Vajda, Peter, Duval, Quentin, Girdhar, Rohit, Sumbaly, Roshan, Rambhatla, Sai Saketh, Tsai, Sam, Azadi, Samaneh, Datta, Samyak, Chen, Sanyuan, Bell, Sean, Ramaswamy, Sharadh, Sheynin, Shelly, Bhattacharya, Siddharth, Motwani, Simran, Xu, Tao, Li, Tianhe, Hou, Tingbo, Hsu, Wei-Ning, Yin, Xi, Dai, Xiaoliang, Taigman, Yaniv, Luo, Yaqiao, Liu, Yen-Cheng, Wu, Yi-Chiao, Zhao, Yue, Kirstain, Yuval, He, Zecheng, He, Zijian, Pumarola, Albert, Thabet, Ali, Sanakoyeu, Artsiom, Mallya, Arun, Guo, Baishan, Araya, Boris, Kerr, Breena, Wood, Carleigh, Liu, Ce, Peng, Cen, Vengertsev, Dimitry, Schonfeld, Edgar, Blanchard, Elliot, Juefei-Xu, Felix, Nord, Fraylie, Liang, Jeff, Hoffman, John, Kohler, Jonas, Fire, Kaolin, Sivakumar, Karthik, Chen, Lawrence, Yu, Licheng, Gao, Luya, Georgopoulos, Markos, Moritz, Rashel, Sampson, Sara K., Li, Shikai, Parmeggiani, Simone, Fine, Steve, Fowler, Tara, Petrovic, Vladan, Du, Yuming

We present Movie Gen, a cast of foundation models that generates high-quality, 1080p HD videos with different aspect ratios and synchronized audio. We also show additional capabilities such as precise instruction-based video editing and generation of

Externí odkaz: http://arxiv.org/abs/2410.13720

Neural Architecture Search of Hybrid Models for NPU-CIM Heterogeneous AR/VR Devices

Autor: Zhao, Yiwei, Li, Ziyun, Khwa, Win-San, Sun, Xiaoyu, Zhang, Sai Qian, Sarwar, Syed Shakib, Stangherlin, Kleber Hugo, Lu, Yi-Lun, Gomez, Jorge Tomas, Seo, Jae-Sun, Gibbons, Phillip B., De Salvo, Barbara, Liu, Chiao

Low-Latency and Low-Power Edge AI is essential for Virtual Reality and Augmented Reality applications. Recent advances show that hybrid models, combining convolution layers (CNN) and transformers (ViT), often achieve superior accuracy/performance tra

Externí odkaz: http://arxiv.org/abs/2410.08326

Deep Nets with Subsampling Layers Unwittingly Discard Useful Activations at Test-Time

Autor: Yang, Chiao-An, Liu, Ziwei, Yeh, Raymond A.

Subsampling layers play a crucial role in deep nets by discarding a portion of an activation map to reduce its spatial dimensions. This encourages the deep net to learn higher-level representations. Contrary to this motivation, we hypothesize that th

Externí odkaz: http://arxiv.org/abs/2410.01083

Digital Twins of Business Processes: A Research Manifesto

Autor: Fornari, Fabrizio, Compagnucci, Ivan, De Donato, Massimo Callisto, Bertrand, Yannis, Beyel, Harry Herbert, Carrión, Emilio, Franceschetti, Marco, Groher, Wolfgang, Grüger, Joscha, Kilic, Emre, Koschmider, Agnes, Leotta, Francesco, Li, Chiao-Yun, Lugaresi, Giovanni, Malburg, Lukas, Mangler, Juergen, Mecella, Massimo, Pastor, Oscar, Riss, Uwe, Seiger, Ronny, Serral, Estefania, Torres, Victoria, Valderas, Pedro

Modern organizations necessitate continuous business processes improvement to maintain efficiency, adaptability, and competitiveness. In the last few years, the Internet of Things, via the deployment of sensors and actuators, has heavily been adopted

Externí odkaz: http://arxiv.org/abs/2410.08219