Zobrazeno 1 - 10
of 275
pro vyhledávání: '"Shibuya, Takashi"'
Autor:
Comunità, Marco, Zhong, Zhi, Takahashi, Akira, Yang, Shiqi, Zhao, Mengjie, Saito, Koichi, Ikemiya, Yukara, Shibuya, Takashi, Takahashi, Shusuke, Mitsufuji, Yuki
Recent advances in generative models that iteratively synthesize audio clips sparked great success to text-to-audio synthesis (TTA), but with the cost of slow synthesis speed and heavy computation. Although there have been attempts to accelerate the
Externí odkaz:
http://arxiv.org/abs/2406.17672
Autor:
Uchida, Kengo, Shibuya, Takashi, Takida, Yuhta, Murata, Naoki, Takahashi, Shusuke, Mitsufuji, Yuki
In motion generation, controllability as well as generation quality and speed is becoming more and more important. There are various motion editing tasks, such as in-betweening, upper body editing, and path-following, but existing methods perform mot
Externí odkaz:
http://arxiv.org/abs/2406.01867
In this study, we aim to construct an audio-video generative model with minimal computational cost by leveraging pre-trained single-modal generative models for audio and video. To achieve this, we propose a novel method that guides each single-modal
Externí odkaz:
http://arxiv.org/abs/2405.17842
Autor:
Saito, Koichi, Kim, Dongjun, Shibuya, Takashi, Lai, Chieh-Hsin, Zhong, Zhi, Takida, Yuhta, Mitsufuji, Yuki
Sound content is an indispensable element for multimedia works such as video games, music, and films. Recent high-quality diffusion-based sound generation models can serve as valuable tools for the creators. However, despite producing high-quality so
Externí odkaz:
http://arxiv.org/abs/2405.18503
Autor:
Seo, Junyoung, Fukuda, Kazumi, Shibuya, Takashi, Narihira, Takuya, Murata, Naoki, Hu, Shoukang, Lai, Chieh-Hsin, Kim, Seungryong, Mitsufuji, Yuki
Generating novel views from a single image remains a challenging task due to the complexity of 3D scenes and the limited diversity in the existing multi-view datasets to train a model on. Recent research combining large-scale text-to-image (T2I) mode
Externí odkaz:
http://arxiv.org/abs/2405.17251
Autor:
Yang, Shiqi, Zhong, Zhi, Zhao, Mengjie, Takahashi, Shusuke, Ishii, Masato, Shibuya, Takashi, Mitsufuji, Yuki
In recent years, with the realistic generation results and a wide range of personalized applications, diffusion-based generative models gain huge attention in both visual and audio generation areas. Compared to the considerable advancements of text2i
Externí odkaz:
http://arxiv.org/abs/2405.14598
Autor:
Takida, Yuhta, Ikemiya, Yukara, Shibuya, Takashi, Shimada, Kazuki, Choi, Woosung, Lai, Chieh-Hsin, Murata, Naoki, Uesaka, Toshimitsu, Uchida, Kengo, Liao, Wei-Hsiang, Mitsufuji, Yuki
Vector quantization (VQ) is a technique to deterministically learn features with discrete codebook representations. It is commonly performed with a variational autoencoding model, VQ-VAE, which can be further extended to hierarchical structures for m
Externí odkaz:
http://arxiv.org/abs/2401.00365
Autor:
Zhao, Mengjie, Ono, Junya, Zhong, Zhi, Lai, Chieh-Hsin, Takida, Yuhta, Murata, Naoki, Liao, Wei-Hsiang, Shibuya, Takashi, Wakaki, Hiromi, Mitsufuji, Yuki
Contrastive cross-modal models such as CLIP and CLAP aid various vision-language (VL) and audio-language (AL) tasks. However, there has been limited investigation of and improvement in their language encoder, which is the central component of encodin
Externí odkaz:
http://arxiv.org/abs/2310.13267
Autor:
Shimada, Kazuki, Uchida, Kengo, Koyama, Yuichiro, Shibuya, Takashi, Takahashi, Shusuke, Mitsufuji, Yuki, Kawahara, Tatsuya
Sound event localization and detection (SELD) systems estimate direction-of-arrival (DOA) and temporal activation for sets of target classes. Neural network (NN)-based SELD systems have performed well in various sets of target classes, but they only
Externí odkaz:
http://arxiv.org/abs/2309.09223
Generative adversarial network (GAN)-based vocoders have been intensively studied because they can synthesize high-fidelity audio waveforms faster than real-time. However, it has been reported that most GANs fail to obtain the optimal projection for
Externí odkaz:
http://arxiv.org/abs/2309.02836