M2oE: Multimodal Collaborative Expert Peptide Model

Autor:	Guo, Zengzhu, Ma, Zhiqi
Rok vydání:	2024
Předmět:	Computer Science - Machine Learning Computer Science - Artificial Intelligence Quantitative Biology - Biomolecules
Druh dokumentu:	Working Paper
Popis:	Peptides are biomolecules comprised of amino acids that play an important role in our body. In recent years, peptides have received extensive attention in drug design and synthesis, and peptide prediction tasks help us better search for functional peptides. Typically, we use the primary sequence and structural information of peptides for model encoding. However, recent studies have focused more on single-modal information (structure or sequence) for prediction without multi-modal approaches. We found that single-modal models are not good at handling datasets with less information in that particular modality. Therefore, this paper proposes the M2oE multi-modal collaborative expert peptide model. Based on previous work, by integrating sequence and spatial structural information, employing expert model and Cross-Attention Mechanism, the model's capabilities are balanced and improved. Experimental results indicate that the M2oE model performs excellently in complex task predictions. Comment: accepted by bibm 2024
Databáze:	arXiv
Externí odkaz:	http://arxiv.org/abs/2411.15208 Zobrazit plný text záznamu View this record from Arxiv