NLPBK at VLSP-2020 shared task: Compose transformer pretrained models for Reliable Intelligence Identification on Social network

Autor:	Nguyen, Thanh Chinh, Nguyen, Van Nha
Rok vydání:	2021
Předmět:	Computer Science - Computation and Language Computer Science - Information Retrieval
Druh dokumentu:	Working Paper
Popis:	This paper describes our method for tuning a transformer-based pretrained model, to adaptation with Reliable Intelligence Identification on Vietnamese SNSs problem. We also proposed a model that combines bert-base pretrained models with some metadata features, such as the number of comments, number of likes, images of SNS documents,... to improved results for VLSP shared task: Reliable Intelligence Identification on Vietnamese SNSs. With appropriate training techniques, our model is able to achieve 0.9392 ROC-AUC on public test set and the final version settles at top 2 ROC-AUC (0.9513) on private test set. Comment: 5 pages, 2 figures
Databáze:	arXiv
Externí odkaz:	http://arxiv.org/abs/2101.12672 Zobrazit plný text záznamu View this record from Arxiv