Flipover outperforms dropout in deep learning

Autor: Yuxuan Liang, Chuang Niu, Pingkun Yan, Ge Wang
Jazyk: angličtina
Rok vydání: 2024
Předmět:
Zdroj: Visual Computing for Industry, Biomedicine, and Art, Vol 7, Iss 1, Pp 1-9 (2024)
Druh dokumentu: article
ISSN: 2524-4442
DOI: 10.1186/s42492-024-00153-y
Popis: Abstract Flipover, an enhanced dropout technique, is introduced to improve the robustness of artificial neural networks. In contrast to dropout, which involves randomly removing certain neurons and their connections, flipover randomly selects neurons and reverts their outputs using a negative multiplier during training. This approach offers stronger regularization than conventional dropout, refining model performance by (1) mitigating overfitting, matching or even exceeding the efficacy of dropout; (2) amplifying robustness to noise; and (3) enhancing resilience against adversarial attacks. Extensive experiments across various neural networks affirm the effectiveness of flipover in deep learning.
Databáze: Directory of Open Access Journals