Comparison Between CNN, ViT and CCT for Channel Frequency Response Interpretation and Application to G.Fast

Autor: Philippe Dierickx, Axel Van Damme, Nicolas Dupuis, Olivier Delaby
Jazyk: angličtina
Rok vydání: 2023
Předmět:
Zdroj: IEEE Access, Vol 11, Pp 24039-24052 (2023)
Druh dokumentu: article
ISSN: 2169-3536
DOI: 10.1109/ACCESS.2023.3247877
Popis: Convolutional Neural Networks (CNN) and more recently Visual Transformers (ViT) have been heavily used in specific areas like computer vision. Through this work, we explore and compare the CNNs and ViT models applied to a telecommunication signal, more specifically to interpret a G.fast channel frequency response. As both CNNs and ViT bring advantages, we have deepened the research by using a combination of both convolutions and transformers using Compact Convolutional Transformers (CCT) models. This study demonstrates that using transformer based models on a 1-D signal processing use case, we have significantly gained in accuracy compared to traditional convolution based models.
Databáze: Directory of Open Access Journals