TensorProjection Layer: A Tensor-Based Dimensionality Reduction Method in CNN

Autor:	Morimoto, Toshinari, Huang, Su-Yun
Rok vydání:	2020
Předmět:	Statistics - Machine Learning Computer Science - Computer Vision and Pattern Recognition Computer Science - Machine Learning
Druh dokumentu:	Working Paper
Popis:	In this paper, we propose a dimensionality reduction method applied to tensor-structured data as a hidden layer (we call it TensorProjection Layer) in a convolutional neural network. Our proposed method transforms input tensors into ones with a smaller dimension by projection. The directions of projection are viewed as training parameters associated with our proposed layer and trained via a supervised learning criterion such as minimization of the cross-entropy loss function. We discuss the gradients of the loss function with respect to the parameters associated with our proposed layer. We also implement simple numerical experiments to evaluate the performance of the TensorProjection Layer. Comment: 18 pages
Databáze:	arXiv
Externí odkaz:	http://arxiv.org/abs/2004.04454 Zobrazit plný text záznamu View this record from Arxiv