Implementation of Parallel Lanczos Method for Intrusion Detection with Cloud Technologies

Autor: Bo Chen, Yu Le Deng, Tie Ming Chen
Rok vydání: 2013
Předmět:
Zdroj: Applied Mechanics and Materials. :2412-2415
ISSN: 1662-7482
DOI: 10.4028/www.scientific.net/amm.303-306.2412
Popis: The aim of dimensionality reduction is to construct a low-dimensional representation of high dimensional input data in such a way, that important parts of the structure of the input data are preserved. This paper proposes to apply the dimensionality reduction to intrusion detection data based on the parallel Lanczos-SVD (PLSVD) with the cloud technologies. The massive input data is stored on distribution files system, like HDFS. And the Map/Reduce method is used for the parallel analysis on many cluster nodes. Our experiment results show that, compared with the PCA algorithm, PLSVD algorithm has better scalability and flexibility.
Databáze: OpenAIRE