Improving Deep Unsupervised Anomaly Detection by Exploiting VAE Latent Space Distribution
Autor: | Fabio Fassetti, Fabrizio Angiulli, Luca Ferragina |
---|---|
Rok vydání: | 2020 |
Předmět: |
Computer science
business.industry Feature vector Pattern recognition 02 engineering and technology Density estimation Regularization (mathematics) Term (time) Reduction (complexity) 020204 information systems Outlier 0202 electrical engineering electronic engineering information engineering Key (cryptography) 020201 artificial intelligence & image processing Anomaly detection Artificial intelligence business |
Zdroj: | Discovery Science ISBN: 9783030615260 DS |
DOI: | 10.1007/978-3-030-61527-7_39 |
Popis: | Anomaly detection methods exploiting autoencoders (AE) have shown good performances. Unfortunately, deep non-linear architectures are able to perform high dimensionality reduction while keeping reconstruction error low, thus worsening outlier detecting performances of AEs. To alleviate the above problem, recently some authors have proposed to exploit Variational autoencoders (VAE), which arise as a variant of standard AEs designed for generative purposes. The key idea of VAEs is take into account a regularization term constraining the organization of the latent space. However, VAEs share with standard AEs the problem that they generalize so well that they can also well reconstruct anomalies. In this work we argue that the approach of selecting the worst reconstructed examples as anomalies is too simplistic if a VAE architecture is employed. We show that outliers tend to lie in the sparsest regions of the combined latent/error space and propose a novel unsupervised anomaly detection algorithm, called VAEOut, that identifies outliers by performing density estimation in this augmented feature space. The proposed approach shows sensible improvements in terms of detection performances over the standard approach based on the reconstruction error. |
Databáze: | OpenAIRE |
Externí odkaz: |