A blended framework for audio spoof detection with sequential models and bags of auditory bites.

Autor: Sharafudeen M; Machine Intelligence Research Laboratory, Department of Computer Science, University of Kerala, Thiruvananthapuram, Kerala, India., S S VC; Machine Intelligence Research Laboratory, Department of Computer Science, University of Kerala, Thiruvananthapuram, Kerala, India. vinod@keralauniversity.ac.in., J A; Department of Computer Science and Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal, 576104, Karnataka, India. andrew.j@manipal.edu., Sei Y; Graduate School of Informatics and Engineering, The University of Electro-Communications, Tokyo, Japan.
Jazyk: angličtina
Zdroj: Scientific reports [Sci Rep] 2024 Aug 30; Vol. 14 (1), pp. 20192. Date of Electronic Publication: 2024 Aug 30.
DOI: 10.1038/s41598-024-71026-w
Abstrakt: An automated speaker verification system uses the process of speech recognition to verify the identity of a user and block illicit access. Logical access attacks are efforts to obtain access to a system by tampering with its algorithms or data, or by circumventing security mechanisms. DeepFake attacks are a form of logical access threats that employs artificial intelligence to produce highly realistic audio clips of human voice, that may be used to circumvent vocal authentication systems. This paper presents a framework for the detection of Logical Access and DeepFake audio spoofings by integrating audio file components and time-frequency representation spectrograms into a lower-dimensional space using sequential prediction models. Bidirectional-LSTM trained on the bonafide class generates significant one-dimensional features for both classes. The feature set is then standardized to a fixed set using a novel Bags of Auditory Bites (BoAB) feature standardizing algorithm. The Extreme Learning Machine maps the feature space to predictions that differentiate between genuine and spoofed speeches. The framework is evaluated using the ASVspoof 2021 dataset, a comprehensive collection of audio recordings designed for evaluating the strength of speaker verification systems against spoofing attacks. It achieves favorable results on synthesized DeepFake attacks with an Equal Error Rate (EER) of 1.18% in the most optimal setting. Logical Access attacks were more challenging to detect at an EER of 12.22%. Compared to the state-of-the-arts in the ASVspoof2021 dataset, the proposed method notably improves EER for DeepFake attacks by an improvement rate of 95.16%.
(© 2024. The Author(s).)
Databáze: MEDLINE
Externí odkaz: