Fast Lip Feature Extraction Using Psychologically Motivated Gabor Features
| Autor: | Chengxiang Gao, Amir Hussain, Leslie S. Smith, Roger Watt, Andrew Abe |
|---|---|
| Rok vydání: | 2018 |
| Předmět: |
business.industry
Computer science Feature extraction Pattern recognition 02 engineering and technology Lip feature Image (mathematics) Domain (software engineering) 03 medical and health sciences Range (mathematics) 0302 clinical medicine 0202 electrical engineering electronic engineering information engineering 020201 artificial intelligence & image processing 030212 general & internal medicine Artificial intelligence business |
| Zdroj: | SSCI |
| DOI: | 10.1109/ssci.2018.8628931 |
| Popis: | The extraction of relevant lip features is of continuing interest in the speech domain. Using end-to-end feature extraction can produce good results, but at the cost of the results being difficult for humans to comprehend and relate to. We present a new, lightweight feature extraction approach, motivated by glimpse based psychological research into racial barcodes. This allows for 3D geometric features to be produced using Gabor based image patches. This new approach can successfully extract lip features with a minimum of processing, with parameters that can be quickly adapted and used for detailed analysis, and with preliminary results showing successful feature extraction from a range of different speakers. These features can be generated online without the need for trained models, and are also robust and can recover from errors, making them suitable for real world speech analysis. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|