Robust domain-adaptive discriminant analysis
Autor: | Marco Loog, Wouter M. Kouw |
---|---|
Přispěvatelé: | Signal Processing Systems, Bayesian Intelligent Autonomous Systems |
Jazyk: | angličtina |
Rok vydání: | 2021 |
Předmět: |
Transduction (machine learning)
Robust Estimator Speech recognition Robust statistics 02 engineering and technology 01 natural sciences Transduction Artificial Intelligence 0103 physical sciences 0202 electrical engineering electronic engineering information engineering 010306 general physics Domain adaptation business.industry Estimation theory Supervised learning Estimator Discriminant Analysis Pattern recognition Linear discriminant analysis ComputingMethodologies_PATTERNRECOGNITION Signal Processing 020201 artificial intelligence & image processing Computer Vision and Pattern Recognition Artificial intelligence Psychology business Classifier (UML) Software Subspace topology |
Zdroj: | Pattern Recognition Letters, 148, 107-113. Elsevier Pattern Recognition Letters, 148 |
ISSN: | 0167-8655 |
Popis: | Consider a domain-adaptive supervised learning setting, where a classifier learns from labeled data in a source domain and unlabeled data in a target domain to predict the corresponding target labels. If the classifier’s assumption on the relationship between domains (e.g. covariate shift, common subspace, etc.) is valid, then it will usually outperform a non-adaptive source classifier. If its assumption is invalid, it can perform substantially worse. Validating assumptions on domain relationships is not possible without target labels. We argue that, in order to make domain-adaptive classifiers more practical, it is necessary to focus on robustness; robust in the sense that an adaptive classifier will still perform at least as well as a non-adaptive classifier without having to rely on the validity of strong assumptions. With this objective in mind, we derive a conservative parameter estimation technique, which is transductive in the sense of Vapnik and Chervonenkis, and show for discriminant analysis that the new estimator is guaranteed to achieve a lower risk on the given target samples compared to the source classifier. Experiments on problems with geographical sampling bias indicate that our parameter estimator performs well. |
Databáze: | OpenAIRE |
Externí odkaz: |