The Conditional Super Learner
| Autor: | Efstathios D. Gennatas, Yannet Interian, Gilmer Valdes, Mark J. van der Laan |
|---|---|
| Rok vydání: | 2022 |
| Předmět: |
Meta learning (computer science)
Optimization algorithm business.industry Computer science Applied Mathematics Cross-validation Machine Learning CLs upper limits Computational Theory and Mathematics Artificial Intelligence Covariate Computer Vision and Pattern Recognition Artificial intelligence business Empirical evidence Algorithms Software Interpretability |
| Zdroj: | IEEE Transactions on Pattern Analysis and Machine Intelligence. 44:10236-10243 |
| ISSN: | 1939-3539 0162-8828 |
| Popis: | Using cross validation to select the best model from a library is standard practice in machine learning. Similarly, meta learning is a widely used technique where models previously developed are combined (mainly linearly) with the expectation of improving performance with respect to individual models. In this article we consider the Conditional Super Learner (CSL), an algorithm that selects the best model candidate from a library of models conditional on the covariates. The CSL expands the idea of using cross validation to select the best model and merges it with meta learning. We propose an optimization algorithm that finds a local minimum to the problem posed and proves that it converges at a rate faster than Osubp/sub(nsup-1/4/sup). We offer empirical evidence that: (1) CSL is an excellent candidate to substitute stacking and (2) CLS is suitable for the analysis of Hierarchical problems. Additionally, implications for global interpretability are emphasized. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|