Interactive Learning for Multimedia at Large
| Autor: | Khan, O.S., Jónsson, B.Þ., Rudinac, S., Zahálka, J., Ragnarsdóttir, H., Þorleiksdóttir, Þ., Guðmundsson, G.Þ., Amsaleg, L., Worring, M., Jose, J.M., Yilmaz, E., Magalhães, J., Castells, P., Ferro, N., Silva, M.J., Martins, F. |
|---|---|
| Přispěvatelé: | IT University of Copenhagen (ITU), School of Computer Science [Reykjavik], Reykjavík University, Informatics Institute [Amsterdam], University of Amsterdam [Amsterdam] (UvA), bohem.ai [Prague], Creating and exploiting explicit links between multimedia fragments (LinkMedia), Inria Rennes – Bretagne Atlantique, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-MEDIA ET INTERACTIONS (IRISA-D6), Institut de Recherche en Informatique et Systèmes Aléatoires (IRISA), Université de Rennes (UR)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut National des Sciences Appliquées (INSA)-Institut National des Sciences Appliquées (INSA)-Université de Bretagne Sud (UBS)-École normale supérieure - Rennes (ENS Rennes)-Institut National de Recherche en Informatique et en Automatique (Inria)-CentraleSupélec-Centre National de la Recherche Scientifique (CNRS)-IMT Atlantique (IMT Atlantique), Institut Mines-Télécom [Paris] (IMT)-Institut Mines-Télécom [Paris] (IMT)-Université de Rennes (UR)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut Mines-Télécom [Paris] (IMT)-Institut Mines-Télécom [Paris] (IMT)-Institut de Recherche en Informatique et Systèmes Aléatoires (IRISA), Institut National des Sciences Appliquées (INSA)-Institut National des Sciences Appliquées (INSA)-Université de Bretagne Sud (UBS)-École normale supérieure - Rennes (ENS Rennes)-CentraleSupélec-Centre National de la Recherche Scientifique (CNRS)-IMT Atlantique (IMT Atlantique), Institut Mines-Télécom [Paris] (IMT)-Institut Mines-Télécom [Paris] (IMT), IT University of Copenhagen, MEDIA ET INTERACTIONS (IRISA-D6), Université de Bretagne Sud (UBS)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut National des Sciences Appliquées (INSA)-Université de Rennes (UNIV-RENNES)-Institut National des Sciences Appliquées (INSA)-Université de Rennes (UNIV-RENNES)-Institut National de Recherche en Informatique et en Automatique (Inria)-École normale supérieure - Rennes (ENS Rennes)-Centre National de la Recherche Scientifique (CNRS)-Université de Rennes 1 (UR1), Université de Rennes (UNIV-RENNES)-CentraleSupélec-IMT Atlantique Bretagne-Pays de la Loire (IMT Atlantique), Institut Mines-Télécom [Paris] (IMT)-Institut Mines-Télécom [Paris] (IMT)-Université de Bretagne Sud (UBS)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut Mines-Télécom [Paris] (IMT)-Institut Mines-Télécom [Paris] (IMT)-Inria Rennes – Bretagne Atlantique, Institut National de Recherche en Informatique et en Automatique (Inria), Operations Management (ABS, FEB), Faculty of Science, Intelligent Sensory Information Systems (IVI, FNWI) |
| Rok vydání: | 2020 |
| Předmět: |
High-dimensional indexing
Multimedia Computer science Large multimedia collections Scale (chemistry) Search engine indexing [INFO.INFO-MM]Computer Science [cs]/Multimedia [cs.MM] Relevance feedback 020207 software engineering 02 engineering and technology computer.software_genre Article Interactive Learning Interactive multimodal learning 0202 electrical engineering electronic engineering information engineering Key (cryptography) 020201 artificial intelligence & image processing Relevance (information retrieval) State (computer science) YFCC100M computer |
| Zdroj: | Lecture Notes in Computer Science ISBN: 9783030454388 ECIR (1) Advances in Information Retrieval 42nd European Conference on IR Research, ECIR 42nd European Conference on IR Research, ECIR, Apr 2020, Lisbon (Portugal), France. pp.495-510, ⟨10.1007/978-3-030-45439-5_33⟩ Advances in Information Retrieval. ECIR 2020 Advances in Information Retrieval. ECIR 2020, pp.495-510, 2020, ⟨10.1007/978-3-030-45439-5_33⟩ Advances in Information Retrieval: 42nd European Conference on IR Research, ECIR 2020, Lisbon, Portugal, April 14-17, 2020 : proceedings, I, 495-510 Khan, O S, Jónsson, B T, Rudinac, S, Zahálka, J, Ragnarsdóttir, H, Þorleiksdóttir, Þ, Guðmundsson, G Þ, Amsaleg, L & Worring, M 2020, Interactive Learning for Multimedia at Large . in Advances in Information Retrieval : 42nd European Conference on IR Research, ECIR 2020 . Springer, Lisbon, Portugal, Lecture Notes in Computer Science, vol. 12035, pp. 495-510 . https://doi.org/10.1007/978-3-030-45439-5_33 |
| Popis: | International audience; Interactive learning has been suggested as a key method for addressing analytic multimedia tasks arising in several domains. Until recently, however, methods to maintain interactive performance at the scale of today's media collections have not been addressed. We propose an interactive learning approach that builds on and extends the state of the art in user relevance feedback systems and high-dimensional indexing for multimedia. We report on a detailed experimental study using the ImageNet and YFCC100M collections, containing 14 million and 100 million images respectively. The proposed approach outperforms the relevant state-of-the-art approaches in terms of interactive performance, while improving suggestion relevance in some cases. In particular, even on YFCC100M, our approach requires less than 0.3 s per interaction round to generate suggestions, using a single computing core and less than 7 GB of main memory. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|