Incremental and multimodal visualization of discographies: exploring the WASABI music knowledge base

Autor: Aline Menin, Michel Buffa, Maroua Tikat, Benjamin Molinet, Guillaume Pellerin, Laurent Pottier, Franck Michel, Marco Winckler
Přispěvatelé: Web-Instrumented Man-Machine Interactions, Communities and Semantics (WIMMICS), Inria Sophia Antipolis - Méditerranée (CRISAM), Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Scalable and Pervasive softwARe and Knowledge Systems (Laboratoire I3S - SPARKS), Laboratoire d'Informatique, Signaux, et Systèmes de Sophia Antipolis (I3S), Université Nice Sophia Antipolis (1965 - 2019) (UNS), COMUE Université Côte d'Azur (2015-2019) (COMUE UCA)-COMUE Université Côte d'Azur (2015-2019) (COMUE UCA)-Centre National de la Recherche Scientifique (CNRS)-Université Côte d'Azur (UCA)-Université Nice Sophia Antipolis (1965 - 2019) (UNS), COMUE Université Côte d'Azur (2015-2019) (COMUE UCA)-COMUE Université Côte d'Azur (2015-2019) (COMUE UCA)-Centre National de la Recherche Scientifique (CNRS)-Université Côte d'Azur (UCA)-Laboratoire d'Informatique, Signaux, et Systèmes de Sophia Antipolis (I3S), COMUE Université Côte d'Azur (2015-2019) (COMUE UCA)-COMUE Université Côte d'Azur (2015-2019) (COMUE UCA)-Centre National de la Recherche Scientifique (CNRS)-Université Côte d'Azur (UCA), Université Côte d'Azur (UCA), Institut de Recherche et Coordination Acoustique/Musique (IRCAM), Centre Interdisciplinaire d'Etudes et de recherche sur l'Expression Contemporaine (CIEREC), Université Jean Monnet - Saint-Étienne (UJM), Département Informatique [Université Nice Sophia Antipolis], COMUE Université Côte d'Azur (2015-2019) (COMUE UCA)-COMUE Université Côte d'Azur (2015-2019) (COMUE UCA)-Université Côte d'Azur (UCA)
Jazyk: angličtina
Rok vydání: 2022
Předmět:
Zdroj: WAC 2022-Web Audio Conference 2022
WAC 2022-Web Audio Conference 2022, Jul 2022, Cannes, France. ⟨10.5281/zenodo.6767530⟩
Popis: International audience; Collaborations between artists is very frequent in music industry and data analysis can help understand the impact of collaborative projects on artists’ careers. In this paper, we propose an incremental and multimodal visualization to support the exploration of artists’ discography and collabo- rations. Visualization techniques are used here to support the discovery of meaningful patterns and causal relation- ships. Our approach combines meta-data, graphics, inter- active audio, and MIR analysis to explore the data using a Web browser. As a case of study, we explore the data from the WASABI knowledge graph, which describes the discography of more than 77,000 artists, representing over 200,000 albums and two million songs. We designed a web platform that requests metadata of any artist/band, parses the results, and displays the data through a visualization technique that combines stream-graphs, timelines and net- work representation. Audio thumbnailing techniques have been used to summarize an entire album or discography, which is used through a Web Audio augmented player integrated into the visualization to support auditory exploration of data. Advanced in-depth exploration of individual songs is supported through MIR analysis performed and displayed directly in the web browser. We demonstrate the use and feasibility of our method through a series of usage scenarios and validate its usefulness through expert judgment.
Databáze: OpenAIRE