Off-Line Evaluation of Mobile-Centric Indoor Positioning Systems: The Experiences from the 2017 IPIN Competition.

Autor: Torres-Sospedra J; Institute of New Imaging Technologies, Universitat Jaume I, 12071 Castelló, Spain. jtorres@uji.es., Jiménez AR; Centre for Automation and Robotics (CAR), CSIC-UPM, 28500 Arganda del Rey, Spain. antonio.jimenez@csic.es., Moreira A; Algoritmi Research Centre, University of Minho, 4800-058 Guimarães, Portugal. adriano@dsi.uminho.pt., Lungenstrass T; AraraDS, Monseñor Sótero Sanz 161, 8340457 Santiago, Chile. tomas@ararads.com., Lu WC; Department of Electrical Engineering, Yuan Ze University, Zhongli 32003, Taiwan. dennis70413@gmail.com., Knauth S; Faculty for Geomatics, Computer Science and Mathematics, HFT Stuttgart-University of Applied Sciences, 70174 Stuttgart, Germany. stefan.knauth@hft-stuttgart.de., Mendoza-Silva GM; Institute of New Imaging Technologies, Universitat Jaume I, 12071 Castelló, Spain. gmendoza@uji.es., Seco F; Centre for Automation and Robotics (CAR), CSIC-UPM, 28500 Arganda del Rey, Spain. fernando.seco@car.upm-csic.es., Pérez-Navarro A; Estudis d'Informàtica, Multimèdia i Telecomunicació, Universitat Oberta de Catalunya, Rambla del Poblenou 156, 08018 Barcelona, Spain. aperezn@uoc.edu.; Internet Interdisciplinary Institute IN3, Av. Carl Friedrich Gauss 5, 08860 Castelldefels, Barcelona, Spain. aperezn@uoc.edu., Nicolau MJ; Algoritmi Research Centre, University of Minho, 4800-058 Guimarães, Portugal. maria.j.nicolau@algoritmi.uminho.pt., Costa A; Algoritmi Research Centre, University of Minho, 4800-058 Guimarães, Portugal. antonio.costa@algoritmi.uminho.pt., Meneses F; Centro de Computação Gráfica (CCG), 4800-058 Guimarães, Portugal. filipe.meneses@ccg.pt., Farina J; AraraDS, Monseñor Sótero Sanz 161, 8340457 Santiago, Chile. joaquin@ararads.com., Morales JP; AraraDS, Monseñor Sótero Sanz 161, 8340457 Santiago, Chile. juanpablo@ararads.com., Lu WC; Department of Electrical Engineering, Yuan Ze University, Zhongli 32003, Taiwan. s1054605@mail.yzu.edu.tw., Cheng HT; Department of Electrical Engineering, Yuan Ze University, Zhongli 32003, Taiwan. s1054601@mail.yzu.edu.tw., Yang SS; Department of Electrical Engineering, National Ilan University, Yilan 26047, Taiwan. shen49853@gmail.com., Fang SH; Department of Electrical Engineering, Yuan Ze University, Zhongli 32003, Taiwan. shfang@saturn.yzu.edu.tw., Chien YR; Department of Electrical Engineering, National Ilan University, Yilan 26047, Taiwan. yrchien@niu.edu.tw., Tsao Y; Research Center for Information Technology Innovation, Academia Sinica, Taipei 11529, Taiwan. yu.tsao@citi.sinica.edu.tw.
Jazyk: angličtina
Zdroj: Sensors (Basel, Switzerland) [Sensors (Basel)] 2018 Feb 06; Vol. 18 (2). Date of Electronic Publication: 2018 Feb 06.
DOI: 10.3390/s18020487
Abstrakt: The development of indoor positioning solutions using smartphones is a growing activity with an enormous potential for everyday life and professional applications. The research activities on this topic concentrate on the development of new positioning solutions that are tested in specific environments under their own evaluation metrics. To explore the real positioning quality of smartphone-based solutions and their capabilities for seamlessly adapting to different scenarios, it is needed to find fair evaluation frameworks. The design of competitions using extensive pre-recorded datasets is a valid way to generate open data for comparing the different solutions created by research teams. In this paper, we discuss the details of the 2017 IPIN indoor localization competition, the different datasets created, the teams participating in the event, and the results they obtained. We compare these results with other competition-based approaches (Microsoft and Perf-loc) and on-line evaluation web sites. The lessons learned by organising these competitions and the benefits for the community are addressed along the paper. Our analysis paves the way for future developments on the standardization of evaluations and for creating a widely-adopted benchmark strategy for researchers and companies in the field.
Competing Interests: The authors declare no conflict of interest. The founding sponsors had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, and in the decision to publish the results.
Databáze: MEDLINE
Externí odkaz:
Nepřihlášeným uživatelům se plný text nezobrazuje