Off-Line Evaluation of Mobile-Centric Indoor Positioning Systems: The Experiences from the 2017 IPIN Competition

Autor: Ying-Ren Chien, Yu Tsao, Shih-Hau Fang, Adriano Moreira, Wen-Chen Lu, Joaquín Torres-Sospedra, Juan Pablo Morales, Shi-Shen Yang, Germán Martín Mendoza-Silva, António Costa, Fernando Seco, Antoni Perez-Navarro, Joaquín Farina, Wei-Chung Lu, Ho-Ti Cheng, Antonio Jiménez, Stefan Knauth, Maria João Nicolau, Filipe Meneses, Tomas Lungenstrass
Přispěvatelé: Ministerio de Economía, Industria y Competitividad (España), Universidade do Minho
Rok vydání: 2018
Předmět:
Computer science
Telefonia mòbil
media_common.quotation_subject
Cellular telephone systems
Teléfono móvil
02 engineering and technology
lcsh:Chemical technology
01 natural sciences
Biochemistry
Field (computer science)
Article
Analytical Chemistry
competitions
Benchmark (surveying)
0202 electrical engineering
electronic engineering
information engineering

Quality (business)
lcsh:TP1-1185
benchmarking
Electrical and Electronic Engineering
Instrumentation
media_common
sensor fusion
Science & Technology
Event (computing)
010401 analytical chemistry
Competitions
020206 networking & telecommunications
Ciências Naturais::Ciências da Computação e da Informação
Sensor fusion
Data science
Atomic and Molecular Physics
and Optics

0104 chemical sciences
Benchmarking
indoor positioning and navigation
Wi-Fi fingerprinting
Ciências da Computação e da Informação [Ciências Naturais]
Zdroj: Repositório Científico de Acesso Aberto de Portugal
Repositório Científico de Acesso Aberto de Portugal (RCAAP)
instacron:RCAAP
O2, repositorio institucional de la UOC
Universitat Oberta de Catalunya (UOC)
Sensors; Volume 18; Issue 2; Pages: 487
Repositori Universitat Jaume I
Universitat Jaume I
Sensors
Sensors, Vol 18, Iss 2, p 487 (2018)
Sensors (Basel, Switzerland)
Digital.CSIC. Repositorio Institucional del CSIC
instname
Recercat. Dipósit de la Recerca de Catalunya
ISSN: 2015-7142
Popis: The development of indoor positioning solutions using smartphones is a growing activity with an enormous potential for everyday life and professional applications. The research activities on this topic concentrate on the development of new positioning solutions that are tested in specific environments under their own evaluation metrics. To explore the real positioning quality of smartphone-based solutions and their capabilities for seamlessly adapting to different scenarios, it is needed to find fair evaluation frameworks. The design of competitions using extensive pre-recorded datasets is a valid way to generate open data for comparing the different solutions created by research teams. In this paper, we discuss the details of the 2017 IPIN indoor localization competition, the different datasets created, the teams participating in the event, and the results they obtained. We compare these results with other competition-based approaches (Microsoft and Perf-loc) and on-line evaluation web sites. The lessons learned by organising these competitions and the benefits for the community are addressed along the paper. Our analysis paves the way for future developments on the standardization of evaluations and for creating a widely-adopted benchmark strategy for researchers and companies in the field.
We would like to thank Topcon Corporation for sponsoring the competition track with an award for the winning team. We are also grateful to Francesco Potorti, Sangjoon Park, Hideo Makino, Nobuo Kawaguchi, Takeshi Kurata and Jesus Urena for their invaluable help in organizing and promoting the IPIN competition and conference. Many thanks to Raul Montoliu, Emilio Sansano, Marina Granel and Luis Alisandra for collecting the databases in the UJITI building. Parts of this work were carried out with the financial support received from projects and grants: REPNIN network (TEC2015-71426-REDT), LORIS (TIN2012-38080-C04-04), TARSIUS (TIN2015-71564-C4-2-R (MINECO/FEDER)), SmartLoc (CSIC-PIE Ref. 201450E011), "Metodologias avanzadas para el diseno, desarrollo, evaluacion e integracion de algoritmos de localizacion en interiores" (TIN2015-70202-P), GEO-C (Project ID: 642332, H2020-MSCA-ITN-2014-Marie Sklodowska-Curie Action: Innovative Training Networks), and financial support from the Ministry of Science and Technology, Taiwan (106-3114-E-007-005 and 105-2221-E-155-013-MY3). The HFTS team has been supported in the frame of the German Federal Ministry of Education and Research programme "FHprofUnt2013" under contract 03FH035PB3 (Project SPIRIT). The UMinho team has been supported by COMPETE: POCI-01-0145-FEDER-007043 and FCT-Fundacao para a Ciencia e Tecnologia within the Project Scope: UID/CEC/00319/2013. G.M. Mendoza-Silva gratefully acknowledges funding from grant PREDOC/2016/55 by Universitat Jaume I.
info:eu-repo/semantics/publishedVersion
Databáze: OpenAIRE