The skyline as a marker for augmented reality in urban context

Autor: Leo Valque, Mihaela Scuturici, Mehdi Ayadi, Chokri Ben Amar, Serge Miguet
Přispěvatelé: REsearch Group in Intelligent Machines [Sfax] (REGIM-Lab), École Nationale d'Ingénieurs de Sfax | National School of Engineers of Sfax (ENIS), Extraction de Caractéristiques et Identification (imagine), Laboratoire d'InfoRmatique en Image et Systèmes d'information (LIRIS), Institut National des Sciences Appliquées de Lyon (INSA Lyon), Université de Lyon-Institut National des Sciences Appliquées (INSA)-Université de Lyon-Institut National des Sciences Appliquées (INSA)-Centre National de la Recherche Scientifique (CNRS)-Université Claude Bernard Lyon 1 (UCBL), Université de Lyon-École Centrale de Lyon (ECL), Université de Lyon-Université Lumière - Lyon 2 (UL2)-Institut National des Sciences Appliquées de Lyon (INSA Lyon), Université de Lyon-Université Lumière - Lyon 2 (UL2), Laboratoire LIRIS, Ayadi, Mehdi
Jazyk: angličtina
Rok vydání: 2018
Předmět:
Matching (statistics)
Computer science
[INFO.INFO-TS] Computer Science [cs]/Signal and Image Processing
Context (language use)
02 engineering and technology
Augmented reality
[INFO.INFO-CV] Computer Science [cs]/Computer Vision and Pattern Recognition [cs.CV]
[INFO.INFO-TS]Computer Science [cs]/Signal and Image Processing
0202 electrical engineering
electronic engineering
information engineering

Redundancy (engineering)
Computer vision
3D city model
Skyline
Pixel
business.industry
[INFO.INFO-CV]Computer Science [cs]/Computer Vision and Pattern Recognition [cs.CV]
020207 software engineering
Object (computer science)
[INFO.INFO-TI] Computer Science [cs]/Image Processing [eess.IV]
Feature (computer vision)
[INFO.INFO-TI]Computer Science [cs]/Image Processing [eess.IV]
020201 artificial intelligence & image processing
Artificial intelligence
business
Zdroj: International Symposium on Visual Computing (ISVC)
13th International Symposium on Visual Computing
13th International Symposium on Visual Computing, Nov 2018, Las Vegas, United States
BASE-Bielefeld Academic Search Engine
Advances in Visual Computing ISBN: 9783030038007
ISVC
Popis: International audience; In recent years, augmented reality (AR) technologies have emerged as powerful tools to help visualize the future impacts of new constructions on cities. Many approaches that use costly sensors and height-end platforms to run AR in real-time have been developed. Little efforts have been made to embed AR on mobile phones. In this paper, we present a novel approach that uses the Skyline as a marker in an AR system. This lightweight feature enables real-time matching of virtual and real skyline on smartphones. We use device's embedded instruments to estimate the user's pose. This approximation is used to insert a synthetic object in the live video stream. This first approach gives a very unrealistic impression of the viewed scene: the inserted objects appear to hover and float with the user's movements. In order to address this problem, we use the live video camera feed as additional source of information which provides a redundancy to the instruments estimation. We extract the Skyline (a set of pixels that defines the boundary between the building and the sky) as main visual feature. Our proposal is to use these automatically extracted points and track them throughout the video sequence, to allow synthetic objects to anchor these visual features, making it possible to simulate a a landscape from multiple viewpoints using a smartphone. We use images of the Lyon city (France) to illustrate our proposal.
Databáze: OpenAIRE