Book Search in Stack Rooms by Augmented Reality and Image Analysis Techniques
| Autor: | Yang, Shih-Ming, 楊士旻 |
|---|---|
| Rok vydání: | 2015 |
| Druh dokumentu: | 學位論文 ; thesis |
| Popis: | 103 When people visit a book-related space, such as a bookstore, a library, or a stack room, they might get lost or have no idea about how to reach a desired location or a book. In this study, an indoor guidance system based on augmented reality (AR) and image analysis techniques for the application of book search in a book-related space by the use of a mobile device is proposed. The system has two main functions: book search in the book-related space and book information introduction, both being based on AR techniques. At first, for book search, in order to guide a user to walk along a planned path, a set of signal-rich-art code images is created and attached at proper locations in the book-related space for use as landmarks in the guidance process. In each code image, the position information of a prominent spot or corner in the environment is embedded. The proposed system can extract the information embedded in each signal-rich-art code image from a captured version of the code image obtained with a mobile-device camera, and analyze the user’s location at each visited spot using the extracted information. When the user wants to search a book, the system finds out by text search the book shelf on which the book is located, takes it as a destination, and plans a path from the user’s location to the destination. Then, the system generates AR arrows and displays them on the user’s mobile-device screen to guide the user to visit the path nodes one by one. Specifically, at each node, the user takes an image of the landmark for the system to locate the user and generate accordingly the next arrow for the user to follow until reaching the destination which is a bookcase. About AR-based book information introduction, when the user reaches the destination book shelf where the searched book is located, the user takes an image of the book shelf on which, in addition to the desired book, there are others. Recognition of the desired book in the acquired image is thus required. For this, book-spine image recognition is adopted. In order to accomplish this goal, a book-spine image database is constructed in advance. At first, image processing techniques are adopted to segment book-spine images. Then, a knowledge-based OCR technique is proposed to construct a book-spine image database which is augmented with book titles. With the database ready, a method is proposed to recognize the book spine in the book shelf image by SURF matching against the book-spine image database. Finally, for AR-based book information introduction, after the book spine of the searched book is recognized, the book information is overlaid onto the book-shelf image shown on the mobile device for the user to inspect. Good experimental results are also included to show the feasibility of the proposed system and methods. Precision measures and statistics are shown as well to indicate the system’s effectiveness in handling real conditions in book search applications. |
| Databáze: | Networked Digital Library of Theses & Dissertations |
| Externí odkaz: |
|