Im2code - Markup Language Generation Model for Graphical User Interface

Autor: Che-Hsien Lin, 林哲賢
Rok vydání: 2018
Druh dokumentu: 學位論文 ; thesis
Popis: 106
Successful application user interfaces (UI) depend on well cooperation between designers and developers. However, a conceptual gap exists between UI design and UI development, which relies on a markup language to describe the layout for devices to generate UI. And it often takes a lot of time to bridge the gap during development processes. To speed up the automated generation of UI descriptions in a markup language, we propose simplified schemes based on ResNet feature extractors and attention decoders. The proposed scheme can be further divided into two models, Im2code-MT and Im2code-IC, according to attaching feature encoder or not. Through the Im2code-IC model, we achieve the same level performance but 10 times less training period. We compare our experiments in different architectures with visualization and statistic methods. Based on our achievements, the task of UI-tomarkup-language is reformulated into image caption tasks, which would be recommended for future research.
Databáze: Networked Digital Library of Theses & Dissertations