Sensing Posture-Aware Pen+Touch Interaction on Tablets
| Autor: | Gierad Laput, Michael J. McGuffin, Yang Zhang, Haijun Xia, Christian Holz, Ken Hinckley, Andrew Pyon Mittereder, William A. S. Buxton, Michel Pahud, Xiao Tu, Fei Su |
|---|---|
| Rok vydání: | 2019 |
| Předmět: |
Orientation (computer vision)
Computer science 05 social sciences GRASP 020207 software engineering 02 engineering and technology law.invention Touchscreen Human–computer interaction law 0202 electrical engineering electronic engineering information engineering 0501 psychology and cognitive sciences User interface 050107 human factors |
| Zdroj: | CHI |
| DOI: | 10.1145/3290605.3300285 |
| Popis: | Many status-quo interfaces for tablets with pen + touch input capabilities force users to reach for device-centric UI widgets at fixed locations, rather than sensing and adapting to the user-centric posture. To address this problem, we propose sensing techniques that transition between various nuances of mobile and stationary use via postural awareness. These postural nuances include shifting hand grips, varying screen angle and orientation, planting the palm while writing or sketching, and detecting what direction the hands approach from. To achieve this, our system combines three sensing modalities: 1) raw capacitance touchscreen images, 2) inertial motion, and 3) electric field sensors around the screen bezel for grasp and hand proximity detection. We show how these sensors enable posture-aware pen+touch techniques that adapt interaction and morph user interface elements to suit fine-grained contexts of body-, arm-, hand-, and grip-centric frames of reference. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|