GesturePod
| Autor: | Harsha Vardhan Simhadri, Chirag Pabbaraju, Shishir G. Patil, Vivek Seshadri, Don Kurian Dennis, Prateek Jain, Nadeem Shaheer, Manik Varma |
|---|---|
| Rok vydání: | 2019 |
| Předmět: |
Computer science
05 social sciences Visual impairment 020207 software engineering 02 engineering and technology Pipeline (software) Mode (computer interface) White cane Gesture recognition Human–computer interaction Phone 0202 electrical engineering electronic engineering information engineering medicine 0501 psychology and cognitive sciences medicine.symptom 050107 human factors Gesture |
| Zdroj: | UIST |
| DOI: | 10.1145/3332165.3347881 |
| Popis: | People using white canes for navigation find it challenging to concurrently access devices such as smartphones. Building on prior research on abandonment of specialized devices, we explore a new touch free mode of interaction wherein a person with visual impairment can perform gestures on their existing white cane to trigger tasks on their smartphone. We present GesturePod, an easy-to-integrate device that clips on to any white cane, and detects gestures performed with the cane. With GesturePod, a user can perform common tasks on their smartphone without touch or even removing the phone from their pocket or bag. We discuss the challenges in building the device and our design choices. We propose a novel, efficient machine learning pipeline to train and deploy the gesture recognition model. Our in-lab study shows that GesturePod achieves 92% gesture recognition accuracy and can help perform common smartphone tasks faster. Our in-wild study suggests that GesturePod is a promising tool to improve smartphone access for people with VI, especially in constrained outdoor scenarios. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|