Interactive Hyperparameter Optimization with Paintable Timelines
| Autor: | Shotaro Sano, Keita Higuchi, Takeo Igarashi |
|---|---|
| Rok vydání: | 2021 |
| Předmět: |
SIMPLE (military communications protocol)
Computer science business.industry 05 social sciences Dashboard (business) 020207 software engineering Timeline 02 engineering and technology Machine learning computer.software_genre Range (mathematics) Interactivity Feature (computer vision) Hyperparameter optimization 0202 electrical engineering electronic engineering information engineering Leverage (statistics) 0501 psychology and cognitive sciences Artificial intelligence business computer 050107 human factors |
| Zdroj: | Conference on Designing Interactive Systems |
| DOI: | 10.1145/3461778.3462077 |
| Popis: | We propose a method to integrate more interactivity into automatic hyperparameter optimization systems to leverage the user’s prior knowledge on parameter distribution. In our method, the user continuously observes automatic optimization’s progress and dynamically specifies where to search in the parameter space. We present a prototype implementation of an interactive dashboard for an optimizer to show our method’s feasibility. The interactive dashboard’s main feature is “paintable timeline” where the user can not only observe the past parameter values tested as in standard timeline but also specify the range of future parameters to be tested with simple painting operations. We show three examples where user intervention might improve the performance of automatic optimizations. We run a user study with experts and the results show that, with prior knowledge about parameter distribution of the target problem, interactive optimization can reach better results compared to fully automatic optimization. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|