Jarvis: A Multimodal Visualization Tool for Bioinformatic Data
| Autor: | Brent H. Cochran, Mark Hutchens, James Pustejovsky, Nikhil Krishnaswamy |
|---|---|
| Rok vydání: | 2020 |
| Předmět: |
0303 health sciences
Information retrieval Computer science business.industry Interface (computing) 02 engineering and technology Domain (software engineering) Visualization 03 medical and health sciences Data visualization 0202 electrical engineering electronic engineering information engineering Data analysis 020201 artificial intelligence & image processing business Word (computer architecture) 030304 developmental biology |
| Zdroj: | Lecture Notes in Computer Science ISBN: 9783030601515 HCI (45) |
| DOI: | 10.1007/978-3-030-60152-2_9 |
| Popis: | In this paper we present Jarvis, a multimodal explorer and navigation system for biocuration data, from both curated sources and text-derived datasets. This system harnesses voice and haptic control for a bioinformatic research context, specifically manipulation of data visualizations such as heatmaps and word clouds showing related terms in the dataset. We combine external speech systems with Clustergrammer [1] for the generation of bioinformatic queries, the BoB interface [2] for answering queries in that domain, and the VoxML framework [12] for manipulating the results and semantic grounding. We deploy the resulting system to iOS on an iPad for use by researchers over a test dataset of gene expression in tumor samples. The intent is to integrate multimodal control (here voice and haptics), so as to facilitate interaction with and analysis of data, taking advantages of using both modalities. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|