Multimodal Mathematical Expressions Recognition: Case of Speech and Handwriting
| Autor: | Christian Viard-Gaudin, Harold Mouchère, Simon Petitrenaud, Sofiane Medjkoune |
|---|---|
| Přispěvatelé: | irccyn-ivc, Institut de Recherche en Communications et en Cybernétique de Nantes (IRCCyN), Mines Nantes (Mines Nantes)-École Centrale de Nantes (ECN)-Ecole Polytechnique de l'Université de Nantes (EPUN), Université de Nantes (UN)-Université de Nantes (UN)-PRES Université Nantes Angers Le Mans (UNAM)-Centre National de la Recherche Scientifique (CNRS)-Mines Nantes (Mines Nantes)-École Centrale de Nantes (ECN)-Ecole Polytechnique de l'Université de Nantes (EPUN), Université de Nantes (UN)-Université de Nantes (UN)-PRES Université Nantes Angers Le Mans (UNAM)-Centre National de la Recherche Scientifique (CNRS), Laboratoire d'Informatique de l'Université du Mans (LIUM), Le Mans Université (UM), Région Pays de la Loire, Projet DEPART, Kurosu, Masaaki, DEPART |
| Jazyk: | angličtina |
| Rok vydání: | 2013 |
| Předmět: |
Process (engineering)
Computer science Intelligent character recognition Speech recognition speech 02 engineering and technology computer.software_genre 01 natural sciences Multimodality [INFO.INFO-TS]Computer Science [cs]/Signal and Image Processing Handwriting 0202 electrical engineering electronic engineering information engineering data fusion Modality (human–computer interaction) business.industry 010401 analytical chemistry Sensor fusion 0104 chemical sciences graphical languages 020201 artificial intelligence & image processing Artificial intelligence business computer [SPI.SIGNAL]Engineering Sciences [physics]/Signal and Image processing Natural language processing handwriting |
| Zdroj: | Lecture Notes in Computer Science Human-Computer Interaction. Interaction Modalities and Techniques 15th International Conference on Human-Computer Interaction 15th International Conference on Human-Computer Interaction, Jul 2013, Las Vegas, United States. pp.77-86, ⟨10.1007/978-3-642-39330-3_9⟩ Human-Computer Interaction. Interaction Modalities and Techniques ISBN: 9783642393297 HCI (4) |
| ISSN: | 0302-9743 |
| DOI: | 10.1007/978-3-642-39330-3_9⟩ |
| Popis: | International audience; In this work, we propose to combine two modalities, handwriting and speech, to build a mathematical expression recognition system. Based on two sub-systems which process each modality, we explore various fusion methods to resolve ambiguities which naturally occur independently. The results that are reported on the HAMEX bimodal database show an improvement with respect to a mono-modal based system. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|