Speech Technology for Unwritten Languages

Autor: Mark Hasegawa-Johnson, Lucas Ondel, Elin Larsen, Shruti Palaskar, Liming Wang, Sebastian Stüker, Francesco Ciannella, Markus Müller, Odette Scharenborg, Rachid Riad, Florian Metze, Pierre Godard, Laurent Besacier, Mingxing Du, Alan W. Black, Danny Merkx, Emmanuel Dupoux, Philip Arthur, Graham Neubig

Publikováno v: IEEE/ACM Transactions on Audio, Speech and Language Processing
IEEE/ACM Transactions on Audio, Speech and Language Processing, 2020, ⟨10.1109/TASLP.2020.2973896⟩
IEEE/ACM Transactions on Audio Speech and Language Processing, 28, 964-975
IEEE/ACM Transactions on Audio Speech and Language Processing, 28, pp. 964-975
IEEE/ACM Transactions on Audio, Speech and Language Processing, Institute of Electrical and Electronics Engineers, 2020, ⟨10.1109/TASLP.2020.2973896⟩
IEEE-ACM Transactions on Audio, Speech, and Language Processing, 28

International audience; Speech technology plays an important role in our everyday life. Speech is, among others, used for human-computer interaction, including, for instance, information retrieval and on-line shopping. In the case of an unwritten lan

Externí odkaz: https://explore.openaire.eu/search/publication?articleId=doi_dedup___::91e8981c6d7470b56776e09c0e74b11f
https://doi.org/10.1109/taslp.2020.2973896

Learning to Recognise Words Using Visually Grounded Speech

Autor: Sebastiaan Scholten, Odette Scharenborg, Danny Merkx

Publikováno v: ISCAS
2021 IEEE International Symposium on Circuits and Systems (ISCAS)

We investigated word recognition in a Visually Grounded Speech model. The model has been trained on pairs of images and spoken captions to create visually grounded embeddings which can be used for speech to image retrieval and vice versa. We investig

Externí odkaz: https://explore.openaire.eu/search/publication?articleId=doi_dedup___::bbdde3e385bf5373ac1dc9730bbce443
https://doi.org/10.1109/iscas51556.2021.9401692

Human Sentence Processing. Recurrence or Attention?

Autor: Danny Merkx, Stefan L. Frank

Publikováno v: Proceedings of the Workshop on Cognitive Modeling and Computational Linguistics (CMCL), pp. 12-22
Proceedings of the Workshop on Cognitive Modeling and Computational Linguistics (CMCL), 12-22. online : Association for Computational Linguistics
STARTPAGE=12;ENDPAGE=22;TITLE=Proceedings of the Workshop on Cognitive Modeling and Computational Linguistics (CMCL)
Proceedings of the Workshop on Cognitive Modeling and Computational Linguistics (CMCL 2021)
CMLS

Recurrent neural networks (RNNs) have long been an architecture of interest for computational models of human sentence processing. The recently introduced Transformer architecture outperforms RNNs on many natural language processing tasks but little

Externí odkaz: https://explore.openaire.eu/search/publication?articleId=doi_dedup___::a4a12282f8d089e3eaa3869d5cf68c56

Learning semantic sentence representations from visually grounded language without lexical knowledge

Autor: Danny Merkx, Stefan L. Frank

Publikováno v: Natural Language Engineering, 25, 4, pp. 451-466
Natural Language Engineering
Natural Language Engineering, 25, 451-466

Current approaches to learning semantic representations of sentences often use prior word-level knowledge. The current study aims to leverage visual information in order to capture sentence level semantics without the need for word embeddings. We use

Externí odkaz: https://explore.openaire.eu/search/publication?articleId=doi_dedup___::c63f5de52947e262048ef898c3ef6de4
https://hdl.handle.net/2066/205977

Linguistic unit discovery from multi-modal inputs in unwritten languages: Summary of the 'Speaking Rosetta' JSALT 2017 Workshop

Autor: Liming Wang, Graham Neubig, Danny Merkx, Florian Metze, Odette Scharenborg, Rachid Riad, Philip Arthur, Lucas Ondel, Sebastian Stüker, Shruti Palaskar, Markus Müller, Laurent Besacier, Mark Hasegawa-Johnson, Emmanuel Dupoux, Elin Larsen, Alan W. Black, Francesco Ciannella, Mingxing Du, Pierre Godard

Publikováno v: HAL
ICASSP 2018-IEEE International Conference on Acoustics, Speech and Signal Processing
ICASSP 2018-IEEE International Conference on Acoustics, Speech and Signal Processing, Apr 2018, Calgary, Alberta, Canada
ICASSP

We summarize the accomplishments of a multi-disciplinary workshop exploring the computational and scientific issues surrounding the discovery of linguistic units (subwords and words) in a language without orthography. We study the replacement of orth

Externí odkaz: https://explore.openaire.eu/search/publication?articleId=doi_dedup___::d46ae9985fa5c1c05ed9dbbbc9526906