Evaluation of abstraction capabilities and detection of discomfort with a newscaster chatbot for entertaining elderly users

Autor: Enrique Costa-Montenegro, Francisco J. González-Castaño, Silvia García-Méndez, Francisco de Arriba-Pérez
Jazyk: angličtina
Rok vydání: 2021
Předmět:
Zdroj: Investigo. Repositorio Institucional de la Universidade de Vigo
Universidade de Vigo (UVigo)
Sensors (Basel, Switzerland)
Sensors, Vol 21, Iss 5515, p 5515 (2021)
Sensors
Volume 21
Issue 16
Popis: We recently proposed a novel intelligent newscaster chatbot for digital inclusion. Its controlled dialogue stages (consisting of sequences of questions that are generated with hybrid Natural Language Generation techniques based on the content) support entertaining personalisation, where user interest is estimated by analysing the sentiment of his/her answers. A differential feature of our approach is its automatic and transparent monitoring of the abstraction skills of the target users. In this work we improve the chatbot by introducing enhanced monitoring metrics based on the distance of the user responses to an accurate characterisation of the news content. We then evaluate abstraction capabilities depending on user sentiment about the news and propose a Machine Learning model to detect users that experience discomfort with precision, recall, F1 and accuracy levels over 80%. Xunta de Galicia | Ref. GRC2018/053
Databáze: OpenAIRE