Human interaction smart subsystem-extending speech-based human-robot interaction systems with an implementation of external smart sensors

Autor: Ryszard Beniak, Arkadiusz Gardecki, Jose Lopez Vicario, Michal Podpora, Bartlomiej Klin, Aleksandra Kawala-Sterniuk
Rok vydání: 2020
Předmět:
Pepper robot
0209 industrial biotechnology
Sensor networks
smart infrastructure
Thermal imaging
Computer science
Cloud computing
02 engineering and technology
lcsh:Chemical technology
Biochemistry
Human–robot interaction
Article
Analytical Chemistry
020901 industrial engineering & automation
sensor networks
Human–computer interaction
0202 electrical engineering
electronic engineering
information engineering

thermal imaging
lcsh:TP1-1185
Humanoid robots
Electrical and Electronic Engineering
Instrumentation
business.industry
Smart infrastructure
COVID-19
humanoid robots
Knowledge acquisition
Atomic and Molecular Physics
and Optics

cloud services
Identification (information)
Front office
Cloud services
Robot
020201 artificial intelligence & image processing
business
Wireless sensor network
Humanoid robot
pepper robot
Zdroj: Dipòsit Digital de Documents de la UAB
Universitat Autònoma de Barcelona
Sensors
Volume 20
Issue 8
Sensors (Basel, Switzerland)
Sensors, Vol 20, Iss 2376, p 2376 (2020)
Popis: This paper presents a more detailed concept of Human-Robot Interaction systems architecture. One of the main differences between the proposed architecture and other ones is the methodology of information acquisition regarding the robot&rsquo
s interlocutor. In order to obtain as much information as possible before the actual interaction took place, a custom Internet-of-Things-based sensor subsystems connected to Smart Infrastructure was designed and implemented, in order to support the interlocutor identification and acquisition of initial interaction parameters. The Artificial Intelligence interaction framework of the developed robotic system (including humanoid Pepper with its sensors and actuators, additional local, remote and cloud computing services) is being extended with the use of custom external subsystems for additional knowledge acquisition: device-based human identification, visual identification and audio-based interlocutor localization subsystems. These subsystems were deeply introduced and evaluated in this paper, presenting the benefits of integrating them into the robotic interaction system. In this paper a more detailed analysis of one of the external subsystems&mdash
Bluetooth Human Identification Smart Subsystem&mdash
was also included. The idea, use case, and a prototype, integration of elements of Smart Infrastructure systems and the prototype implementation were performed in a small front office of the Weegree company as a decent test-bed application area.
Databáze: OpenAIRE