Integration of Speech and Vision for Perception in Assistive Robots Using Robot Operating System

Autor: Rajesh Kannan Megalingam, Motheram Manaswini, R. V. Rohith Raj, Akhil Masetti, Jahnavi Yannam, Tammana Akhil
Rok vydání: 2021
Předmět:
Zdroj: Computer Networks and Inventive Communication Technologies ISBN: 9789811596469
DOI: 10.1007/978-981-15-9647-6_38
Popis: Perception is a boon which is one of its kinds for every human being around the world. In this modern world, where technology has been tremendously developing, there has also been an escalation in the number of people being born with vision impairment. This paper provides a solution with a system that serves as an ability to hear and see for the assistive technologies such as service robots and rescue robots which could help for the old and crippled. This research deals with the integration of an object recognition technique with speech recognition using the robot operating system (ROS) to come up with a speech-based visual perceiving system that can aid the visually impaired people. The proposed object recognition uses Kinect v2 camera and YOLO algorithm for efficient object recognition. Here, mutual communication between the visually challenged and robot is established. This paper also discusses the system architecture implemented and tested in real and noisy environments.
Databáze: OpenAIRE