Coupling Deep Discriminative and Generative Models for Reactive Robot Planning in Human-Robot Collaboration
| Autor: | Olusegun Oshin, Edward Tunstel, Varma Richa, Richard W. Osborne, Binu M. Nair, Edgar A. Bernal, Francesca Stramandinoli, Jerry Ding |
|---|---|
| Rok vydání: | 2019 |
| Předmět: |
0209 industrial biotechnology
Robot kinematics Computer science business.industry 02 engineering and technology Machine learning computer.software_genre Human–robot interaction Generative model 020901 industrial engineering & automation Discriminative model Action (philosophy) Analytics 0202 electrical engineering electronic engineering information engineering Task analysis Robot 020201 artificial intelligence & image processing Artificial intelligence Inference engine business computer |
| Zdroj: | SMC |
| DOI: | 10.1109/smc.2019.8913974 |
| Popis: | Human-robot collaboration towards achieving a common goal is most effective when the robot has the capability to estimate the intentions and needs of its human partner, and to plan complementary actions accordingly. To this end, synergistic coupling between inference engines and task-planning algorithms is essential: the earlier the robot can anticipate the actions performed by its partner, the safer and more seamless the interaction between the two parties will be.In this work, we propose a perception-based analytics framework that incorporates discriminative and generative models, which together estimate the current and future class of an action being performed by a human. The analytics leverage a sequence of human skeletal joint locations extracted from a depth map video stream of the human partner. The generative model ingests current and previous joint positions and outputs a sequence of predicted future positions. The discriminative model produces a vector of probabilities indicating the likelihood that the future action belongs to each class within a set of action classes being considered. The information on current and future actions is fed to a task planning module which selects the robot collaborative action that better suits the estimated present and future human states. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|