Sorry, you need to enable JavaScript to visit this website.

facebooktwittermailshare

Multimodal Signal Processing and Learning Aspects of Human-Robot Interaction for an Assistive Bathing Robot

Abstract: 

We explore new aspects of assistive living on smart human-robot interaction (HRI) that involve automatic recognition and online validation of speech and gestures in a natural interface, providing social features for HRI. We introduce a whole framework and resources of a real-life scenario for elderly subjects supported by an assistive bathing robot, addressing health and hygiene care issues. We contribute a new dataset and a suite of tools used for data acquisition and a state-of-the-art pipeline for multimodal learning within the framework of the I-Support bathing robot, with emphasis on audio and RGB-D visual streams. We consider privacy issues by evaluating the depth visual stream along with the RGB, using Kinect sensors. The audio-gestural recognition task on this new dataset yields up to 84.5%, while the online validation of the I-Support system on elderly users accomplishes up to 84% when the two modalities are fused together. The results are promising enough to support further research in the area of multimodal recognition for assistive social HRI, considering the difficulties of the specific task.

up
0 users have voted:

Paper Details

Authors:
A. Zlatintsi, I. Rodomagoulakis, P. Koutras, A. C. Dometios, V. Pitsikalis, C. S. Tzafestas, and P. Maragos
Submitted On:
25 April 2018 - 3:48am
Short Link:
Type:
Poster
Event:
Presenter's Name:
Athanasia Zlatintsi
Paper Code:
ICASSP18001
Document Year:
2018
Cite

Document Files

Zlatintsi+_HRIforAssistiveBathRobot_ICASSP2018_poster_Final.pdf

(41 downloads)

Subscribe

[1] A. Zlatintsi, I. Rodomagoulakis, P. Koutras, A. C. Dometios, V. Pitsikalis, C. S. Tzafestas, and P. Maragos, "Multimodal Signal Processing and Learning Aspects of Human-Robot Interaction for an Assistive Bathing Robot", IEEE SigPort, 2018. [Online]. Available: http://sigport.org/3174. Accessed: Jul. 20, 2018.
@article{3174-18,
url = {http://sigport.org/3174},
author = {A. Zlatintsi; I. Rodomagoulakis; P. Koutras; A. C. Dometios; V. Pitsikalis; C. S. Tzafestas; and P. Maragos },
publisher = {IEEE SigPort},
title = {Multimodal Signal Processing and Learning Aspects of Human-Robot Interaction for an Assistive Bathing Robot},
year = {2018} }
TY - EJOUR
T1 - Multimodal Signal Processing and Learning Aspects of Human-Robot Interaction for an Assistive Bathing Robot
AU - A. Zlatintsi; I. Rodomagoulakis; P. Koutras; A. C. Dometios; V. Pitsikalis; C. S. Tzafestas; and P. Maragos
PY - 2018
PB - IEEE SigPort
UR - http://sigport.org/3174
ER -
A. Zlatintsi, I. Rodomagoulakis, P. Koutras, A. C. Dometios, V. Pitsikalis, C. S. Tzafestas, and P. Maragos. (2018). Multimodal Signal Processing and Learning Aspects of Human-Robot Interaction for an Assistive Bathing Robot. IEEE SigPort. http://sigport.org/3174
A. Zlatintsi, I. Rodomagoulakis, P. Koutras, A. C. Dometios, V. Pitsikalis, C. S. Tzafestas, and P. Maragos, 2018. Multimodal Signal Processing and Learning Aspects of Human-Robot Interaction for an Assistive Bathing Robot. Available at: http://sigport.org/3174.
A. Zlatintsi, I. Rodomagoulakis, P. Koutras, A. C. Dometios, V. Pitsikalis, C. S. Tzafestas, and P. Maragos. (2018). "Multimodal Signal Processing and Learning Aspects of Human-Robot Interaction for an Assistive Bathing Robot." Web.
1. A. Zlatintsi, I. Rodomagoulakis, P. Koutras, A. C. Dometios, V. Pitsikalis, C. S. Tzafestas, and P. Maragos. Multimodal Signal Processing and Learning Aspects of Human-Robot Interaction for an Assistive Bathing Robot [Internet]. IEEE SigPort; 2018. Available from : http://sigport.org/3174