Skip to main content

Lund University Publications

LUND UNIVERSITY LIBRARIES

3D Human Sensing, Action and Emotion Recognition in Robot Assisted Therapy of Children with Autism

Marinoiu, Elisabeta ; Zanfir, Mihai ; Olaru, Vlad and Sminchisescu, Cristian LU (2018) 31st Meeting of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2018 p.2158-2167
Abstract

We introduce new, fine-grained action and emotion recognition tasks defined on non-staged videos, recorded during robot-assisted therapy sessions of children with autism. The tasks present several challenges: a large dataset with long videos, a large number of highly variable actions, children that are only partially visible, have different ages and may show unpredictable behaviour, as well as non-standard camera viewpoints. We investigate how state-of-the-art 3d human pose reconstruction methods perform on the newly introduced tasks and propose extensions to adapt them to deal with these challenges. We also analyze multiple approaches in action and emotion recognition from 3d human pose data, establish several baselines, and discuss... (More)

We introduce new, fine-grained action and emotion recognition tasks defined on non-staged videos, recorded during robot-assisted therapy sessions of children with autism. The tasks present several challenges: a large dataset with long videos, a large number of highly variable actions, children that are only partially visible, have different ages and may show unpredictable behaviour, as well as non-standard camera viewpoints. We investigate how state-of-the-art 3d human pose reconstruction methods perform on the newly introduced tasks and propose extensions to adapt them to deal with these challenges. We also analyze multiple approaches in action and emotion recognition from 3d human pose data, establish several baselines, and discuss results and their implications in the context of child-robot interaction.

(Less)
Please use this url to cite or link to this publication:
author
; ; and
organization
publishing date
type
Chapter in Book/Report/Conference proceeding
publication status
published
subject
host publication
Proceedings - 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2018
article number
8578328
pages
10 pages
publisher
IEEE Computer Society
conference name
31st Meeting of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2018
conference location
Salt Lake City, United States
conference dates
2018-06-18 - 2018-06-22
external identifiers
  • scopus:85062829702
ISBN
9781538664209
DOI
10.1109/CVPR.2018.00230
language
English
LU publication?
yes
id
ae455035-d323-4a24-a60e-587ac6c53a29
date added to LUP
2019-04-01 09:49:33
date last changed
2022-05-03 18:57:08
@inproceedings{ae455035-d323-4a24-a60e-587ac6c53a29,
  abstract     = {{<p>We introduce new, fine-grained action and emotion recognition tasks defined on non-staged videos, recorded during robot-assisted therapy sessions of children with autism. The tasks present several challenges: a large dataset with long videos, a large number of highly variable actions, children that are only partially visible, have different ages and may show unpredictable behaviour, as well as non-standard camera viewpoints. We investigate how state-of-the-art 3d human pose reconstruction methods perform on the newly introduced tasks and propose extensions to adapt them to deal with these challenges. We also analyze multiple approaches in action and emotion recognition from 3d human pose data, establish several baselines, and discuss results and their implications in the context of child-robot interaction.</p>}},
  author       = {{Marinoiu, Elisabeta and Zanfir, Mihai and Olaru, Vlad and Sminchisescu, Cristian}},
  booktitle    = {{Proceedings - 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2018}},
  isbn         = {{9781538664209}},
  language     = {{eng}},
  month        = {{12}},
  pages        = {{2158--2167}},
  publisher    = {{IEEE Computer Society}},
  title        = {{3D Human Sensing, Action and Emotion Recognition in Robot Assisted Therapy of Children with Autism}},
  url          = {{http://dx.doi.org/10.1109/CVPR.2018.00230}},
  doi          = {{10.1109/CVPR.2018.00230}},
  year         = {{2018}},
}