3D Human Sensing, Action and Emotion Recognition in Robot Assisted Therapy of Children with Autism
(2018) 31st Meeting of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2018 p.2158-2167- Abstract
We introduce new, fine-grained action and emotion recognition tasks defined on non-staged videos, recorded during robot-assisted therapy sessions of children with autism. The tasks present several challenges: a large dataset with long videos, a large number of highly variable actions, children that are only partially visible, have different ages and may show unpredictable behaviour, as well as non-standard camera viewpoints. We investigate how state-of-the-art 3d human pose reconstruction methods perform on the newly introduced tasks and propose extensions to adapt them to deal with these challenges. We also analyze multiple approaches in action and emotion recognition from 3d human pose data, establish several baselines, and discuss... (More)
We introduce new, fine-grained action and emotion recognition tasks defined on non-staged videos, recorded during robot-assisted therapy sessions of children with autism. The tasks present several challenges: a large dataset with long videos, a large number of highly variable actions, children that are only partially visible, have different ages and may show unpredictable behaviour, as well as non-standard camera viewpoints. We investigate how state-of-the-art 3d human pose reconstruction methods perform on the newly introduced tasks and propose extensions to adapt them to deal with these challenges. We also analyze multiple approaches in action and emotion recognition from 3d human pose data, establish several baselines, and discuss results and their implications in the context of child-robot interaction.
(Less)
- author
- Marinoiu, Elisabeta ; Zanfir, Mihai ; Olaru, Vlad and Sminchisescu, Cristian LU
- organization
- publishing date
- 2018-12-17
- type
- Chapter in Book/Report/Conference proceeding
- publication status
- published
- subject
- host publication
- Proceedings - 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2018
- article number
- 8578328
- pages
- 10 pages
- publisher
- IEEE Computer Society
- conference name
- 31st Meeting of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2018
- conference location
- Salt Lake City, United States
- conference dates
- 2018-06-18 - 2018-06-22
- external identifiers
-
- scopus:85062829702
- ISBN
- 9781538664209
- DOI
- 10.1109/CVPR.2018.00230
- language
- English
- LU publication?
- yes
- id
- ae455035-d323-4a24-a60e-587ac6c53a29
- date added to LUP
- 2019-04-01 09:49:33
- date last changed
- 2022-05-03 18:57:08
@inproceedings{ae455035-d323-4a24-a60e-587ac6c53a29, abstract = {{<p>We introduce new, fine-grained action and emotion recognition tasks defined on non-staged videos, recorded during robot-assisted therapy sessions of children with autism. The tasks present several challenges: a large dataset with long videos, a large number of highly variable actions, children that are only partially visible, have different ages and may show unpredictable behaviour, as well as non-standard camera viewpoints. We investigate how state-of-the-art 3d human pose reconstruction methods perform on the newly introduced tasks and propose extensions to adapt them to deal with these challenges. We also analyze multiple approaches in action and emotion recognition from 3d human pose data, establish several baselines, and discuss results and their implications in the context of child-robot interaction.</p>}}, author = {{Marinoiu, Elisabeta and Zanfir, Mihai and Olaru, Vlad and Sminchisescu, Cristian}}, booktitle = {{Proceedings - 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2018}}, isbn = {{9781538664209}}, language = {{eng}}, month = {{12}}, pages = {{2158--2167}}, publisher = {{IEEE Computer Society}}, title = {{3D Human Sensing, Action and Emotion Recognition in Robot Assisted Therapy of Children with Autism}}, url = {{http://dx.doi.org/10.1109/CVPR.2018.00230}}, doi = {{10.1109/CVPR.2018.00230}}, year = {{2018}}, }