Advanced

Towards classification of head movements in audiovisual recordings of read news

Frid, Johan LU ; Ambrazaitis, Gilbert LU ; Svensson Lundmark, Malin LU and House, David (2017) 4th European and 7th Nordic Symposium on Multimodal Communication In Linköping Electronic Conference Proceedings p.4-9
Abstract (Swedish)
In this paper we develop a system for detection of word-related head movements in audiovisu-al recordings of read news. Our materials consist of Swedish television news broadcasts and comprise audiovisual recordings of five news readers (two female, three male). The corpus was manually labelled for head movement, applying a simplistic annotation scheme consisting of a binary decision about absence/presence of a movement in relation to a word. We use OpenCV for frontal face detection and based on this we calculate velocity and acceleration features. Then we train a machine learning system to predict absence or presence of head movement and achieve an accuracy of 0.892, which is better than the baseline. The system may thus be helpful for... (More)
In this paper we develop a system for detection of word-related head movements in audiovisu-al recordings of read news. Our materials consist of Swedish television news broadcasts and comprise audiovisual recordings of five news readers (two female, three male). The corpus was manually labelled for head movement, applying a simplistic annotation scheme consisting of a binary decision about absence/presence of a movement in relation to a word. We use OpenCV for frontal face detection and based on this we calculate velocity and acceleration features. Then we train a machine learning system to predict absence or presence of head movement and achieve an accuracy of 0.892, which is better than the baseline. The system may thus be helpful for head movement labelling. (Less)
Abstract
In this paper we develop a system for detection of word-related head movements in audiovisu-al recordings of read news. Our materials consist of Swedish television news broadcasts and comprise audiovisual recordings of five news readers (two female, three male). The corpus was manually labelled for head movement, applying a simplistic annotation scheme consisting of a binary decision about absence/presence of a movement in relation to a word. We use OpenCV for frontal face detection and based on this we calculate velocity and acceleration features. Then we train a machine learning system to predict absence or presence of head movement and achieve an accuracy of 0.892, which is better than the baseline. The system may thus be helpful for... (More)
In this paper we develop a system for detection of word-related head movements in audiovisu-al recordings of read news. Our materials consist of Swedish television news broadcasts and comprise audiovisual recordings of five news readers (two female, three male). The corpus was manually labelled for head movement, applying a simplistic annotation scheme consisting of a binary decision about absence/presence of a movement in relation to a word. We use OpenCV for frontal face detection and based on this we calculate velocity and acceleration features. Then we train a machine learning system to predict absence or presence of head movement and achieve an accuracy of 0.892, which is better than the baseline. The system may thus be helpful for head movement labelling. (Less)
Please use this url to cite or link to this publication:
author
organization
publishing date
type
Chapter in Book/Report/Conference proceeding
publication status
published
subject
in
Linköping Electronic Conference Proceedings
editor
Paggio, Patrizia; Navarretta, Costanza; and
pages
6 pages
publisher
Linköping University Electronic Press, Linköpings universitet
conference name
4th European and 7th Nordic Symposium on Multimodal Communication
ISSN
1650-3686
1650-3740
ISBN
978-91-7685-423-5
language
English
LU publication?
yes
id
1c99e24d-d86a-499d-af65-0ea2006b236c
alternative location
http://www.ep.liu.se/ecp/141/002/ecp17141002.pdf
date added to LUP
2017-09-25 14:32:23
date last changed
2017-11-14 09:54:44
@inproceedings{1c99e24d-d86a-499d-af65-0ea2006b236c,
  abstract     = {In this paper we develop a system for detection of word-related head movements in audiovisu-al recordings of read news. Our materials consist of Swedish television news broadcasts and comprise audiovisual recordings of five news readers (two female, three male). The corpus was manually labelled for head movement, applying a simplistic annotation scheme consisting of a binary decision about absence/presence of a movement in relation to a word. We use OpenCV for frontal face detection and based on this we calculate velocity and acceleration features. Then we train a machine learning system to predict absence or presence of head movement and achieve an accuracy of 0.892, which is better than the baseline. The system may thus be helpful for head movement labelling.},
  author       = {Frid, Johan and Ambrazaitis, Gilbert and Svensson Lundmark, Malin and House, David},
  booktitle    = {Linköping Electronic Conference Proceedings},
  editor       = {Paggio, Patrizia and Navarretta, Costanza},
  isbn         = {978-91-7685-423-5},
  issn         = {1650-3686},
  language     = {eng},
  month        = {09},
  pages        = {4--9},
  publisher    = {Linköping University Electronic Press, Linköpings universitet},
  title        = {Towards classification of head movements in audiovisual recordings of read news},
  year         = {2017},
}