Skip to main content

Lund University Publications

LUND UNIVERSITY LIBRARIES

Investigating visual prosody using articulography

Frid, Johan LU orcid ; Svensson Lundmark, Malin LU orcid ; Gilbert, Ambrazaitis ; Schötz, Susanne LU orcid and House, David (2019) DHN 2019 Digital Humanities in the Nordic Countries 4th Conference
Abstract
In this paper we describe present work on multimodal prosody by
means of simultaneous recordings of articulation and head movements. Earlier
work has explored patterning, usage and machine-learning based detection of
focal pitch accents, head beats and eyebrow beats through audiovisual recordings.
Kinematic data obtained through articulography allows for more comparable
and accurate measurements, as well as three-dimensional data. Therefore,
our current approach involves examining speech and body movements concurrently,
using electromagnetic articulography (EMA). We have recorded large
amounts of this kind of data previously, but for other purposes. In this paper, we
present results from a study on the... (More)
In this paper we describe present work on multimodal prosody by
means of simultaneous recordings of articulation and head movements. Earlier
work has explored patterning, usage and machine-learning based detection of
focal pitch accents, head beats and eyebrow beats through audiovisual recordings.
Kinematic data obtained through articulography allows for more comparable
and accurate measurements, as well as three-dimensional data. Therefore,
our current approach involves examining speech and body movements concurrently,
using electromagnetic articulography (EMA). We have recorded large
amounts of this kind of data previously, but for other purposes. In this paper, we
present results from a study on the interplay between head movements and
phrasing and find tendencies for upward movements occuring before and
downward movements occuring after prosodic boundaries. (Less)
Please use this url to cite or link to this publication:
author
; ; ; and
organization
publishing date
type
Chapter in Book/Report/Conference proceeding
publication status
published
subject
host publication
Proceedings of4th Conference of The Association Digital Humanities in the Nordic Countries : Copenhagen, March 6-8 2019 - Copenhagen, March 6-8 2019
publisher
CEUR-WS
conference name
DHN 2019 Digital Humanities in the Nordic Countries 4th Conference
conference location
Copenhagen, Denmark
conference dates
2019-03-06 - 2019-03-08
external identifiers
  • scopus:85066040918
project
The production of prosodic prominence: integrating bodily and articulatory gestures
Språkbanken & Swe-Clarin
language
English
LU publication?
yes
id
a6338acf-a935-4c5e-8e5f-b6cff0e03c08
alternative location
http://ceur-ws.org/Vol-2364/12_paper.pdf
date added to LUP
2019-03-26 12:45:49
date last changed
2023-09-08 20:34:14
@inproceedings{a6338acf-a935-4c5e-8e5f-b6cff0e03c08,
  abstract     = {{In this paper we describe present work on multimodal prosody by<br/>means of simultaneous recordings of articulation and head movements. Earlier<br/>work has explored patterning, usage and machine-learning based detection of<br/>focal pitch accents, head beats and eyebrow beats through audiovisual recordings.<br/>Kinematic data obtained through articulography allows for more comparable<br/>and accurate measurements, as well as three-dimensional data. Therefore,<br/>our current approach involves examining speech and body movements concurrently,<br/>using electromagnetic articulography (EMA). We have recorded large<br/>amounts of this kind of data previously, but for other purposes. In this paper, we<br/>present results from a study on the interplay between head movements and<br/>phrasing and find tendencies for upward movements occuring before and<br/>downward movements occuring after prosodic boundaries.}},
  author       = {{Frid, Johan and Svensson Lundmark, Malin and Gilbert, Ambrazaitis and Schötz, Susanne and House, David}},
  booktitle    = {{Proceedings of4th Conference of The Association Digital Humanities in the Nordic Countries : Copenhagen, March 6-8 2019}},
  language     = {{eng}},
  publisher    = {{CEUR-WS}},
  title        = {{Investigating visual prosody using articulography}},
  url          = {{https://lup.lub.lu.se/search/files/62164628/Contribution_133.pdf}},
  year         = {{2019}},
}