Skip to main content

Lund University Publications

LUND UNIVERSITY LIBRARIES

Learning actions from observations

Krüger, Volker LU orcid ; Herzog, Dennis ; Baby, Sanmohan ; Ude, Aleš and Kragic, Danica (2010) In IEEE Robotics and Automation Magazine 17(2). p.30-43
Abstract

In the area of imitation learning, one of the important research problems is action representation. There has been a growing interest in expressing actions as a combination of meaningful subparts called action primitives. Action primitives could be thought of as elementary building blocks for action representation. In this article, we present a complete concept of learning action primitives to recognize and synthesize actions. One of the main novelties in this work is the detection of primitives in a unified framework, which takes into account objects and actions being applied to them. As the first major contribution, we propose an unsupervised learning approach for action primitives that make use of the human movements as well as... (More)

In the area of imitation learning, one of the important research problems is action representation. There has been a growing interest in expressing actions as a combination of meaningful subparts called action primitives. Action primitives could be thought of as elementary building blocks for action representation. In this article, we present a complete concept of learning action primitives to recognize and synthesize actions. One of the main novelties in this work is the detection of primitives in a unified framework, which takes into account objects and actions being applied to them. As the first major contribution, we propose an unsupervised learning approach for action primitives that make use of the human movements as well as object state changes. As the second major contribution, we propose using parametric hidden Markov models (PHMMs) [1], [2] for representing the discovered action primitives. PHMMs represent movement trajectories as a function of their desired effect on the object, and we will discuss 1) how these PHMMs can be trained in an unsupervised manner, 2) how they can be used for synthesizing movements to achieve a desired effect, and 3) how they can be used to recognize an action primitive and the effect from an observed acting human.

(Less)
Please use this url to cite or link to this publication:
author
; ; ; and
organization
publishing date
type
Contribution to journal
publication status
published
subject
keywords
Action grammars, Action primitives, Human body tracking, Motor primitives, Parametric hidden Markov models
in
IEEE Robotics and Automation Magazine
volume
17
issue
2
article number
5481141
pages
14 pages
publisher
IEEE - Institute of Electrical and Electronics Engineers Inc.
external identifiers
  • scopus:77953328682
ISSN
1070-9932
DOI
10.1109/MRA.2010.936961
language
English
LU publication?
yes
id
14f9b011-bd19-4553-8608-6e32229405dc
date added to LUP
2019-06-28 09:23:55
date last changed
2022-04-02 19:49:23
@article{14f9b011-bd19-4553-8608-6e32229405dc,
  abstract     = {{<p>In the area of imitation learning, one of the important research problems is action representation. There has been a growing interest in expressing actions as a combination of meaningful subparts called action primitives. Action primitives could be thought of as elementary building blocks for action representation. In this article, we present a complete concept of learning action primitives to recognize and synthesize actions. One of the main novelties in this work is the detection of primitives in a unified framework, which takes into account objects and actions being applied to them. As the first major contribution, we propose an unsupervised learning approach for action primitives that make use of the human movements as well as object state changes. As the second major contribution, we propose using parametric hidden Markov models (PHMMs) [1], [2] for representing the discovered action primitives. PHMMs represent movement trajectories as a function of their desired effect on the object, and we will discuss 1) how these PHMMs can be trained in an unsupervised manner, 2) how they can be used for synthesizing movements to achieve a desired effect, and 3) how they can be used to recognize an action primitive and the effect from an observed acting human.</p>}},
  author       = {{Krüger, Volker and Herzog, Dennis and Baby, Sanmohan and Ude, Aleš and Kragic, Danica}},
  issn         = {{1070-9932}},
  keywords     = {{Action grammars; Action primitives; Human body tracking; Motor primitives; Parametric hidden Markov models}},
  language     = {{eng}},
  month        = {{06}},
  number       = {{2}},
  pages        = {{30--43}},
  publisher    = {{IEEE - Institute of Electrical and Electronics Engineers Inc.}},
  series       = {{IEEE Robotics and Automation Magazine}},
  title        = {{Learning actions from observations}},
  url          = {{http://dx.doi.org/10.1109/MRA.2010.936961}},
  doi          = {{10.1109/MRA.2010.936961}},
  volume       = {{17}},
  year         = {{2010}},
}